# dap incremental

Generates and downloads only the new or modified records of a table within a specified timeframe. This efficient, resource-effective approach helps keep datasets up-to-date with minimal overhead. Incremental queries enable near-real-time updates, reducing the need for frequent full dataset downloads.

### Usage

```
dap [arguments] incremental [flags]
```

### Options

**`--namespace <string>`**\
Specifies the data source (namespace). Available options: {canvas, canvas\_logs, catalog, new\_quizzes}.

**`--table <string>`**\
Specifies the table(s) to fetch data from. Can be a single table name, a comma separated list of table names or the special `all` keyword to fetch all tables in the namespace.

**`--since <datetime>`**\
Start timestamp for the incremental query. Examples: `2024-12-01T09:30:00Z`

**`--until <datetime>`**\
End timestamp for the incremental query. Examples: `2024-12-01T09:30:00Z`

**`--format <string> (default: JSONL)`**\
Defines the output format. Available options: {CSV, JSONL, Parquet, TSV}.

**`--output-directory <string> (default: downloads)`**\
Specifies the absolute or relative path to the output directory where the snapshot will be stored.

### Global options

**`--client-id <string>`**\
Client ID obtained from the Identity Service. Skip, if `DAP_CLIENT_ID` environment variable is set.

**`--client-secret <string>`**\
Client Secret obtained from the Identity Service. Skip, if `DAP_CLIENT_SECRET` environment variable is set.

**`-h, --help`**\
Displays help information for the command.

### Examples

Get new or modified records of the `courses` table from the `canvas` namespace since October 1, 2024:\
`$ dap incremental --namespace canvas --table courses --since 2024-11-01T00:00:00`

Get new or modified records of all tables from the `canvas` namespace between October 1, 2024, and October 31, 2024:\
`$ dap incremental --namespace canvas --table all --since 2024-11-01T00:00:00 --then 2024-11-01T00:00:00`

### Related Resources

<table data-view="cards"><thead><tr><th></th><th></th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><strong>Key Concepts</strong></td><td>Get familiar with the key concepts in DAP.</td><td><a href="../../key-concepts">key-concepts</a></td></tr><tr><td><strong>Rate Limits &#x26; Policies</strong></td><td>Learn more about the limits and our policies in DAP.</td><td><a href="../../limits-policies">limits-policies</a></td></tr><tr><td><strong>Datasets</strong></td><td>Discover the available namespaces and tables.</td><td><a href="../../dataset">dataset</a></td></tr></tbody></table>