2. Datasets

Datasets are the standard unit of data flow on the platform. Synced external tables become raw datasets, which pipelines then process into derived datasets.

Dataset list

1. Sync a raw dataset

Open the datasource detail page, pick a table and click [Sync as dataset]. The platform reads the table schema and maps it to the platform schema.

2. Overview & schema

The overview shows the datasource, sync status and version; the schema shows fields and types.

Dataset overview

3. Preview data

Run a LIMIT 50 query in [Data preview] to confirm the ingestion came through correctly.

Data preview

4. Configure sync

Configure the sync mode and schedule under [Settings]; check each run’s result under [Sync logs].

Sync settings

Data preview only issues restricted queries and never pulls full data. When you need cleansing or joins, continue to 3. Pipelines.