OndatraSQL
Guides
On this page
Step-by-step guides. Each guide walks through a specific task.
- Fetch Data from APIs: ingest data from REST APIs using lib functions
- Create a Lib Function: build a lib function for API ingestion or outbound sync
- Set Up OAuth Authentication: authenticate with OAuth providers for API access
- Sync Data to External APIs: push data with change detection
- Preview Changes: run the full pipeline against a temporary catalog
- Maintain DuckLake Storage: compact files, expire snapshots, clean up
- Mask Sensitive Columns: apply mask, hash, or redact tags
How to build a lib function for API ingestion or outbound sync. Step-by-step from API dict to working fetch/push function.
How to authenticate with OAuth providers for API ingestion and outbound sync. One-time setup, automatic token refresh.
Pull data from REST APIs into your pipeline using lib functions. Pagination, incremental loads, OAuth, and error handling.
Preview all pipeline changes before committing to production. OndatraSQL's sandbox mode runs against a temporary catalog copy.
Compact files, expire snapshots, and clean up storage in DuckLake.
Push pipeline data to external APIs using @push. Step-by-step setup with batching, rate limiting, and per-row tracking.
Apply mask, hash, or redact tags to columns and the pipeline handles the rest. Protect sensitive data during materialization.