Connect External Datasets to Keboola
We’re excited to launch External Datasets, a powerful feature that allows you to connect data from your Snowflake or BigQuery to Keboola within seconds—no need to set up an extractor or manage data pipelines manually.
Why This Matters
If you’re operating in Bring-Your-Own-Database (BYODB) mode, data stored in your warehouse is not automatically accessible in Keboola. External Datasets solve this by linking your database schema directly to Keboola Storage, making your data available instantly. You can now leverage Keboola's powerful data transformation capabilities without the time-consuming setup processes traditionally involved.
Key Benefits
- Ease of Use: Connect any DB scheme to Keboola Storage within seconds, bypassing the need to set up and run an extractor.
- Cost Efficiency: This feature is available at no additional cost, offering significant savings for businesses managing large volumes of data.
- Enhanced Flexibility: Users can effortlessly integrate their existing Snowflake data into Keboola, enabling immediate work on data transformations and analytics.
You can enable this feature in your projects settings:
Supports: registration of external datasets from Snowflake, BigQuery and BigLake Tables (for external data in BigQuery).
Limitations: currently, only read-only access is supported, and BigQuery datasets cannot be shared between Keboola projects yet.
Secure Data Share - Real-Time Data Collaboration
We’re also introducing Snowflake Secure Data Share. This feature enables seamless data sharing across Snowflake accounts without duplication or data movement.
How Secure Data Share Works
- Producers define what data to share (tables, views, or schemas)
- Consumers (Keboola projects) access the data instantly as a read-only database.
Key Benefits
- No More Manual Exports – Share live data securely without file transfers.
- Real-Time Access – Always work with up-to-date datasets.
- Zero Storage Overhead – No additional copies, saving storage costs.
Availability: Secure Data Share is in beta for BYODB Snowflake users and must be enabled per project - request this via our support!
Allowing using External buckets in Input Mapping
You can now include external datasets in input mapping, making it easier to integrate and process data from multiple sources. This enhancement gives you greater flexibility in designing your workflows and reduces the need for manual data imports.
To start using this feature, please reach out to our support team for activation. Let us know if you have any questions or feedback!
Find more info in our user documentation.