Components

New DuckDB Processor 🦆

We are excited to introduce the new DuckDB processor, now available in beta! 

New DuckDB Processor 🦆

This powerful processor allows you to transform the following sources only using SQL:

  • Tables from Storage
  • Files from Storage (Parquet, JSON)
  • Files from URLs

The processor offers two modes:

  • Simple mode: It operates on a single table and exports the table.
  • Advanced mode: It allows you to import multiple sources, perform one or multiple transformations on them, and export any number of tables.

One of the biggest advantages of DuckDB is its performance. Compared to single-purpose processors, it is much faster. You’ll see even greater time savings when replacing a chain of old processors with a single DuckDB configuration.

Find more, including example configurations, in the processor documentation.

For additional information, check out the DuckDB documentation.