Dynamically Delete Table Rows during Output Mapping (Beta)
You can now delete rows from Table storage during Output Mapping, using dynamic filter based on selected table.
Delete Rows in Output Mapping
We’re introducing a new capability to dynamically delete table rows in Storage as part of Output Mapping, using values from a table defined in your transformation. This brings more flexibility and control to incremental data pipelines—especially when cleaning up stale or obsolete records.
New UI Option in Output Mapping
You’ll now see a new “Delete Rows” section: “From transformation table“ in the Output Mapping UI. It allows you to select a target column in the Storage table and match it against a column in a table created in transformation:
Key Benefits
- Clean up specific rows without a full reload
- Use live data from within your transformation to define what to delete
How to Enable It
Go to Project Setting → Features → Delete rows from transformation table
Dynamic vs Static Deletes
This feature complements the existing static delete option where you manually define values to be deleted.