Telemetry Update: New PPU Field
We're about to introduce a new field to improve the monitoring of your PPU expenses and help you estimate potential savings.
We will be adding a new credit_type field to the kbc_job table so that we can properly tag which PPU (project power unit, otherwise known as a credit) was used to run the job.
We will also be adding the sql_ppu and cdc_ppu values to the usage_metric_id field in the kbc_usage_metrics_values table so that we can properly track the consumption of the new credit types. Currently, three different types of PPUs can be used in the platform:
- KBC PPUs: These are the standard credits that every customer needs to run either all jobs in the platform or all non-SQL/non-CDC jobs in the platform (see below) depending on the deployment of Keboola.
- SQL PPUs: These are special credits. Customers who have a hybrid deployment (BYODB or bring your own database) need them to run SQL transformation jobs.
- CDC PPUs: These are also special credits. Customers who are using our add-on CDC functionality need them to run CDC extraction jobs.
Depending on your deployment of Keboola and add-on features (CDC), you may need all three types of PPUs or only a single type of PPU:
- If you are one of our multi-tenant customers with Keboola-provisioned Snowflake, you need at most only two types of PPUs (KBC PPUs and CDC PPUs), depending on whether you are also using our CDC add-on feature.
- If you are one of our multi-tenant customers with a hybrid deployment (BYODB), you may need all three types of PPUs (KBC PPUs, SQL PPUs, and CDC PPUs). By default, you will definitely need SQL PPUs to run SQL transformation jobs and KBC PPUs to run all other jobs. You will need CDC PPUs if you are also using our CDC add-on feature.
- If you are one of our single-tenant customers, you need only one type of PPU (KBC PPU).
Why make the change?
The change not only allows our existing customers with a BYODB deployment and our customers using our CDC add-on feature to better track their PPU spending, but it also allows our existing customers with Keboola-provisioned Snowflake to better estimate the potential savings if they move to a BYODB deployment.