Example: Skew

Definity's dashboard highlights high v-core underutilization in a static allocation pipeline. It recommends reducing the number of executors while also identifying the root cause behind poor utilization and parallelization.

Detecting Data Skew

By analyzing the execution timeline, Definity detects a data skew event affecting performance. It automatically identifies the skew, tests for the skew key, and informs the user of the specific application issue responsible for the inefficiency.

In this case, customer ID -999 is a faulty value, leading to excessive redundant work and skew.

With these insights, users can optimize resource allocation, improve parallelization, and eliminate bottlenecks in their pipelines.