Diagram
Side-by-side comparison of data leakage versus training-serving skew across definition, example, effect, and prevention, both requiring knowledge of feature meaning.
Preparing Data to Reduce Bias and Improve Reliability
Two related data quality problems can also hurt production performance even when test scores look good. The table below compares data leakage and training-serving skew.
| Data quality problem | What it means | Example | Effect |
|---|---|---|---|
| Data leakage | Training uses input features that leak information about the target that is unavailable when the model is served. | A model predicts subscription sign-up using a future subscription payment as an input feature. | Strong test performance but poor production performance. |
| Training-serving skew | Training-time input features differ from serving-time input features. | A model predicts hourly temperatures but trains only on weekly temperatures. | Poor model quality in production. |
Domain 6 of 7
28 practice questions
Practice this DomainLast updated