Open main menu
DocsBlogPricingAboutContact
GitHub 🌟
Michal Oleszak

Michal Oleszak

ML Engineer & Data Science Instructor | Top Writer in AI & Statistics

Detecting Concept Drift: Impact on Machine Learning Performance
Data DriftMonitoring Workflow
•

Detecting Concept Drift: Impact on Machine Learning Performance

When should I retrain my model?

Detecting Concept Drift: Impact on Machine Learning Performance
Data DriftMonitoring Workflow
•

Detecting Concept Drift: Impact on Machine Learning Performance

When should I retrain my model?

How to detect data drift with hypothesis testing
Data Drift
•

How to detect data drift with hypothesis testing

Hint: forget about the p-values

Bad Machine Learning models can still be well-calibrated
Machine Learning
•

Bad Machine Learning models can still be well-calibrated

You don’t need a perfect oracle to get your probabilities right.

Detecting Covariate Shift: A Guide to the Multivariate Approach
Data DriftnannyML Research
•

Detecting Covariate Shift: A Guide to the Multivariate Approach

Good old PCA can alert you when the distribution of your production data changes.

Estimating Model Performance without Ground Truth
Popular ReadsnannyML Research Monitoring Workflow
•

Estimating Model Performance without Ground Truth

It’s possible, as long as you keep your probabilities calibrated