model-monitoring
Monitor ML model performance in production. Covers Evidently AI reports and tests, Whylogs profiling, NannyML performance estimation, prediction distribution monitoring, ground truth collection, feature importance tracking, latency and throughput monitoring, error rate tracking, custom business metrics, alerting rules and thresholds (static, dynamic, adaptive), Grafana dashboards, Prometheus metrics, prediction logging, batch vs real-time monitoring, SLA compliance, and monitoring infrastructure. Use when setting up production model monitoring, creating alerts, building dashboards, or debugging model performance degradation.
- Version
- 1.0
- License
- Apache-2.0
Pinned to revision 45cf0fa3c5e7, so it is the text this page describes rather than whatever the author pushed since.
Files
- skills/model-monitoring/SKILL.md
- skills/model-monitoring/references/REFERENCE.md
- skills/model-monitoring/scripts/monitor_model.py
- skills/model-monitoring/scripts/setup_alerts.py
Every link opens the file at its source, pinned to the revision this page describes.