The MLOps Specialization from Duke University equips learners with essential skills in machine learning operations, focusing on Python and Rust. Participants will enhance their productivity using GitHub Copilot and gain hands-on experience with platforms like Amazon SageMaker and Azure ML.
claude install tawounfouet/mlops-specialiazation-dukeThe MLOps Specialization from Duke University is a comprehensive 4-course series designed for programmers, data scientists, and researchers to master machine learning operations. You'll learn Python and Rust fundamentals, leverage GitHub Copilot for productivity, and build production-ready ML systems using Amazon SageMaker, Azure ML, and MLflow. The curriculum covers designing full MLOps pipelines, fine-tuning Large Language Models with Hugging Face, and deploying containerized models in ONNX format. Hands-on projects include automating data preprocessing, building ML/AI solutions with AI pair programming, and implementing GPU-accelerated tasks for improved performance.
1. **Define Metrics**: Replace [SPECIFIC_METRICS] with the key performance indicators (KPIs) for your model (e.g., latency, accuracy, resource usage). Use Duke’s MLOps curriculum to identify which metrics are critical for your use case. 2. **Set Thresholds**: Customize [CRITICAL_FAILURES] based on your model’s SLA (e.g., latency < 200ms, accuracy > 95%). Refer to Azure ML/SageMaker’s documentation for platform-specific thresholds. 3. **Deploy Exporter**: Build the Rust exporter using `cargo build --release` and deploy it alongside your model (e.g., as a sidecar in Kubernetes). Test locally with `curl http://localhost:9090/metrics`. 4. **Configure Prometheus**: Add the exporter’s endpoint to Prometheus’s `prometheus.yml` under `scrape_configs`. Reload Prometheus with `kill -HUP <pid>`. 5. **Visualize & Alert**: Import the provided Grafana dashboard JSON into Grafana Cloud or self-hosted Grafana. Link Alertmanager to your email/SMS/pagerduty for notifications. **Tips**: Use Duke’s MLOps labs to practice deploying Prometheus in a sandbox environment. For Rust exporters, leverage the `prometheus` crate’s examples to handle authentication and retries robustly.
Automating ML model deployment
Streamlining data pipeline management
Enhancing collaboration in ML projects
Optimizing cloud resource usage for ML
claude install tawounfouet/mlops-specialiazation-dukegit clone https://github.com/tawounfouet/mlops-specialiazation-dukeCopy the install command above and run it in your terminal.
Launch Claude Code, Cursor, or your preferred AI coding agent.
Use the prompt template or examples below to test the skill.
Adapt the skill to your specific use case and workflow.
As an MLOps engineer with Duke University's MLOps Specialization, design a production-ready monitoring pipeline for [ML_MODEL_NAME] deployed on [CLOUD_PLATFORM: Azure ML / SageMaker]. Include: (1) Prometheus metrics to track [SPECIFIC_METRICS: e.g., inference latency, model drift, GPU utilization], (2) alerting rules for [CRITICAL_FAILURES: e.g., prediction accuracy drops below 90%, 5xx errors > 1%], and (3) a Rust-based exporter to expose custom metrics from [MODEL_ENDPOINT_URL]. Provide Grafana dashboard JSON for visualization.
For a fraud detection model named 'fraud-detection-v3' deployed on Azure ML (endpoint: https://fraud-detection.azureml.net/endpoint), the monitoring pipeline includes:
1. **Prometheus Metrics**:
- `ml_inference_latency_seconds{model="fraud-detection-v3",endpoint="azure-ml"}`: Tracks 99th percentile latency (avg: 120ms, p99: 280ms).
- `ml_model_drift_score{model="fraud-detection-v3",metric="auc"}`: AUC dropped from 0.98 to 0.89 over 7 days (threshold: 0.95).
- `ml_gpu_utilization{model="fraud-detection-v3"}`: GPU usage at 85% during peak hours (alert if >90%).
2. **Alerting Rules** (Prometheus Alertmanager):
- `HighInferenceLatency`: Trigger if `ml_inference_latency_seconds > 500ms for 5m`.
- `ModelDriftDetected`: Trigger if `ml_model_drift_score < 0.95 for 1h`.
- `GPUOverload`: Trigger if `ml_gpu_utilization > 95% for 10m`.
3. **Rust Exporter**: A custom exporter written in Rust (using `prometheus` crate) scrapes Azure ML’s `/metrics` endpoint every 30s and exposes the data to Prometheus. The exporter handles authentication via Azure AD tokens and retries failed requests.
4. **Grafana Dashboard**: A pre-built dashboard (JSON provided) visualizes:
- Time-series graphs for latency and drift.
- Heatmaps for GPU utilization by hour.
- Alert state panels showing active incidents.
**Next Steps**: Deploy the exporter as a Kubernetes pod with resource limits (0.5 CPU, 256MB RAM). Configure Prometheus’s `scrape_configs` to target the exporter’s `/metrics` endpoint. Test alerts by injecting synthetic latency spikes using Locust.Experiment tracking for ML teams
Microsoft's cloud platform for compute, storage, AI, and hybrid infrastructure
Control SaaS spending with visibility and analytics
Collaborative productivity platform with integrated CRM workflows
Accounting software with automated invoicing and reporting
Enhance performance monitoring and root cause analysis with real-time distributed tracing.
Take a free 3-minute scan and get personalized AI skill recommendations.
Take free scan