Skip to content

Domain 4: ML Solution Monitoring, Maintenance, and Security

Weight: 24% of scored content

This domain covers monitoring, cost optimization, and security for ML solutions.

Topics Covered

Topic Description
Model Monitoring Model Monitor, data drift
CloudWatch Logging CloudWatch, CloudTrail
Cost Optimization Cost Explorer, Budgets
IAM Security IAM, KMS, Secrets Manager
Compliance Macie, Config

Key Concepts

Monitoring Workflow

graph LR
    A[Production Data] --> B[Model Monitor]
    B --> C{Drift Detected?}
    C -->|Yes| D[CloudWatch Alarm]
    D --> E[SNS Notification]
    E --> F[Retrain Model]
    C -->|No| G[Continue Monitoring]

Security Layers

Layer Services
Identity IAM, IAM Identity Center
Encryption KMS, S3 encryption
Network VPC, Security Groups
Data Macie, data masking
Secrets Secrets Manager

Study Checklist

  • Understand SageMaker Model Monitor types
  • Know CloudWatch metrics and alarms
  • Understand cost optimization strategies
  • Know IAM best practices for ML
  • Understand encryption options (KMS)
  • Know VPC configuration for SageMaker