Production AI Deployment

About this course

Take AI systems toward production with model APIs, reproducible packaging, evaluation gates, monitoring and rollback planning.

This professional course is part of the Software, Cloud & DevOps school. Work through the curriculum below in a cohort-based / instructor-led format, with an estimated study time of 35 h.

Course curriculum

• Module 1 — Serving Patterns and Capacity
• Module 2 — Packaging Models and Environments
• Module 3 — Building Model APIs
• Module 4 — Testing and CI/CD with Evaluation Gates
• Module 5 — Safe Releases and Rollback
• Module 6 — Monitoring, SLOs and Drift
• Module 7 — LLMOps: Operating LLM Applications
• Module 8 — Security, Reliability and Operations

Applied learning

• Case study — Kestrel's leak model, first season in production
• Lab 1 — Containerise and deploy the model API
• Lab 2 — CI with an evaluation gate that is neither blind nor flaky
• Lab 3 — Monitoring dashboards and alerts from real metrics
• Capstone — A Production Deployment Package

Who this course is for

Engineer / Architect; Technology Professional

Prerequisites

NE-AGI-302

Course details

• Course code: NE-SWC-403
• Level: Professional
• Estimated duration: 35 h
• Delivery: Cohort-Based / Instructor-Led