Skip to main content

Azure Learning Roadmap

The AWS roadmap follows a sensible progression: cloud fundamentals, identity, networking and compute first; then storage, databases, containers, serverless and operations. This Azure roadmap follows the same learning philosophy and expands it into an enterprise-grade programme covering cloud architecture, application delivery, AI engineering, cybersecurity, Responsible AI, regulatory compliance and operating-model design.

Terminology note: Microsoft’s current documentation refers to its unified enterprise AI development platform as Microsoft Foundry. You may still encounter the previous “Azure AI Foundry” name in existing projects and interfaces.

Capability map

  1. Cloud fundamentals and Azure global infrastructure
  2. Resource hierarchy, landing zones and Azure Policy
  3. Microsoft Entra ID, Azure RBAC and managed identities
  4. Virtual networks, private endpoints and hub-and-spoke
  5. Virtual machines, App Service and traffic management
  6. Storage, Azure SQL, Cosmos DB and Managed Redis
  7. API Management, Service Bus, Event Grid and Event Hubs
  8. ACR, Container Apps, AKS and Azure Functions
  9. Observability, reliability, Bicep and DevSecOps
  10. Zero Trust, Key Vault, Defender for Cloud and Sentinel
  11. Microsoft Foundry, RAG, agents and AI security
  12. AI governance, NIST AI RMF, ISO 42001, EU AI Act and GDPR
  13. Purview, FinOps and the governed AI capstone

Learning cycle

The aim is not to recognise Azure product names. The aim is to turn an ambiguous business requirement into a secure, scalable, governed and commercially viable Azure solution.

Roadmap at a glance

StageFocusOutcome
0Cloud fundamentalsUnderstand cloud models and shared responsibility
1Azure foundationsUnderstand tenants, subscriptions, resources and Regions
2Landing zonesBuild an enterprise Azure foundation
3IdentitySecure users, applications and workloads
4NetworkingDesign public, private and hybrid connectivity
5ComputeDeploy applications using virtual machines
6Application platformsUse App Service and managed application hosting
7StorageDesign secure object, file, queue and disk storage
8DataUse Azure SQL, Cosmos DB and managed caching
9IntegrationBuild APIs, messages, events and workflows
10ContainersUse ACR, Container Apps and AKS
11ServerlessBuild event-driven systems using Azure Functions
12ObservabilityImplement logs, metrics, tracing and alerting
13ReliabilityDesign backup, resilience and disaster recovery
14Infrastructure as codeAutomate Azure environments
15DevSecOpsSecure software and AI delivery pipelines
16Cloud securityApply Zero Trust and defence in depth
17AI foundationsUnderstand machine learning, generative AI and agents
18Microsoft FoundryBuild and operate enterprise AI applications
19AI securitySecure models, data, prompts, RAG and agents
20AI governanceImplement policies, accountability and lifecycle controls
21AI complianceApply ISO 42001, NIST AI RMF, GDPR and the EU AI Act
22FinOpsControl infrastructure and token consumption
23CapstoneDeliver a governed enterprise AI platform

AWS-to-Azure mental model

AWSAzure equivalent or closest service
AWS accountAzure subscription
IAMMicrosoft Entra ID and Azure RBAC
VPCAzure Virtual Network
EC2Azure Virtual Machines
S3Azure Blob Storage
RDS / DynamoDBAzure SQL Database / Cosmos DB
ECS/Fargate / EKSAzure Container Apps / AKS
LambdaAzure Functions
API GatewayAzure API Management
CloudWatchAzure Monitor, Log Analytics and Application Insights
Bedrock/SageMakerMicrosoft Foundry and Azure Machine Learning

Stage journey (condensed)

Stages 0–2 — Foundations and landing zones

Learn IaaS/PaaS/SaaS and shared responsibility; Regions, Availability Zones and region selection; then tenants, management groups, subscriptions, resource groups and landing-zone design areas (identity, connectivity, management, policy).

Build: Region-selection decision record, shared-responsibility matrix, small management-group hierarchy and policy initiative (Regions, tags, public storage, diagnostics, AI resource restrictions).

Stages 3–4 — Identity and networking

Separate Entra directory roles from Azure RBAC. Prefer managed identities over keys. Apply Conditional Access and PIM. Design VNets, NSGs, private endpoints, NAT Gateway, Firewall and hub-and-spoke topology.

Build: identity matrix with managed-identity app access; hub-and-spoke with private endpoints for Storage, Key Vault and SQL; AI egress allowlist.

Stages 5–8 — Compute, apps, storage and data

Use VMs and Scale Sets when you need OS control; App Service for managed hosting; Blob/Files with lifecycle and AI data zones; Azure SQL, Cosmos DB and Managed Redis by access pattern—not by fashion.

Build: Front Door → Application Gateway → Scale Set → SQL; App Service API with slots, Key Vault and WAF; secure document platform with Raw/Curated/AI-ready/Evidence zones.

Stages 9–11 — Integration, containers and serverless

Use API Management as an AI gateway; Service Bus for reliable business messaging; Event Grid for reactive routing; Event Hubs for high-volume streams. Prefer Container Apps unless Kubernetes is justified; use Functions for short event-driven work.

Build: AI gateway policies (quotas, content safety, correlation); containerised RAG API; blob → Event Grid → Function ingestion pipeline.

Stages 12–16 — Operations, IaC, DevSecOps and cloud security

Centralise on Azure Monitor and Application Insights (including AI correlation without indiscriminate prompt logging). Automate with Bicep. Secure pipelines with federation, scanning and AI evaluation gates. Apply Zero Trust, Key Vault, Defender for Cloud and Sentinel.

Build: ops dashboard with AI metrics; modular Bicep repo; secure CI/CD with AI release gates; private Key Vault and Sentinel detections for AI gateway events.

Stages 17–21 — AI engineering, security, governance and compliance

Treat enterprise AI as layered systems (UX → orchestration → retrieval → models → data → platform → governance). Build on Microsoft Foundry; secure RAG and agents with deterministic authorisation; operate governance through the full lifecycle; map to NIST AI RMF, ISO/IEC 42001, EU AI Act and GDPR.

Build: enterprise RAG prototype; AI threat model and agent permission matrix; use-case intake, risk tiers and governance artefact pack; regulatory role assessment (provider/deployer).

Stages 22–23 — FinOps and capstone

Track infrastructure and token economics. Deliver a governed financial-services AI assistant that cites sources, redacts PII, escalates uncertainty and never transfers money autonomously.

Build: tagging standard and AI unit-cost model; full capstone through discovery, governance, architecture, prototype, production engineering, validation, deployment and operation.

Capstone architecture

Supporting services: Key Vault, managed identities, private endpoints, Purview, Defender for Cloud, Monitor, Sentinel, Service Bus, Event Grid, Policy, Cost Management, Bicep and CI/CD.

24-week plan (summary)

WeeksFocusKey deliverable
1–2Cloud and Azure fundamentalsRegion decision record, responsibility matrix
3–4Resource governanceManagement groups, policy initiative, subscription design
5–6IdentityIdentity matrix, managed-identity app, PIM process
7–8NetworkingPrivate network, flow diagram, DNS design
9–10Compute and app platformsLoad-balanced app, autoscaling, private data path
11–12Storage and dataSecure documents, SQL vs Cosmos, backup test
13–14Containers and serverlessContainer API, event worker, platform ADR
15–16Integration and observabilityAsync workflow, dashboard, alerts and runbooks
17–18Cloud securityBaseline, threat model, Sentinel detections
19–20AI engineeringRAG prototype, model-selection report, eval set
21–22AI securityThreat model, red-team tests, PII benchmark
23–24AI governanceFramework, inventory, risk tiers, capstone presentation

Completion checklist

Azure architecture

  • Explain why you chose VMs, App Service, Container Apps, AKS or Functions
  • Describe subscription and landing-zone model, zone redundancy and regional failure
  • Show how infrastructure is recreated from code

Identity and networking

  • Explain user, application and agent authentication
  • Identify public versus private endpoints and outbound controls
  • Confirm AI workloads cannot reach arbitrary external systems

Data and AI

  • Justify data necessity, ownership, classification, access and deletion
  • State evaluation thresholds, hallucination detection and feedback loops
  • Describe prompt-injection defence, output validation, agent permissions and PII handling

Governance and operations

  • Name accountable owners, risk tier, approvals and retained evidence
  • Know disable/fallback/recovery/retirement paths
  • Show unit cost, adoption metrics and measurable business value

Common mistakes to avoid

  • Memorising services without building systems
  • Choosing AKS because it looks advanced
  • Permanent privileged access and shared credentials
  • Public PaaS endpoints without justification
  • Relying on system prompts as security boundaries
  • Letting models enforce access control over retrieved documents
  • Caching AI responses without tenant and user context
  • Treating Prompt flow as a long-term dependency for new work
  • Logging full prompts and responses without retention policy
  • Shipping AI without evaluation, cost limits or incident runbooks

Core principle

The result should be more than an Azure deployment. It should be a governed operating system for delivering AI: technically feasible, commercially valuable, secure by design, compliant, observable, recoverable and accountable.

Discussion

Comments

Share feedback or questions about this page. No account required.

Loading comments…