7 posts tagged with "Cloud"

Enterprise generative AI engineering is no longer limited to writing prompts and connecting an application to a large language model. A production AI system must combine software engineering, governed data access, model routing, retrieval, tool execution, evaluation, monitoring, security, cost control and continuous delivery.

Databricks addresses these requirements through an integrated set of capabilities covering the complete GenAI lifecycle: querying foundation models and agents, building custom and low-code agents, connecting agents to governed tools, preparing structured and unstructured data, implementing retrieval with AI Search, deploying agents and applications, governing traffic through Unity AI Gateway, tracing with MLflow, evaluating and monitoring quality, operationalising through LLMOps, and delivering governed experiences through Genie One.

Generative AI cost management is more complicated than ordinary cloud cost management. A conventional application might be charged according to CPU hours, memory, storage, and network usage. An LLM application can accumulate costs through input tokens, output tokens, cached tokens, reasoning tokens, embeddings, retrieval, reranking, guardrails, model evaluation, agent tool calls, retries, observability, and the infrastructure supporting the application.

The main FinOps challenge is therefore not simply:

How can we use the cheapest model?

The correct question is:

What is the lowest sustainable cost at which the application can meet its quality, latency, reliability, security, and business-outcome requirements?

The AWS roadmap in the classic one-page diagram provides a strong high-level sequence: begin with cloud fundamentals, IAM, VPC and EC2; continue into S3, SES, Route 53, CloudWatch and CloudFront; add databases and containers; and finish with serverless computing. The diagram also recommends learning by deploying a simple application rather than studying every AWS service independently.

This expanded roadmap turns that sequence into a practical learning system. It explains what each service does, why and when you would use it, which concepts matter, which exercises to complete, how services work together, which production topics are often missing from one-page maps, and how to progress from a simple application to an enterprise-ready AWS platform.

The AWS Learning Roadmap follows a sensible progression: learn cloud fundamentals, identity, networking and compute first; then add storage, databases, containers, serverless and operational services. This Azure roadmap follows the same learning philosophy but expands it into an enterprise-grade programme covering cloud architecture, application delivery, AI engineering, cybersecurity, Responsible AI, regulatory compliance and operating-model design.

Terminology note: Microsoft’s current documentation refers to its unified enterprise AI development platform as Microsoft Foundry. You may still encounter the previous “Azure AI Foundry” name in existing projects, articles and interfaces. Microsoft Foundry brings together models, agents, development tooling and production AI operations as an Azure platform service. (Microsoft Learn)

These frameworks provide structured approaches, tools and methodologies that streamline the development, deployment and management of AI systems. No single library or methodology covers the full journey from ambiguous business problem to governed production capability. End-to-end AI solution engineering therefore uses a stack: consulting and strategy frameworks to decide what to build; data, ML, MLOps and orchestration frameworks to build and run it; domain toolkits for specialised capabilities; and security–governance frameworks as gatekeepers that decide whether work may proceed.

The AWS Learning Roadmap progresses from cloud fundamentals into identity, networking, compute, storage, databases, containers and serverless services. This Google Cloud roadmap follows the same learning sequence, but extends it into enterprise foundations, data engineering, generative AI, agentic AI, cybersecurity, governance, compliance, FinOps and production operations.

Terminology note: Google Cloud’s product naming is evolving, particularly around generative and agentic AI:

• Cloud Functions capabilities are now presented as Cloud Run functions.
• Dataplex Universal Catalog is now Knowledge Catalog.
• Current Vertex AI Agent Engine documentation redirects to the Gemini Enterprise Agent Platform, which includes Agent Runtime, Sessions, Memory Bank, Sandbox, Agent Gateway, evaluation and governance capabilities.
• Vertex AI continues to provide broader machine-learning capabilities such as model development, training, tuning, model management and deployment. (Google Cloud Documentation)

Model FinOps is the discipline of understanding, allocating, forecasting, governing and optimising the complete cost of building and operating AI systems. It extends traditional cloud FinOps because AI spending is not driven only by servers, storage and networking—it also depends on tokens, embeddings, retrieval, agents, training, dedicated capacity, evaluation and governance.

The FinOps Foundation frames FinOps for AI as addressing cost complexity, rapid development cycles, unpredictable consumption and the need to connect allocation and optimisation decisions to business value.

The objective is not simply to minimise AI spending. The objective is the best combination of business value, quality, reliability and security for an acceptable total cost, risk and operational complexity. A cheaper model that produces poor answers or requires extensive human correction may be more expensive overall than a more capable model.