Pass the Microsoft Certified: Machine Learning Operations (MLOps) Engineer AI-300 Questions and answers with ExamsMirror

Microsoft ' s Azure AI Foundry documentation defines built-in roles scoped to the resource hierarchy. The Azure AI Administrator role grants permissions to manage the Azure AI Hub resource itself — including network settings, shared connections, quota, and governance configuration — which is appropriate for platform engineers who configure resource-level settings. The Azure AI Developer role grants permissions to create, update, and manage project-level assets such as deployments, prompt flows, fine-tuning jobs, and evaluations, without access to resource-level configuration. This precisely matches the developer requirement and enforces least privilege. Disabling Entra ID authentication (option B) violates security policy and removes the identity-based access control that makes RBAC possible. Sharing a single API key (option D) violates the least-privilege principle — all users would have identical, undifferentiated access with no audit trail.

Microsoft Learn Reference Topic: Manage access to Azure AI Foundry – Built-in roles: Azure AI Administrator and Azure AI Developer

The key concept here is low-priority (spot) VMs, which are available at a significant discount because Azure can reclaim them at any time. Azure Machine Learning compute clusters are the only target in the list that directly supports low-priority VM nodes as a cost-saving configuration. You set the minimum and maximum node counts and specify that new nodes should be provisioned as low-priority. Azure Container Instances (ACI) does not support low-priority pricing. Local deployment runs on the developer ' s machine with no Azure billing model. Azure Kubernetes Service (AKS) does support spot node pools but requires significantly more infrastructure management and is not the primary mechanism for low-priority compute in Azure Machine Learning. The exam tests whether you know that AML compute clusters are the managed way to leverage low-priority discounts inside Azure Machine Learning.

Microsoft Learn Reference Topic: Create and manage Azure Machine Learning compute clusters – Low-priority VMs

According to Microsoft ' s Azure Machine Learning documentation on managed online endpoints, a single endpoint can host multiple named deployments simultaneously, and you can control what percentage of incoming traffic each deployment receives. This traffic-splitting capability is the foundation of blue/green and canary deployment strategies. When you route 10% of traffic to a new deployment and 90% to the existing one, you can monitor error rates, latency, and output quality of the new version under real production load without risking the majority of users. Microsoft explicitly recommends this pattern for safe rollouts. Option A (batch endpoint) is inappropriate for real-time serving. Option C (replacing the endpoint) is high-risk with no validation window. Option D (routing all traffic to the new deployment) provides zero protection if the new version has issues.

Microsoft Learn Reference Topic: Safe rollout of machine learning models – Traffic splitting on managed online endpoints

Speed of recovery is the central requirement. Rolling back traffic to the previous deployment is the fastest possible action: because the previous deployment still exists on the same endpoint, you simply update the traffic weights — setting the old deployment to 100% and the new deployment to 0% — using a single Azure ML CLI command or SDK call that completes in seconds without reprovisioning any compute. Deleting and redeploying (option B) requires tearing down the endpoint, waiting for deprovisioning, recreating it, re-deploying the model, and waiting for containers to start — potentially 10 to 30 minutes. Changing authentication type (option C) does not affect application errors caused by a bad model. Increasing compute size (option D) does not fix model logic errors. The entire reason Azure ML supports multiple concurrent deployments with traffic splitting is precisely to enable this instant rollback pattern.

Microsoft Learn Reference Topic: Roll back deployments on managed online endpoints – Azure Machine Learning safe deployment practices

Git commits on the main branch provide the immutable, ordered history that auditors need: every change is timestamped, attributed to a specific developer, and reversible via git revert — this is the audit trail and rollback mechanism required by the first requirement. Git branches allow developers to create and test multiple prompt variants in complete isolation from the production prompt on the main branch, addressing the second requirement. A developer on an experiment branch can run full evaluations without touching the production prompt. When a variant is approved, it is merged via pull request. You cannot use branches alone for audit history because branches can be deleted, and you cannot use main-branch commits alone for parallel variant comparison without disrupting the history. Git ' s branch-and-merge model provides both capabilities simultaneously.

Microsoft Learn Reference Topic: Version control for AI prompts – Git branch strategies for prompt management in Microsoft Foundry

A loan approval model must be assessed for both transparency and demographic fairness before registration. Option D (feature importance) addresses prediction transparency — using SHAP or Azure ML ' s Responsible AI dashboard, the team can see which features drive individual predictions, revealing whether proxy variables for protected attributes are influencing decisions inappropriately. Option E (error rates across demographic cohorts) directly measures whether the model makes more mistakes for specific groups — a core fairness metric required under Responsible AI principles. Option A (global error rates) masks disparities since you need cohort-level analysis. Option B (endpoint latency) is a performance engineering concern. Option C (inference schema compatibility) is a technical integration check. The Azure ML Responsible AI dashboard combines both error analysis and feature importance in a unified interface designed for exactly this type of pre-deployment fairness assessment.

Microsoft Learn Reference Topic: Responsible AI dashboard in Azure Machine Learning – Error analysis and model interpretability

During high traffic, the question is whether the endpoint is keeping up with demand. Requests per minute (B) tells you the actual request load on the endpoint, letting you correlate traffic spikes with degradation. Connections active (C) reveals whether the endpoint ' s connection pool is saturating — too many concurrent connections without adequate scaling causes queuing and timeouts. Request latency (E) is the gold-standard measure of user-perceived performance; rising latency under load is the clearest signal of degradation. Feature count (A) is a model-design attribute, not a runtime performance metric. Dataset size (D) is a training-time concern unrelated to endpoint performance. Azure Machine Learning online endpoints expose these metrics through Azure Monitor, and Microsoft recommends configuring alert rules on latency and request rate thresholds for all production endpoints.

Microsoft Learn Reference Topic: Monitor Azure Machine Learning online endpoints – Azure Monitor metrics for managed endpoints

All three requirements point to Git as the underlying mechanism, but each uses a different Git capability. For reviewing changes before production: a branch-based workflow where prompt changes are made on feature branches and merged to the main branch only after pull request approval enforces the review gate. For restoring previous versions: Git ' s commit history and tag system provide a precise, immutable record of every prompt state, and a git revert or checkout to a specific commit SHA restores any prior version instantly. For governance parity with application code: by storing prompts in the same Git repository as application code, all the same CI/CD, branch protection, code review, and audit trail policies apply automatically. The alternatives such as Blob Storage or embedded configuration files lack native review workflows, branch protection, and full audit history.

Microsoft Learn Reference Topic: Prompt management and versioning with Git integration in Microsoft Foundry

Preference comparison data with chosen versus rejected response pairs is the input format for Direct Preference Optimization (DPO) or RLHF-style fine-tuning — an advanced fine-tuning technique available in Microsoft Foundry. A valid DPO dataset record must have three fields: a prompt as the input, a chosen field containing the preferred response, and a rejected field containing the less preferred response. The file must be in JSONL format with UTF-8 encoding, where each line represents one complete preference pair. When evaluating statements about this dataset, mark True if the dataset contains all three required fields and chosen responses represent higher-quality outputs than rejected ones. Mark False if the format is incompatible with DPO requirements, if the required rejected field is missing, or if the chosen and rejected responses appear to be of equivalent quality with no clear preference signal.

Microsoft Learn Reference Topic: Advanced fine-tuning with preference data in Microsoft Foundry – DPO dataset format

MLflow is the industry-standard open-source platform for experiment tracking, and Azure Machine Learning has first-class native integration with it. When you use MLflow within an Azure ML job, parameters, metrics, and artifacts are automatically logged to the run history of the AML workspace, making every run reproducible and comparable. Option A (AML job output logs) only captures console output and lacks structured parameter and metric logging. Option C (Application Insights logs) is designed for application-level telemetry, not ML experiment metadata. Option D (Azure Monitor alerts) is a reactive notification tool, not a tracking system. MLflow ' s autologging capability means that for common frameworks such as scikit-learn, XGBoost, and PyTorch, parameters and metrics are captured without a single line of custom code, directly answering Fabrikam ' s requirement for consistent experiment tracking.

Microsoft Learn Reference Topic: Track ML experiments with MLflow – Azure Machine Learning MLflow integration