Pass the Amazon Web Services AWS Certified AI Practitioner AIF-C01 Questions and answers with ExamsMirror

The ML model shows 90% recall on training data but only 40% recall on unseen testing data, indicating a significant performance drop. This discrepancy suggests the model has learned the training data too well, including noise and specific patterns that do not generalize to new data, which is a classic sign of overfitting.

Exact Extract from AWS AI Documents:

From the Amazon SageMaker Developer Guide:

"Overfitting occurs when a model performs well on training data but poorly on unseen test data, as it has learned patterns specific to the training set, including noise, that do not generalize. A large gap between training and testing performance metrics, such as recall, is a common indicator of overfitting."

(Source: Amazon SageMaker Developer Guide, Model Evaluation and Overfitting)

Detailed Explanation:

Option A: The model is overfitting on the training data.This is the correct answer. The significant drop in recall from 90% (training) to 40% (testing) indicates the model is overfitting, as it performs well on training data but fails to generalize to unseen data.

Option B: The model is underfitting on the training data.Underfitting occurs when the model performs poorly on both training and testing data due to insufficient learning. With 90% recall on training data, the model is not underfitting.

Option C: The model has insufficient training data.Insufficient training data could lead to poor performance, but the high recall on trainingdata (90%) suggests the model has learned the training data well, pointing to overfitting rather than a lack of data.

Option D: The model has insufficient testing data.Insufficient testing data might lead to unreliable test metrics, but it does not explain the large performance gap between training and testing, which is more indicative of overfitting.

Decision trees are an interpretable machine learning algorithm that clearly documents the decision-making process by showing how each input feature affects the output. This transparency is particularly useful when explaining how the model arrives at a certain decision, making it suitable for classifying genes into categories.

Option A (Correct): "Decision trees": This is the correct answer because decision trees provide a clear and interpretable representation of how input features influence the model's output, making it ideal for understanding the inner mechanisms affecting predictions.

Option B: "Linear regression" is incorrect because it is used for regression tasks, not classification.

Option C: "Logistic regression" is incorrect as it does not provide the same level of interpretability in documenting decision-making processes.

Option D: "Neural networks" is incorrect because they are often considered "black boxes" and do not easily explain how they arrive at their outputs.

AWS AI Practitioner References:

Interpretable Machine Learning Models on AWS: AWS supports using interpretable models, such as decision trees, for tasks that require clear documentation of how input data affects output decisions.

The company is training an image classification model for diagnosing insect bites using a diverse dataset that includes photos from different genders, ethnicities, and geographic locations. This approach demonstrates the principle of fairness in responsible AI, as it aims to reduce bias and ensure the model performs equitably across diverse populations.

Exact Extract from AWS AI Documents:

From the AWS AI Practitioner Learning Path:

"Fairness in AI involves ensuring that models do not exhibit bias against certain groups and perform equitably across diverse populations. This can be achieved by training models on diverse datasets that represent various demographics, such as gender, ethnicity, and geographic location."

(Source: AWS AI Practitioner Learning Path, Module on Responsible AI)

Detailed Explanation:

Option A: FairnessThis is the correct answer. By using a diverse dataset, the company ensures the model is less likely to be biased against specific groups, promoting fairness in its predictions and treatments for insect bites.

Option B: ExplainabilityExplainability refers to making the model’s decisions understandable to users, such as byproviding insights into how predictions are made. The scenario focuses on dataset diversity, not explainability.

Option C: GovernanceGovernance involves establishing policies and processes to manage AI systems, such as compliance and oversight. The scenario does not describe governance mechanisms.

Option D: TransparencyTransparency involves disclosing how a model works, its limitations, and its data sources. While transparency is important, the scenario specifically highlights the diversity of the dataset, which aligns more directly with fairness.

Overfitting occurs when an ML model learns the training data too well, including noise and patterns that do not generalize to new data. A key cause of overfitting is when the training dataset does not represent all possible input values, leading the model to over-specialize on the limited data it was trained on, failing to generalize to unseen data.

Exact Extract from AWS AI Documents:

From the Amazon SageMaker Developer Guide:

"Overfitting often occurs when the training dataset is not representative of the broader population of possible inputs, causing the model to memorize specific patterns, including noise, rather than learning generalizable features."

(Source: Amazon SageMaker Developer Guide, Model Evaluation and Overfitting)

Detailed Explanation:

Option A: The training dataset does not represent all possible input values.This is the correct answer. If the training dataset lacks diversity and does not cover the range of possible inputs, the model overfits by learning patterns specific to the training data, failing to generalize.

Option B: The model contains a regularization method.Regularization methods (e.g., L2 regularization) are used to prevent overfitting, not cause it. This option is incorrect.

Option C: The model training stops early because of an early stopping criterion.Early stopping is a technique to prevent overfitting by halting training when performance on a validation set degrades. It does not cause overfitting.

Option D: The training dataset contains too many features.While too many features can contribute to overfitting (e.g., by increasing model complexity), this is less directly tied to overfitting than a non-representative dataset. The dataset’s representativeness is the primary cause.

The company is developing ML applications for various use cases, and the task is to select the correct ML paradigm (supervised or unsupervised learning) for each. Supervised learning involves training a model on labeled data to make predictions, while unsupervised learning identifies patterns or structures in unlabeled data. Each use case aligns with one of these paradigms based on its requirements.

Exact Extract from AWS AI Documents:

From the AWS AI Practitioner Learning Path:

"Supervised learning uses labeled data to train models for tasks like classification (e.g., binary or multi-class classification), where the model predicts a category. Unsupervised learning works with unlabeled data for tasks like clustering (e.g., K-means clustering) or dimensionality reduction, identifying patternsor reducing data complexity without predefined labels."

(Source: AWS AI Practitioner Learning Path, Module on Machine Learning Strategies)

Detailed Explanation:

Binary classification: Supervised learningBinary classification involves predicting one of two classes (e.g., yes/no, spam/not spam) using labeled data, making it a supervised learning task. The model learns from examples where the correct class is provided.

Multi-class classification: Supervised learningMulti-class classification extends binary classification to predict one of multiple classes (e.g., categorizing items into several groups). Like binary classification, it requires labeled data, so it falls under supervised learning.

K-means clustering: Unsupervised learningK-means clustering groups data into clusters based on similarity, without requiring labeled data. This is a classic unsupervised learning task, as the algorithm identifies patterns in the data on its own.

Dimensionality reduction: Unsupervised learningDimensionality reduction (e.g., using techniques like PCA) reduces the number of features in a dataset while preserving important information. It does not require labeled data, making it an unsupervised learning task.

Hotspot Selection Analysis:

The hotspot lists four use cases, each with a dropdown containing "Select...," "Supervised learning," and "Unsupervised learning." The correct selections are:

Binary classification: Supervised learning

Multi-class classification: Supervised learning

K-means clustering: Unsupervised learning

Dimensionality reduction: Unsupervised learning

Each paradigm (supervised and unsupervised learning) is used twice, as the question allows for paradigms to be selected one or more times.

The ecommerce company’s chatbot, powered by AI, automates customer order submissions and is accessible 24/7 via the website. Prompt injection is an AI system input vulnerability where malicious users craft inputs to manipulate the chatbot’s behavior, such as bypassing safeguards or accessing unauthorized information. This vulnerability must be resolved before the chatbot is made available to ensure security.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

"Prompt injection is a vulnerability in AI systems, particularly chatbots, where malicious inputs can manipulate the model’s behavior, potentially leading to unauthorized actions or harmful outputs. Implementing guardrails and input validation can mitigate this risk."

(Source: AWS Bedrock User Guide, Security Best Practices)

Detailed Explanation:

Option A: Data leakageData leakage refers to the unintended exposure of sensitive data during model training or inference, not an input vulnerability affecting a chatbot’s operation.

Option B: Prompt injectionThis is the correct answer. Prompt injection is a critical input vulnerability for chatbots, where malicious prompts can exploit the AI to produce harmful or unauthorized responses, a risk that must be addressed before launch.

Option C: Large language model (LLM) hallucinationsLLM hallucinations refer to the model generating incorrect or ungrounded responses, which is an output issue, not an input vulnerability.

Option D: Concept driftConcept drift occurs when the data distribution changes over time, affecting model performance. It is not an input vulnerability but a long-term performance issue.

The airline company aims to build a conversational AI assistant using large language models (LLMs) and a knowledge base to create a text-based chatbot with minimal development effort. Retrieval Augmented Generation (RAG) on Amazon Bedrock is an ideal solution because it combines LLMs with a knowledge base to provide accurate, contextually relevant responses without requiring extensive model training or custom development. RAG retrieves relevant information from a knowledge base and uses an LLM to generate responses, simplifying the development process.

Exact Extract from AWS AI Documents:

From the AWS Bedrock User Guide:

"Retrieval Augmented Generation (RAG) in Amazon Bedrock enables developers to build conversational AI applications by combining foundation models with external knowledge bases. This approach minimizes development effort by leveraging pre-trained models and integrating them with data sources, such as FAQs or databases, to provide accurate and contextually relevant responses."

(Source: AWS Bedrock User Guide, Retrieval Augmented Generation)

Detailed Explanation:

Option A: Train models on Amazon SageMaker Autopilot.SageMaker Autopilot is designed for automated machine learning (AutoML) tasks like classification or regression, not for building conversational AI with LLMs and knowledge bases. It requires significant data preparation and is not optimized for chatbot development, making it less suitable.

Option B: Develop a Retrieval Augmented Generation (RAG) agent by using Amazon Bedrock.This is the correct answer. RAG on Amazon Bedrock allows the company to use pre-trained LLMs and integrate them with a knowledge base (e.g., flight schedules or FAQs) to build a chatbot with minimal effort. It avoids the need for extensive training or coding, aligning with the requirement for least development effort.

Option C: Create a Python application by using Amazon Q Developer.While Amazon Q Developer can assist with code generation, building a chatbot from scratch in Python requires significant development effort, including integrating LLMs and a knowledge base manually, which is more complex than using RAG on Bedrock.

Option D: Fine-tune models on Amazon SageMaker Jumpstart.Fine-tuning models on SageMaker Jumpstart requires preparing training data and customizing LLMs, which involves more effort than using a pre-built RAG solution on Bedrock. This option is not the least effort-intensive.

A confusion matrix is the correct metric for evaluating the performance of a classification model, such as the deep learning model built to classify types of materials in images.

Confusion Matrix:

It is a table used to describe the performance of a classification model by comparing the actual and predicted classifications.

Provides detailed insights into the model’s performance, including true positives, true negatives, false positives, and false negatives.

Why Option A is Correct:

Performance Measurement: Helps measure various performance metrics like accuracy, precision, recall, and F1-score, which are critical for evaluating a classification model.

Comprehensive Evaluation: Allows for a thorough analysis of where the model is making errors and the types of errors being made.

Why Other Options are Incorrect:

B. Correlation matrix: Used to identify relationships between variables, not for evaluating classification performance.

C. R2 score: Used for regression models, not classification.

D. Mean squared error (MSE): Also a metric for regression, measuring the average of the squares of the errors.

The correct answer is A because Amazon Macie is a fully managed data security and privacy service that uses machine learning to automatically detect sensitive data such as PII (personally identifiable information) in Amazon S3. It requires no custom development, and it can be configured to generate alerts when sensitive data is detected in newly uploaded objects.

From AWS documentation:

"Amazon Macie automatically discovers and classifies sensitive data in S3 buckets and generates alerts when it detects sensitive content, such as names, addresses, and credit card numbers."

Explanation of other options:

B. Deploying an LLM on SageMaker to perform redaction is custom and operationally intensive.

C. Regex-based detection is brittle and requires extensive manual work, with high maintenance overhead.

D. Asking customers to avoid sharing sensitive data is not enforceable and does not meet compliance or security standards.

Referenced AWS AI/ML Documents and Study Guides:

Amazon Macie Documentation – Sensitive Data Discovery and Alerting

AWS Security Best Practices – Data Privacy and Governance

AWS ML Specialty Guide – Governance and Compliance Automation