Pass the SISA Cyber Security for AI CSPAI Questions and answers with ExamsMirror

Positional encoding in Transformers addresses the lack of inherent sequential information in self-attention by embedding word order into token representations, using functions like sine and cosine to assign unique positional vectors. This enables the model to differentiate word positions, crucial for translation where syntax and context depend on sequence (e.g., subject-verb-object order). Without it, Transformers treat inputs as bags of words, losing syntactic accuracy. Positional encoding ensures precise contextual understanding, unlike options that misrepresent its role. Exact extract: "Positional encoding helps Transformers distinguish word order, leading to more accurate translations by maintaining positional context." (Reference: Cyber Security for AI by SISA Study Guide, Section on Transformer Components, Page 55-57).

The ChatGPT Plugin Privacy Leak highlighted vulnerabilities in plugin ecosystems, where weak API security led to data exposure. Implementing robust authentication (e.g., OAuth) and authorization (e.g., RBAC), coupled with regular audits, ensures only verified entities access APIs, preventing leaks. IP whitelisting is less comprehensive, and open access heightens risks. Audits detect misconfigurations, aligning with secure AI practices. Exact extract: "Stringent authentication, authorization, and regular audits are key to securing API access and preventing leaks in LLM plugins." (Reference: Cyber Security for AI by SISA Study Guide, Section on Plugin Security Case Studies, Page 170-173).

Hallucinations in AI, particularly LLMs, arise from gaps in training data, overfitting, or inadequate generalization, leading to plausible but false outputs. The most effective mitigation is retraining with expansive, high-quality datasets that cover diverse scenarios, ensuring factual grounding and reducing fabrication risks. This involves curating verified sources, incorporating fact-checking mechanisms, and using techniques like data augmentation to fill knowledge voids. Complementary strategies include prompt engineering and external verification, but foundational retraining addresses root causes, enhancing overall trustworthiness. In security contexts, this prevents misinformation propagation, critical for applications in decision-making or content generation. Exact extract: "To reduce hallucinations and improve trustworthiness, retrain the model with more comprehensive and accurate datasets, ensuring better factual alignment and reduced erroneous confidence in outputs." (Reference: Cyber Security for AI by SISA Study Guide, Section on LLM Risks and Mitigations, Page 120-123).

Effective AI risk management requires comprehensive penetration testing and continuous evaluation of both internal and third-party supply chain components to identify vulnerabilities like backdoors or weak APIs. This holistic approach, aligned with SISA risk models, ensures robust security across the AI ecosystem, unlike limited or external-only testing. Exact extract: "Comprehensive penetration testing and continuous evaluation of internal and third-party components are crucial for AI risk management." (Reference: Cyber Security for AI by SISA Study Guide, Section on AI Risk Assessment Models, Page 180-183).

A secondary chatbot, powered by an LLM, acts as a fallback or supplementary assistant, handling complex or overflow queries when the primary system is insufficient. This enhances CX by ensuring continuity and depth in responses, with security benefits like isolating sensitive tasks to a monitored secondary layer. Unlike replacing primary systems or handling unrelated tasks, this role leverages LLMs’ flexibility to complement, not supplant, core functionalities. Exact extract: "LLMs as secondary chatbots serve as fallback assistants for complex queries, improving system resilience and user experience." (Reference: Cyber Security for AI by SISA Study Guide, Section on AI in Support Systems, Page 80-82).