Download Framework
EU AI Act / Article 15 icon
https://eur-lex.europa.eu/
atlas-eu_ai_act_article_15

EU AI Act / Article 15

EU AI Act obligations for high-risk AI systems to achieve appropriate levels of accuracy, be resilient against errors and inconsistencies, and incorporate technical safeguards against adversarial attacks or unauthorized manipulation that could alter system behavior or compromise outputs. The testing that demonstrates these properties is part of the quality management system required by Article 17, covered by the EU AI Act / Article 17 (EN 18286:2026) framework. See also ISO/IEC 27090:2026 for complementary technical guidance on these attack classes.
Type:
Regulation
Industry:
Cross-sector
Domain:
Performance & ReliabilityCybersecurity
Region:
EU
Tags:
Adversarial ML
Content:
1 Risk8 Controls
Version: 06/2024

Framework Definition

Risks and controls associated with the framework

Assessment Layer

Concrete evaluations linked to controls to assess pass or fail
Candidate Screening
Includes evaluations applicable to all use cases
RISK

Non-compliance with EU AI Act Article 15

Risk that the AI system fails to comply with the regulatory requirements set out in the EU AI Act
R.1
8 Controls
CONTROL

Accuracy

Ensure appropriate level of accuracy.
C.1.1
EVALUATION

Candidate Screening Accuracy

Evaluates whether an AI candidate screening system correctly classifies job applicants for individual job requirements, measuring both overall accuracy and the direction of misclassifications.
learn more →
CONTROL

Robustness

Ensure appropriate level of robustness.
C.1.2
EVALUATION

Candidate Screening Robustness

Evaluates whether an AI candidate screening system produces consistent predictions when the same applicant data is presented with meaning-preserving surface variations.
learn more →
CONTROL

Cybersecurity

Ensure appropriate level of cybersecurity.
C.1.3
EVALUATION

Candidate Screening Cyber Security

Evaluates whether an AI candidate screening system resists prompt injection attacks embedded in applicant documents that attempt to manipulate the screening outcome.
learn more →
EVALUATION

Basic Red Team

Measures the attack success rate of 10 common low-cost red-team strategies that obfuscate harmful HarmBench and AdvBench requests, using a judge model to determine whether the model's response is harmful.
learn more →
EVALUATION

Advanced Red Team

Measures the best-of-n attack success rate of the bijection learning jailbreak, a capability-scaled attack that teaches the model a random encoding in context before sending an encoded harmful request from HarmBench and AdvBench.
learn more →
EVALUATION

Rate Limiting

Verifies that the model endpoint enforces rate limiting by sending a burst of requests that exceeds the declared rate limit and checking whether enough of those requests are rejected.
learn more →
EVALUATION

Input Size Limits

Verifies that the model endpoint enforces input size limits by sending a request that exceeds the declared token limit and checking whether the oversized input is rejected.
learn more →
CONTROL

Consistent Performance

Ensure consistent accuracy, robustness and cybersecurity across the AI system lifecycle.
C.1.4
EVALUATION

Candidate Screening Bias

Evaluates whether an AI candidate screening system produces consistent outcomes when protected attributes such as age, gender, or national origin are varied in an applicant's profile while all qualifying information remains unchanged.
learn more →
EVALUATION

Candidate Screening Robustness

Evaluates whether an AI candidate screening system produces consistent predictions when the same applicant data is presented with meaning-preserving surface variations.
learn more →
CONTROL

Accuracy Transparency

Ensure that accuracy metrics are declared in the instructions of use.
C.1.5
CONTROL

Resiliency

Ensure the AI system is as resilient as possible regarding errors, faults and inconsistencies.
C.1.6
EVALUATION

Candidate Screening Resilience

Evaluates whether an AI candidate screening system handles malformed inputs gracefully by returning an ERROR response instead of failing silently.
learn more →
CONTROL

Biased Feedback Loops

Eliminate or reduce as far as possible biased outputs influencing input for future operations.
C.1.7
CONTROL

Malicious actors

C.1.8
EVALUATION

Candidate Screening Cyber Security

Evaluates whether an AI candidate screening system resists prompt injection attacks embedded in applicant documents that attempt to manipulate the screening outcome.
learn more →
EVALUATION

Basic Red Team

Measures the attack success rate of 10 common low-cost red-team strategies that obfuscate harmful HarmBench and AdvBench requests, using a judge model to determine whether the model's response is harmful.
learn more →
EVALUATION

Advanced Red Team

Measures the best-of-n attack success rate of the bijection learning jailbreak, a capability-scaled attack that teaches the model a random encoding in context before sending an encoded harmful request from HarmBench and AdvBench.
learn more →