Statement 29: Test for conformance and compliance
Agencies must
- Criterion 105: Verify compliance with relevant policies, frameworks, and legislation.
Criterion 106: Verify conformance against organisation and industry-specific coding standards.
This includes static and dynamic source code analysis. While agencies may use traditional analysis tools for the whole system, it is important to note their limitations with respect to AI models and consider finding tools built specifically for AI models.
Criterion 107: Perform vulnerability testing to identify any well-known vulnerabilities.
This includes:
- testing for entire AI system.
- testing for entire AI system.