AI/ML technologies are rapidly advancing and becoming integral to business operations. AI holds a vast potential to improve lives, advance businesses and tackle global challenges. At the same time, AI may also contribute to harm, perpetuate biases, introduce security vulnerabilities and raise ethical and societal concerns.  

DNV’s AI vendor capability assessment is an independent third-party audit that helps you assess and demonstrate capability in developing and operating trustworthy AI/ML and data-driven solutions. Through interviews and review of documentation, we perform an assessment of your AI/ML capabilities helping you position your organization as a leader in the AI/ML landscape, ready to meet the challenges and opportunities of the future with integrity and assurance. The AI assessment is a comprehensive service designed to evaluate the readiness and capability of your organization in developing and delivering and operating AI/ML and data-driven solutions. This service is particularly aimed at companies that develop AI and need to demonstrate their capabilities to stakeholders, clients and regulatory bodies.

Key benefits of the AI vendor capability assessment include: 

  • Credibility and trust: The independent assessment of maturity enhances the organization’s credibility and builds trust with clients and stakeholders, setting it apart from competitors. 
  • Risk mitigation: Identifying and addressing gaps reduces risks associated with AI/ML development and deployment, ensuring proactive issue resolution and making improvements toward an AI-ready organization. 
  • Regulatory compliance preparation: Helps in preparing to meet regulatory requirements and standards. 
  • Strategic improvement: The assessment's recommendations support strategic enhancement and optimization of AI/ML processes and governance. 

Assessing your AI capability and risk: how does it work?

What does the AI capability and risk assessment include?

The assessment consists of the following parts: 

  1. Setting the target levels/requirements to AI capabilities: depending on the importance and risk level of your AI solution, we define requirements to AI capabilities. 
  2. Assessment: Through documentation and interviews, we help you identify the current state of your organization’s capability levels 
  3. Recommendations: We provide general recommendations for improvement to close any potential gaps. 
  4. Statement of capability: Upon completing the assessment, you will receive a detailed statement of your AI capabilities, along with a digital assurance mark. This mark can be used for external communications, signifying that your organization has undergone a rigorous, independent third-party audit by DNV. This indicates that your organization has demonstrated a certain level of capability to deliver AI/ML and data-driven solutions. 

What AI capabilities does the assessment cover?

The assessment covers the eight key topics of AI capabilities, including: 

  • Governance 
  • Organization and people 
  • Processes 
  • Process efficiency 
  • Requirement management 
  • Technology 
  • Standards

How are the AI vendor capability levels defined and what are the requirements?

Capability levels describe how well an organization manages and uses its data. In addition, it determines where improvement is needed. The assessment provides a score according to a five-point scale: 

  • Level 1: Initial 
  • Level 2: Repeatable 
  • Level 3: Defined 
  • Level 4: Managed 
  • Level 5: Optimized

Meet some of our AI experts:

Headshot of Frank Børre Pedersen

Dr Frank Børre Pedersen

Dr Pedersen is one of DNV’s leading AI experts and leverages extensive technical and managerial experience across oil & gas, maritime and renewable energy domains. He is driven by his passion for integrating understanding of technology with practical applications to meet customer needs.

Headshot of Abdillah Suyuthi

Dr Abdillah Suyuthi

Dr Suyuthi leverages extensive industry experience in executing simulation model projects, creating trustworthy machine learning solutions and developing efficient methods and tools, with a passion for data quality, integration of large language models and ontologies to propel progress and foster sustainability.

Headshot of Christian Agrell

Dr Christian Agrell

Dr Agrell has extensive experience in developing trustworthy AI, particularly for high-risk and safety-critical systems in an industrial context. He is driven by a passion for the intersection of machine learning, uncertainty quantification, physics -based and data-driven simulation, assurance of complex systems and risk.

Learn more about industrial AI

 

Recommended practices:

Featured articles:

Training courses:

On-demand webinars:

Read our frequently asked questions about Artificial Intelligence (AI):

Artificial intelligence (AI) is a common designation of technologies where a machine performs tasks that are considered to require intelligence. This typically relates to speech recognition, computer vision, problem solving, logical inference, optimalizations, recommendations, etc.

AI is often divided into two main domains: Rule-based AI and machine learning. Rule-based AI is where we take human insight and knowledge and codify it into rules, such that the machine can perform tasks based on these rules. This kind of AI is very structured and explainable, but less flexible, as it can only be used for tasks for which specific rules have been developed. Machine learning (ML), on the other hand, is AI which is created from data. The applications infer their own rules and correlations from the data. This makes for flexible models, but with larger ML models, it can be difficult to explain decisions. In many practical applications, a combination of rule-based and machine learning is used.

The EU AI Act is a new regulation of AI use in the European Union. 

The Act’s purpose is: 

‘To improve the functioning of the internal market and promote the uptake of human-centric and trustworthy artificial intelligence (AI), while ensuring a high level of protection of health, safety, fundamental rights enshrined in the Charter of Fundamental Rights, including democracy, the rule of law and environmental protection, against the harmful effects of artificial intelligence systems (AI systems) in the Union, and to support innovation.’ 

The Act sets a common risk-based framework for using and supplying AI systems in the EU. It is binding on all EU member states and requires no additional approval at national level. However, variations on how national regulatory bodies are set up, and guidelines on how to align with other member states’ regulations, and so on, will be established. Learn more on EU’s official pages here.

The EU AI Act regulates all AI in Europe. To understand what is required, one must first assess the risk category of the AI. Learn more on EU’s official pages here.

The EU Act passed the EU Parliament in March 2024, and will entry into force June 2024. There is in general a 2-year period until compliance must be in place.  But there are also earlier statutory milestones along the way. For example, after 6 months of the Act coming into force, a ban on prohibited AI practices must be in place. Rules on General Purpose AI (GPAI) are required after 12 months. Obligations for high-risk systems must be in force within 24 months. Learn more on EU’s official pages here.

High-risk AI means that the supplier and deployer (user) must meet stringent regulatory requirements for use. Providers of a high-risk AI system will have to put it through a regulatory conformity assessment before offering it in the EU or otherwise putting it into service. They will also have to implement quality and risk management systems for such an AI system. Learn more on EU’s official pages here.

Generative AI is a type of machine learning that can create new data (numbers, text, video, etc) from an underlying data distribution. Generative AI is therefore probabilistic in nature.

Conformance testing (or compliance testing) means to test a system to assess if it meets given standards or specific requirements.

Fairness of an AI system is often defined to mean that the AI system does not contain bias or discrimination. This means that the AI system is created from data that are representative for the kind of distribution and algorithmic behaviour we would want the AI system to have.

Algorithm verification means to assess if an algorithm meets specific requirements. When AI is deployed into larger systems, we need to assess how the system and its components work. Algorithm testing is one way of verifying that the AI algorithm works as intended.

AI assurance means to (i) establish what requirements the AI needs to meet and (ii) verify compliance to these requirements.

The AI lifecycle covers all the phases of AI, from problem definition to data acquisition, to model development, deployment and update. The lifecycle is often iterated several times.

Model validation means to ensure that the model is solving the right problem, by comparing model outputs to independent real-world observations. Without a validated model you cannot trust that the models are solving the right problem.

Black-box testing means testing of a model without access to or insight into its internal structure or working. Inputs are provided to the black-box and outputs are received.

Want to learn more about how we can help you on your AI journey?

Contact us

Receive insights and updates on Digital Trust articles, case studies, and invitations to webinars and events

Subscribe here