Proctorio Blog

As we all know, artificial intelligence is reshaping assessment.

AI is now being used to create test content, score responses, verify identity, monitor testing sessions, and protect exam integrity. As these technologies become more common, assessment organizations face an important challenge: how do they embrace innovation while maintaining fairness, security, transparency, and trust?

To help organizations navigate these challenges, the Association of Test Publishers (ATP) recently released Aligning AI Policy for Assessment Applications to the NIST AI Risk Management Framework. Developed by ATP's Global AI and Privacy Compliance Subcommittee, the report provides practical guidance for organizations looking to adopt AI responsibly.

Among the contributors was Melissa DeWees, Director of AI Ethics and Compliance at Proctorio, who worked alongside experts from organizations including ETS, PSI, Learnosity, and MHS to help develop recommendations for responsible AI use across the assessment industry.

The publication is available free to ATP members and for purchase by non-members through ATP's resource library.

While the report covers a wide range of topics, five key lessons stand out.

1. Trust Has to Be Built In

The report's most important message is that trust cannot be an afterthought. Organizations need to think about fairness, transparency, accountability, and human oversight from the beginning. AI systems should be designed and managed in ways that stakeholders can understand and trust.

For assessment organizations, trust is everything. Students, candidates, educators, employers, and credentialing bodies all need confidence that outcomes are fair, secure, and reliable.

How Proctorio Supports This: Trust starts with transparency. Proctorio is committed to being clear about where and how AI is used within its solutions, the role AI plays in decision-making processes, and the safeguards in place to support fairness, accountability, and human oversight. Through its commitment to transparency and accountability, including its Trust Center, Proctorio helps institutions build confidence in assessment outcomes.

2. AI Governance Is an Ongoing Process

AI governance is not a one-time project. AI systems evolve. Threats evolve. Regulations evolve.

The report encourages organizations to continuously review risks, monitor performance, and improve controls over time. The goal is not simply to deploy AI, but to ensure it remains trustworthy as technology and expectations change.

How Proctorio Supports This: Proctorio treats AI governance as a continuous discipline, not a one-time compliance milestone. As one of the first companies in the assessment industry to achieve ISO/IEC 42001 certification for its AI Management System, Proctorio regularly reviews AI systems, evaluates emerging risks, and updates governance practices to help ensure AI remains trustworthy as technology and expectations evolve. Additional information is available through Proctorio's Audits and Compliance resources.

3. Human Oversight Still Matters

Despite advances in AI, humans remain essential. AI can identify patterns, flag unusual activity, and automate routine tasks. However, important decisions should still involve human judgment, particularly in high-stakes environments such as education, certification, licensure, and hiring.

The report stresses the importance of review processes, escalation paths, and appeals mechanisms that ensure accountability and fairness.

How Proctorio Supports This: Proctorio's AI systems are designed to support human judgment, not replace it. While AI can help identify patterns, surface information, and improve efficiency, institutions retain control over policies, review processes, and final decisions. This approach helps preserve accountability, transparency, and fairness in high-stakes assessment environments. Learn more about Proctorio's Identity Verification solutions and Live Proctoring capabilities.

4. Assessment Integrity Faces New AI-Era Threats

The report highlights a rapidly changing threat landscape. Deepfakes, impersonation attacks, AI-generated responses, automated assistance tools, and agentic AI systems are creating new challenges for testing organizations.

As a result, the focus is shifting from simply preventing misconduct to verifying authenticity. Organizations increasingly need confidence that the right person completed the assessment, that the work is genuinely their own, and that results accurately reflect knowledge and ability.

How Proctorio Supports This: Through ongoing governance reviews, risk assessments, and monitoring of emerging technologies, Proctorio works to adapt its approach as threats evolve. This commitment to continuous improvement helps institutions navigate a changing assessment landscape while maintaining trust in assessment outcomes. Organizations can learn more about Proctorio's approach to ethical AI in Building Trust: The Foundations of Responsible AI and its broader approach to assessment authenticity.

5. Good AI Starts With Good Data

Strong AI governance begins with strong data governance. Organizations need clear policies for how data is collected, stored, protected, and used. This is particularly important when working with personal information and sensitive assessment data.

Strong data practices help reduce risk, protect privacy, improve transparency, and increase confidence in AI-driven outcomes. Without quality data and proper oversight, even the most advanced AI systems can produce unreliable results.

How Proctorio Supports This: Strong data governance is fundamental to trustworthy AI. Proctorio's architecture reflects this principle by design. Assessment data is encrypted using a zero-knowledge approach, personal information is protected through privacy-focused practices, and AI models are trained only on ethically sourced datasets, never on customer exam content. These safeguards help ensure that as AI becomes more integrated into assessment, the underlying data practices remain secure, transparent, and trustworthy. Learn more about Proctorio's Data Privacy and Security practices and the Trust Center.

Looking Ahead

The ATP report reinforces a broader shift taking place across the assessment industry. Success will not be defined solely by adopting AI, but by adopting it responsibly. Organizations that prioritize transparency, accountability, human oversight, and strong governance will be best positioned to build trust and confidence in an AI-enabled future.

It also highlights the importance of collaboration. The report brought together experts from across the assessment ecosystem, including Melissa DeWees from Proctorio, to help establish practical guidance for organizations navigating the opportunities and risks of AI.

Artificial intelligence will continue to transform assessment. The organizations that succeed will not simply be those that adopt AI fastest. They will be the organizations that can demonstrate that their AI systems are trustworthy, accountable, and worthy of the confidence placed in them.

To learn more about Proctorio's approach to responsible AI, visit the Trust Center, read Building Trust: The Foundations of Responsible AI, or review the company's ISO/IEC 42001 certification announcement.