Item-level performance, response time patterns, cohort trends, individual candidate flags, and much more. Digital assessment platforms generate more data than most institutions have previously had access to. And the analytical potential is substantial, as we explored in an earlier post in this series.
But generating data and putting it to use are quite different things. The gap between what a platform makes available and what an institution actually does with that data is a recurring challenge in digital assessment, and one that tends not to be talked about.
Why the Gap Exists
The reasons institutions underuse assessment analytics are well understood, even if not always acknowledged. Time pressure is the most common. Assessment teams are typically small relative to the scale of what they manage, and the period immediately after a major exam sitting is consumed by results processing, candidate communications, and the next cycle of preparation. It can be hard to find the space to really look into the data, interrogate it, and feed the insights into the decision-making process.
Dashboard design is often a contributing factor. Platforms that present every available metric simultaneously – item facility, discrimination indices, response time distributions, cohort comparisons – can overwhelm rather than guide. An institution new to digital assessment analytics needs a clear starting point, not access to everything all at once.
Digital maturity varies significantly across institutions. An assessment team that has spent years with paper-based processes will approach analytics tools differently from one that has grown up with them. The same platform can feel powerful to one client and impenetrable to another. This is not a reflection of capability, but of where each institution is in its journey.
Finally, regulatory uncertainty holds some institutions back. Data governance requirements differ by territory and are always evolving. Institutions unsure of what they are permitted to do with candidate data – how long it can be retained, who can access it, whether anonymisation is required – will often default to doing as little as possible with it, just to be on the safe side.
The Supplier’s Responsibility
None of these are problems that clients should be expected to solve alone. They are predictable challenges that good suppliers anticipate and address as part of an ongoing partnership.
Training that builds genuine confidence
A one-off onboarding session at the point of implementation is not sufficient. Institutions need training that continues as their familiarity with the platform deepens — introducing more advanced analytical capabilities when clients are ready for them. Different users within the same institution have different needs: assessment leads require analytical depth, administrators need operational clarity, and senior decision-makers need summary views that connect data to strategy. Training should reflect these distinctions rather than treating all users as equivalent.
Designing dashboards around the client’s actual questions
The most useful dashboard is not the one that displays the most data, it’s the one that most readily answers the questions the client is actually asking. Suppliers should work with each institution to identify which metrics are most urgent or most meaningful for them at their current stage. Surfacing these clearly, and building a dashboard structure that reflects the client’s priorities rather than the full range of platform capabilities, significantly increases the likelihood that the data gets used.
Supporting regulatory confidence
Suppliers who work with institutions across multiple territories carry a responsibility to help clients navigate the data governance landscape in their jurisdiction. This means more than just signposting regulations. It means working with clients to understand what they need to comply with, building anonymisation, access controls, and retention policies into the platform where possible, and providing clear guidance where the responsibility sits with the institution. A client confident in their compliance obligations is in a position to engage fully with their data, rather than treating it as a potential liability.
Partnership, Not Just Platform
The institutions that get the most from digital assessment analytics are those whose suppliers treat implementation as the beginning of a relationship rather than the end of a sale. The platform creates the capability. What determines whether that capability translates into better assessments, stronger curricula, and better-supported candidates is everything that happens afterwards: the training, the dashboard design, the regulatory guidance, and the ongoing conversation about what the data are actually saying. Digital assessment has raised the ceiling for what institutions can know about their assessments and their candidates. Reaching that ceiling is a shared endeavour.
Maxinity provides digital exam software for high-stakes medical assessments. This post is part of a series on digital assessment in medical education.