Psychometrics · 14 min read

Why Generic Assessments Don't Work for Your Company

SHL, TestGorilla, Harver — they offer the same tests to everyone. Why that's a problem and what the alternative is.

Door Ingmar van Maurik · Founder & CEO, Making Moves


The assessment industry sells one-size-fits-all

The big assessment publishers — SHL, Harver, TestGorilla, Saville, Aon Assessment Solutions — have a solid business model: develop one test and sell it to thousands of companies. It's scalable, profitable, and the marketing sounds convincing: "validated on 100,000+ candidates", "proven predictive value", "scientifically backed".

The problem: your company isn't the same as those thousands of other companies. The developer who succeeds at a corporate bank is a different profile than the developer who thrives at a fast-growing startup. The sales manager who tops performance in an enterprise environment has different traits than someone who excels in an SMB team.

And yet all these companies use the same test, with the same norm group, and the same interpretation.

The fundamental problem with generic tests

Generic norm groups miss the context

Generic assessment scores are compared to a norm group of thousands of random people. This norm group is a statistical average that isn't specifically relevant for anyone:

  • Your ideal developer might score lower on extraversion than the market average, but that's precisely what works in your introvert-friendly engineering culture
  • A candidate who scores "average" on the generic norm group could be an absolute top performer in your context
  • A high score on "conscientiousness" predicts success at an accounting firm but might signal micromanagement tendencies at a creative agency
  • The consequence: you filter out good candidates and let less suitable ones through, simply because you're using the wrong benchmark.

    No company context or culture fit

    A personality test measuring "teamwork" doesn't account for what teamwork looks like in your specific culture:

  • At company A, teamwork means daily standups, pair programming, and consensus-based decision making
  • At company B, teamwork means autonomous contributions toward a shared goal, with weekly meetings
  • At company C, teamwork means cross-functional collaboration with a high degree of conflict tolerance
  • The same "teamwork" score can be a perfect match at company A and a complete mismatch at company C. The generic test doesn't make this distinction.

    Static models in a dynamic world

    The test doesn't change. Whether you administer it in 2020 or 2026, it's the same test with the same norm group and the same interpretation. But your company changes continuously:

  • Technology stack evolves — the skills that were relevant 3 years ago are different today
  • Culture shifts — after a merger, reorganization, or growth from 50 to 200 employees, what constitutes a good fit changes
  • Roles transform — the job content of a "product manager" today differs from 5 years ago
  • Market conditions — in a tight labor market, different competencies become critical than in a loose market
  • A static assessment cannot keep up with this dynamism by definition.

    Limited predictive value

    Let's look at the numbers honestly. Research shows that generic cognitive tests have a correlation of r = 0.30-0.50 with job performance. Sounds reasonable, but what does this mean in practice?

  • A correlation of 0.30 explains only 9% of the variance in job performance
  • That means 91% of the variance is determined by other factors
  • Even at r = 0.50, only 25% is explained
  • This is better than nothing — and certainly better than unstructured interviews (r = 0.20) — but far from the accuracy companies think they're getting when paying for a "scientifically validated" assessment.

    The costs add up

    Generic assessments aren't cheap:

    ProviderCost per candidateCost at 500 candidates/year

    |----------|-------------------|----------------------------|

    SHL€80-€150€40,000-€75,000 Harver€50-€100€25,000-€50,000 TestGorilla€30-€60€15,000-€30,000 Assessment center€500-€2,000€250,000+ (selective)

    And this excludes ATS integration, training for interpretation, and the time recruiters spend reading reports they often don't fully understand.

    The alternative: custom assessments

    Step 1: analyze your top performers

    Instead of using generic tests, start by analyzing your best employees:

  • What cognitive abilities do they share? Perhaps it's not abstract reasoning, but pattern recognition in complex data or rapid context switching between tasks
  • What personality traits predict success? Not based on generic theory, but based on your data
  • What behavior do they show in specific situations? How do your top performers react to ambiguity, conflict, or pressure?
  • What motivation patterns exist? Are your best people driven by autonomy, mastery, or purpose?
  • This produces a success profile unique to your organization — and it can vary per role.

    Step 2: build your own norm groups

    Your scores are compared with your own employees, not the market:

  • A new developer is compared with your current developers — segmented by seniority level and team
  • A sales candidate is benchmarked against your proven top performers in sales
  • The norm group grows with every hire, making the comparison increasingly accurate
  • Step 3: continuous improvement

    After every hire, the model is validated:

    1. The candidate scores on the assessment

    2. After 6 months: performance review

    3. Calculate correlation: was the prediction correct?

    4. Adjust the model based on results

    5. Repeat — the system gets smarter

    This is the principle of continuous validation: your assessment evolves with your organization. After 50-100 hires, you have a model that predicts significantly better than any generic assessment.

    Step 4: integrate into the hiring flow

    Custom assessments deliver the most value when seamlessly integrated:

  • Candidate applies via your [job page](/artikelen/high-converting-job-pages)
  • Immediately after applying, the assessment starts — no separate links, no external tools
  • Results are automatically combined with [AI CV screening](/artikelen/ai-replacing-cv-screening) and optionally an [AI pre-interview](/artikelen/ai-pre-interviews-future)
  • The recruiter sees one integrated profile, not separate reports from different tools
  • The business case

    Say you make 100 hires per year with an average failure rate of 15% (the market average).

    Current situation with generic assessments:

  • 15 bad hires per year
  • [Cost per bad hire](/artikelen/how-much-bad-hire-costs): €50,000-€100,000
  • Total damage: €750,000-€1,500,000 per year
  • After implementing custom assessments:

  • 20-30% improvement in predictive validity
  • 10-11 bad hires instead of 15
  • Savings: 4-5 bad hires x €50,000-€100,000 = €200,000-€500,000 per year
  • The investment in your own assessment system — as part of a complete hiring platform — pays for itself within the first year. And it becomes more valuable every year as the model learns.

    Beyond financial savings:

  • Better candidate experience — integrated flow instead of separate tools
  • Faster time-to-hire — automatic scoring without manual interpretation
  • More diversity — bias monitoring on your specific population
  • Strategic insight — what makes people successful at your company?
  • Key takeaways

    Generic assessments are a compromise born of necessity: they were the best option when company-specific solutions were too expensive and too complex. But that time has passed.

    With modern technology and your own data, you can build assessments that:

  • Are based on your top performers, not generic norm groups
  • Continuously improve after every hire
  • Seamlessly integrate into your hiring flow
  • Predict significantly better who will succeed
  • The future of assessments isn't generic. It's company-specific, data-driven, and continuously learning.

    Want to discover how company-specific assessments work in practice? Schedule a demo or explore our AI hiring system that offers custom assessments as core functionality.


    Book an intake call · View our AI Hiring System