Evidence library · peer-reviewed literature

Research evidence & success rates behind our methods

Direct answer: Real World Careers uses work-relevant cognitive tasks, person–job matching, and structured decision support — the same families of methods studied for decades in personnel psychology. Classic meta-analysis reports cognitive ability predicting job performance at about r ≈ .51 (Schmidt & Hunter, 1998). Modern re-analyses still support meaningful prediction while revising some absolute figures (Sackett et al., 2022). r is not a “success percentage.” RWC-specific outcome percentages come only from approved pilot case studies — we do not invent them.

What the literature finds (with citations)

1. Cognitive ability is among the strongest predictors of job performance

Schmidt & Hunter (1998) synthesized 85 years of selection research. General mental ability (GMA) showed operational validity around r = .51 for job performance in medium-complexity jobs — often summarized as the single best (or among the best) predictors across occupations. Validity is typically higher for more complex professional and technical work (figures often cited near .56–.58 in that research tradition).

What that means for hiring: better ranking of applicants on cognitive/work-relevant problem-solving tends to raise average performance among those hired — especially when you can be selective.

Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology. Psychological Bulletin, 124(2), 262–274. https://doi.org/10.1037/0033-2909.124.2.262

2. Modern science still supports ability-related assessment — carefully

Sackett, Zhang, Berry, & Lievens (2022) revisited range-restriction corrections and argued many classic meta-analytic validities were overstated. Cognitive ability remains a meaningful predictor under more conservative assumptions; absolute coefficients are often discussed as lower than .51. Structured interviews remain highly competitive in this updated picture.

Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection. Journal of Applied Psychology, 107(11), 2040–2068. https://doi.org/10.1037/apl0000994

3. Person–job fit improves attitudes and reduces quit intent

Kristof-Brown, Zimmerman, & Johnson (2005) meta-analyzed 172 studies and 836 effect sizes. Person–job fit relates positively to job satisfaction, organizational commitment, and performance, and negatively to withdrawal behaviors and intent to leave.

Kristof-Brown, A. L., Zimmerman, R. D., & Johnson, E. C. (2005). Consequences of individuals’ fit at work. Personnel Psychology, 58(2), 281–342. https://doi.org/10.1111/j.1744-6570.2005.00672.x

4. Structured evaluation beats unstructured gut feel

McDaniel et al. (1994) found structured employment interviews more valid than unstructured interviews (large multi-study base). Shared rating language and consistent questions improve prediction versus improvised “culture fit.”

McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. D. (1994). The validity of employment interviews. Journal of Applied Psychology, 79(4), 599–616. https://doi.org/10.1037/0021-9010.79.4.599

5. Combining strong methods raises prediction

Schmidt & Hunter (1998) reported that pairing GMA with other strong methods (e.g., integrity tests or structured interviews) yields higher composite validity — often cited near r ≈ .63–.65 for top combinations. Real World Careers is designed as one structured input alongside interviews and experience — not a sole hire/reject score.

6. Economic utility of better selection

Schmidt & Hunter (1998) summarize utility research: the standard deviation of the dollar value of output across workers is often at least ~40% of mean salary as a lower bound. Superior workers (e.g., ~84th percentile) can produce substantially more than average — skilled/managerial bands often discussed with large percentage-output spreads. Valid selection methods therefore create large economic gains when applied at scale.

Use this to explain why signal matters. Plug your own salary and turnover for ROI — we do not invent a single dollar figure for every buyer.

Success-rate style figures (what they mean)

FigureMeaningSourceRWC claim?
r ≈ .51Classic corrected validity of GMA for job performanceSchmidt & Hunter (1998)Yes — literature context
r higher for complex jobsAbility matters more as job complexity risesSchmidt & Hunter traditionYes — literature
~r .63–.65 compositesGMA + strong second method (classic table)Schmidt & Hunter (1998)Yes — multi-method framing
Lower absolute r under Sackett 2022More conservative meta-analytic assumptionsSackett et al. (2022)Yes — honesty with sophisticated buyers
≥40% of salary SDyLower-bound economic spread of performance valueSchmidt & Hunter utilityYes — utility education
~46% new hires fail in 18 monthsIndustry survey on hire failureLeadership IQ (2005) — not peer-reviewed metaContext only
Your pilot metricsCompletion %, time-to-shortlist, retention, etc.RWC customer dataOnly RWC-specific “success %”

Do not say: “Our test is 51% accurate” or “we reduce bad hires 60%.” Validity is not accuracy percentage. Outcome percentages require approved pilot data.

How this maps to Real World Careers

RWC featureResearch family
50 timed items · six work-relevant domains · max score 110Cognitive / multi-ability work-relevant performance
Career Fit / Hiring Fit / Federal Fit matchingPerson–job (demands–abilities) fit
Shared domain language for managersStructured evaluation vs unstructured interview noise
Credential verify + cohort/compliance exportProcess documentation (Uniform Guidelines–aligned intent)
Federal Fit labeled exploration-onlyCorrect use case — not a qualification determination

Legal and professional frameworks

Full reference list

Hunter, J. E., & Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72–98.

Kristof-Brown, A. L., Zimmerman, R. D., & Johnson, E. C. (2005). Consequences of individuals’ fit at work: A meta-analysis of person–job, person–organization, person–group, and person–supervisor fit. Personnel Psychology, 58(2), 281–342. https://doi.org/10.1111/j.1744-6570.2005.00672.x

McDaniel, M. A., Whetzel, D. L., Schmidt, F. L., & Maurer, S. D. (1994). The validity of employment interviews: A comprehensive review and meta-analysis. Journal of Applied Psychology, 79(4), 599–616. https://doi.org/10.1037/0021-9010.79.4.599

Sackett, P. R., Zhang, C., Berry, C. M., & Lievens, F. (2022). Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range. Journal of Applied Psychology, 107(11), 2040–2068. https://doi.org/10.1037/apl0000994

Salgado, J. F., Anderson, N., Moscoso, S., Bertua, C., de Fruyt, F., & Rolland, J. P. (2003). International validity generalization of GMA and cognitive abilities: A European Community meta-analysis. Personnel Psychology, 56, 573–605.

Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. Psychological Bulletin, 124(2), 262–274. https://doi.org/10.1037/0033-2909.124.2.262

Society for Industrial and Organizational Psychology. (2018). Principles for the validation and use of personnel selection procedures (5th ed.).

U.S. Equal Employment Opportunity Commission et al. (1978). Uniform Guidelines on Employee Selection Procedures.

Leadership IQ. (2005). Hiring for Attitude (industry survey; ~46% of new hires fail within 18 months — non-peer-reviewed context only).

Related Real World Careers resources

Start Pilot — $750 Career Fit $99 / $199 Employer solutions

Citations describe research context for the class of methods Real World Careers draws on. They are not Real World Careers customer outcome statistics. Not legal advice. Not a job guarantee. Not an IQ classification or medical exam. Federal Fit is exploration / decision support — not a qualification determination.