Introduction
Every forensic evaluator knows the moment. You’ve delivered your opinion on a defendant’s competency, and opposing counsel leans in: “But Doctor — isn’t that just your professional opinion?” How you can answer that question is, in large part, what separates a defensible competency evaluation from a vulnerable one.
The answer lives in two words psychologists use constantly and courts increasingly expect: reliability and validity. Here’s what they actually mean, why the field’s testing standards care about them, and why a standardized T-score belongs in a competency report.
What “defensible” means in forensic testing
Forensic instruments are measured against a published benchmark: the AERA/APA/NCME Standards for Educational and Psychological Testing (2014) — the jointly authored reference the field treats as the bar for sound measurement. An instrument built and documented to those Standards isn’t defensible because its author says so; it’s defensible because its reliability and validity have been quantified, published, and can be examined. The MCES and J-MCES were developed to that benchmark.
Reliability: would the result repeat?
Reliability asks a simple question: if you measured again, would you get the same answer? An instrument that gives different results for the same defendant on Tuesday and Thursday isn’t measuring anything you can rely on. Psychologists quantify this in a few ways:
- Internal consistency — do the items hang together as a coherent measure? Reported as Cronbach’s alpha, where .70 is the usual floor. The combined MCES/J-MCES system reports α = .99, with subscale reliabilities consistently above .90 for both adults and juveniles.
- Test–retest — does the score hold across administrations? Agreement across phases is strong (average intraclass correlation ≈ .80).
High reliability is what lets you say a change in score reflects a change in the defendant, not noise in the instrument.
Validity: does it measure competency?
Reliability is necessary but not sufficient — a bathroom scale reliably reports a number, but not your competency. Validity asks whether the instrument measures the thing it claims to. The strongest evidence is how the instrument’s conclusions compare to an external truth:
- Against courts’ own findings: the instrument’s competency classifications agreed with courts’ independent determinations at Cohen’s κ = .76, with an area under the curve of .95 and roughly 92% classification accuracy (sensitivity ~93%, specificity ~89%).
- Against another competency measure: a convergent correlation of r = .88 with an established adult competency instrument.
- Structurally: a factor analysis found a single dominant competency factor explaining the large majority of variance — evidence the scale measures one coherent construct rather than a grab-bag.
Why T-scores belong in the report
A narrative opinion — “the defendant demonstrated limited understanding” — is a description. A T-score is a measurement. Normed on a reference sample of 437 individuals across ages 11 to 79, MCES/J-MCES results are reported as T-scores with a mean of 50 and a standard deviation of 10. So a score of 60 isn’t a vibe; it’s a defined position — one standard deviation above the normative mean. That standardization does three things a narrative can’t:
- It compares. The same number means the same thing across examiners and cases.
- It tracks. Re-administer the instrument and the change is quantified, not asserted.
- It anchors testimony. “60T, one SD above the normative mean” is a far sturdier place to stand than “in my impression.”
What this buys you on the stand
Return to that cross-examination question. With a standardized instrument, the honest answer is no longer “yes, it’s my opinion” — it’s “my opinion is supported by a normed instrument with published reliability and validity, built to the 2014 testing Standards, whose classifications agree with courts’ own findings about 92% of the time.” That is the difference defensibility makes — not that you’re never challenged, but that you have something solid to stand on when you are.
Put measurement behind your testimony. The MCES and J-MCES deliver normed T-scores, percentiles, and benchmarked classifications you can defend. Evaluator subscribers also get APA-approved CE at a discount.