← Back to Testify
QUESTION DEVELOPMENT METHODOLOGY

A good practice question must test law, not pattern recognition.

Testify’s original questions are designed to require legal application under facts. The methodology below explains what the platform checks, what it teaches after an answer, and where automated QA stops and substantive legal review begins.

See the free practice loop →
1 • AUTHORSHIP

Start with the doctrine and the decision the learner must make.

An original item is built around a legally meaningful distinction: a rule, exception, procedural posture, timing requirement, element, remedy, burden, or competing doctrine. Facts should create the legal issue without naming the answer in the stem.

2 • KEY VALIDATION

The keyed choice must remain the best answer after competing rules are considered.

Review asks whether another choice becomes defensible because of an exception, missing fact, jurisdiction qualifier, procedural posture, or overbroad statement. An answer is not treated as sound merely because it matches the intended rule.

3 • DISTRACTORS

Wrong choices should fail for a legal reason.

Distractors are screened for implausibility, grammatical giveaways, repeated templates, extreme length cues, doctrine-name leakage, and choices that are so obviously wrong they do not test analysis. A distractor should usually represent a real legal confusion without becoming another correct answer.

4 • TEACHING LAYER

The explanation is structured around transfer.

Core bar-style items are designed to support a governing explanation, answer-specific A–D rationales, a Fact Flip that changes a material fact, an authority anchor, and a next study action. The goal is to show not just what won, but what fact or rule boundary would change the result.

A–D rationales

Each answer choice should receive an answer-specific explanation rather than one generic paragraph reused four times.

Fact Flip

A material fact is changed so the learner can see where the governing rule stops or a competing doctrine begins.

Authority anchor

Authorities are included as study anchors where appropriate. They are not presented as exhaustive legal research or a substitute for current primary law.

Next review action

Weak, low-confidence, or overdue material can return through spaced repair instead of disappearing after one attempt.

5 • AUTOMATED QA

Automation finds structural risk; it does not certify law.

Current structural checks include answer-position distribution, exact and near duplicates, answer-length cues, repeated key patterns, malformed choice sets, missing rationales, missing Fact Flips, missing authority anchors, stem-length flags, topic coverage, and selected rule-leakage patterns.

Those checks cannot establish substantive legal accuracy, current-law treatment, ambiguity, exception handling, or psychometric equivalence to an official exam. Those remain separate review questions.

6 • CORRECTIONS

Material changes return to review.

A question can be returned to the review queue because of user feedback, a legal update, an explanation defect, a changed authority, calibration data, or a material rewrite. Testify’s beta reporting system is intentionally built to surface criticism rather than suppress it.

7 • SOURCE BOUNDARY

Original Testify content is kept distinct from official or licensed content.

The current core bank is independently authored. Public official references may be linked or cited when legally appropriate. Content should be labeled “licensed” only if Testify later has an actual license granting the relevant use rights. Protected NCBE or competitor questions must not be scraped, cloned, or closely paraphrased.

Current release standard: Automated structural screening is reported separately from substantive legal approval. The complete bank should not be represented as commercially certified until the documented substantive review requirement is satisfied.