Neyman–Pearson Randomized Test
Spend a false-positive budget on the outcomes with the strongest likelihood ratios.
Free theory articleSpend a false-positive budget on the outcomes with the strongest likelihood ratios.
Concept & interpretation
The Neyman–Pearson lemma provides the optimal way to test a simple null hypothesis against a simple alternative hypothesis. It asserts that the test with the highest power for a given size α is a likelihood-ratio test. For discrete distributions, achieving the exact size α often requires randomizing the decision at the boundary.
Experiment
Follow these ordered instructions using the interactive controls to observe how the randomized decision rule is constructed:
- Adjust the Alpha twelfths slider control to 4 (which equals an α of 4/12).
- Observe the mathematical results in the Rejection Probabilities section: φ2 becomes 1, φ1 becomes 1/2, and φ0 remains 0.
- Select an Observed outcome using its slider control to view the specific rejection probability for that particular data point.
Try a full-page version at https://riano.app/module/neyman-pearson-randomized-test to observe how boundary cases like α = 0 or α = 1 completely constrain or relax the test.