Delta Method Transformations
Compare tangent-based uncertainty with an exact transformed sampling distribution.
Free theory articleCompare tangent-based uncertainty with an exact transformed sampling distribution.
Concept & interpretation
The delta method approximates the sampling distribution of a transformed random variable. If a sequence of random variables (like a sample mean) converges in probability to a constant, and a function is differentiable at that constant, we can approximate the variance of the transformed variable using the first-order Taylor expansion (the tangent line).
Experiment
Follow these steps using the Delta Method Transformations module to explore the limits of the first-order approximation:
- Set Transform to
Square, Success probability to0.5, and Sample count to10. Observe the Delta variance matches our calculated0.025. - Change Transform to
Centered square(which is g(x) = (x-0.5)²). - Observe that the Transform derivative at p=0.5 is exactly
0, meaning the Delta variance approximation is0. - However, the Exact transformed variance is strictly positive (
0.001125). This demonstrates that when the first derivative vanishes, higher-order terms dominate the true variance.