Fano Decoding Entropy Bound
Relate decoding errors to conditional entropy and separate channel noise from optimal decoding.
Free theory articleRelate decoding errors to conditional entropy and separate channel noise from optimal decoding.
Concept & interpretation
Fano's inequality relates the probability of error in guessing a discrete random variable to its conditional entropy. It quantifies how much uncertainty remains about a transmitted message even after observing the received signal.
Reproduce the bound
Open the Fano Decoding Entropy Bound module.
- Select Classes 3 and Channel error 0.25.
- Observe that the Fano entropy upper bound matches the Conditional entropy nats.