Varentropy decreases under the polar transform

Date

2016

Authors

Arıkan, E.

Editor(s)

Advisor

Supervisor

Co-Advisor

Co-Supervisor

Instructor

Source Title

IEEE Transactions on Information Theory

Print ISSN

0018-9448

Electronic ISSN

Publisher

Institute of Electrical and Electronics Engineers Inc.

Volume

62

Issue

6

Pages

3390 - 3400

Language

English

Journal Title

Journal ISSN

Volume Title

Series

Abstract

We consider the evolution of variance of entropy (varentropy) in the course of a polar transform operation on binary data elements (BDEs). A BDE is a pair (X,Y) consisting of a binary random variable X and an arbitrary side information random variable Y. The varentropy of (X,Y) is defined as the variance of the random variable-log pX|Y(X|Y). A polar transform of order two is a certain mapping that takes two independent BDEs and produces two new BDEs that are correlated with each other. It is shown that the sum of the varentropies at the output of the polar transform is less than or equal to the sum of the varentropies at the input, with equality if and only if at least one of the inputs has zero varentropy. This result is extended to polar transforms of higher orders and it is shown that the varentropy asymptotically decreases to zero when the BDEs at the input are independent and identically distributed.

Course

Other identifiers

Book Title

Degree Discipline

Degree Level

Degree Name

Citation

Published Version (Please cite this version)