Rényi entropy yields artificial biases not in the data and incorrect updating due to the finite-size data

Abstract

We show that the Rényi entropy implies artificial biases not warranted by the data and incorrect updating information due to the finite size of the data despite being additive. It is demonstrated that this is so because it does not conform to the system and subset independence axioms of Shore and Johnson [J. IEEE Trans. Inf. Theory 26, 26 (1980)]. We finally show that the escort averaged constraints do not remedy the situation.

Description

Citation

Oikonomou, T.; Bagci, G. B. (2019). Rényi entropy yields artificial biases not in the data and incorrect updating due to the finite-size data. Physical Review E, 99(3), 032134. DOI: 10.1103/PhysRevE.99.032134

Collections

Endorsement

Review

Supplemented By

Referenced By