Top Qs
Timeline
Chat
Perspective

Rademacher distribution

Discrete probability distribution From Wikipedia, the free encyclopedia

Remove ads

In probability theory and statistics, the Rademacher distribution (which is named after Hans Rademacher) is a discrete probability distribution where a random variate X has a 50% chance of being +1 and a 50% chance of being −1.[1]

Quick Facts Support, PMF ...

A series (that is, a sum) of Rademacher distributed variables can be regarded as a simple symmetrical random walk where the step size is 1.

Remove ads

Mathematical formulation

Summarize
Perspective

The probability mass function of this distribution is

In terms of the Dirac delta function, as

Remove ads

Bounds on sums of independent Rademacher variables

Summarize
Perspective

There are various results in probability theory around analyzing the sum of i.i.d. Rademacher variables, including concentration inequalities such as Bernstein inequalities as well as anti-concentration inequalities like Tomaszewski's conjecture.

Concentration inequalities

Let {xi} be a set of random variables with a Rademacher distribution. Let {ai} be a sequence of real numbers. Then

where ||a||2 is the Euclidean norm of the sequence {ai}, t > 0 is a real number and Pr(Z) is the probability of event Z.[2]

Let Y = Σ xiai and let Y be an almost surely convergent series in a Banach space. The for t > 0 and s ≥ 1 we have[3]

for some constant c.

Let p be a positive real number. Then the Khintchine inequality says that[4]

where c1 and c2 are constants dependent only on p.

For p ≥ 1,

Tomaszewski’s conjecture

In 1986, Bogusław Tomaszewski proposed a question about the distribution of the sum of independent Rademacher variables. A series of works on this question[5][6] culminated into a proof in 2020 by Nathan Keller and Ohad Klein of the following conjecture.[7]

Conjecture. Let , where and the 's are independent Rademacher variables. Then

For example, when , one gets the following bound, first shown by Van Zuijlen.[8]

The bound is sharp and better than that which can be derived from the normal distribution (approximately Pr > 0.31).

Remove ads

Applications

The Rademacher distribution has been used in bootstrapping. See Chapter 17 of Testing Statistical Hypotheses for example.[9] The distribution is particularly useful in high-dimensional statistics.[10]

The Rademacher distribution can be used to show that normally distributed and uncorrelated does not imply independent.

Random vectors with components sampled independently from the Rademacher distribution are useful for various stochastic approximations, for example:

Rademacher random variables are used in the Symmetrization Inequality.

  • Bernoulli distribution: If X has a Rademacher distribution, then has a Bernoulli(1/2) distribution.
  • Laplace distribution: If X has a Rademacher distribution and Y ~ Exp(λ) is independent from X, then XY ~ Laplace(0, 1/λ).

References

Loading related searches...

Wikiwand - on

Seamless Wikipedia browsing. On steroids.

Remove ads