On this page
Sudakov's minoration and the dual Sudakov inequality
Imports 9 library modules and 29 external
- GaussianAnalysis.gaussian.measurable_matrix
- GaussianAnalysis.gaussian.normal_integral
- GaussianAnalysis.gaussian.gauss
- GaussianAnalysis.matrix.euclidean
- GaussianAnalysis.comparison.gauss_smoothing
- GaussianAnalysis.comparison.gauss_concentration
- GaussianAnalysis.comparison.slepian
- GaussianAnalysis.comparison.gauss_shift
- GaussianAnalysis.comparison.escape
External: HB.structures, mathcomp.classical.all_ssreflect_compat, mathcomp.algebra.algebraic_hierarchy.ssralg, mathcomp.algebra.numeric_hierarchy.ssrnum, mathcomp.algebra.interval, mathcomp.algebra.matrix, mathcomp.algebra.ring_tactic, mathcomp.algebra.field_tactic, mathcomp.algebra.arithmetic_tactic, mathcomp.classical.boolp, mathcomp.classical.classical_sets, mathcomp.classical.functions, mathcomp.reals.reals, mathcomp.analysis.ereal, mathcomp.analysis.topology_theory.topology, mathcomp.analysis.normedtype_theory.normedtype, mathcomp.analysis.sequences, mathcomp.analysis.derive, mathcomp.analysis.realfun, mathcomp.analysis.exp, mathcomp.analysis.trigo, mathcomp.analysis.measure_theory.measure, mathcomp.analysis.lebesgue_stieltjes_measure, mathcomp.analysis.lebesgue_measure, mathcomp.analysis.numfun, mathcomp.analysis.measurable_realfun, mathcomp.analysis.lebesgue_integral_theory.lebesgue_integral, mathcomp.analysis.probability_theory.probability, mathcomp.analysis.probability_theory.normal_distribution
Two classical entropy bounds for Gaussian processes, with explicit constants, and the facts they rest on. g has law gauss n.
- gauss_max_lower: the largest of n independent standard normal variables has mean at least sqrt (ln n) / 2 - 2.
- sudakov_minoration (Sudakov): if the points xs i of 'rV[R]_n, i < k + 1, are pairwise at distance at least eps, then eps (sqrt (ln (k + 1)) / 2 - 2) <= sqrt 2 E max_i <g, xs i>. Proof: the Sudakov-Fernique inequality (slepian.v) against independent normal variables of variance eps^2 / 2, then gauss_max_lower.
- gauss_shift_sym: for a measurable symmetric set A, gauss n (h + A) >= exp (- |h|^2 / 2) gauss n A, by the Cameron-Martin formula (gauss_shift.v) and cosh >= 1.
- dual_sudakov (Pajor and Tomczak-Jaegermann, by Talagrand's argument): if nrm is a measurable seminorm with E nrm(g) <= L, the points of the Euclidean ball of radius r that are pairwise more than eps apart for nrm are at most 2 exp (8 r^2 L^2 / eps^2).
- separated_net: if the eps-separated lists of points of a set K have at most M points, K has an eps-net of at most M of its own points, a separated list of largest size.
These two bounds replace volume arguments: covering.v covers the nuclear-norm ball by products of column balls with them.
separated dist K eps s | s is a list of distinct points of K, pairwise more than eps apart for dist |
Main results
| Results | Statement |
|---|---|
Sudakov's minoration: if xs i, i < k + 1, are pairwise at distance at least eps in 'rV[R]_n, then eps (sqrt (ln (k + 1)) / 2 - 2) <= sqrt 2 E max_i <g, xs i> for g of law gauss n; the maximum of n independent standard normal variables has mean at least sqrt (ln n) / 2 - 2. | |
The dual Sudakov inequality of Pajor and Tomczak-Jaegermann (Talagrand's proof): for a measurable seminorm nrm with E nrm(g) <= L, the points of the Euclidean ball of radius r that are pairwise more than eps apart for nrm are at most 2 exp (8 r^2 L^2 / eps^2). gauss n (h + A) >= exp (- |h|^2 / 2) gauss n A for A measurable and symmetric. A set whose eps-separated lists have at most M points has an eps-net of at most M of its points. |
Declarations8 exported, 1 local
Context {R : realType} {T : eqType}. Variables (dist : T -> T -> R) (K : set T) (eps : R). Hypothesis dist_sym : forall x y, dist x y = dist y x. Hypothesis dist_refl : forall x, dist x x <= eps.
forall {R : realType} {T : eqType}, (T -> T -> R) -> set T -> R -> seq T -> Prop
Definition separated (s : seq T) := [/\ uniq s, {subset s <= K} & forall x y, x \in s -> y \in s -> x != y -> eps < dist x y].
s is a list of distinct points of K, pairwise more than eps apart.
Used by 4 declarations in 2 files
- GaussianAnalysis.matrix.covering: frob_sep, colmax_sep, dual_ball_covering
- this file: separated_net
forall {R : realType} {T : eqType} [dist : T -> T -> R] [K : set T] [eps : R], (forall x y : T, dist x y = dist y x) -> (forall x : T, dist x x <= eps) -> forall [M : nat], (forall s : seq T, separated dist K eps s -> (size s <= M)%N) -> exists s : seq T, [/\ {subset s <= K}, (size s <= M)%N & forall x : T, K x -> exists2 y : T, y \in s & dist x y <= eps]
If the eps-separated lists of points of K have at most M points, K has an eps-net of at most M of its points: a separated list of largest size.
Stated in the README together with dual_sudakov.
Statement as written in the source
Lemma separated_net (M : nat) : (forall s, separated s -> (size s <= M)%N) -> exists s : seq T, [/\ {subset s <= K}, (size s <= M)%N & forall x, K x -> exists2 y, y \in s & dist x y <= eps].
Used by 1 declaration in 1 file
- GaussianAnalysis.matrix.covering: dual_ball_covering
Context {R : realType}. Local Notation N := (@normal_prob R 0 1).
forall {R : realType} [t : R], 0 <= t -> ((expR (- ((t + 1) ^+ 2 / 2)) / 3)%:E <= normal_prob 0 1 `]t, (t + 1)%R])%E
A lower bound on the standard normal probability of ]t, t + 1].
Statement as written in the source
Lemma normal_prob_itv_ge (t : R) : 0 <= t -> ((expR (- ((t + 1) ^+ 2 / 2)) / 3)%:E <= N `]t, (t + 1)%R]%classic)%E.
Used by 1 declaration in 1 file
- this file: gauss_max_lower
Let mx_norm_frob m n' (B : 'M[R]_(m, n')) : `|B| <= frobenius B.
Used by 1 declaration in 1 file
- this file: gauss_max_lower
forall {R : realType} (k : nat), Num.ExtraDef.sqrtr (ln k.+1%:R) / 2 - 2 <= \int[gauss k.+1]_g rmax (g : 'rV_k.+1)
The largest of n independent standard normal variables has mean at least sqrt (ln n) / 2 - 2.
Stated in the README together with sudakov_minoration.
Statement as written in the source
Used by 1 declaration in 1 file
- this file: sudakov_minoration
Context {R : realType}.
Statement as written in the source
Used by 1 declaration in 1 file
- this file: sudakov_minoration
forall {R : realType} [n k : nat] [xs : 'I_k.+1 -> 'rV_n] [eps : R], 0 <= eps -> (forall i j : 'I_k.+1, i != j -> eps <= frobenius (xs i - xs j)) -> eps * (Num.ExtraDef.sqrtr (ln k.+1%:R) / 2 - 2) <= Num.ExtraDef.sqrtr 2 * \int[gauss n]_g rmax (\row_i mxdot g (xs i))
Sudakov's minoration: if the points xs i of 'rV[R]_n are pairwise at distance at least eps, then E max_i <g, xs i> is at least eps (sqrt (ln (k + 1)) / 2 - 2) / sqrt 2.
Sudakov's minoration: if xs i, i < k + 1, are pairwise at distance at least eps in 'rV[R]_n, then eps (sqrt (ln (k + 1)) / 2 - 2) <= sqrt 2 E max_i <g, xs i> for g of law gauss n; the maximum of n independent standard normal variables has mean at least sqrt (ln n) / 2 - 2.
Statement as written in the source
Used by 2 declarations in 2 files
- GaussianAnalysis.matrix.covering: frob_sep
- GaussianAnalysis.matrix.tensor_packing: sudakov_mx_series
Context {R : realType} {n : nat}.
forall {R : realType} {n : nat} [A : set 'rV_n] (h : 'rV_n), (measure_matrix_display default_measure_display).-measurable A -> (forall x : 'rV_n, A x -> A (- x)) -> ((expR (- (mxdot h h / 2)))%:E * gauss n A <= gauss n [set x | A (x - h)%R])%E
The Gaussian measure of a symmetric set decreases at most by the factor exp (- |h|^2 / 2) under the translation by h (Cameron-Martin).
Stated in the README together with dual_sudakov.
Statement as written in the source
Used by 1 declaration in 1 file
- this file: dual_sudakov
forall {R : realType} {n : nat} [nrm : 'rV_n -> R] [r eps L : R] [k : nat] [xs : 'I_k.+1 -> 'rV_n], measurable_fun [set: 'rV_n] nrm -> (forall x : 'rV[R]_n, nrm (- x) = nrm x) -> (forall x y : 'rV[R]_n, nrm (x + y) <= nrm x + nrm y) -> (forall (c : R) (x : 'rV[R]_n), 0 <= c -> nrm (c *: x) = c * nrm x) -> (gauss n).-integrable [set: 'rV_n] (EFin \o nrm) -> 0 < eps -> 0 < L -> \int[gauss n]_g nrm g <= L -> (forall i : 'I_k.+1, frobenius (xs i) <= r) -> (forall i j : 'I_k.+1, i != j -> eps < nrm (xs i - xs j)) -> k.+1%:R <= 2 * expR (8 * r ^+ 2 * L ^+ 2 / eps ^+ 2)
The dual Sudakov inequality of Pajor and Tomczak-Jaegermann, by Talagrand's argument: if nrm is a seminorm with E nrm(g) <= L, points of the Euclidean ball of radius r that are pairwise more than eps apart for nrm are at most 2 exp (8 r^2 L^2 / eps^2).
The dual Sudakov inequality of Pajor and Tomczak-Jaegermann (Talagrand's proof): for a measurable seminorm nrm with E nrm(g) <= L, the points of the Euclidean ball of radius r that are pairwise more than eps apart for nrm are at most 2 exp (8 r^2 L^2 / eps^2). gauss n (h + A) >= exp (- |h|^2 / 2) gauss n A for A measurable and symmetric. A set whose eps-separated lists have at most M points has an eps-net of at most M of its points.
Statement as written in the source
Theorem dual_sudakov (nrm : 'rV[R]_n -> R) (r eps L : R) k (xs : 'I_k.+1 -> 'rV[R]_n) : measurable_fun setT nrm -> (forall x, nrm (- x) = nrm x) -> (forall x y, nrm (x + y) <= nrm x + nrm y) -> (forall (c : R) x, 0 <= c -> nrm (c *: x) = c * nrm x) -> (gauss n).-integrable setT (EFin \o nrm) -> 0 < eps -> 0 < L -> \int[gauss n]_g nrm g <= L -> (forall i, frobenius (xs i) <= r) -> (forall i j, i != j -> eps < nrm (xs i - xs j)) -> k.+1%:R <= 2 * expR (8 * r ^+ 2 * L ^+ 2 / eps ^+ 2).
Used by 1 declaration in 1 file
- GaussianAnalysis.matrix.covering: colmax_sep