← All Objects
Lemma

Stein Bounds for TV Metric

Probability Theory · probability.tex
Stein's Lemma Stein's Equation Stein's Method TV Metric Proposition We take the seperating class that defined the total variation metric : \[ \mathcal{H}_{TV} = \{\mathbb{1}_B : B \in \mathcal{B}(\mathbb{R})\} \] The proposition is as follows: Let $h : \mathbb{R} \to [0,1]$ (a bigger subset than of indicator functions), be a Borel function. Then Then if we denote $f_h$ the solution to the Stein equation associated with $h$ then we have \[ ||f_h||< \sqrt{\pi/2} and ||f'_h||_\infty \le 2 \]
Proof
Recall \[ f_h(x) = e^{x^2/2}\int_{-\infty}^x [h(y)-\mathbb{E}(h(N))]e^{y^2/2} dy \] Note that \[ |h(y)-\mathbb{E}(h(N))|\le 1 \] Note that : \[ \int_{-\infty}^x = \int_{-\infty}^\infty - \int_x^{\infty} = - \int_x^{\infty} \] So, \[ |f_h(x)| \le e^{x^2/2}\int_{-\infty}^x e^{y^2/2} dy \] But also \[ |f_h(x)| \le e^{x^2/2}\int_{x}^\infty e^{y^2/2} dy \] If $x>0$, then \[ |f_h(x)| \le e^{x^2/2}\int_{|x|}^\infty e^{y^2/2} dy \] If $x<0$, then \[ |f_h(x)| \le e^{x^2/2}\int_{-\infty}^{|x|} e^{y^2/2} dy = e^{x^2/2}\int_{|x|}^{\infty} e^{y^2/2} \] We have obtained that \[ |f_h(x)| \le e^{x^2/2}\int_{-\infty}^{|x|} e^{y^2/2} dy = e^{x^2/2}\int_{|x|}^{\infty} e^{-y^2/2} dy \quad \forall x \] The function $x \mapsto e^{x^2/2}\int_{|x|}^{\infty} e^{-y^2/2} dy$ attins its maximum at $x=0$. and \[ \int_0^\infty e^{y^2/2}dy = \sqrt{\pi/2} \] Which proves the result by taking the $\sup$. For the derivative, \[ f_h'(x) = x e^{x^2/2}\int_{-\infty}^x [h(y)-\mathbb{E}(h(N))]e^{-y^2/2}dy + 0 = h(x)-\mathbb{E}(h(N))+xe^{x^2/2}\int ... dy \] Now we take bounds \[ |f'_h(x)| \le 1 + |x|e^{x^2/2}\int_{-\infty}^x e^{-y^2/2} \] \begin{lemma}[Kol Topology > Cvg Cdf Topology] Kolmogorov Metric The topology induced by the Kolmogorov metric is strictly stronger than the topology induced by convergence of CDFs of random variables. \end{lemma}
Depends on
Dependency Graph
flowchart LR classDef current fill:#6366f1,color:#fff,stroke:#4f46e5 n52ca04cc["Stein's Lemma"] n19bfbd84["Stein's Equation"] nca6a663f["Stein's Method"] n046c3273["TV Metric"] ncfde8c86["Proposition"] na8ae60fa["Stein Bounds for TV Metric"]:::current n52ca04cc --> na8ae60fa n19bfbd84 --> na8ae60fa nca6a663f --> na8ae60fa n046c3273 --> na8ae60fa ncfde8c86 --> na8ae60fa click n52ca04cc "../objects/52ca04cc.html" "_self" click n19bfbd84 "../objects/19bfbd84.html" "_self" click nca6a663f "../objects/ca6a663f.html" "_self" click n046c3273 "../objects/046c3273.html" "_self" click ncfde8c86 "../objects/cfde8c86.html" "_self"