Hanqing Li Hanqing Li 李汉青


Local asymptotic normality is a quadratic approximation of the entire likelihood-ratio process on the root-\(n\) parameter scale. It identifies a Gaussian shift limit and thereby determines local testing power, minimax risk, and the form of regular estimator limits.

The LAN property

Definition. A sequence of experiments \(\{P_{n,\theta}:\theta\in\Theta\subset\mathbb R^p\}\) is locally asymptotically normal at \(\theta_0\) with rate matrices \(r_n\) and information \(I\) if, for every fixed \(h\), \[ \log\frac{\mathrm{d}P_{n,\theta_0+r_n^{-1}h}} {\mathrm{d}P_{n,\theta_0}} = h^\top\Delta_n-\frac12h^\top Ih+o_{P_{n,\theta_0}}(1), \] where \[ \Delta_n\rightsquigarrow N_p(0,I) \quad\text{under }P_{n,\theta_0}. \] In regular i.i.d. models, \(r_n=\sqrt n\,I_p\).

The same matrix \(I\) is the covariance of the central sequence and the negative quadratic curvature of the log likelihood. This compatibility ensures that the limiting exponential likelihood ratio has expectation one.

Quadratic mean differentiability

Definition. A dominated model \(\{p_\theta:\theta\in\Theta\}\) is differentiable in quadratic mean at \(\theta_0\) if a score \(\dot\ell_{\theta_0}\in L_2^p(P_{\theta_0})\) exists such that \[ \int\left[ \sqrt{p_{\theta_0+t}} -\sqrt{p_{\theta_0}} -\frac12t^\top\dot\ell_{\theta_0}\sqrt{p_{\theta_0}} \right]^2\mathrm{d}\mu =o(\|t\|^2). \]

Proposition. Quadratic mean differentiability implies \[ P_{\theta_0}\dot\ell_{\theta_0}=0, \qquad I_{\theta_0} = P_{\theta_0} (\dot\ell_{\theta_0}\dot\ell_{\theta_0}^\top) <\infty. \]

Proof. The \(L_2\)-norm of every square-root density equals one. Expand \[ \|\sqrt{p_{\theta_0+t}}\|_2^2-\|\sqrt{p_{\theta_0}}\|_2^2=0 \] using the quadratic-mean expansion. The coefficient of the linear term is \(t^\top P_{\theta_0}\dot\ell_{\theta_0}\), which must vanish for every \(t\). Square integrability of the score is part of the expansion; its second moment defines \(I_{\theta_0}\). \(\square\)

DQM implies LAN for i.i.d. samples

Theorem. If the one-observation model is differentiable in quadratic mean at \(\theta_0\), then for i.i.d. observations and every fixed \(h\), \[ \log\frac{\mathrm{d}P_{\theta_0+h/\sqrt n}^{\,n}} {\mathrm{d}P_{\theta_0}^{\,n}} = h^\top\Delta_n -\frac12h^\top I_{\theta_0}h +o_{P_{\theta_0}}(1), \] where \[ \Delta_n = \frac1{\sqrt n}\sum_{i=1}^n \dot\ell_{\theta_0}(X_i) \rightsquigarrow N_p(0,I_{\theta_0}). \]

Proof outline. Put \[ s_{n,h}(x) = \sqrt{\frac{p_{\theta_0+h/\sqrt n}(x)} {p_{\theta_0}(x)}}-1. \] DQM gives \[ s_{n,h} = \frac1{2\sqrt n}h^\top\dot\ell_{\theta_0} +r_{n,h}, \qquad P_{\theta_0}r_{n,h}^2=o(n^{-1}). \] Since \(\log(p_{\theta_0+h/\sqrt n}/p_{\theta_0}) =2\log(1+s_{n,h})\), use \[ 2\log(1+s)=2s-s^2+O(|s|^3) \] after truncating rare large \(s\). Summing linear terms yields \(h^\top\Delta_n\). The normalization \(P_{\theta_0}(1+s_{n,h})^2=1\) determines the mean correction, and the sum of quadratic terms converges to \(-\frac12h^\top I_{\theta_0}h\). DQM controls the accumulated remainders. The multivariate central limit theorem gives the central-sequence limit. \(\square\)

Weak convergence to the Gaussian shift

Theorem. If LAN holds, then for every finite \(K=\{h_0=0,h_1,\ldots,h_k\}\), the local experiments \[ \{P_{n,\theta_0+r_n^{-1}h}:h\in K\} \] converge weakly to the Gaussian shift experiment \[ \{N_p(Ih,I):h\in K\} \] observed through its canonical statistic.

Proof. Under the base parameter, the vector of log likelihood ratios is \[ \left( h_j^\top\Delta_n-\tfrac12h_j^\top Ih_j+o_p(1) \right)_{j=1}^k. \] By the continuous-mapping theorem it converges jointly to the corresponding vector with \(\Delta\sim N(0,I)\). Exponentiation gives the likelihood-ratio vector of the Gaussian shift, whose coordinates have mean one. Apply the likelihood-ratio criterion for weak convergence of experiments. \(\square\)

Local alternatives and the central sequence

Corollary. Under \(P_{n,\theta_0+r_n^{-1}h}\), \[ \Delta_n\rightsquigarrow N_p(Ih,I). \]

This follows from Le Cam's third lemma. Local alternatives change the mean of the score but not its covariance to first order.

Reparameterization

Proposition. If \(\eta=\phi(\theta)\) is differentiable at \(\theta_0\) with nonsingular Jacobian \(J=\partial\phi(\theta_0)/\partial\theta^\top\), then the information in \(\eta\)-coordinates is \[ I_\eta=J^{-\top}I_\theta J^{-1}. \]

The quadratic form is invariant: \[ h_\theta^\top I_\theta h_\theta =h_\eta^\top I_\eta h_\eta, \qquad h_\eta=Jh_\theta. \] Thus LAN information is a coordinate tensor defining the local statistical metric.

Uniform LAN and local asymptotic quadraticity

Pointwise LAN holds for each fixed \(h\). Many estimator and minimax arguments need the remainder uniform on compact sets: \[ \sup_{h\in K} \left| \log\frac{\mathrm{d}P_{n,\theta_0+r_n^{-1}h}} {\mathrm{d}P_{n,\theta_0}} -h^\top\Delta_n+\frac12h^\top Ih \right| \to_p0. \] Local asymptotic quadraticity allows a random or parameter-dependent information matrix and is useful beyond exactly Gaussian limits. Uniformity must be proved; it does not follow from pointwise LAN alone.