A new algorithm for estimating the effective dimension-reduction subspace

Arnak S. Dalalyan, Anatoly Juditsky, Vladimir Spokoiny

Результат исследований: Вклад в журналСтатьярецензирование

25 Цитирования (Scopus)

Аннотация

The statistical problem of estimating the effective dimension-reduction (EDR) subspace in the multi-index regression model with deterministic design and additive noise is considered. A new procedure for recovering the directions of the EDR subspace is proposed. Many methods for estimating the EDR subspace perform principal component analysis on a family of vectors, say β̂1, ... β̂L nearly lying in the EDR subspace. This is in particular the case for the structure-adaptive approach proposed by Hristache et al. (2001a). In the present work, we propose to estimate the projector onto the EDR subspace by the solution to the optimization problem minimize max l=1,...,L β̂lT(I - A)β̂l subject to A ∈ Am*, where Am* is the set of all symmetric matrices with eigenvalues in [0,1] and trace less than or equal to m*, with m* being the true structural dimension. Under mild assumptions, √n-consistency of the proposed procedure is proved (up to a logarithmic factor) in the case when the structural dimension is not larger than 4. Moreover, the stochastic error of the estimator of the projector onto the EDR subspace is shown to depend on L logarithmically. This enables us to use a large number of vectors β̂l for estimating the EDR subspace. The empirical behavior of the algorithm is studied through numerical simulations.

Язык оригиналаАнглийский
Страницы (с-по)1647-1678
Число страниц32
ЖурналJournal of Machine Learning Research
Том9
СостояниеОпубликовано - авг. 2008
Опубликовано для внешнего пользованияДа

Fingerprint

Подробные сведения о темах исследования «A new algorithm for estimating the effective dimension-reduction subspace». Вместе они формируют уникальный семантический отпечаток (fingerprint).

Цитировать