統計数学セミナー
過去の記録 ~05/21|次回の予定|今後の予定 05/22~
担当者 | 吉田朋広、増田弘毅、荻原哲平、小池祐太 |
---|---|
目的 | 確率統計学およびその関連領域に関する研究発表, 研究紹介を行う. |
2025年05月16日(金)
13:30-14:30 数理科学研究科棟(駒場) 128 号室
ハイブリッド開催
Maud Delattre 氏 (INRAE)
Efficient precondition stochastic gradient descent for estimation in latent variables models (English)
https://u-tokyo-ac-jp.zoom.us/meeting/register/yixIylc3S8uJqOQ_Vqm_3Q
ハイブリッド開催
Maud Delattre 氏 (INRAE)
Efficient precondition stochastic gradient descent for estimation in latent variables models (English)
[ 講演概要 ]
Latent variable models are powerful tools for modeling complex phenomena involving in particular partially observed data, unobserved variables or underlying complex unknown structures. Inference is often difficult due to the latent structure of the model. To deal with parameter estimation in the presence of latent variables, well-known efficient methods exist, such as gradient-based and EM-type algorithms, but with practical and theoretical limitations. In this work, we propose as an alternative for parameter estimation an efficient preconditioned stochastic gradient algorithm.
Our method includes a preconditioning step based on a positive definite Fisher information matrix estimate. We prove convergence results for the proposed algorithm under mild assumptions for very general latent variable models. We illustrate through relevant simulations the performance of the proposed methodology in a nonlinear mixed-effects model.
[ 参考URL ]Latent variable models are powerful tools for modeling complex phenomena involving in particular partially observed data, unobserved variables or underlying complex unknown structures. Inference is often difficult due to the latent structure of the model. To deal with parameter estimation in the presence of latent variables, well-known efficient methods exist, such as gradient-based and EM-type algorithms, but with practical and theoretical limitations. In this work, we propose as an alternative for parameter estimation an efficient preconditioned stochastic gradient algorithm.
Our method includes a preconditioning step based on a positive definite Fisher information matrix estimate. We prove convergence results for the proposed algorithm under mild assumptions for very general latent variable models. We illustrate through relevant simulations the performance of the proposed methodology in a nonlinear mixed-effects model.
https://u-tokyo-ac-jp.zoom.us/meeting/register/yixIylc3S8uJqOQ_Vqm_3Q