Distributed multilevel modeling

Citation
Afshartous, David et Michailidis, George, Distributed multilevel modeling, Journal of computational and graphical statistics , 16(4), 2007, pp. 901-924
ISSN journal
10618600
Volume
16
Issue
4
Year of publication
2007
Pages
901 - 924
Database
ACNP
SICI code
Abstract
Multilevel modeling is a popular statistical technique for analyzing data in hierarchical format, and thus naturally fits within a distributed database framework. We consider the computational aspects of multilevel modeling across distributed databases. In addition, we consider these aspects under a generalization of the multilevel model where the distributed groups (or databases) are allowed to specify different models at both level-1 (individual) and level-2 (group). For a variety of scenarios, we develop the distributed computation algorithm for two-step least squares (LS) estimators and also for iterative MLE estimators of the parameters of interest; in particular, we determine the required data structure at each computing site, the necessary information (original data, cross-product matrices, coefficient vectors), and the order in which such information needs to be passed between sites. Finally, we discuss recursive updating, fault tolerance, and security issues.