A framework for epistemological analysis in empirical (laboratory and field) studies

In their search for generalizable behavioral patterns and design principles , cognitive field researchers should reflect on the epistemological limitat ions of empirical studies. In this paper we describe a framework for episte mological analysis that can help serve this purpose and discuss its applica tion to two prototypical cases of cognitive engineering research: laborator y experiments and field studies. The framework examines two, often implicit , processes in empirical research: the abstraction from empirical data and the substantiation of theoretical constructs and principles. By explicitly considering these two processes in several systematic steps, we can gain ap preciation for the epistemological contribution of empirical studies to cog nitive engineering research. The framework and its application also provide guidance to such important issues as generalizability of results and exter nal validity. Possible applications of this research include providing guid ance to researchers and practitioners in evaluating design principles or co nducting field studies.