Limitations of controlled experimental systems as models for natural systems: a conceptual assessment of experimental practices in biogeochemistry and soil science

Experimental systems in which phenomena are studied under controlled condit ions allow scientists to infer causal relationships from observable effects . When investigating ecosystems, however, scientists face complex systems. The conventional approach is to divide the system into conceptual units and to prepare experimental systems accordingly. Experimental systems are used as models for ecosystems: initially, scientists assume an analogy between the experimental system and ecosystem, then encode the experimental system into a formal system by measuring variables, and decode statements from the formal system to the ecosystem. We distinguish three types of experimental systems, i.e. laboratory, container and field set-ups, further divided int o seven subtypes. Starting from the premises of experimental systems, we co mment on the possibilities and limitations of experimentally derived causal relationships and on their significance for ecosystem understanding and pr ediction, illustrated by examples from soil science and the environmental s ciences. Experimental set-ups have a characteristic duration, degree of str uctural integrity, internal variability and boundaries, which relate to con ceptual closure and experimental control: control tends to be maximum on sh ort time scales, in homogeneous set-ups with analytical boundaries, and in systems with few parameters to be observed. Complexity is increased at the expense of control. The higher the degree of manipulation, however, the bet ter is reproducibility, but the larger is the deviation from unique ecosyst ems with their infinite number of factors. The material realization of clos ed systems is preceded by a conceptual closure of the system. Closure is re lative to the domain of phenomena of interest, the theory and the list of v ariables selected by the scientist. Successful decoding from experimental s ystems to ecosystems largely depends on the validity of the chosen analogy. Laboratory systems are idealized systems which contain a limited number of a priori defined variables, and which are shielded from environmental infl uences. In contrast, ecosystems are materially and conceptually open, non-s tationary, historical systems, in which system-level properties can emerge, and in which variables are produced internally. We conclude that when cond ucting experiments, causal factors can be identified, but that causal knowl edge derived from insufficiently closed systems is invalid. In ecosystems, innumerous factors interact. which may enhance, reduce or neutralize the ef fect of an experimentally determined factor. Thus, experimental model syste ms need to be evaluated for concrete. well-defined ecosystems with a concre te history. Increasingly detailed studies of isolated phenomena in the labo ratory will probably not contribute much to ecosystem-level understanding. When conducting experiments. scientists should aim at the maximum degree of complexity they can actually handle and they should justify the chosen ana logy. (C) 2001 Elsevier Science B.V. All rights reserved.