The paper develops a multilevel approach to the design and analysis of
systems with ''action-oriented perception'', situating various robot
and animal ''designs'' in an evolutionary perspective. We present a se
t of biological design principles within a broader perspective that sh
ows their relevance for robot design. We. introduce schemas to provide
a coarse-grain analysis of ''cooperative computation'' in the brains
of animals and the ''brains'' of robots, starting with an analysis of
approach, avoidance, detour behavior, and path planning in frogs. An e
xplicit account of neural mechanism of avoidance behavior in the frog
illustrates how schemas may be implemented in neural networks. The foc
us of the rest of the article is on the relation of instinctive to ref
lective behavior. We generalize an analysis of the interaction of perc
eptual schemas in the VISIONS system for computer vision to a view of
the interaction of perceptual and motor schemas in distributed plannin
g which, we argue, has great promise for integrating mechanisms for ac
tion and perception in both animal and robot. We conclude with general
observations on the lessons on relating structure and function which
can be carried from biology to technology.