This paper extends previous work of Ball et al. [BDKY] to control of a mode
l of a simple queueing server. There are n queues of customers to be served
by a single server who can service only one queue at a time. Each queue is
subject to an unknown arrival rate, called a "disturbance" in accord with
standard usage from H-infinity theory. An H-infinity-type performance crite
rion is formulated. The resulting control problem has several novel feature
s distinguishing it from the standard smooth case already studied in the co
ntrol literature: the presence of constraining dynamics on the boundary of
the state space to ensure the physical property that queue lengths remain n
onnegative, and jump discontinuities in any nonconstant state-feedback law
caused by the finiteness of the admissible control set (choice of queue to
be served). We arrive at the solution to the appropriate Hamilton-Jacobi eq
uation via an analogue of the stable invariant manifold for the associated
Hamiltonian flow (as was done by van der Schaft for the smooth case) and re
late this solution to the (lower) Value of a restricted differential game,
similar to that formulated by Soravia for problems without constraining dyn
amics. An additional example is included which shows that the projection dy
namics used to maintain nonnegativity of the state variables must be handle
d carefully in more general models involving interactions among the differe
nt queues. Primary motivation comes from the application to traffic signal
control. Other application areas, such as manufacturing systems and compute
r networks, are mentioned.