The purpose of this paper is to show that many integral stochastic orders have a generator consisting of infinitely differentiable functions. This especially holds for all stochastic orders with characterizations via difference operators. The usefulness of this result is demonstrated in two applications relating to stochastic ordering of multivariate normal distributions and ordering of random vectors in a random environment.