Asymptotic expansions are derived for a class of averages of the coverage probabilities for some sequential confidence bounds, when the data consist of i.i.d. observations from a one-parameter exponential family. These expansions show the effect of the optional stopping on the coverage probabilities quite clearly and provide a method for changing the confidence limits to reduce this effect.