Algebraic convergence in the L2-sense is studied for general time-continuous, reversible Markov chains with countable state space, and especially for birth--death chains. Some criteria for the convergence are presented. The results are effective since the convergence region can be completely covered, as illustrated by two examples.