The dynamics of oscillation in a laser with an unstable cavity is numerical
ly simulated. The calculations are made in the nonstationary diffraction ap
proximation taking into account the gain saturation in an active medium. Th
e range of parameters in which stationary stable lasing is not reached was
found to be considerably wider than the instability region obtained on the
basis of the linear analysis of stability of stationary modes. The analysis
showed the existence of a self-modulation instability that leads to the ge
neration of a train of short sharp power peaks. The dependence of their rep
etition period on the gain relaxation time and the excess over the laser th
reshold was obtained. Doubling and quadrupling of the period of power peaks
were found and the conditions providing lasing with the dynamic chaos were
determined.