Replicating text: The cumulation of knowledge in social science

Obtaining a statistically significant result does not necessarily tell us w hether we would obtain significant results in other, similar studies, parti cularly if the original sample sizes were small. This is why we are suppose d to replicate experiments. The present study concerns social science event s that cannot be repeated by virtue of their being historically situated. A mong social science events, many textual data are datable and, by definitio n, unrepeatable. One solution to this quandary lies in bootstrap replicatio ns, which are based on the original data. A case in point is that of foundi ng political speeches such as those that buoy the European construction. We analyze and compare 82 speeches made by President Delors over the period 1 988-1994, and 28 by President Santer over the period 1995-1997. We have all these speeches (N = 110) concorded as to which words are used, how often, where, and when, with the help of a computer-aided content analysis package . We then test various hypotheses using replication bootstrap estimates, th at is, by replicating the original sample a large number of times and recre ating several thousand samples from the population so created.