Accurate simulation of large parallel applications can be facilitated with
the use of direct execution and parallel discrete event simulation. This pa
per describes the use of COMPASS, a direct execution-driven, parallel simul
ator for performance prediction of programs that include both communication
and I/O intensive applications. The simulator has been used to predict the
performance of such applications on both distributed memory machines like
the IBM SP and shared-memory machines like the SGI Origin 2000. The paper i
llustrates the usefulness of COMPASS as a versatile performance prediction
tool. We use both real-world applications and synthetic benchmarks to study
application scalability, sensitivity to communication latency, and the int
erplay between factors like communication pattern and parallel file system
caching an application performance. We also show that the simulator is accu
rate in its predictions and that it is also efficient in its ability to use
parallel simulation to reduce its own execution time which, in some cases,
has yielded a near-linear speedup.