To. Humphries et al., An infrastructure for generating and sharing experimental workloads for persistent object systems, SOFTW PR EX, 30(4), 2000, pp. 387-417
Performance evaluation of persistent object system implementations requires
the use and evaluation of experimental workloads. Such workloads include a
schema describing how the data are related, and application behaviors that
capture how the data are manipulated over time, In this paper, we describe
an infrastructure for generating and sharing experimental workloads to be
used in evaluating the performance of persistent object system implementati
ons. The infrastructure consists of a toolkit that aids the analyst in mode
ling and instrumenting experimental workloads, and a trace format that allo
w the analyst to easily reuse and share the workloads, Our infrastructure p
ro,ides the following benefits: the process of building new experiments for
analysis is made easier; experiments to evaluate the performance of implem
entations can be conducted and reproduced with less effort; and pertinent i
nformation can be gathered in a cost-effective manner. We describe the two
major components of this infrastructure, the trace format and the toolkit.
We also describe our experiences using these components to model, instrumen
t, and experiment with the OO7 benchmark. Copyright (C) 2000 John Wiley & S
ons, Ltd.