This directory contains .ps files showing runtime and solution length
curves for each domain in turn. In each domain, there is a first page
showing the curves for all 8 switch configurations in the same
figure. Then, there are two figures for all 8 * 7 / 2 = 28 pairs of
configurations, one showing the respective runtime curves, one showing
the respective solution length curves. To order the instances in each
domain in terms of growing size---which must be done in some way to
draw runtime curves---we took as our criterion the number of
objects. In each domain, results for all tasks with the same number of
objects were thus averaged, where we considered unsolved tasks as
taking the maximal 150 seconds running time. Solution lengths were
averaged only for those tasks that were solved. Curves were then drawn
using gnuplot with the data set containing one average value for each
number of objects value in a domain. Data points were no task got
solved by a configuration are left out of the respective curve. Below
each figure, four values are printed: the significance that we
obtained comparing the performance of the first to the second planner
(1: second better, -1: first better, 0: no significance), and the
average difference between first value and second value; additionally,
to show how our significance test (described in Section 8.3)
corresponds to what one sees in the figures, we show the results of
the same computations when using the input for gnuplot, i.e. the data
averaged for each number of objects.
