Running the evaluation suite

The script RUN uses input data from the data subdirectory, saving all output in the results subdirectory. This output is then compared with the test output data in the data subdirectory. (Note that test input and output data is mixed together in data, as in some cases the output from one tool was used as input to another one.) Each tool's output is compared with the example data output and a percentage error is generated - this may not be exactly zero as different hardware platforms can give slightly different results without this being classified as an "error". Each tool's error is scaled so that a reported error of 1% is considered a failure.

If you get any failures, you may want to send us the complete text output from RUN, and also the complete results directory (in the form of a tar.gz archive.


FEEDS/Running (last edited 17:17:46 24-06-2013 by DuncanMortimer)