Need simple benchmark for inter-branch comparisons of speed and memory
James E Keenan
jkeen at verizon.net
Sun Apr 3 21:07:38 UTC 2011
James E Keenan wrote:
>
> What I would like to have is a benchmark test I could run which, on the
> one hand, gives a small resource machine a good workout, but, on the
> other hand, is small enough for me to run it consecutively enough times
> to give me a statistically significant result in testing the various
> garbage-collection-focused branches. For example, I know that regardless
> of which machine I test on, t/compilers/opsc/02-parse-all-ops.t takes
> longer than just about any file in our test suite. If I were able to run
> it 30 times on master and 30 times in a GC-branch, I would have a good
> measure of the degree to which a GC-branch improves over master (if
> indeed it does improve over master ;-) ).
>
> The problem is that 02-parse-all-ops.t takes so long to run on
> small-resource machines that I can not, in practical terms, afford to
> run it 30 times in a row. What I'd like is a test that takes say, about
> 4 seconds to run on a small resource box (and, of course, much faster on
> most contemporary machines) so that I could run it 30 times in two
> minutes on a given branch. That way, I could relatively quickly compare
> various branches.
I never got any response to this post last year. The need is still
there: I've been asked to test the compreg_imcc branch on both of my
machines. Can anyone help?
Thank you very much.
kid51
More information about the parrot-dev
mailing list