Some benchmark info

Jonathan Leto jaleto at gmail.com
Thu Sep 16 09:32:45 UTC 2010


Howdy,

I saw chromatic++ lament that I haven't done benchmarks recently, so I got
back on my horse.

I am only benchmarking from 2.0.0 forward, for now. Let me know if you want
to go further back.

Looks like trunk is just slightly slower on oofib.pir than 2.0.0, which was
the fastest :

$ ./bin/bench ~/svn/parrot/examples/benchmarks/oofib.pir  parrot --count=10
--order=avg
                                                     min     max     avg
total
 parrot /home/leto/src/parrot/parrot-2.0.0/parrot  0.1010  0.1037  0.1018
1.0181
 parrot /home/leto/svn/parrot/parrot               0.1218  0.1315  0.1261
1.2607
 parrot /home/leto/src/parrot/parrot-2.7.0/parrot  0.1506  0.1545  0.1519
1.5195
 parrot /home/leto/src/parrot/parrot-2.2.0/parrot  0.1525  0.1582  0.1559
1.5587
 parrot /home/leto/src/parrot/parrot-2.4.0/parrot  0.1578  0.1628  0.1596
1.5963
 parrot /home/leto/src/parrot/parrot-2.6.0/parrot  0.1579  0.1651  0.1606
1.6060
 parrot /home/leto/src/parrot/parrot-2.5.0/parrot  0.1605  0.1665  0.1621
1.6214
 parrot /home/leto/src/parrot/parrot-2.3.0/parrot  0.1704  0.1754  0.1720
1.7198
 parrot /home/leto/src/parrot/parrot-2.1.0/parrot  0.1719  0.1805  0.1764
1.7637

Trunk is the fastest (since 2.0.0) on array_access.pir :

./bin/bench ~/svn/parrot/examples/benchmarks/array_access.pir  parrot
--count=10 --order=avg
                                                     min     max     avg
total
 parrot /home/leto/svn/parrot/parrot               0.1350  0.1385  0.1370
1.3697
 parrot /home/leto/src/parrot/parrot-2.7.0/parrot  0.1569  0.1626  0.1586
1.5865
 parrot /home/leto/src/parrot/parrot-2.6.0/parrot  0.1612  0.1671  0.1638
1.6381
 parrot /home/leto/src/parrot/parrot-2.5.0/parrot  0.1615  0.1705  0.1647
1.6469
 parrot /home/leto/src/parrot/parrot-2.4.0/parrot  0.1626  0.1666  0.1647
1.6473
 parrot /home/leto/src/parrot/parrot-2.1.0/parrot  0.1717  0.1816  0.1749
1.7491
 parrot /home/leto/src/parrot/parrot-2.2.0/parrot  0.1751  0.1814  0.1782
1.7820
 parrot /home/leto/src/parrot/parrot-2.3.0/parrot  0.1780  0.1828  0.1803
1.8033
 parrot /home/leto/src/parrot/parrot-2.0.0/parrot  0.5041  0.5199  0.5104
5.1040

Looks like we have had a decent slow-down in stress_strings.pir since 2.7.0
:

~/svn/parrot/examples/benchmarks/stress_strings.pir  parrot --count=10
--order=avg

                                                     min     max     avg
total
 parrot /home/leto/src/parrot/parrot-2.7.0/parrot  4.8719  5.0959  4.9980
49.9796
 parrot /home/leto/svn/parrot/parrot               6.7321  7.6730  6.8563
68.5632
 parrot /home/leto/src/parrot/parrot-2.1.0/parrot  6.7691  8.4052  7.1787
71.7872
 parrot /home/leto/src/parrot/parrot-2.0.0/parrot  7.9390  9.0192  8.0925
80.9246
 parrot /home/leto/src/parrot/parrot-2.2.0/parrot  8.2251  8.3730  8.3064
83.0641
 parrot /home/leto/src/parrot/parrot-2.4.0/parrot  8.4186  8.6742  8.4949
84.9494
 parrot /home/leto/src/parrot/parrot-2.6.0/parrot  8.4986  8.5820  8.5157
85.1569
 parrot /home/leto/src/parrot/parrot-2.5.0/parrot  8.5344  8.7179  8.6342
86.3421
 parrot /home/leto/src/parrot/parrot-2.3.0/parrot  8.6598  8.7073  8.6844
86.8441

That is all I have for now. Let me know what y'all would like to see.

Duke

-- 
Jonathan "Duke" Leto
jonathan at leto.net
http://leto.net
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.parrot.org/pipermail/parrot-dev/attachments/20100916/58719022/attachment.html>


More information about the parrot-dev mailing list