Performace Graphs

[benfwalker]

I dont really understand the performance graphs. What are all the dotted lines? Are they other peoples runs? If so, what does the min/max mean?

Also, what is the time scale? I'm pretty sure it isnt milliseconds, because I imagine that no-one is hitting nanoseconds at any input scale.

[m8pple]

If you mean the straight lines, then they are straight lines on a log-log graph, so the slope
is allowing you to judge the slope of other lines.

For the other wavy dotted lines, they should be giving you the min/median/max across all
implementations. So they should form a bracket on your personal results (which appear in
bold - though if you have no results for an implementation it won't appear).

As to the time-scale, there was a question about it here #34. The newer graphs (if they ever finish),
have a different y-scale. However, you have all your raw data available in the logs.

[benfwalker]

Ah right, so just to check, the colored (red and turquoise) min/max lines are what they seem, i.e. the best and worst implementations of the master branch of everyone who's opted in?

[m8pple]

Yes, that's correct.