The Analysis/Plot module is probably the biggest module of benchit.org. It enables you to do plots based on your own files or those shared by other users of benchit.org.
Currently, there are 4 different approaches to get to a plot:
- by measured architecture
- by used measurement kernel
- by using the Quick Analysis Wizard
- by loading a previously Stored Plot
They are all different in what view on the published files they present. The architecture path's focus is on hardware attributes, so you can easily compare a e.g. AMD Opteron-based machine against a Intel Itanium one. The kernel path is designed to compare different kernels against each other, where the actual machines are less important.
Finally, the Stored Plots enable you to reload and modify previously stored plots.
The Architecture Path
You can start the architecture path from 2 different points: either view just result files you have uploaded yourself, or view all files accessible for you including yours and those uploaded by other users. In both cases, you have to go through several steps:
- specify which hardware attribute you want to compare
- select one or more values for that atttribute
- select the kernels you whish to compare
- specify which functions from which files you want to include in the plot
- select the legend options for the functions (what and how to display)
after these 5 steps, you are directed to the plot view, where you can view your plot, export it to different file formats or fine-tune the plots appeareance with the help of the basic & advanced wizard. At this Point, all plot paths unite, so the other paths descriptions will not refer to them.
The Kernel Path
The kernel path has basically the same options as the architecture path. You can choose to compare your own file only, or to include all visible files. Thereafter, you have to:
- select the kernel(s) you want to compare
- specify which functions from which result files you want to include in the plot
- select legend options for the functions
Completing these steps leads immediately to the plot, where you have the same options as described in the architecture path above.
The Quick Analysis Wizard
The Quick Analysis Wizard (or QAW as it is also called) follows a different approach to lead you to a plot: It is about filtering a list of result files using different attributes.
The best way so understand what the QAW does is to see it in action.
- If not done already, log into your benchit account
- select Analysis/Plot from the navigation bar
- choose start the Quick Analysis Wizard
You are now presented with the initial dialog of the QAW, showing lists of all available hardware and software attributes to search for, as well as a list of all public result files.
The first thing to do is to enable the automagic filtering, so the QAW can filter the lists according to your selection.
- Right then, you can start selecting items from the lists, and watch their impact on the result list.
- Do this as long as you want, until you are happy with the remaining result files.
- Now, select one ore more of the remainig result files and click on the plot file(s) button.
- A message is displayed then, to inform you that the selected files will be plotted using manual or default options.
This is the point where you leave the QAW, and come to the generic plot options present also in the architecture and kernel path. We won't discuss these settings here, have a look at the architecture path to learn about them.
Instead, we'll discuss the options of the QAW:
The automagic-filtering controls, if the QAW should reload all the lists after you have made a selection in one of them. Reloading is not activated until you actually leave a list, i.e. tab out or mouse out of it (click outside, if mousing out doesn't work instantly). This may sound strange at once, but if your getting used to it, you'll never switch back. This is some sort of Mouse Gesture.
|This behaviour is forced because of browser limitations. Automagic-filtering is disabled by default, so users new to this feature are not taken by surprise when using their mouse as usual|
Another side-effect of the automagic filter is that it won't let you get stuck in a dead end. You simply cannot select conflictive options.
|You are stronly advised to enable the Automagic Filter. Otherwise, you may and will select items that have no common result files. The Automagic Filter prevents this, by showing only items that are valid for all previously selected attributes.|
Default Plot Options
The idea behind this is to reduce the dedicions you have to make, before you can view a plot. Enabling this will always select all functions from all files while at the same disabling all legends. This is usefull if you just want to examine one or two files, but not for publication purposes. It gives you a quick overview over the measurement.
|The QAW can not know, what is your focus on a plot. So it can't select appropriate functions or legends.However, after the first overview, you can go back to the QAW, disable default plot options and select file functions and legends yourself. The default-plot feature is not intended to compare several complex measurements (i.e. Matrix Multiplications) with scientific standards.|