registered user login
login
password
lost password?
 >> News

The BenchIT Project

"Contrary to common belief, performance evaluation is an art." (Raj Jain, 1991) - and even artists need some tools. The BenchIT project is designed to provide the computational tools necessary to evaluate a given computer system successfully.

The BenchIT project contains two linked but independent packages - this website for the evaluation of measurement data and a measurement environment for the generation of your own measurement data to contribute to the evaluation platform. Be assured that a group policy is included in the website specifications, therefore generating confidential data and uploading it to this evaluation platform is possible, since you do not have to share your data; additionally we can add a new group for a team working on confidential data to share the data only within that group.

Registration

The download of the measurement environment, which holds a set of ready-to-go kernels but also allows you to plug in your own measuring kernels, and the access to the data-presentation and data-evaluation on this website is restricted. After you fill out the registration form, you will receive full access to the restricted sections of this website.

Logging in

Please fill in your username and password in the form fields provided to the lower right (in the horizontal bar at the bottom of this screen) and click on "Login" to access the restricted area.

More Information

More detailed information on the usage of the measurement environment and the data-center on this website is located in the restricted section as well - please register for access.
Recent publications and presentations of the BenchIT project are located in the document -section. If you have further questions, please do not hesitate to contact us.

BenchIT - Performance Measurement and Comparison for Scientific Applications - © 2002 - 2009 Center for Information Services & High Performance Computing - Dresden University of Technology - Germany

BenchIT News BenchIT News
BenchIT Web News
 [top]
new packaging system
we are testing a new packaging backend on our website - if you want to test the newest checkout of the stable tree: benchit.release.tar.gz
posted by Thomas William - 2010-03-30
Access to the site through the GUI temporarily disabled


Due to a security issue is actually no connection between GUI and Website possible. We are sorry for this breakdown, but we have to ensure the safety of our users. We are working intensively on this problem to provide this service again as soon as possible.


posted by Andy Georgi - 2010-02-16
x86_membench update
A new version of the x86 memory benchmark suite (Recources Tab => x86_membench) is available.

Highlights:

- new bandwidth kernels with concurrent read and write streams

- support for systems with more than 16 CPUs
posted by Daniel Molka - 2009-12-15
limited functionality due to a small bug
We had a bug report concerning the links of some of the icons on our page. As this bug is related to our template engine we had to disable the click-feature of all icons for the time being. We will inform you when the feature is available again.
posted by Thomas William - 2009-10-05
First updates to BenchITv6
There were some minor and some major bugs that had to be fixed - business as usual one could say ;)

Here's the log:

r12 | domke | 2009-09-18 17:34:53 +0200 (Fri, 18 Sep 2009) | 1 line

xaxis legendtexts was empty and cause an error while website upload

r11 | domke | 2009-09-18 17:25:01 +0200 (Fri, 18 Sep 2009) | 1 line

xaxis text (with ';') cause an error while website upload

r10 | domke | 2009-09-18 17:24:04 +0200 (Fri, 18 Sep 2009) | 1 line

xaxis text (with ';') cause an error while website upload

r9 | hoehlig | 2009-09-16 15:24:03 +0200 (Wed, 16 Sep 2009) | 6 lines

Improved reference_run.sh:

added -a flag for ALL kernels

added -p flag to give a path to kernels you want to process

filters *.sh files to do not execute them

use regex to avoid errors while grep-ing

r8 | hoehlig | 2009-09-15 13:12:54 +0200 (Tue, 15 Sep 2009) | 2 lines

Fixed BUG in reference_run.sh (-s option had no influence)
posted by Thomas William - 2009-09-22
BenchIT Version 6
It's finally done. It took us almost 6 month of consolidation but now we have a release that deserves the name stable compared to what we've started with.

We fixed all the major bugs and found numerous new ones (and fixed them too) while fixing the others. Many kernels from older releases were ported to our new interface. A special set of x86 specific kernels can be downloaded separately (see X86membench).

The reference run has made it into the release and we provide a script "reference_run.sh" to run all these kernels with one single command. See the README on how to set up your system for that (it only takes a few small preparational steps).

An still experimental feature is the hardware detection that is further described in the README but helps a lot whith the LOCALDEF files.

We hope that you as a user learn as much while using BenchIT as we learned and had fun in the making.


posted by Thomas William - 2009-09-13
New feature of next stable release
We are planning to introduce a new feature in the next stable release, the reference run. This simply is a set of kernels without any dependencies despite a c compiler. Therefore these kernels should run on every machine out of the box. The actual set of planned kernels can be found here
posted by Thomas William - 2009-08-06
Archive upload is available again


Due to a gnuplot error the uploaded files couldn't be processed correct. We had to remove the "truecolor" and "transparency" option until a gnuplot update is available.


posted by Andy Georgi - 2009-05-08
Archive upload temporarily not available


The upload of archives is temporarily not available. It's still possible to upload single result files.

We are working on this problem and kindly excuse any inconvenience.


posted by Andy Georgi - 2009-05-06
New stable version in sight - RC1 available

As the stable version dates back to the long forgotten 2006 we decided that it's time for an update. We are also are running short on personnel - so all help testing the release candidate is very much appreciated. Look for the Developers Stable Build in the files-section under resources.

posted by Thomas William - 2009-01-28
news archive ...