benchDBI

A Benchmark for Evaluating DBI Frameworks

Get benchDBI benchmark and sources from BitBucket site

Top

 


Description

benchDBI is a bunch of programs that confirms a benchmark specifically created for evaluating DBI frameworks. Currently, it has been used for evaluating Pin, Valgrind and DynamoRIO in a GNU/Linux 64-bit environment. The applications included in benchDBI are: 

 

  • bzip2 (bzip2-1.0.6.tar.gz)
  • GNU go (gnugo-3.8.tar.gz)
  • hmmer (hmmer-3.1b1.tar.gz)
  • libquantum (libquantum-1.1.1.tar.gz)
  • h264ref (jm18.5.zip)
  • ripemd (ripemd1.1.tar.gz)
  • aes (aescrypt-3.0.9.tgz)
  • memtester (memtester-4.3.0.tar.gz)
  • ffmpeg (ffmpeg-2.0.1.tar.gz)
  • milc ( milc_qcd-7.7.8.1.tar.gz)
  • povray (povray-3.6.tar.gz)
  • mlucas (Mlucas_12.09.2012.tgz)
  • namd (NAMD_2.9_Source.tar.gz)
  • linpack (1000d.f)

Go back to top

Citation

For citation, please use the following Bibtex cite format:


 

@UNPUBLISHED{benchDBI,
  author = {Ricardo J. Rodr\'{i}guez and Juan Antonio Artal and José Merseguer},
  title = {{benchDBI}},
  note = {Accesible at \url{http://webdiis.unizar.es/GISED/?q=tool/benchdbi}},
  year = {2013}
}

 


Go back to top.

The next requirements have been detected as necessary to run benchDBI:
  • DBA tools compiled with the framework DBI to test.
  • Benchmark applications compiled with the desired optimisation and in the desired environment.

Go back to top.

Dec, 2013  - version 1.0 (first release)


Go back to top.

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

 

GPL v3 license


Go back to top.

This program has been developed by Juan Antonio Artal, former undergraduate student at University of Zaragoza, Spain, and Ricardo J. Rodríguez, former PhD. student at University of Zaragoza, Spain. For any inquiry, contact by electronic mail at here.

 

 

Go back to top

Download

For downloading benchDBI, several options are provided:


Go back to top

Example

These graphics are examples of the evaluation of Pin, Valngrind and DynamoRIO on a Fedora Core 14 32-bit O.S.

Slowdown of float CPU-intensive applications (click on the image for enlarge):

Slowdown of float CPU-intensive applications (click on the image for enlarge)

Slowdown of integer CPU-intensive applications (click on the image for enlarge):

Slowdown of integer CPU-intensive applications (click on the image for enlarge)

Memory consumption of instrumented applications (click on the image for enlarge):

Memory consumption of instrumented applications (click on the image for enlarge)

See full report for further information.


Go back to top

Installation and Execution

You can check README file in BitBucket where more details about how to use and execute are provided.

Go back to top.

Maintainer

benchDBI is currently being maintained by Ricardo J. Rodríguez, reach him here.

Go back to top.