HPC Challenge Awards BOF
The HPC Challenge committee is pleased to announce the annual
HPC Challenge Award Competition
(www.hpcchallenge.org).
The goal of the competition is to focus the HPC community's attention
on developing a broad set of HPC hardware and HPC software capabilities
that are necessary to productively use HPC systems. The awards session
will be held during the SC11 conference.
The core of the HPC Challenge Award Competition is the HPC Challenge
benchmark suite developed at the University of Tennessee under the
DARPA HPCS program with contributions from a wide range of organizations from
around the world (see http://icl.cs.utk.edu/hpcc/).
The Competition will focus on four of the most challenging benchmarks in the suite:
- Global HPL
- Global RandomAccess
- EP STREAM (Triad) per system
- Global FFT
For the HPCC Awards there will be two classes of awards.
Class 1: Best Performance (4 awards)
Best performance on a base or optimized run submitted to the HPC Challenge website.
The benchmarks to be judged are: Global HPL, Global RandomAccess, EP STREAM (Triad)
per system and Global FFT.
Class 2: Most Productivity (at least 1 award)
Most "elegant" implementation of at least four and at most five computationally intensive
kernels. At least 3 tests of the Class 1 have to be included (choose from Global HPL,
Global RandomAccess, EP STREAM Triad per system
and Global FFT). At most 2 kernels may be selected that are not currently included
in HPC Challenge (this allows more flexibility for the participants to show the strength
of their system and implementation). The kernels not present in HPCC need to conform to HPCC's rigor:
they need to include testing, verification, and performance reporting components.
Also, justification needs to be provided as to why the new kernels were chosen for submission:
the stress is on relevance for computational science and the difficulty of parallel implementation
and optimization. An example set of computational kernels is included
in the following publications:
- The
Landscape of Parallel Computing Research: A View from Berkeley (EECS-2006-183)
- The
Parallel Computing Laboratory at U.C. Berkeley: A Research Agenda Based
on the Berkeley View (EECS-2008-23)
-
Communications
of the ACM, October 2009 (Vol. 52, No. 10)
Submissions that include additional kernels are equally welcome.
This award would be weighted 50% on performance and 50% on code elegance,
clarity, and size. Both will be determined by an evaluation committee. For this award,
the implementer must submit to hpcc-awards AT cs.utk.edu (by October 24th, 2011) a short description of:
- the implementation,
- the performance achieved,
- lines-of-code, and
- the actual source code of their implementation.
- optionally: justification for choosing a computational kernels not present in HPCC
Evaluation and Scoring
The evaluation committee will select a set of finalists who are invited to give a
short presentation at the
HPC Challenge Awards BOF at SC11.
This presentation is
judged by the evaluation committee to select the winner. Multiple winners
could be selected.
The Class 1 awards are decided based on benchmark results and should be a clear cut.
Benchmark results are accepted up to the last moment.
The Class 2 award is more subjective. The submission procedure works as follows:
- "Early bird" entry to get feedback on the submission is by October 1st, 2011.
We provide feedback by October 7th so the submission could be improved.
- This is to help for compliance of the rules
- Only one attempt at an early bird submission is allowed (the process is not iterative)
- The final deadline is October 24th, 2011 for the submission.
- Awards Committee chooses finalists who make a presentation
at the SC11 session and winners are chosen at the session.
For more information or questions on the HPCC Challenge Awards, please contact:
hpcc-awards AT cs.utk.edu.
Awards Committee:
- David Bailey, LBNL NERSC
- Jack Dongarra, (Co-Chair) U of Tennesse/ORNL
- Jeremy Kepner, (Co-Chair) MIT Lincoln Lab
- Bob Lucas, ISI
- Rusty Lusk, Argonne National Lab
- Piotr Luszczek, U of Tennessee
- John McCalpin, TACC
- Rolf Rabenseifner, HLRS, Stuttgart
- Daisuke Takahashi, U of Tsukuba
- Jeff Vetter, ORNL
See also:
Last year, the evaluation committee selected a set of finalists who were
invited to give a short presentation during the HPC Challenge Award BOF at
SC10. This presentation will be
judged by the evaluation committee to select the winner. The prize was
$2000 plus a certificate for this award and was split among the "best"
entries. The awards were presented at the HPC Challenge Award BOF at
SC10.
The following are the winners of the 2011 HPC Challenge Class 1 Awards:
The following are the winners of the 2011 HPC Challenge Class 2 Awards:
| Award |
Presenter |
Affiliation |
Language |
PDF |
| Most Elegant Language $1000 |
Brad Chamberlain |
Cray |
Chapel |
slides |
| Most Elegant Language, Honorable Mention |
Laksono Adhianto |
Rice University |
Coarray Fortran 2.0 |
slides |
| Best Performance $1000 |
Laxmikant V. Kale |
University of Illinois at Urbana-Champaign |
Charm++ |
slides |
| Best Performance, Honorable Mention |
Laksono Adhianto |
Rice University |
Coarray Fortran 2.0 |
slides |
The following are the finalists of the 2011 HPC Challenge Class 2 Awards:
| Finalists |
Affiliation |
Language |
PDF |
| Bradford L. Chamberlain, Sung-Eun Choi, Vassily Litvinov, Tom Hildebrandt,
Greg Titus, Johnathan Claridge, John G. Lewis, and Kristi Maschhoff |
Cray |
Chapel |
PDF report |
| John Mellor-Crummey, Laksono Adhianto, Guohua Jin, Mark Krentel, Karthik Murthy, William Scherer, Chaoran Yang |
Rice University |
Coarray Fortran 2.0 |
PDF report |
| Laxmikant V. Kale, Anshu Arya, Abhinav Bhatele, Abhishek Gupta, Nikhil Jain, Pritish Jetley,
Jonathan Lifflander, Phil Miller, Yanhua Sun, Ramprasad Venkataraman, Lukasz Wesolowski, Gengbin Zheng |
University of Illinois at Urbana-Champaign |
Charm++ |
PDF report |
