Nubeam results from Franklin

NUBEAM trace results

The following are charts generated from 1-32 proc runs on Franklin using TAU.

http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-data-r453.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-data-r457.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-data-r481.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-data-r528.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-data-r543.png

Scaling:

http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-scaling-r453.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-scaling-r457.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-scaling-r481.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-scaling-r528.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-scaling-r543.png

Speedup:

http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-speedup-r453.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-speedup-r457.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-speedup-r481.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-speedup-r528.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-speedup-r543.png

32 processor profiles, before and after:

http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-32-before.png http://www.nic.uoregon.edu/~amorris/facets/nubeam/franklin-32-after.png

Building TAU on Franklin

The following will build TAU and PDT (used for instrumentation) on Franklin:

#!/bin/bash                                                                                           
                                                                                                      
TOP=`pwd`                                                                                             
PDT=pdtoolkit-2009-02-05                                                                              
TAU=tau2-2009-02-05                                                                                   
wget http://www.nic.uoregon.edu/~amorris/$PDT.tar.gz                                                  
wget http://www.nic.uoregon.edu/~amorris/$TAU.tar.gz                                                  
tar -xzf $PDT.tar.gz                                                                                  
tar -xzf $TAU.tar.gz                                                                                  
cd $TOP/$PDT                                                                                          
./configure                                                                                           
make install -j4                                                                                      
cd $TOP/$TAU                                                                                          
./configure -arch=craycnl -mpi -pdt=$TOP/$PDT -pdt_c++=g++ -useropt=-O3 -LINUXTIMERS                  
echo ""                                                                                               
echo "Please add $TOP/$TAU/x86_64/bin to your \$PATH"                                                 
echo "Please set \$TAU_MAKEFILE to $TOP/$TAU/include/Makefile"                                        
echo ""                                                                                               

You may also use TAU built in amorris's directory. Simply set these variables:

export PATH=$PATH:/u0/a/amorris/tau2/craycnl/bin
export TAU_MAKEFILE=/u0/a/amorris/tau2/include/Makefile
export TAU_OPTIONS="-optVerbose -optTauSelectFile=/path/to/nubeam/tools/select.tau"

Building NUBEAM with TAU

One would normally configure NUBEAM on Franklin with something like this:

../configure --prefix=$SCRATCH/nubeam-parallel --enable-parallel FC=ftn F77=ftn CC=cc CXX=CC --with-netcdf-dir=/usr/common/usg/netcdf/3.6.2 --with-netlib_lite-dir=/project/projectdirs/facets/franklin/contrib/netlib_lite

To configure with TAU, use:

../configure --prefix=$SCRATCH/nubeam-parallel-tau --enable-parallel FC=tau_f90.sh F77=tau_f90.sh CC=tau_cc.sh CXX=tau_cxx.sh --with-netcdf-dir=/usr/common/usg/netcdf/3.6.2 --with-netlib_lite-dir=/project/projectdirs/facets/franklin/contrib/netlib_lite