Cray XC40 (Cori) Build Example

PLEASE NOTE: if you are using ADIOS 1.13 in your application, you'll likely need a special version of Flexpath/EVPath - please set the $FLEXPATH_DIR environment variable manually in that case, rather than loading the Flexpath module.

Building on Cori is somewhat straightforward, as some of the software pre-requisites are already installed on the system. EVPath is not available as a module, but SQLite3 is in installed in the system directory. Unfortunately, the SQLite3 library is not a static library, and the compiler default is to perform static links. To set up your environment, do the following:

• Build SQLite3 See instructions on the main page.

• Build EVPath Follow the instructions on the main page of this wiki, but before running chaos_build.pl, read and follow the instructions at the bottom of the chaos_build_config file. To summarize, do this:

mkdir chaos
cd chaos
wget http://www.cc.gatech.edu/systems/projects/EVPath/chaos_bootstrap.pl
perl ./chaos_bootstrap.pl adios-1.13 /desired/path/to/evpath/installation

edit the chaos_build_config file, then run:

perl ./chaos_build.pl

• Load modules (see note, above)

module unload darshan
module swap PrgEnv-intel PrgEnv-gnu
module swap craype-haswell craype-mic-knl
module load papi
module load cmake

• Get the SOS source code:

git clone [email protected]:cdwdirect/sos_flow.git
cd sos_flow
git checkout master
mkdir build-cori-knl
cd build-cori-knl

• Configure with cmake:

# set an installation prefix location, or just "." for testing
sosdir=/path/to/sos/installation/prefix
FLEXPATH_DIR=/path/to/chaos/installation
SQLite3_DIR=/path/to/sqlite3/installation
cmake \
        -DCMAKE_BUILD_TYPE=RelWithDebInfo \
        -DBUILD_SHARED_LIBS=FALSE \
        -DCMAKE_INSTALL_PREFIX=${sosdir} \
        -DCMAKE_C_COMPILER=cc \
        -DCMAKE_CXX_COMPILER=CC \
        -DSOS_CLOUD_SYNC_WITH_EVPATH=TRUE \
        -DEVPath_DIR=${FLEXPATH_DIR} \
        -DSQLite3_DIR=${SQLite3_DIR} \
        ..

• Compile!

make -j4
make install