Ver el código de «ORcompDCAO DCAO»

Compilation at DCAO's computational classroom

= Installation steps using modipsl =
* Required packages:
<pre># apt-get install subversion git libnetcdf-dev libnetcdff-dev netcdf-bin make 
  ncview ksh csh mpi mpich vim
</pre>
* Additional for python and netcdf (not required by ORCHIDEE)
<pre># apt-get install python-matplotlib python-matplotlib-data python-matplotlib-doc 
python-mpltoolkits.basemap python-mpltoolkits.basemap-data dvipng python-netcdf4
</pre>
* And fake gmake (Ubunutu)
<pre>ln -s /usr/bin/make /usr/bin/gmake</pre>
* Go to the installation directory <code>[INSTALLDIR]</code> (for hydra <code>[INSTALLDIR]=/home/administrador/installOR</code>)
<pre>$ cd [INSTALLDIR]</pre>
* Getting the IPSL-models suite
<pre>$ svn co https://forge.ipsl.jussieu.fr/igcmg/svn/modipsl/trunk modipsl</pre>
* Going to the <code>util</code> folder:
<pre>$ cd modipsl/util</pre>
* Getting the off-line version of ORCHIDEE
<!--pre>$ ./model ORCHIDEE_trunk >& run_get_model.log</pre-->
<pre>$ ./model ORCHIDEE_trunk</pre>
* We got some issues with the ports, thus, it needs to be manually done:
<pre>$ cd ../modeles</pre>
* Getting IOIPSL:
<pre>$ mkdir -p IOIPSL/src 
$ svn co https://forge.ipsl.jussieu.fr/igcmg/svn/IOIPSL/tags/v2_2_2/src IOIPSL/src</pre>
* Getting XIOS library
<pre>$ svn co -r 1043 https://forge.ipsl.jussieu.fr/ioserver/svn/XIOS/trunk XIOS</pre>
* By the end one should have:
<pre>$ ls
IOIPSL  ORCHIDEE  XIOS</pre>
* Going back to <code>util</code> to proceed
<pre>$ cd ../util</pre>
<!--% username: sechiba
 passw: ipsl2000 -->
* These are the final versions of the codes
** ORCHIDEE: 6094
** ORCHIDEE_OL: 4622
** IOIPSL: 3379
** XIOS: 1043
* Preparing compilation environment for <code>hydra</code>. One need to add into <code>AA_make.gdef</code> specifications for <code>DCAO_gfortran</code> (at the end of file):
<pre>
#-Q- DCAO_gfortran  #- Global definitions for DCAO, mpi gfortran
#-Q- DCAO_gfortran  LIB_MPI = MPI1
#-Q- DCAO_gfortran  LIB_MPI_BIS = MPI1
#-Q- DCAO_gfortran  FCM_ARCH = DCAO_gfortran 
#-Q- DCAO_gfortran  M_K = make
#-Q- DCAO_gfortran  P_C = cpp
#-Q- DCAO_gfortran  P_O = -fpreprocessed -P -C -traditional $(P_P)
#-Q- DCAO_gfortran  F_C = gfortran -c -cpp
#-Q- DCAO_gfortran  #-D- MD    F_D = -g -Wall -fbounds-check -pedantic -finit-real=nan
#-Q- DCAO_gfortran  #-D- MN    F_D =
#-Q- DCAO_gfortran  #-P- I4R4  F_P =
#-Q- DCAO_gfortran  #-P- I4R8  F_P = -fdefault-real-8
#-Q- DCAO_gfortran  #-P- I8R8  F_P = -fdefault-integer-8 -fdefault-real-8
#-Q- DCAO_gfortran  w_w = -O3 -funroll-all-loops $(F_D) $(F_P) -I$(MODDIR)
#-Q- DCAO_gfortran  F_O = $(w_w) -J$(MODDIR)
#-Q- DCAO_gfortran  F_L = gfortran
#-Q- DCAO_gfortran  M_M = 0
#-Q- DCAO_gfortran  L_X = 0
#-Q- DCAO_gfortran  L_O =
#-Q- DCAO_gfortran  A_C = ar -rs
#-Q- DCAO_gfortran  A_G = ar -x
#-Q- DCAO_gfortran  C_C = cc -c
#-Q- DCAO_gfortran  C_O =
#-Q- DCAO_gfortran  C_L = cc
#-Q- DCAO_gfortran  #-
#-Q- DCAO_gfortran  NCDF_INC = /usr/include
#-Q- DCAO_gfortran  NCDF_LIB = -L/usr/lib/x86_64-linux-gnu -lnetcdf
#-Q- DCAO_gfortran  #-
</pre>
* Creation of the configuration <code>arch</code> files for the compilation of each component

== XIOS ==
** Creation of 'fcm' compilation environtment file for <code>DCAO_gfortran</code>
<pre>$ vim ../modeles/XIOS/arch/arch-DCAO_gfortran.fcm</pre>
** values:
<pre>################################################################################
###################                Projet XIOS               ###################
################################################################################

%CCOMPILER      /usr/bin/mpicc
%FCOMPILER      /usr/bin/mpif90
%LINKER         /usr/bin/mpif90 -nofor-main

%BASE_CFLAGS    -ansi -w -D_GLIBCXX_USE_CXX11_ABI=0
%PROD_CFLAGS    -O3 -DBOOST_DISABLE_ASSERTS
%DEV_CFLAGS     -g -O2
%DEBUG_CFLAGS   -g

%BASE_FFLAGS    -D__NONE__ -ffree-line-length-none
%PROD_FFLAGS    -O3
%DEV_FFLAGS     -g -O2
%DEBUG_FFLAGS   -g

%BASE_INC       -D__NONE__
%BASE_LD        -lstdc++

%CPP            cpp
%FPP            cpp -P
%MAKE           gmake</pre>
** Creation of 'path' compilation environtment file for <code>DCAO_gfortran</code>
<pre>$ vim ../modeles/XIOS/arch/arch-DCAO_gfortran.path</pre>
** values:
<pre>NETCDF_INCDIR="-I $NETCDF_INC_DIR"
NETCDF_LIBDIR="-L $NETCDF_LIB_DIR"
NETCDF_LIB="-lnetcdff -lnetcdf"

MPI_INCDIR=""
MPI_LIBDIR=""
MPI_LIB="-lcurl"

HDF5_INCDIR="-I $HDF5_INC_DIR"
HDF5_LIBDIR="-L $HDF5_LIB_DIR"
HDF5_LIB="-lhdf5_hl -lhdf5 -lhdf5 -lz"

#OASIS_INCDIR="-I$PWD/../../oasis3-mct/BLD/build/lib/psmile.MPI1"
#OASIS_LIBDIR="-L$PWD/../../oasis3-mct/BLD/lib"
#OASIS_LIB="-lpsmile.MPI1 -lscrip -lmct -lmpeu"</pre>

** Creation of 'env' compilation environtment file for <code>DCAO_gfortran</code>
<pre>$ vim ../modeles/XIOS/arch/arch-DCAO_gfortran.env</pre>

** values:
<pre>export HDF5_INC_DIR=/usr/include
export HDF5_LIB_DIR=/usr/lib/x86_64-linux-gnu

export NETCDF_INC_DIR=/usr/include
export NETCDF_LIB_DIR=/usr/lib/x86_64-linux-gnu</pre>

== ORCHIDEE ==
** Creation of 'fcm' compilation environtment file for <code>DCAO_gfortran</code>
<pre>$ vim ../modeles/ORCHIDEE/arch/arch-DCAO_gfortran.fcm</pre>
** values:
<pre>%COMPILER            /usr/bin/mpicc
%LINK                /usr/bin/mpif90
%AR                  ar
%MAKE                make
%FPP_FLAGS           -P -C -traditional -nostdinc
%FPP_DEF
%BASE_FFLAGS         -fdefault-real-8
%PROD_FFLAGS         -O3 -funroll-all-loops
%DEV_FFLAGS          -O
%DEBUG_FFLAGS        -ffpe-trap=invalid,zero,overflow -Wall -fbounds-check -g3 -O0 -fstack-protector-all
%MPI_FFLAGS
%OMP_FFLAGS          -openmp -openmp-threadprivate compat
%BASE_LD
%MPI_LD
%OMP_LD              -openmp</pre>
** Creation of 'path' compilation environtment file for <code>DCAO_gfortran</code>
<pre>$ vim ../modeles/ORCHIDEE/arch/arch-DCAO_gfortran.path</pre>
** values:
<pre>NETCDF_INCDIR="-I/usr/include"
NETCDF_LIBDIR="-L/usr/lib/x86_64-linux-gnu"
NETCDF_LIB="-lnetcdf -lnetcdff"

IOIPSL_INCDIR="-I${ORCHDIR}/../../lib -I${ORCHDIR}/../IOIPSL/inc"
IOIPSL_LIBDIR="-L${ORCHDIR}/../../lib -L${ORCHDIR}/../IOIPSL/lib"
IOIPSL_LIB="-lioipsl"

XIOS_INCDIR="-I${ORCHDIR}/../XIOS/inc"
XIOS_LIBDIR="-L${ORCHDIR}/../XIOS/lib"
XIOS_LIB="-lxios"</pre>

== Building & compiling ==
** Installing the code:
<pre>$ ./ins_make -t DCAO_gfortran >& run_ins_make.log</pre>
** Going there:
<pre>$ cd ../config/ORCHIDEE_OL</pre>
** No need to loading the right environment since in <code>hydra</code> its by default
** Compiling XIOS in sequential (in <code>Makefile</Code>, adding no-parallel compilation):
<pre>./make_xios --netcdf_lib netcdf4_seq (...)</pre>
** Compiling (we must compile without XIOS, otherwise it is not working):
<pre>$ gmake without_xios >& run_gmake.log</pre>
** Checking if everything went fine:
<pre>$ cat -n run_gmake.log | grep Error
$ cat -n run_gmake.log | grep undefined
$ ls ../../bin/ 
orchideedriver orchidee_ol </pre>

= Compiling rebuild =

Due to the fact that <code>hydra</code> does not have the netcdf libraries compiled in parallel, ORCHDEE output is written with multiple files being a file for each process. In order to overcome this output. IPSL does prepare a tool to join the files and provide the expected output. This tool is called <code>rebuild</code> (a Kornshell script which encapsulates de exacutable <code>flio_rbld</code>) and it comes with the <code>IOIPSL</code> libraries. The IOIPSL libraries, are a set of old libraries developed by the IPSL (M. A. Foujuls, J. Polcher among others) to deal with the netCDF data access for all the models developed at the IOIPSL. Compiling IOIPSL (following [http://lmdz.lmd.jussieu.fr/utilisateurs/faq-en/installation/comment-installer-ioipsl-et-loutil-rebuild install rebuild]. It has to be compiled independently. Here it is explained how it has to be done.

* Go to the instalation directory <code>[INSTALLDIR]</code>
<pre>$ cd [INSTALLDIR]</pre>
* getting the last version of the code
<pre>$ svn co https://forge.ipsl.jussieu.fr/igcmg/svn/modipsl/trunk modipsl_IOIPSLtools</pre>
* going to prepare compilation/installation
<pre>$ cd modipsl_IOIPSLtools/util</pre>
* preparing environment
<pre>./model IOIPSL_PLUS</pre>
* We got some issues with the ports, thus, it needs to be manually done:
<pre>$ cd ../modeles</pre>
* Getting IOIPSL ('''NOTE:''' notice the difference in library's version from the previous one):
<pre>$ svn co https://forge.ipsl.jussieu.fr/igcmg/svn/IOIPSL/tags/v2_2_3 IOIPSL</pre>
* Comming back to the <code>util</code> folder
<pre>$ cd ../util</pre>
* Creation of the compilation environment for <code>`DCAO'</code> using <code>'gfortran'</code> inside <code>AA_make.gdef</code> as in the full compilation
<pre>$ cp ../../modipsl/util/AA_make.gdef ./</pre>
* Preparing makefiles
<pre>$ ./ins_make -t "DCAO_gfortran" -p I4R8</pre>
* going to src folder to compile
<pre>$ cd ../modeles/IOIPSL/src</pre>
* cleaning (you never know...)
<pre>$ make clean</pre>
* compiling
<pre>$ make >& run_make.log</pre>
* Checking no errors:
<pre>$ cat -n run_make.log | grep Error</pre>
* compilation of tools (file concatenation)
<pre>$ cd ../tools </pre>
* cleaning (you never know...)
<pre>$ make clean</pre>
* compiling
<pre>$ make >& run_make.log</pre>
* Checking no errors:
<pre>$ cat -n run_make.log | grep Error</pre>
* One should have:
<pre>$ ls ../../../bin/ 
flio_rbld  rebuild</pre>

= debug Instalation =
Getting a debugging copy for test purposes

== Instalation steps using modipsl ==
* Go to the instalation directory <code>[INSTALLDIR]</code>
<pre>$ cd [INSTALLDIR]</pre>
* Getting the IPSL-models suite (r 3379)
<pre>$ svn co https://forge.ipsl.jussieu.fr/igcmg/svn/modipsl/trunk modipsl_dbg</pre>
* Once we got the codes, we need to copy the specificities of the installation for <code>hydra</code>
<pre>$ cp ../../modipsl/util/AA_make.gdef ./
$ cp ../../modipsl/modeles/XIOS/arch/*hydra* ../modeles/XIOS/arch/
$ cp ../../modipsl/modeles/ORCHIDEE/arch/*hydra* ../modeles/ORCHIDEE/arch/</pre>
* Everything is the same as for the installation, except that we need to indicate debugging compilation:
<pre>./ins_make -t DCAO_gfortran -d >& run_ins_make.log</pre>
* And on <code>Makefile</code> from <code>config/ORCHIDEE_OL</code>, change all the <code>-prod</code> by <code>-debug</code>
<pre>(...)
xios : 
        (cd  ../../modeles/XIOS ; ./make_xios --netcdf_lib netcdf4_seq \
--debug --arch ${FCM_ARCH} --job 8 ; cp bin/xios_server.exe ../../bin/. ; ) 
(...)
driver : 
        (cd ../../modeles/ORCHIDEE ; ./makeorchidee_fcm -j 8 -parallel mpi -debug -arch ${FCM_ARCH} -driver ; )
(...)
driver_xios : 
        (cd ../../modeles/ORCHIDEE ; ./makeorchidee_fcm -xios2 -j 8 -parallel mpi -debug -arch ${FCM_ARCH} -driver ; ) 
(...)</pre>
* Compiling:
<pre>$ gmake >& run_gmake.log</pre>
* Checking if everything went fine:
<pre>$ cat -n run_gmake.log | grep Error 
$ cat -n run_gmake.log | grep undefined
$ ls ../../bin/ 
orchidee_ol  xios_server.exe</pre>