From 606b3fd31f2792e7a074352fe422961e4a4cb672 Mon Sep 17 00:00:00 2001 From: bne Date: Wed, 10 Apr 2019 15:45:33 +0200 Subject: [PATCH] Better/more description of msa_fix_ld --- modular-jobs.rst | 15 +++++++++++++-- 1 file changed, 13 insertions(+), 2 deletions(-) diff --git a/modular-jobs.rst b/modular-jobs.rst index 28d7bcd..d26f7ec 100644 --- a/modular-jobs.rst +++ b/modular-jobs.rst @@ -75,8 +75,6 @@ When the nodes of a job belong to different interconnects and MPI communication To request gateway nodes for a job the mandatory option --gw_num has to be specified at submit/allocation time. In addition, communication with the psgwd has to be ensured via loading the software module **pscom-gateway** either via ``xenv`` or the ``module`` command. -**April 2019** For the time being, prefixing binaries via ``msa_fix_ld`` is necessary, due to a libmpi version that does not support the psgwd. We hope this will go away soon. - To start an interactive pack job using two gateway nodes the following command must be used: .. code-block:: none @@ -99,6 +97,19 @@ When submitting a job that will run later, you have to specify the number of gat srun xenv -L pscom-gateway msa_fix_ld ./prog1 : xenv -L pscom-gateway msa_fix_ld ./prog2 +Current MPI Workaround (April 2019) +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +For the time being, prefixing binaries via ``msa_fix_ld`` is necessary. This is due to the fact that the installed libmpi version does not support the psgwd. We hope this will go away soon. +``msa_fix_ld`` is modifying the environment, so it might influence the modules you load. + +.. code-block:: none + + #!/bin/bash + export PSP_PSM=1 + export LD_LIBRARY_PATH="/usr/local/jsc/msa_parastation_mpi/lib:/usr/local/jsc/msa_parastation_mpi/lib/mpi-hpl-gcc/:${LD_LIBRARY_PATH}" + $* + Debugging ~~~~~~~~~ -- GitLab