[FLASH-USERS] MPI issue

[Christos Stavrou]

Hi all,

Thank you to Tony for his help earlier; this next issue may or may not be related with the one I had earlier (compiling with GCC10).

At the moment, I can successfully run setup to create the object directory, enter the object directory and run make successfully, albeit with a fair amount of warnings (e.g. "Warning: Type mismatch between actual argument at (1) and actual argument at (2) (REAL(8)/INTEGER(4)" from a call to MPI_Bcast).

When I subsequently try to run the code, it goes through some of the initialisation, but stops and gives me an MPI-related error message. The example below is for the case of:

./setup Sedov -auto
cd object
make

The error message:

Initial dt verified
 *** An error occurred in MPI_Comm_create_keyval
 *** reported by process [222691329,0]
 *** on communicator MPI_COMM_WORLD
 *** MPI_ERR_ARG: invalid argument of some other kind
 *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
 ***    and potentially your MPI job)

If I run "ldd flash4", I get the following output:

linux-vdso.so.1 (0x00007ffd537fd000)
libhdf5_mpich.so.103 => /lib/x86_64-linux-gnu/libhdf5_mpich.so.103 (0x00007f8b7c91e000)
libmpi_mpifh.so.40 => /lib/x86_64-linux-gnu/libmpi_mpifh.so.40 (0x00007f8b7c8ba000)
libmpi.so.40 => /lib/x86_64-linux-gnu/libmpi.so.40 (0x00007f8b7c794000)
libgfortran.so.5 => /lib/x86_64-linux-gnu/libgfortran.so.5 (0x00007f8b7c4d8000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f8b7c38a000)
libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f8b7c36f000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f8b7c181000)
libsz.so.2 => /lib/x86_64-linux-gnu/libsz.so.2 (0x00007f8b7c17c000)
libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f8b7c160000)
libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f8b7c159000)
libmpich.so.12 => /lib/x86_64-linux-gnu/libmpich.so.12 (0x00007f8b7b6c3000)
libopen-pal.so.40 => /lib/x86_64-linux-gnu/libopen-pal.so.40 (0x00007f8b7b60f000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f8b7b5ed000)
libopen-rte.so.40 => /lib/x86_64-linux-gnu/libopen-rte.so.40 (0x00007f8b7b531000)
libhwloc.so.15 => /lib/x86_64-linux-gnu/libhwloc.so.15 (0x00007f8b7b4d8000)
libquadmath.so.0 => /lib/x86_64-linux-gnu/libquadmath.so.0 (0x00007f8b7b48e000)
/lib64/ld-linux-x86-64.so.2 (0x00007f8b7d478000)
libaec.so.0 => /lib/x86_64-linux-gnu/libaec.so.0 (0x00007f8b7b483000)
librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f8b7b478000)
libutil.so.1 => /lib/x86_64-linux-gnu/libutil.so.1 (0x00007f8b7b473000)
libevent_core-2.1.so.7 => /lib/x86_64-linux-gnu/libevent_core-2.1.so.7 (0x00007f8b7b43b000)
libevent_pthreads-2.1.so.7 => /lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7 (0x00007f8b7b436000)
libudev.so.1 => /lib/x86_64-linux-gnu/libudev.so.1 (0x00007f8b7b40b000)

As I noted in my previous message, which Tony helped me with (adding the "-fallow-argument-mismatch" flag to allow compiling with GCC10), I had managed to set-up, compile and run the code without these issues before upgrading from Ubuntu 20.04 to Ubuntu 21.04.

Any help or pointers would be much appreciated.

Kind regards,

Christos
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://flash.rochester.edu/pipermail/flash-users/attachments/20210702/be09eb88/attachment.htm>