[FLASH-USERS] error running './flash4': double free or corruption

Aodhan McIlvenny amcilvenny01 at qub.ac.uk
Mon Jan 6 11:04:12 EST 2020


Hi,

I have successfully compiled FLASH and have been able to run it on the 
system. However, so far I can only get a simulations to run on the 
system's 'login node' and not on the main nodes (Even though I have 
loaded the same compilers, mpi etc). I get the following error so I was 
wondering if this was familiar to anyone so I that I could track down my 
issue?

error running './flash4': double free or corruption

Thanks,

Aodhan

(Sorry for spamming...)


-------------- next part --------------
(base) [40082858 at node019 [kelvin2] object]$ mpirun -n 4 ./flash4
*** Error in `./flash4': double free or corruption (fasttop): 0x0000000002f1f660 ***
======= Backtrace: =========
/lib64/libc.so.6(+0x81489)[0x7ff328717489]
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPIDI_Populate_vc_node_ids+0x415)[0x7ff329da93f5]
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPID_Init+0x126)[0x7ff329da3e16]
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPIR_Init_thread+0x239)[0x7ff329e557d9]
*** Error in `./flash4': double free or corruption (fasttop): 0x0000000002e50660 ***
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPI_Init+0xa6)[0x7ff329e551a6]
======= Backtrace: =========
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPI_INIT+0x1f)[0x7ff329d85d4f]
./flash4[0x412770]
./flash4[0x40600d]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7ff3286b83d5]
./flash4[0x40604c]
======= Memory map: ========
00400000-0086f000 r-xp 00000000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a6e000-00a6f000 r--p 0046e000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a6f000-00a71000 rw-p 0046f000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a71000-01428000 rw-p 00000000 00:00 0 
02f1b000-02f3c000 rw-p 00000000 00:00 0                                  [heap]
7ff324000000-7ff324021000 rw-p 00000000 00:00 0 
7ff324021000-7ff328000000 ---p 00000000 00:00 0 
7ff328492000-7ff328494000 r-xp 00000000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7ff328494000-7ff328694000 ---p 00002000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7ff328694000-7ff328695000 r--p 00002000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7ff328695000-7ff328696000 rw-p 00003000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7ff328696000-7ff328858000 r-xp 00000000 fd:00 660150                   /lib64/libc.so.6(+0x81489)[0x7f9af4522489]
  /usr/lib64/libc-2.17.so
7ff328858000-7ff328a58000 ---p 001c2000 fd:00 660150                     /usr/lib64/libc-2.17.so
7ff328a58000-7ff328a5c000 r--p 001c2000 fd:00 660150                     /usr/lib64/libc-2.17.so
7ff328a5c000-7ff328a5e000 rw-p 001c6000 fd:00 660150                     /usr/lib64/libc-2.17.so
7ff328a5e000-7ff328a63000 rw-p 00000000 00:00 0 
7ff328a63000-7ff328a9e000 r-xp 00000000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7ff328a9e000-7ff328c9d000 ---p 0003b000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7ff328c9d000-7ff328c9e000 r--p 0003a000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7ff328c9e000-7ff328c9f000 rw-p 0003b000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7ff328c9f000-7ff328cb4000 r-xp 00000000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7ff328cb4000-7ff328eb3000 ---p 00015000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7ff328eb3000-7ff328eb4000 r--p 00014000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7ff328eb4000-7ff328eb5000 rw-p 00015000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7ff328eb5000-7ff328fb6000 r-xp 00000000 fd:00 660158                     /usr/lib64/libm-2.17.so
7ff328fb6000-7ff3291b5000 ---p 00101000 fd:00 660158                     /usr/lib64/libm-2.17.so
7ff3291b5000-7ff3291b6000 r--p 00100000 fd:00 660158                     /usr/lib64/libm-2.17.so
7ff3291b6000-7ff3291b7000 rw-p 00101000 fd:00 660158                     /usr/lib64/libm-2.17.so
7ff3291b7000-7ff3292d6000 r-xp 00000000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7ff3292d6000-7ff3294d6000 ---p 0011f000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7ff3294d6000-7ff3294d7000 r--p 0011f000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7ff3294d7000-7ff3294d9000 rw-p 00120000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7f/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPIDI_Populate_vc_node_ids+0x415)[0x7f9af5bb43f5]
f3294d9000-7ff3294f0000 r-xp 00000000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7ff3294f0000-7ff3296ef000 ---p 00017000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7ff3296ef000-7ff3296f0000 r--p 00016000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7ff3296f0000-7ff3296f1000 rw-p 00017000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7ff3296f1000-7ff3296f5000 rw-p 00000000 00:00 0 
7ff3296f5000-7ff3296fc000 r-xp 00000000 fd:00 660180                     /usr/lib64/librt-2.17.so
7ff3296fc000-7ff3298fb000 ---p 00007000 fd:00 660180                     /usr/lib64/librt-2.17.so
7ff3298fb000-7ff3298fc000 r--p 00006000 fd:00 660180                     /usr/lib64/librt-2.17.so
7ff3298fc000-7ff3298fd000 rw-p 00007000 fd:00 660180                     /usr/lib64/librt-2.17.so
7ff3298fd000-7ff329901000 r-xp 00000000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7ff329901000-7ff329b00000 ---p 00004000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7ff329b00000-7ff329b01000 r--p 00003000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7ff329b01000-7ff329b02000 rw-p 00004000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7ff329b02000-7ff329b03000 r-xp 00000000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7ff329b03000-7ff329d02000 ---p 00001000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7ff329d02000-7ff329d03000 r--p 00000000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7ff329d03000-7ff329d04000 rw-p 00001000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7ff329d04000-7ff329f1e000 r-xp 00000000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7ff329f1e000-7ff32a11e000 ---p 0021a000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7ff32a11e000-7ff32a12b000 r--p 0021a000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7ff32a12b000-7ff32a130000 rw-p 00227000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7ff32a130000-7ff32a169000 rw-p 00000000 00:00 0 
7ff32a169000-7ff32a16b000 r-xp 00000000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7ff32a16b000-7ff32a36a000 ---p 00002000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7ff32a36a000-7ff32a36b000 r--p 00001000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7ff32a36b000-7ff32a36c000 rw-p 00002000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7ff32a36c000-7ff32a381000 r-xp 00000000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7ff32a381000-7ff32a580000 ---p 00015000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7ff32a580000-7ff32a581000 r--p 00014000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7ff32a581000-7ff32a582000 rw-p 00015000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7ff32a582000-7ff32a956000 r-xp 00000000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7ff32a956000-7ff32ab55000 ---p 003d4000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2./opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPID_Init+0x126)[0x7f9af5baee16]
0
7ff32ab55000-7ff32ab5f000 r--p 003d3000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7ff32ab5f000-7ff32ab68000 rw-p 003dd000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7ff32ab68000-7ff32ab6b000 rw-p 00000000 00:00 0 
7ff32ab6b000-7ff32ab8d000 r-xp 00000000 fd:00 657937                     /usr/lib64/ld-2.17.so
7ff32ad73000-7ff32ad7b000 rw-p 00000000 00:00 0 
7ff32ad8a000-7ff32ad8c000 rw-p 00000000 00:00 0 
7ff32ad8c000-7ff32ad8d000 r--p 00021000 fd:00 657937                     /usr/lib64/ld-2.17.so
7ff32ad8d000-7ff32ad8e000 rw-p 00022000 fd:00 657937                     /usr/lib64/ld-2.17.so
7ff32ad8e000-7ff32ad8f000 rw-p 00000000 00:00 0 
7fff80a02000-7fff80a24000 rw-p 00000000 00:00 0                          [stack]
7fff80aa0000-7fff80aa2000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]

Program received signal SIGABRT: Process abort signal.

Backtrace for this error:
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPIR_Init_thread+0x239)[0x7f9af5c607d9]
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPI_Init+0xa6)[0x7f9af5c601a6]
*** Error in `./flash4': double free or corruption (fasttop): 0x0000000002e01660 ***
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPI_INIT+0x1f)[0x7f9af5b90d4f]
======= Backtrace: =========
./flash4[0x412770]
./flash4[0x40600d]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f9af44c33d5]
./flash4[0x40604c]
======= Memory map: ========
00400000-0086f000 r-xp 00000000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a6e000-00a6f000 r--p 0046e000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a6f000-00a71000 rw-p 0046f000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a71000-01428000 rw-p 00000000 00:00 0 
02e4c000-02e6d000 rw-p 00000000 00:00 0                                  [heap]
7f9af0000000-7f9af0021000 rw-p 00000000 00:00 0 
7f9af0021000-7f9af4000000 ---p 00000000 00:00 0 
7f9af429d000-7f9af429f000 r-xp 00000000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7f9af429f000-7f9af449f000 ---p 00002000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7f9af449f000-7f9af44a0000 r--p 00002000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7f9af44a0000-7f9af44a1000 rw-p 00003000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7f9af44a1000-7f9af4663000 r-xp 00000000 fd:00 660150                     /usr/lib64/libc-2.17.so
7f9af4663000-7f9af4863000 ---p 001c2000 fd:00 660150                     /usr/lib64/libc-2.17.so
7f9af4863000-7f9af4867000 r--p 001c2000 fd:00 660150                     /usr/lib64/libc-2.17.so
7f9af4867000-7f9af4869000 rw-p 001c6000 fd:00 660150                     /usr/lib64/libc-2.17.so
7f9af4869000-7f9af486e000 rw-p 00000000 00:00 0 
7f9af486e000-7f9af48a9000 r-xp 00000000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7f9af48a9000-7f9af4aa8000 ---p 0003b000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7f9af4aa8000-7f9af4aa9000 r--p 0003a000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7f9af4aa9000-7f9af4aaa000 rw-p 0003b000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7f9af4aaa000-7f9af4abf000 r-xp 00000000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f9af4abf000-7f9af4cbe000 ---p 00015000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f9af4cbe000-7f9af4cbf000 r--p 00014000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f9af4cbf000-7f9af4cc0000 rw-p 00015000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f9af4cc0000-7f9af4dc1000 r-xp 00000000 fd:00 660158                     /usr/lib64/libm-2.17.so
7f9af4dc1000-7f9af4fc0000 ---p 00101000 fd:00 660158                     /usr/lib64/libm-2.17.so
7f9af4fc0000-7f9af4fc1000 r--p 00100000 fd:00 660158                     /usr/lib64/libm-2.17.so
7f9af4fc1000-7f9af4fc2000 rw-p 00101000 fd:00 660158                     /usr/lib64/libm-2.17.so
7f9af4fc2000-7f9af50e1000 r-xp 00000000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7f9af50e1000-7f9af52e1000 ---p 0011f000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7f9af52e1000-7f9af52e2000 r--p 0011f000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7f9af52e2000-7f9af52e4000 rw-p 00120000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7f9af52e4000-7f9af52fb000 r-xp 00000000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7f9af52fb000-7f9af54fa000 ---p 00017000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7f9af54fa000-7f9af54fb000 r--p 00016000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7f9af54fb000-7f9af54fc000 rw-p 00017000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7f9af54fc000-7f9af5500000 rw-p 00000000 00:00 0 
7f9af5500000-7f9af5507000 r-xp 00000000 fd:00 660180                     /usr/lib64/librt-2.17.so
7f9af5507000-7f9af5706000 ---p 00007000 fd:00 660180                     /usr/lib64/librt-2.17.so
7f9af5706000-7f9af5707000 r--p 00006000 fd:00 660180                     /usr/lib64/librt-2.17.so
7f9af5707000-7f9af5708000 rw-p 00007000 fd:00 660180                     /usr/lib64/librt-2.17.so
7f9af5708000-7f9af570c000 r-xp 00000000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7f9af570c000-7f9/lib64/libc.so.6(+0x81489)[0x7f629be64489]
af590b000 ---p 00004000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7f9af590b000-7f9af590c000 r--p 00003000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7f9af590c000-7f9af590d000 rw-p 00004000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7f9af590d000-7f9af590e000 r-xp 00000000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7f9af590e000-7f9af5b0d000 ---p 00001000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7f9af5b0d000-7f9af5b0e000 r--p 00000000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7f9af5b0e000-7f9af5b0f000 rw-p 00001000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7f9af5b0f000-7f9af5d29000 r-xp 00000000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7f9af5d29000-7f9af5f29000 ---p 0021a000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7f9af5f29000-7f9af5f36000 r--p 0021a000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7f9af5f36000-7f9af5f3b000 rw-p 00227000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7f9af5f3b000-7f9af5f74000 rw-p 00000000 00:00 0 
7f9af5f74000-7f9af5f76000 r-xp 00000000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7f9af5f76000-7f9af6175000 ---p 00002000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7f9af6175000-7f9af6176000 r--p 00001000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7f9af6176000-7f9af6177000 rw-p 00002000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7f9af6177000-7f9af618c000 r-xp 00000000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7f9af618c000-7f9af638b000 ---p 00015000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7f9af638b000-7f9af638c000 r--p 00014000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7f9af638c000-7f9af638d000 rw-p 00015000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7f9af638d000-7f9af6761000 r-xp 00000000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7f9af6761000-7f9af6960000 ---p 003d4000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2./opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPIDI_Populate_vc_node_ids+0x415)[0x7f629d4f63f5]
0
7f9af6960000-7f9af696a000 r--p 003d3000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7f9af696a000-7f9af6973000 rw-p 003dd000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7f9af6973000-7f9af6976000 rw-p 00000000 00:00 0 
7f9af6976000-7f9af6998000 r-xp 00000000 fd:00 657937                     /usr/lib64/ld-2.17.so
7f9af6b7e000-7f9af6b86000 rw-p 00000000 00:00 0 
7f9af6b95000-7f9af6b97000 rw-p 00000000 00:00 0 
7f9af6b97000-7f9af6b98000 r--p 00021000 fd:00 657937                     /usr/lib64/ld-2.17.so
7f9af6b98000-7f9af6b99000 rw-p 00022000 fd:00 657937                     /usr/lib64/ld-2.17.so
7f9af6b99000-7f9af6b9a000 rw-p 00000000 00:00 0 
7ffc620bb000-7ffc620dd000 rw-p 00000000 00:00 0                          [stack]
7ffc62133000-7ffc62135000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]

Program received signal SIGABRT: Process abort signal.
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPID_Init+0x126)[0x7f629d4f0e16]

Backtrace for this error:
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPIR_Init_thread+0x239)[0x7f629d5a27d9]
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPI_Init+0xa6)[0x7f629d5a21a6]
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPI_INIT+0x1f)[0x7f629d4d2d4f]
./flash4[0x412770]
./flash4[0x40600d]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f629be053d5]
./flash4[0x40604c]
======= Memory map: ========
00400000-0086f000 r-xp 00000000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a6e000-00a6f000 r--p 0046e000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a6f000-00a71000 rw-p 0046f000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a71000-01428000 rw-p 00000000 00:00 0 
02dfd000-02e1e000 rw-p 00000000 00:00 0                                  [heap]
7f6294000000-7f6294021000 rw-p 00000000 00:00 0 
7f6294021000-7f6298000000 ---p 00000000 00:00 0 
7f629bbdf000-7f629bbe1000 r-xp 00000000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7f629bbe1000-7f629bde1000 ---p 00002000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7f629bde1000-7f629bde2000 r--p 00002000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7f629bde2000-7f629bde3000 rw-p 00003000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7f629bde3000-7f629bfa5000 r-xp 00000000 fd:00 660150                     /usr/lib64/libc-2.17.so
7f629bfa5000-7f629c1a5000 ---p 001c2000 fd:00 660150                     /usr/lib64/libc-2.17.so
7f629c1a5000-7f629c1a9000 r--p 001c2000 fd:00 660150                     /usr/lib64/libc-2.17.so
7f629c1a9000-7f629c1ab000 rw-p 001c6000 fd:00 660150                     /usr/lib64/libc-2.17.so
7f629c1ab000-7f629c1b0000 rw-p 00000000 00:00 0 
7f629c1b0000-7f629c1eb000 r-xp 00000000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7f629c1eb000-7f629c3ea000 ---p 0003b000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7f629c3ea000-7f629c3eb000 r--p 0003a000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7f629c3eb000-7f629c3ec000 rw-p 0003b000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7f629c3ec000-7f629c401000 r-xp 00000000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f629c401000-7f629c600000 ---p 00015000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f629c600000-7f629c601000 r--p 00014000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f629c601000-7f629c602000 rw-p 00015000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7f629c602000-7f629c703000 r-xp 00000000 fd:00 660158                     /usr/lib64/libm-2.17.so
7f629c703000-7f629c902000 ---p 00101000 fd:00 660158                     /usr/lib64/libm-2.17.so
7f629c902000-7f629c903000 r--p 00100000 fd:00 660158                     /usr/lib64/libm-2.17.so
7f629c903000-7f629c904000 rw-p 00101000 fd:00 660158                     /usr/lib64/libm-2.17.so
7f629c904000-7f629ca23000 r-xp 00000000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7f629ca23000-7f629cc23000 ---p 0011f000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7f629cc23000-7f629cc24000 r--p 0011f000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7f629cc24000-7f629cc26000 rw-p 00120000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7f629cc26000-7f629cc3d000 r-xp 00000000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7f629cc3d000-7f629ce3c000 ---p 00017000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7f629ce3c000-7f629ce3d000 r--p 00016000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7f629ce3d000-7f629ce3e000 rw-p 00017000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7f629ce3e000-7f629ce42000 rw-p 00000000 00:00 0 
7f629ce42000-7f629ce49000 r-xp 00000000 fd:00 660180                     /usr/lib64/librt-2.17.so
7f629ce49000-7f629d048000 ---p 00007000 fd:00 660180                     /usr/lib64/librt-2.17.so
7f629d048000-7f629d049000 r--p 00006000 fd:00 660180                     /usr/lib64/librt-2.17.so
7f629d049000-7f629d04a000 rw-p 00007000 fd:00 660180                     /usr/lib64/librt-2.17.so
7f629d04a000-7f629d04e000 r-xp 00000000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7f629d04e000-7f629d24d000 ---p 00004000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7f629d24d000-7f629d24e000 r--p 00003000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7f629d24e000-7f629d24f000 rw-p 00004000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7f629d24f000-7f629d250000 r-xp 00000000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7f629d250000-7f629d44f000 ---p 00001000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7f629d44f000-7f629d450000 r--p 00000000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7f629d450000-7f629d451000 rw-p 00001000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7f629d451000-7f629d66b000 r-xp 00000000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7f629d66b000-7f629d86b000 ---p 0021a000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7f629d86b000-7f629d878000 r--p 0021a000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7f629d878000-7f629d87d000 rw-p 00227000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7f629d87d000-7f629d8b6000 rw-p 00000000 00:00 0 
7f629d8b6000-7f629d8b8000 r-xp 00000000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7f629d8b8000-7f629dab7000 ---p 00002000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7f629dab7000-7f629dab8000 r--p 00001000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7f629dab8000-7f629dab9000 rw-p 00002000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7f629dab9000-7f629dace000 r-xp 00000000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7f629dace000-7f629dccd000 ---p 00015000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7f629dccd000-7f629dcce000 r--p 00014000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7f629dcce000-7f629dccf000 rw-p 00015000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7f629dccf000-7f629e0a3000 r-xp 00000000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7f629e0a3000-7f629e2a2000 ---p 003d4000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7f629e2a2000-7f629e2ac000 r--p 003d3000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7f629e2ac000-7f629e2b5000 rw-p 003dd000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7f629e2b5000-7f629e2b8000 rw-p 00000000 00:00 0 
7f629e2b8000-7f629e2da000 r-xp 00000000 fd:00 657937                     /usr/lib64/ld-2.17.so
7f629e4c0000-7f629e4c8000 rw-p 00000000 00:00 0 
7f629e4d7000-7f629e4d9000 rw-p 00000000 00:00 0 
7f629e4d9000-7f629e4da000 r--p 00021000 fd:00 657937                     /usr/lib64/ld-2.17.so
7f629e4da000-7f629e4db000 rw-p 00022000 fd:00 657937                     /usr/lib64/ld-2.17.so
7f629e4db000-7f629e4dc000 rw-p 00000000 00:00 0 
7fff75eb4000-7fff75ed6000 rw-p 00000000 00:00 0                          [stack]
7fff75f32000-7fff75f34000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]

Program received signal SIGABRT: Process abort signal.

Backtrace for this error:
*** Error in `./flash4': double free or corruption (fasttop): 0x0000000001fdd660 ***
======= Backtrace: =========
/lib64/libc.so.6(+0x81489)[0x7fe69f91c489]
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPIDI_Populate_vc_node_ids+0x415)[0x7fe6a0fae3f5]
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPID_Init+0x126)[0x7fe6a0fa8e16]
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPIR_Init_thread+0x239)[0x7fe6a105a7d9]
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPI_Init+0xa6)[0x7fe6a105a1a6]
/opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10(MPI_INIT+0x1f)[0x7fe6a0f8ad4f]
./flash4[0x412770]
./flash4[0x40600d]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7fe69f8bd3d5]
./flash4[0x40604c]
======= Memory map: ========
00400000-0086f000 r-xp 00000000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a6e000-00a6f000 r--p 0046e000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a6f000-00a71000 rw-p 0046f000 00:2d 44772841                           /users/40082858/FLASH4.6.2/object/flash4
00a71000-01428000 rw-p 00000000 00:00 0 
01fd9000-01ffa000 rw-p 00000000 00:00 0                                  [heap]
7fe698000000-7fe698021000 rw-p 00000000 00:00 0 
7fe698021000-7fe69c000000 ---p 00000000 00:00 0 
7fe69f697000-7fe69f699000 r-xp 00000000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7fe69f699000-7fe69f899000 ---p 00002000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7fe69f899000-7fe69f89a000 r--p 00002000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7fe69f89a000-7fe69f89b000 rw-p 00003000 fd:00 660156                     /usr/lib64/libdl-2.17.so
7fe69f89b000-7fe69fa5d000 r-xp 00000000 fd:00 660150                     /usr/lib64/libc-2.17.so
7fe69fa5d000-7fe69fc5d000 ---p 001c2000 fd:00 660150                     /usr/lib64/libc-2.17.so
7fe69fc5d000-7fe69fc61000 r--p 001c2000 fd:00 660150                     /usr/lib64/libc-2.17.so
7fe69fc61000-7fe69fc63000 rw-p 001c6000 fd:00 660150                     /usr/lib64/libc-2.17.so
7fe69fc63000-7fe69fc68000 rw-p 00000000 00:00 0 
7fe69fc68000-7fe69fca3000 r-xp 00000000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7fe69fca3000-7fe69fea2000 ---p 0003b000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7fe69fea2000-7fe69fea3000 r--p 0003a000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7fe69fea3000-7fe69fea4000 rw-p 0003b000 fd:00 687264                     /usr/lib64/libquadmath.so.0.0.0
7fe69fea4000-7fe69feb9000 r-xp 00000000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7fe69feb9000-7fe6a00b8000 ---p 00015000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7fe6a00b8000-7fe6a00b9000 r--p 00014000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7fe6a00b9000-7fe6a00ba000 rw-p 00015000 fd:00 655380                     /usr/lib64/libgcc_s-4.8.5-20150702.so.1
7fe6a00ba000-7fe6a01bb000 r-xp 00000000 fd:00 660158                     /usr/lib64/libm-2.17.so
7fe6a01bb000-7fe6a03ba000 ---p 00101000 fd:00 660158                     /usr/lib64/libm-2.17.so
7fe6a03ba000-7fe6a03bb000 r--p 00100000 fd:00 660158                     /usr/lib64/libm-2.17.so
7fe6a03bb000-7fe6a03bc000 rw-p 00101000 fd:00 660158                     /usr/lib64/libm-2.17.so
7fe6a03bc000-7fe6a04db000 r-xp 00000000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7fe6a04db000-7fe6a06db000 ---p 0011f000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7fe6a06db000-7fe6a06dc000 r--p 0011f000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7fe6a06dc000-7fe6a06de000 rw-p 00120000 fd:00 687267                     /usr/lib64/libgfortran.so.3.0.0
7fe6a06de000-7fe6a06f5000 r-xp 00000000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7fe6a06f5000-7fe6a08f4000 ---p 00017000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7fe6a08f4000-7fe6a08f5000 r--p 00016000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7fe6a08f5000-7fe6a08f6000 rw-p 00017000 fd:00 660176                     /usr/lib64/libpthread-2.17.so
7fe6a08f6000-7fe6a08fa000 rw-p 00000000 00:00 0 
7fe6a08fa000-7fe6a0901000 r-xp 00000000 fd:00 660180                     /usr/lib64/librt-2.17.so
7fe6a0901000-7fe6a0b00000 ---p 00007000 fd:00 660180                     /usr/lib64/librt-2.17.so
7fe6a0b00000-7fe6a0b01000 r--p 00006000 fd:00 660180                     /usr/lib64/librt-2.17.so
7fe6a0b01000-7fe6a0b02000 rw-p 00007000 fd:00 660180                     /usr/lib64/librt-2.17.so
7fe6a0b02000-7fe6a0b06000 r-xp 00000000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7fe6a0b06000-7fe6a0d05000 ---p 00004000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7fe6a0d05000-7fe6a0d06000 r--p 00003000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7fe6a0d06000-7fe6a0d07000 rw-p 00004000 00:28 46137936                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpl.so.1.0.0
7fe6a0d07000-7fe6a0d08000 r-xp 00000000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7fe6a0d08000-7fe6a0f07000 ---p 00001000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7fe6a0f07000-7fe6a0f08000 r--p 00000000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7fe6a0f08000-7fe6a0f09000 rw-p 00001000 00:28 46137954                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libopa.so.1.0.0
7fe6a0f09000-7fe6a1123000 r-xp 00000000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7fe6a1123000-7fe6a1323000 ---p 0021a000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7fe6a1323000-7fe6a1330000 r--p 0021a000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7fe6a1330000-7fe6a1335000 rw-p 00227000 00:28 46137932                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpich.so.10.0.4
7fe6a1335000-7fe6a136e000 rw-p 00000000 00:00 0 
7fe6a136e000-7fe6a1370000 r-xp 00000000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7fe6a1370000-7fe6a156f000 ---p 00002000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7fe6a156f000-7fe6a1570000 r--p 00001000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7fe6a1570000-7fe6a1571000 rw-p 00002000 00:28 46137938                   /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5/lib/libmpichf90.so.10.0.4
7fe6a1571000-7fe6a1586000 r-xp 00000000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7fe6a1586000-7fe6a1785000 ---p 00015000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7fe6a1785000-7fe6a1786000 r--p 00014000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7fe6a1786000-7fe6a1787000 rw-p 00015000 fd:00 660469                     /usr/lib64/libz.so.1.2.7
7fe6a1787000-7fe6a1b5b000 r-xp 00000000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7fe6a1b5b000-7fe6a1d5a000 ---p 003d4000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7fe6a1d5a000-7fe6a1d64000 r--p 003d3000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7fe6a1d64000-7fe6a1d6d000 rw-p 003dd000 00:2d 43495709                   /users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103.2.0
7fe6a1d6d000-7fe6a1d70000 rw-p 00000000 00:00 0 
7fe6a1d70000-7fe6a1d92000 r-xp 00000000 fd:00 657937                     /usr/lib64/ld-2.17.so
7fe6a1f78000-7fe6a1f80000 rw-p 00000000 00:00 0 
7fe6a1f8f000-7fe6a1f91000 rw-p 00000000 00:00 0 
7fe6a1f91000-7fe6a1f92000 r--p 00021000 fd:00 657937                     /usr/lib64/ld-2.17.so
7fe6a1f92000-7fe6a1f93000 rw-p 00022000 fd:00 657937                     /usr/lib64/ld-2.17.so
7fe6a1f93000-7fe6a1f94000 rw-p 00000000 00:00 0 
7ffee7006000-7ffee7028000 rw-p 00000000 00:00 0                          [stack]
7ffee710d000-7ffee710f000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]

Program received signal SIGABRT: Process abort signal.

Backtrace for this error:
#0  0x7FF3291D0697
#0  0x7F9AF4FDB697
#0  0x7F629C91D697
#1  0x7FF3291D0CDE
#2  0x7FF3286CC27F
#3  0x7FF3286CC207
#4  0x7FF3286CD8F7
#5  0x7FF32870ED26
#6  0x7FF328717488
#7  0x7FF329DA93F4
#8  0x7FF329DA3E15
#9  0x7FF329E557D8
#10  0x7FF329E551A5
#11  0x7FF329D85D4E
#12  0x41276F in driver_initparallel_ at Driver_initParallel.F90:88
#1  0x7F9AF4FDBCDE
#2  0x7F9AF44D727F
#3  0x7F9AF44D7207
#4  0x7F9AF44D88F7
#5  0x7F9AF4519D26
#6  0x7F9AF4522488
#7  0x7F9AF5BB43F4
#8  0x7F9AF5BAEE15
#9  0x7F9AF5C607D8
#10  0x7F9AF5C601A5
#11  0x7F9AF5B90D4E
#0  0x7FE6A03D5697
#1  0x7F629C91DCDE
#2  0x7F629BE1927F
#3  0x7F629BE19207
#4  0x7F629BE1A8F7
#5  0x7F629BE5BD26
#6  0x7F629BE64488
#7  0x7F629D4F63F4
#8  0x7F629D4F0E15
#9  0x7F629D5A27D8
#10  0x7F629D5A21A5
#11  0x7F629D4D2D4E
#12  0x41276F in driver_initparallel_ at Driver_initParallel.F90:88
#1  0x7FE6A03D5CDE
#2  0x7FE69F8D127F
#3  0x7FE69F8D1207
#4  0x7FE69F8D28F7
#5  0x7FE69F913D26
#6  0x7FE69F91C488
#7  0x7FE6A0FAE3F4
#8  0x7FE6A0FA8E15
#9  0x7FE6A105A7D8
#10  0x7FE6A105A1A5
#11  0x7FE6A0F8AD4E
#12  0x41276F in driver_initparallel_ at Driver_initParallel.F90:88
#13  0x40600C in flash at Flash.F90:47
#12  0x41276F in driver_initparallel_ at Driver_initParallel.F90:88
#13  0x40600C in flash at Flash.F90:47
#14  0x7FF3286B83D4
#14  0x7F9AF44C33D4
#13  0x40600C in flash at Flash.F90:47
#14  0x7F629BE053D4
#13  0x40600C in flash at Flash.F90:47
#14  0x7FE69F8BD3D4

===================================================================================
=   BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
=   EXIT CODE: 6
=   CLEANING UP REMAINING PROCESSES
=   YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
===================================================================================
YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Aborted (signal 6)
This typically refers to a problem with your application.
Please see the FAQ page for debugging suggestions
(base) [40082858 at node019 [kelvin2] object]$ 
-------------- next part --------------
# FLASH makefile definitions for x86-64 Linux (GNU compilers)
#----------------------------------------------------------------------------
# Set the HDF5/MPI library paths -- these need to be updated for your system
#----------------------------------------------------------------------------

MPI_PATH   = /opt/gridware/depots/54e7fb3c/el7/pkg/mpi/mpich/3.0.4/gcc-4.8.5
HDF4_PATH  =
HDF5_PATH  = /users/40082858/hdf5-1.10.6/hdf5
HYPRE_PATH = /users/40082858/hypre-2.11.2/src/hypre

ZLIB_PATH  =

PAPI_PATH  =
PAPI_FLAGS =

NCMPI_PATH =
MPE_PATH   =

#----------------------------------------------------------------------------
# Compiler and linker commands
#
#   Use the MPICH wrappers around the compilers -- these will automatically
#   load the proper libraries and include files.  Version of MPICH prior

#   You need to edit mpif90 and add .F90 to the test of filename extensions,
#   or upgrade your MPICH.
#----------------------------------------------------------------------------

FCOMP   = ${MPI_PATH}/bin/mpif90
CCOMP   = ${MPI_PATH}/bin/mpicc
CPPCOMP = ${MPI_PATH}/bin/mpicxx
LINK    = ${MPI_PATH}/bin/mpif90

# pre-processor flag
PP      = -D

#----------------------------------------------------------------------------
# Compilation flags
#
#  Three sets of compilation/linking flags are defined: one for optimized
#  code, one for testing, and one for debugging.  The default is to use the
#  _OPT version.  Specifying -debug to setup will pick the _DEBUG version,
#  these should enable bounds checking.  Specifying _TEST is used for
#  flash_test, and is set for quick code generation, and (sometimes)
#  profiling.  The Makefile generated by setup will assign the generic token
#  (ex. FFLAGS) to the proper set of flags (ex. FFLAGS_OPT).
#----------------------------------------------------------------------------

OPENMP = -fopenmp

FFLAGS_OPT = -ggdb -c -O2 -fdefault-real-8 -fdefault-double-8 \
-Wuninitialized

#I explictly add -O0 because I found that compiling source files without
#an optimization flag generates the same object code as compiling source
#files with -O2.  The -O0 is required so that gdb no longer shows
#"<value optimized out>" for certain function arguments.

FFLAGS_DEBUG = -ggdb -c -O0 -fdefault-real-8 -fdefault-double-8 \
-pedantic -Wall -Waliasing \
-Wsurprising -Wconversion -Wunderflow \
-ffpe-trap=invalid,zero,overflow -fbounds-check \
-fimplicit-none -fstack-protector-all

FFLAGS_TEST = -ggdb -c -O0 -fdefault-real-8 -fdefault-double-8

FFLAGS_HYPRE = -I${HYPRE_PATH}/include


F90FLAGS =


#The macro _FORTIFY_SOURCE adds some lightweight checks for buffer
#overflows at both compile time and run time (only active at -O1 or higher)
#http://gcc.gnu.org/ml/gcc-patches/2004-09/msg02055.html
CFLAGS_OPT = -ggdb -c -O2 -Wuninitialized -D_FORTIFY_SOURCE=2

CFLAGS_DEBUG = -ggdb -c -O0 -Wno-div-by-zero -Wundef \
-Wconversion -Wstrict-prototypes -Wunreachable-code \
-pedantic -Wall -Winit-self -ftree-vrp -Wfloat-equal \
-Wunsafe-loop-optimizations -Wpadded -fstack-protector-all

CFLAGS_TEST = -ggdb -O0 -c

CFLAGS_HYPRE = -I${HYPRE_PATH}/include

# if we are using HDF5, we need to specify the path to the include files
CFLAGS_HDF5 = -I${HDF5_PATH}/include -DH5_USE_16_API
#CFLAGS_NCMPI = -I${NCMPI_PATH}/include

#----------------------------------------------------------------------------
# Linker flags
#
#  There is a seperate version of the linker flags for each of the _OPT,
#  _DEBUG, and _TEST cases.
#----------------------------------------------------------------------------

LFLAGS_OPT   = -ggdb -o
LFLAGS_DEBUG = -ggdb -O0 -o
LFLAGS_TEST  = -ggdb -O0 -o


#----------------------------------------------------------------------------
# Library specific linking
#
#  If a FLASH module has a 'LIBRARY xxx' line in its Config file, we need to
#  create a macro in this Makefile.h for LIB_xxx, which will be added to the
#  link line when FLASH is built.  This allows us to switch between different
#  (incompatible) libraries.  We also create a _OPT, _DEBUG, and _TEST
#  library macro to add any performance-minded libraries (like fast math),
#  depending on how FLASH was setup.
#----------------------------------------------------------------------------

LIB_OPT   =
LIB_DEBUG =
LIB_TEST  =
#LD_LIBRARY_PATH=/users/40082858/hdf5-1.10.6/hdf5/lib/libhdf5.so.103
LIB_HDF4  =
LIB_HDF5  = -L ${HDF5_PATH}/lib -lhdf5 -lz

LIB_PAPI  =
LIB_MATH  =

LIB_MPI =  
#LIB_NCMPI = -L ${NCMPI_PATH}/lib -lpnetcdf
LIB_NCMPI = 
LIB_MPE   =

LIB_HYPRE = -L${HYPRE_PATH}/lib -lHYPRE

# Uncomment the following line to use electic fence memory debugger.
# export EF_ALLOW_MALLOC_0=1
#CONFIG_LIB = -L/usr/lib64 -lefence

#----------------------------------------------------------------------------
# Additional machine-dependent object files
#
#  Add any machine specific files here -- they will be compiled and linked
#  when FLASH is built.
#----------------------------------------------------------------------------

MACHOBJ =

#----------------------------------------------------------------------------
# Additional commands
#----------------------------------------------------------------------------

MV = mv -f
AR = ar -r
RM = rm -f
CD = cd
RL = ranlib
ECHO = echo


#----------------------------------------------------------------------------
# Fake existence of iso_c_bindings module to prevent unnecessary recompilations.
#---------------------------------------------------------------------------- 
ifeq ($(FLASHBINARY),true)
iso_c_binding.mod :
	touch $@
endif
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Screenshot 2020-01-06 at 13.04.17.png
Type: image/png
Size: 79040 bytes
Desc: not available
URL: <http://flash.rochester.edu/pipermail/flash-users/attachments/20200106/393a7ff9/attachment.png>


More information about the flash-users mailing list