[FLASH-USERS] Issue with Cray Compiler

Baron, Edward A. baron at ou.edu
Thu Nov 12 15:36:56 EST 2020


From the sounds of this, it looks like an optimization error. I’d try turning optimization off and see if it cures it, then you can dig into it.

-eddie

> On Nov 11, 2020, at 8:20 PM, Alan Calder <alan.calder at stonybrook.edu> wrote:
> 
> Hello,
> 
> I am writing to describe an issue with running Flash4 on a Cray A64FX machine with the Cray compiler, version 10.0.1. We are running Flash 4.6.2.  I thought I would describe what I am seeing so as to ask for any
> advice before digging in further.  I am not completely sure if this is a bug, hence my sending it here.
> 
> First I should note that things work well with the Gnu compilers. We do not see this problem when compiling with the gnu compilers.
> 
> The shortest possible summary is that the code seems to enter an unphysical state and crash, and with the split hydro solver I see a warning
> 
> WARNING after gc filling: min. unk(EINT_VAR)=9.9999999735241242E-11           PE=4     block=6
>                     type=1
> 
> We compile with -c -g -G 2 -s real64 -s integer32 and the code generates a few warnings, none of which seem relevant. We've tried a few problems, too, and are seeing the same issues. For this report I ran the Sedov problem.
> 
> With the default units, and set up with
> 
> ./setup Sedov -auto -site=ookami.stonybrook.edu <https://urldefense.proofpoint.com/v2/url?u=http-3A__ookami.stonybrook.edu&d=DwMFaQ&c=qKdtBuuu6dQK9MsRUVJ2DPXW6oayO8fu4TfEHS8sGNk&r=D67MpwQXy8oi2wblxhDSww&m=WYqObZU87Lx3v_TqEQKNMv0UxGqG13upy_pgPEhPtpU&s=EfWCdWjTD8wQR3cFPWYv-9y2_QUWDSyhrjQwdVCsI94&e=>
> 
> the code runs a while and then suddenly the solution seems to hit some bad state causing the time step to suddenly drop and then the code crashes.
> 
> [acalder at fj-debug1 object]$ !mpi
> mpiexec -n 8 ./flash4
>  Grid_init: resolution based on runtime params:
>   lrefine          dx              dy
>       1             0.125           0.125
>       2             0.063           0.063
>       3             0.031           0.031
>       4             0.016           0.016
>       5             0.008           0.008
>       6             0.004           0.004
>  MaterialProperties initialized
>  Cosmology initialized
>  Source terms initialized
>  sim_rhoAmbient is 1.
>   iteration, no. not moved =  2*0
>  refined: total leaf blocks =  1
>  refined: total blocks =  1
>  [amr_morton_process]: Initializing surr_blks using standard orrery implementation
>  INFO: Grid_fillGuardCells is ignoring masking.
>   iteration, no. not moved =  2*0
>  refined: total leaf blocks =  4
>  refined: total blocks =  5
>   iteration, no. not moved =  0,  3
>   iteration, no. not moved =  2*1
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  16
>  refined: total blocks =  21
>   iteration, no. not moved =  0,  6
>   iteration, no. not moved =  1,  0
>  refined: total leaf blocks =  28
>  refined: total blocks =  37
>   iteration, no. not moved =  0,  9
>   iteration, no. not moved =  1,  2
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  40
>  refined: total blocks =  53
>   iteration, no. not moved =  0,  16
>   iteration, no. not moved =  1,  2
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  52
>  refined: total blocks =  69
>   Finished with Grid_initDomain, no restart
>  Ready to call Hydro_init
>  Hydro initialized
>  Gravity initialized
>  Initial dt verified
>  *** Wrote checkpoint file to sedov_hdf5_chk_0000 ****
>  *** Wrote plotfile to sedov_hdf5_plt_cnt_0000 ****
>  Initial plotfile written
>  Driver init all done
>        n          t         dt  (         x,          y,          z) |  dt_hydro
>        1 1.0000E-10 2.0000E-10  ( 0.498    ,  0.498    ,   0.00    ) |  1.012E-04
>        2 3.0000E-10 4.0000E-10  ( 0.498    ,  0.494    ,   0.00    ) |  1.012E-04
>        3 7.0000E-10 8.0000E-10  ( 0.498    ,  0.494    ,   0.00    ) |  1.012E-04
>        4 1.5000E-09 1.6000E-09  ( 0.498    ,  0.494    ,   0.00    ) |  1.012E-04
> 
> snip
> 
>       26 4.4575E-04 4.7891E-05  ( 0.502    ,  0.510    ,   0.00    ) |  4.789E-05
>       27 4.9364E-04 4.5144E-05  ( 0.498    ,  0.510    ,   0.00    ) |  4.514E-05
>       28 5.3879E-04 4.1959E-05  ( 0.498    ,  0.510    ,   0.00    ) |  4.196E-05
>       29 5.8075E-04 2.3721E-05  ( 0.506    ,  0.498    ,   0.00    ) |  2.372E-05
>   iteration, no. not moved =  0,  17
>   iteration, no. not moved =  1,  2
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  88
>  refined: total blocks =  117
>       30 6.0447E-04 1.0000E-10  ( 0.506    ,  0.498    ,   0.00    ) |  4.269E-18
>       31 6.0447E-04 1.0000E-10  ( 0.498    ,  0.498    ,   0.00    ) |  2.897E-56
>       32 6.0447E-04 1.0000E-10  ( 0.510    ,  0.494    ,   0.00    ) |  1.206-156
>  dtCheck= 0.
>  DRIVER_ABORT: [Hydro]: Computed dt is not positive! Aborting!
> --------------------------------------------------------------------------
> MPI_ABORT was invoked on rank 1 in communicator MPI_COMM_WORLD
> with errorcode 1.
> 
> NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
> You may or may not see output from other processes, depending on
> exactly when Open MPI kills them.
> --------------------------------------------------------------------------
> 
> 
> In the above case, the glitch happened after a refinement, but it does not always happen after a refinement. Here I changed the max level of refinement. After step 69 the glitch happens.
> 
> [acalder at fj-debug1 object]$ vi flash.par
> [acalder at fj-debug1 object]$ !mpi
> mpiexec -n 8 ./flash4
>  Grid_init: resolution based on runtime params:
>   lrefine          dx              dy
>       1             0.125           0.125
>       2             0.063           0.063
>       3             0.031           0.031
>       4             0.016           0.016
>       5             0.008           0.008
>       6             0.004           0.004
>       7             0.002           0.002
>  MaterialProperties initialized
>  Cosmology initialized
>  Source terms initialized
>  sim_rhoAmbient is 1.
>   iteration, no. not moved =  2*0
>  refined: total leaf blocks =  1
>  refined: total blocks =  1
>  [amr_morton_process]: Initializing surr_blks using standard orrery implementation
>  INFO: Grid_fillGuardCells is ignoring masking.
>   iteration, no. not moved =  2*0
>  refined: total leaf blocks =  4
>  refined: total blocks =  5
>   iteration, no. not moved =  0,  3
>   iteration, no. not moved =  2*1
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  16
>  refined: total blocks =  21
>   iteration, no. not moved =  0,  6
>   iteration, no. not moved =  1,  0
>  refined: total leaf blocks =  28
>  refined: total blocks =  37
>   iteration, no. not moved =  0,  9
>   iteration, no. not moved =  1,  2
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  40
>  refined: total blocks =  53
>   iteration, no. not moved =  0,  16
>   iteration, no. not moved =  1,  2
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  52
>  refined: total blocks =  69
>   iteration, no. not moved =  0,  20
>   iteration, no. not moved =  2*1
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  64
>  refined: total blocks =  85
>   Finished with Grid_initDomain, no restart
>  Ready to call Hydro_init
>  Hydro initialized
>  Gravity initialized
>  Initial dt verified
>  *** Wrote checkpoint file to sedov_hdf5_chk_0000 ****
>  *** Wrote plotfile to sedov_hdf5_plt_cnt_0000 ****
>  Initial plotfile written
>  Driver init all done
>        n          t         dt  (         x,          y,          z) |  dt_hydro
>        1 1.0000E-10 2.0000E-10  ( 0.499    ,  0.491    ,   0.00    ) |  5.060E-05
>        2 3.0000E-10 4.0000E-10  ( 0.499    ,  0.493    ,   0.00    ) |  5.060E-05
>        3 7.0000E-10 8.0000E-10  ( 0.499    ,  0.493    ,   0.00    ) |  5.060E-05
>        4 1.5000E-09 1.6000E-09  ( 0.499    ,  0.493    ,   0.00    ) |  5.060E-05
>        5 3.1000E-09 3.2000E-09  ( 0.499    ,  0.493    ,   0.00    ) |  5.060E-05
>        6 6.3000E-09 6.4000E-09  ( 0.499    ,  0.493    ,   0.00    ) |  5.059E-05
>        7 1.2700E-08 1.2800E-08  ( 0.499    ,  0.493    ,   0.00    ) |  5.059E-05
>        8 2.5500E-08 2.5600E-08  ( 0.499    ,  0.493    ,   0.00    ) |  5.058E-05
>        9 5.1100E-08 5.1200E-08  ( 0.499    ,  0.495    ,   0.00    ) |  5.057E-05
>       10 1.0230E-07 1.0240E-07  ( 0.499    ,  0.493    ,   0.00    ) |  5.054E-05
>       11 2.0470E-07 2.0480E-07  ( 0.499    ,  0.493    ,   0.00    ) |  5.048E-05
>       12 4.0950E-07 4.0960E-07  ( 0.499    ,  0.493    ,   0.00    ) |  5.036E-05
>       13 8.1910E-07 8.1920E-07  ( 0.499    ,  0.493    ,   0.00    ) |  5.014E-05
>   iteration, no. not moved =  0,  19
>   iteration, no. not moved =  2*1
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  112
>  refined: total blocks =  149
>       14 1.6383E-06 1.6384E-06  ( 0.499    ,  0.493    ,   0.00    ) |  4.968E-05
>       15 3.2767E-06 3.2768E-06  ( 0.499    ,  0.493    ,   0.00    ) |  4.881E-05
>       16 6.5535E-06 6.5536E-06  ( 0.499    ,  0.493    ,   0.00    ) |  4.719E-05
>       17 1.3107E-05 1.3107E-05  ( 0.499    ,  0.487    ,   0.00    ) |  4.400E-05
>       18 2.6214E-05 2.6214E-05  ( 0.499    ,  0.487    ,   0.00    ) |  3.861E-05
>       19 5.2429E-05 3.1822E-05  ( 0.499    ,  0.487    ,   0.00    ) |  3.182E-05
>   iteration, no. not moved =  0,  56
>   iteration, no. not moved =  1,  2
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  160
>  refined: total blocks =  213
>       20 8.4250E-05 2.8211E-05  ( 0.499    ,  0.487    ,   0.00    ) |  2.821E-05
>       21 1.1246E-04 2.6569E-05  ( 0.499    ,  0.487    ,   0.00    ) |  2.657E-05
>       22 1.3903E-04 2.5651E-05  ( 0.499    ,  0.487    ,   0.00    ) |  2.565E-05
> 
> snip
> 
>       64 5.0247E-04 1.7003E-06  ( 0.501    ,  0.501    ,   0.00    ) |  1.700E-06
>       65 5.0417E-04 1.6235E-06  ( 0.501    ,  0.501    ,   0.00    ) |  1.624E-06
>       66 5.0580E-04 1.5568E-06  ( 0.501    ,  0.501    ,   0.00    ) |  1.557E-06
>       67 5.0735E-04 1.4925E-06  ( 0.501    ,  0.501    ,   0.00    ) |  1.493E-06
>       68 5.0885E-04 1.4258E-06  ( 0.501    ,  0.501    ,   0.00    ) |  1.426E-06
>       69 5.1027E-04 1.3543E-06  ( 0.501    ,  0.501    ,   0.00    ) |  1.354E-06
>       70 5.1163E-04 1.0000E-10  ( 0.513    ,  0.489    ,   0.00    ) |  1.888E-14
>       71 5.1163E-04 1.0000E-10  ( 0.487    ,  0.489    ,   0.00    ) |  3.189E-44
>  dtCheck= 0.
>  DRIVER_ABORT: [Hydro]: Computed dt is not positive! Aborting!
> --------------------------------------------------------------------------
> MPI_ABORT was invoked on rank 1 in communicator MPI_COMM_WORLD
> with errorcode 1.
> 
> NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
> You may or may not see output from other processes, depending on
> exactly when Open MPI kills them.
> --------------------------------------------------------------------------
> [acalder at fj-debug1 object]$
> 
> 
> Just to play with it, I tried the split hydro solver. In Units, I see among others
> 
> INCLUDE Driver/DriverMain/Split
> INCLUDE physics/Hydro/HydroMain/split/PPM/PPMKernel
> 
> And when I run it, I see an intriguing warning
> 
> WARNING after gc filling: min. unk(EINT_VAR)=9.9999999735241242E-11           PE=4     block=6
>                     type=1
> 
> Here's the output of a run:
> 
> [acalder at fj-debug1 object]$ !mpi
> mpiexec -n 8 ./flash4
>  RuntimeParameters_read:  ignoring unknown parameter "order"...
>  RuntimeParameters_read:  ignoring unknown parameter "slopeLimiter"...
>  RuntimeParameters_read:  ignoring unknown parameter "LimitedSlopeBeta"...
>  RuntimeParameters_read:  ignoring unknown parameter "use_avisc"...
>  RuntimeParameters_read:  ignoring unknown parameter "use_flattening"...
>  RuntimeParameters_read:  ignoring unknown parameter "use_upwindTVD"...
>  RuntimeParameters_read:  ignoring unknown parameter "RiemannSolver"...
>  RuntimeParameters_read:  ignoring unknown parameter "entropy"...
>  RuntimeParameters_read:  ignoring unknown parameter "shockDetect"...
>  Grid_init: resolution based on runtime params:
>   lrefine          dx              dy
>       1             0.125           0.125
>       2             0.063           0.063
>       3             0.031           0.031
>       4             0.016           0.016
>       5             0.008           0.008
>       6             0.004           0.004
>  MaterialProperties initialized
>  Cosmology initialized
>  Source terms initialized
>  sim_rhoAmbient is 1.
>   iteration, no. not moved =  2*0
>  refined: total leaf blocks =  1
>  refined: total blocks =  1
>  [amr_morton_process]: Initializing surr_blks using standard orrery implementation
>  INFO: Grid_fillGuardCells is ignoring masking.
>   iteration, no. not moved =  2*0
>  refined: total leaf blocks =  4
>  refined: total blocks =  5
>   iteration, no. not moved =  0,  3
>   iteration, no. not moved =  2*1
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  16
>  refined: total blocks =  21
>   iteration, no. not moved =  0,  6
>   iteration, no. not moved =  1,  0
>  refined: total leaf blocks =  28
>  refined: total blocks =  37
>   iteration, no. not moved =  0,  9
>   iteration, no. not moved =  1,  2
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  40
>  refined: total blocks =  53
>   iteration, no. not moved =  0,  16
>   iteration, no. not moved =  1,  2
>   iteration, no. not moved =  2,  0
>  refined: total leaf blocks =  52
>  refined: total blocks =  69
>   Finished with Grid_initDomain, no restart
>  Ready to call Hydro_init
>  Info: Hydro_init has set hy_specialFluxVars to  3
>  Hydro initialized
>  Gravity initialized
>  Initial dt verified
>  *** Wrote checkpoint file to sedov_hdf5_chk_0000 ****
>  *** Wrote plotfile to sedov_hdf5_plt_cnt_0000 ****
>  Initial plotfile written
>  Driver init all done
>        n          t         dt  (         x,          y,          z) |  dt_hydro
>        1 2.0000E-10 2.0000E-10  ( 0.498    ,  0.502    ,   0.00    ) |  7.969E-05
> WARNING after gc filling: min. unk(EINT_VAR)=9.9999999735241242E-11           PE=4     block=6
>                     type=1
>  16  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  15  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  14  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  13  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  12  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  11  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  10  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   9  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   8  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   7  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.26E-04 0.
> 10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   6  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.26E-04 0.
> 10E-09 0.25E-04 0.25E-04 0.25E-04 0.18E-04
>   5  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.26E-04 0.
> 10E-09 0.25E-04 0.25E-04 0.25E-04 0.22E-04
>   4  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 15E-04 0.25E-04 0.25E-04 0.25E-04 0.13E-04
>   3  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 15E-04 0.25E-04 0.25E-04 0.25E-04 0.17E-04
>   2  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 15E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   1  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 23E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
> WARNING after gc filling: min. unk(EINT_VAR)=9.9999999735241242E-11           PE=5     block=3
>                     type=1
>  16  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  15  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  14  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  13  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  12  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  11  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  10  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   9  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   8  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   7  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   6  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   5  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   4  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   3  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   2  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   1  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
> WARNING after gc filling: min. unk(EINT_VAR)=9.9999999384891323E-11           PE=4     block=6
>                     type=1
>  16  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  15  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  14  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  13  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  12  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  11  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>  10  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   9  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   8  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.26E-04 0.
> 10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   7  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.34E-04 0.
> 10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04
>   6  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.34E-04 0.
> 10E-09 0.25E-04 0.25E-04 0.25E-04 0.50E-04
>   5  0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.34E-04 0.
> 10E-09 0.25E-04 0.25E-04 0.25E-04 0.81E-04
>   4  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 28E-05 0.25E-04 0.25E-04 0.25E-04 0.13E-04
>   3  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 28E-05 0.25E-04 0.25E-04 0.25E-04 0.15E-04
>   2  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 28E-05 0.24E-04 0.25E-04 0.25E-04 0.25E-04
>   1  0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.
> 21E-04 0.24E-04 0.25E-04 0.25E-04 0.25E-04
> WARNING after gc filling: min. unk(EINT_VAR)=9.9999999384891323E-11           PE=5     block=3
>                     type=1
> 
> 
> Finally, here are warnings.
> 
> 
> Several things like this:
> 
> USE_16_API -O0 -c -DMAXBLOCKS=1000 -DNXB=8 -DNYB=8 -DNZB=1 -DN_DIM=2 io_attribute.c
> io_attribute.c: In function ‘io_attribute_create_’:
> io_attribute.c:66:5: warning: implicit declaration of function ‘Driver_abortFlashC’ [-Wimplicit-function-d
> eclaration]
>      Driver_abortFlashC("[io_attribute_create]: Unknown I/O");
>      ^~~~~~~~~~~~~~~~~~
> 
> 
> And this one:
> 
> /lustre/projects/global/software/a64fx/openmpi/4.0.5/bin/mpicc -I/cm/shared/apps/hdf5/1.10.1/include -DH5_
> USE_16_API -O0 -c -DMAXBLOCKS=1000 -DNXB=8 -DNYB=8 -DNZB=1 -DN_DIM=2 io_h5write_generic_real_arr.c
> io_h5write_generic_int_arr.c: In function ‘io_h5write_generic_int_arr_’:
> io_h5write_generic_int_arr.c:82:31: warning: implicit declaration of function ‘malloc’ [-Wimplicit-functio
> n-declaration]
>    dataset_name_new = (char *) malloc((*name_len) + 1 * sizeof(char));
>                                ^~~~~~
> io_h5write_generic_int_arr.c:82:31: warning: incompatible implicit declaration of built-in function ‘mallo
> c’
> io_h5write_generic_int_arr.c:82:31: note: include ‘<stdlib.h>’ or provide a declaration of ‘malloc’
> io_h5write_generic_int_arr.c:6:1:
> +#include <stdlib.h>
> 
> io_h5write_generic_int_arr.c:82:31:
>    dataset_name_new = (char *) malloc((*name_len) + 1 * sizeof(char));
>                                ^~~~~~
> io_h5write_generic_int_arr.c:87:3: warning: implicit declaration of function ‘strncpy’ [-Wimplicit-functio
> n-declaration]
>    strncpy(dataset_name_new, dataset_name, *name_len);
>    ^~~~~~~
> io_h5write_generic_int_arr.c:87:3: warning: incompatible implicit declaration of built-in function ‘strncp
> y’
> io_h5write_generic_int_arr.c:87:3: note: include ‘<string.h>’ or provide a declaration of ‘strncpy’
> io_h5write_generic_int_arr.c:6:1:
> +#include <string.h>
> 
> io_h5write_generic_int_arr.c:87:3:
>    strncpy(dataset_name_new, dataset_name, *name_len);
>    ^~~~~~~
> io_h5write_generic_int_arr.c:187:3: warning: implicit declaration of function ‘free’ [-Wimplicit-function-
> declaration]
>    free(dataset_name_new);
>    ^~~~
> io_h5write_generic_int_arr.c:187:3: warning: incompatible implicit declaration of built-in function ‘free’
> io_h5write_generic_int_arr.c:187:3: note: include ‘<stdlib.h>’ or provide a declaration of ‘free’
> /lustre/projects/global/software/a64fx/openmpi/4.0.5/bin/mpicc -I/cm/shared/apps/hdf5/1.10.1/include -DH5_
> USE_16_API -O0 -c -DMAXBLOCKS=1000 -DNXB=8 -DNYB=8 -DNZB=1 -DN_DIM=2 io_h5write_generic_real_arr.c
> io_h5write_generic_real_arr.c: In function ‘io_h5write_generic_real_arr_’:
> io_h5write_generic_real_arr.c:33:31: warning: implicit declaration of function ‘malloc’ [-Wimplicit-functi
> on-declaration]
>    dataset_name_new = (char *) malloc((*name_len) + 1 * sizeof(char));
>                                ^~~~~~
> io_h5write_generic_real_arr.c:33:31: warning: incompatible implicit declaration of built-in function ‘mall
> oc’
> io_h5write_generic_real_arr.c:33:31: note: include ‘<stdlib.h>’ or provide a declaration of ‘malloc’
> io_h5write_generic_real_arr.c:6:1:
> +#include <stdlib.h>
> 
> io_h5write_generic_real_arr.c:33:31:
>    dataset_name_new = (char *) malloc((*name_len) + 1 * sizeof(char));
>                                ^~~~~~
> io_h5write_generic_real_arr.c:38:3: warning: implicit declaration of function ‘strncpy’ [-Wimplicit-functi
> on-declaration]
>    strncpy(dataset_name_new, dataset_name, *name_len);
>    ^~~~~~~
> io_h5write_generic_real_arr.c:38:3: warning: incompatible implicit declaration of built-in function ‘strnc
> py’
> io_h5write_generic_real_arr.c:38:3: note: include ‘<string.h>’ or provide a declaration of ‘strncpy’
> io_h5write_generic_real_arr.c:6:1:
> +#include <string.h>
> 
> io_h5write_generic_real_arr.c:38:3:
>    strncpy(dataset_name_new, dataset_name, *name_len);
>    ^~~~~~~
> io_h5write_generic_real_arr.c:139:3: warning: implicit declaration of function ‘free’ [-Wimplicit-function
> -declaration]
>    free(dataset_name_new);
>    ^~~~
> io_h5write_generic_real_arr.c:139:3: warning: incompatible implicit declaration of built-in function ‘free
>> io_h5write_generic_real_arr.c:139:3: note: include ‘<stdlib.h>’ or provide a declaration of ‘free’
> 
> 
> 
> Thanks for any advice or suggestions!
> 
> Alan Calder
> 
> 
> --
> Alan C. Calder
> Department of Physics and Astronomy
> State University of New York at Stony Brook
> Stony Brook, NY 11794-3800
> 
> office: ESS 438
> phone:  (631) 632-1176
> fax:  (631) 632-1745
> web: http://www.astro.sunysb.edu/acalder <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.astro.sunysb.edu_acalder&d=DwMFaQ&c=qKdtBuuu6dQK9MsRUVJ2DPXW6oayO8fu4TfEHS8sGNk&r=D67MpwQXy8oi2wblxhDSww&m=WYqObZU87Lx3v_TqEQKNMv0UxGqG13upy_pgPEhPtpU&s=4sZXrGGf2UvD3DP_qbYGk2gp3k5EE-qxhehkqcCgXEI&e=>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://flash.rochester.edu/pipermail/flash-users/attachments/20201112/97a5d989/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: Message signed with OpenPGP
URL: <http://flash.rochester.edu/pipermail/flash-users/attachments/20201112/97a5d989/attachment-0001.sig>


More information about the flash-users mailing list