<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">From the sounds of this, it looks like an optimization error. I’d try turning optimization off and see if it cures it, then you can dig into it.<div class=""><br class=""></div><div class="">-eddie<br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Nov 11, 2020, at 8:20 PM, Alan Calder <<a href="mailto:alan.calder@stonybrook.edu" class="">alan.calder@stonybrook.edu</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><meta http-equiv="Content-Type" content="text/html; charset=utf-8" class=""><div dir="ltr" class="">Hello,<br class=""><br class="">I am writing to describe an issue with running Flash4 on a Cray A64FX machine with the Cray compiler, version 10.0.1. We are running Flash 4.6.2. I thought I would describe what I am seeing so as to ask for any <br class="">advice before digging in further. I am not completely sure if this is a bug, hence my sending it here. <br class=""><br class="">First I should note that things work well with the Gnu compilers. We do not see this problem when compiling with the gnu compilers.<br class=""><br class="">The shortest possible summary is that the code seems to enter an unphysical state and crash, and with the split hydro solver I see a warning<br class=""><br class="">WARNING after gc filling: min. unk(EINT_VAR)=9.9999999735241242E-11 PE=4 block=6 <br class=""> type=1<br class=""><br class="">We compile with -c -g -G 2 -s real64 -s integer32 and the code generates a few warnings, none of which seem relevant. We've tried a few problems, too, and are seeing the same issues. For this report I ran the Sedov problem. <br class=""><br class="">With the default units, and set up with <br class=""><br class="">./setup Sedov -auto -site=<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__ookami.stonybrook.edu&d=DwMFaQ&c=qKdtBuuu6dQK9MsRUVJ2DPXW6oayO8fu4TfEHS8sGNk&r=D67MpwQXy8oi2wblxhDSww&m=WYqObZU87Lx3v_TqEQKNMv0UxGqG13upy_pgPEhPtpU&s=EfWCdWjTD8wQR3cFPWYv-9y2_QUWDSyhrjQwdVCsI94&e=" target="_blank" class="">ookami.stonybrook.edu</a><br class=""><br class="">the code runs a while and then suddenly the solution seems to hit some bad state causing the time step to suddenly drop and then the code crashes.<br class=""><br class="">[acalder@fj-debug1 object]$ !mpi<br class="">mpiexec -n 8 ./flash4<br class=""> Grid_init: resolution based on runtime params:<br class=""> lrefine dx dy<br class=""> 1 0.125 0.125<br class=""> 2 0.063 0.063<br class=""> 3 0.031 0.031<br class=""> 4 0.016 0.016<br class=""> 5 0.008 0.008<br class=""> 6 0.004 0.004<br class=""> MaterialProperties initialized<br class=""> Cosmology initialized<br class=""> Source terms initialized<br class=""> sim_rhoAmbient is 1.<br class=""> iteration, no. not moved = 2*0<br class=""> refined: total leaf blocks = 1<br class=""> refined: total blocks = 1<br class=""> [amr_morton_process]: Initializing surr_blks using standard orrery implementation<br class=""> INFO: Grid_fillGuardCells is ignoring masking.<br class=""> iteration, no. not moved = 2*0<br class=""> refined: total leaf blocks = 4<br class=""> refined: total blocks = 5<br class=""> iteration, no. not moved = 0, 3<br class=""> iteration, no. not moved = 2*1<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 16<br class=""> refined: total blocks = 21<br class=""> iteration, no. not moved = 0, 6<br class=""> iteration, no. not moved = 1, 0<br class=""> refined: total leaf blocks = 28<br class=""> refined: total blocks = 37<br class=""> iteration, no. not moved = 0, 9<br class=""> iteration, no. not moved = 1, 2<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 40<br class=""> refined: total blocks = 53<br class=""> iteration, no. not moved = 0, 16<br class=""> iteration, no. not moved = 1, 2<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 52<br class=""> refined: total blocks = 69<br class=""> Finished with Grid_initDomain, no restart<br class=""> Ready to call Hydro_init<br class=""> Hydro initialized<br class=""> Gravity initialized<br class=""> Initial dt verified<br class=""> *** Wrote checkpoint file to sedov_hdf5_chk_0000 ****<br class=""> *** Wrote plotfile to sedov_hdf5_plt_cnt_0000 ****<br class=""> Initial plotfile written<br class=""> Driver init all done<br class=""> n t dt ( x, y, z) | dt_hydro <br class=""> 1 1.0000E-10 2.0000E-10 ( 0.498 , 0.498 , 0.00 ) | 1.012E-04<br class=""> 2 3.0000E-10 4.0000E-10 ( 0.498 , 0.494 , 0.00 ) | 1.012E-04<br class=""> 3 7.0000E-10 8.0000E-10 ( 0.498 , 0.494 , 0.00 ) | 1.012E-04<br class=""> 4 1.5000E-09 1.6000E-09 ( 0.498 , 0.494 , 0.00 ) | 1.012E-04<br class=""><div class=""><br class=""></div><div class="">snip</div><div class=""><br class=""></div> 26 4.4575E-04 4.7891E-05 ( 0.502 , 0.510 , 0.00 ) | 4.789E-05<br class=""> 27 4.9364E-04 4.5144E-05 ( 0.498 , 0.510 , 0.00 ) | 4.514E-05<br class=""> 28 5.3879E-04 4.1959E-05 ( 0.498 , 0.510 , 0.00 ) | 4.196E-05<br class=""> 29 5.8075E-04 2.3721E-05 ( 0.506 , 0.498 , 0.00 ) | 2.372E-05<br class=""> iteration, no. not moved = 0, 17<br class=""> iteration, no. not moved = 1, 2<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 88<br class=""> refined: total blocks = 117<br class=""> 30 6.0447E-04 1.0000E-10 ( 0.506 , 0.498 , 0.00 ) | 4.269E-18<br class=""> 31 6.0447E-04 1.0000E-10 ( 0.498 , 0.498 , 0.00 ) | 2.897E-56<br class=""> 32 6.0447E-04 1.0000E-10 ( 0.510 , 0.494 , 0.00 ) | 1.206-156<br class=""> dtCheck= 0.<br class=""> DRIVER_ABORT: [Hydro]: Computed dt is not positive! Aborting!<br class="">--------------------------------------------------------------------------<br class="">MPI_ABORT was invoked on rank 1 in communicator MPI_COMM_WORLD<br class="">with errorcode 1.<br class=""><br class="">NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.<br class="">You may or may not see output from other processes, depending on<br class="">exactly when Open MPI kills them.<br class="">--------------------------------------------------------------------------<br class=""><br class=""><br class="">In the above case, the glitch happened after a refinement, but it does not always happen after a refinement. Here I changed the max level of refinement. After step 69 the glitch happens.<br class=""><br class="">[acalder@fj-debug1 object]$ vi flash.par<br class="">[acalder@fj-debug1 object]$ !mpi<br class="">mpiexec -n 8 ./flash4<br class=""> Grid_init: resolution based on runtime params:<br class=""> lrefine dx dy<br class=""> 1 0.125 0.125<br class=""> 2 0.063 0.063<br class=""> 3 0.031 0.031<br class=""> 4 0.016 0.016<br class=""> 5 0.008 0.008<br class=""> 6 0.004 0.004<br class=""> 7 0.002 0.002<br class=""> MaterialProperties initialized<br class=""> Cosmology initialized<br class=""> Source terms initialized<br class=""> sim_rhoAmbient is 1.<br class=""> iteration, no. not moved = 2*0<br class=""> refined: total leaf blocks = 1<br class=""> refined: total blocks = 1<br class=""> [amr_morton_process]: Initializing surr_blks using standard orrery implementation<br class=""> INFO: Grid_fillGuardCells is ignoring masking.<br class=""> iteration, no. not moved = 2*0<br class=""> refined: total leaf blocks = 4<br class=""> refined: total blocks = 5<br class=""> iteration, no. not moved = 0, 3<br class=""> iteration, no. not moved = 2*1<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 16<br class=""> refined: total blocks = 21<br class=""> iteration, no. not moved = 0, 6<br class=""> iteration, no. not moved = 1, 0<br class=""> refined: total leaf blocks = 28<br class=""> refined: total blocks = 37<br class=""> iteration, no. not moved = 0, 9<br class=""> iteration, no. not moved = 1, 2<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 40<br class=""> refined: total blocks = 53<br class=""> iteration, no. not moved = 0, 16<br class=""> iteration, no. not moved = 1, 2<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 52<br class=""> refined: total blocks = 69<br class=""> iteration, no. not moved = 0, 20<br class=""> iteration, no. not moved = 2*1<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 64<br class=""> refined: total blocks = 85<br class=""> Finished with Grid_initDomain, no restart<br class=""> Ready to call Hydro_init<br class=""> Hydro initialized<br class=""> Gravity initialized<br class=""> Initial dt verified<br class=""> *** Wrote checkpoint file to sedov_hdf5_chk_0000 ****<br class=""> *** Wrote plotfile to sedov_hdf5_plt_cnt_0000 ****<br class=""> Initial plotfile written<br class=""> Driver init all done<br class=""> n t dt ( x, y, z) | dt_hydro <br class=""> 1 1.0000E-10 2.0000E-10 ( 0.499 , 0.491 , 0.00 ) | 5.060E-05<br class=""> 2 3.0000E-10 4.0000E-10 ( 0.499 , 0.493 , 0.00 ) | 5.060E-05<br class=""> 3 7.0000E-10 8.0000E-10 ( 0.499 , 0.493 , 0.00 ) | 5.060E-05<br class=""> 4 1.5000E-09 1.6000E-09 ( 0.499 , 0.493 , 0.00 ) | 5.060E-05<br class=""> 5 3.1000E-09 3.2000E-09 ( 0.499 , 0.493 , 0.00 ) | 5.060E-05<br class=""> 6 6.3000E-09 6.4000E-09 ( 0.499 , 0.493 , 0.00 ) | 5.059E-05<br class=""> 7 1.2700E-08 1.2800E-08 ( 0.499 , 0.493 , 0.00 ) | 5.059E-05<br class=""> 8 2.5500E-08 2.5600E-08 ( 0.499 , 0.493 , 0.00 ) | 5.058E-05<br class=""> 9 5.1100E-08 5.1200E-08 ( 0.499 , 0.495 , 0.00 ) | 5.057E-05<br class=""> 10 1.0230E-07 1.0240E-07 ( 0.499 , 0.493 , 0.00 ) | 5.054E-05<br class=""> 11 2.0470E-07 2.0480E-07 ( 0.499 , 0.493 , 0.00 ) | 5.048E-05<br class=""> 12 4.0950E-07 4.0960E-07 ( 0.499 , 0.493 , 0.00 ) | 5.036E-05<br class=""> 13 8.1910E-07 8.1920E-07 ( 0.499 , 0.493 , 0.00 ) | 5.014E-05<br class=""> iteration, no. not moved = 0, 19<br class=""> iteration, no. not moved = 2*1<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 112<br class=""> refined: total blocks = 149<br class=""> 14 1.6383E-06 1.6384E-06 ( 0.499 , 0.493 , 0.00 ) | 4.968E-05<br class=""> 15 3.2767E-06 3.2768E-06 ( 0.499 , 0.493 , 0.00 ) | 4.881E-05<br class=""> 16 6.5535E-06 6.5536E-06 ( 0.499 , 0.493 , 0.00 ) | 4.719E-05<br class=""> 17 1.3107E-05 1.3107E-05 ( 0.499 , 0.487 , 0.00 ) | 4.400E-05<br class=""> 18 2.6214E-05 2.6214E-05 ( 0.499 , 0.487 , 0.00 ) | 3.861E-05<br class=""> 19 5.2429E-05 3.1822E-05 ( 0.499 , 0.487 , 0.00 ) | 3.182E-05<br class=""> iteration, no. not moved = 0, 56<br class=""> iteration, no. not moved = 1, 2<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 160<br class=""> refined: total blocks = 213<br class=""> 20 8.4250E-05 2.8211E-05 ( 0.499 , 0.487 , 0.00 ) | 2.821E-05<br class=""> 21 1.1246E-04 2.6569E-05 ( 0.499 , 0.487 , 0.00 ) | 2.657E-05<br class=""> 22 1.3903E-04 2.5651E-05 ( 0.499 , 0.487 , 0.00 ) | 2.565E-05<br class=""><div class=""><br class=""></div><div class="">snip</div><div class=""><br class=""></div> 64 5.0247E-04 1.7003E-06 ( 0.501 , 0.501 , 0.00 ) | 1.700E-06<br class=""> 65 5.0417E-04 1.6235E-06 ( 0.501 , 0.501 , 0.00 ) | 1.624E-06<br class=""> 66 5.0580E-04 1.5568E-06 ( 0.501 , 0.501 , 0.00 ) | 1.557E-06<br class=""> 67 5.0735E-04 1.4925E-06 ( 0.501 , 0.501 , 0.00 ) | 1.493E-06<br class=""> 68 5.0885E-04 1.4258E-06 ( 0.501 , 0.501 , 0.00 ) | 1.426E-06<br class=""> 69 5.1027E-04 1.3543E-06 ( 0.501 , 0.501 , 0.00 ) | 1.354E-06<br class=""> 70 5.1163E-04 1.0000E-10 ( 0.513 , 0.489 , 0.00 ) | 1.888E-14<br class=""> 71 5.1163E-04 1.0000E-10 ( 0.487 , 0.489 , 0.00 ) | 3.189E-44<br class=""> dtCheck= 0.<br class=""> DRIVER_ABORT: [Hydro]: Computed dt is not positive! Aborting!<br class="">--------------------------------------------------------------------------<br class="">MPI_ABORT was invoked on rank 1 in communicator MPI_COMM_WORLD<br class="">with errorcode 1.<br class=""><br class="">NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.<br class="">You may or may not see output from other processes, depending on<br class="">exactly when Open MPI kills them.<br class="">--------------------------------------------------------------------------<br class="">[acalder@fj-debug1 object]$ <br class=""><br class=""><br class="">Just to play with it, I tried the split hydro solver. In Units, I see among others<br class=""><br class="">INCLUDE Driver/DriverMain/Split<br class="">INCLUDE physics/Hydro/HydroMain/split/PPM/PPMKernel<br class=""><br class="">And when I run it, I see an intriguing warning<br class=""><br class="">WARNING after gc filling: min. unk(EINT_VAR)=9.9999999735241242E-11 PE=4 block=6 <br class=""> type=1<br class=""><br class="">Here's the output of a run:<br class=""><br class="">[acalder@fj-debug1 object]$ !mpi<br class="">mpiexec -n 8 ./flash4<br class=""> RuntimeParameters_read: ignoring unknown parameter "order"...<br class=""> RuntimeParameters_read: ignoring unknown parameter "slopeLimiter"...<br class=""> RuntimeParameters_read: ignoring unknown parameter "LimitedSlopeBeta"...<br class=""> RuntimeParameters_read: ignoring unknown parameter "use_avisc"...<br class=""> RuntimeParameters_read: ignoring unknown parameter "use_flattening"...<br class=""> RuntimeParameters_read: ignoring unknown parameter "use_upwindTVD"...<br class=""> RuntimeParameters_read: ignoring unknown parameter "RiemannSolver"...<br class=""> RuntimeParameters_read: ignoring unknown parameter "entropy"...<br class=""> RuntimeParameters_read: ignoring unknown parameter "shockDetect"...<br class=""> Grid_init: resolution based on runtime params:<br class=""> lrefine dx dy<br class=""> 1 0.125 0.125<br class=""> 2 0.063 0.063<br class=""> 3 0.031 0.031<br class=""> 4 0.016 0.016<br class=""> 5 0.008 0.008<br class=""> 6 0.004 0.004<br class=""> MaterialProperties initialized<br class=""> Cosmology initialized<br class=""> Source terms initialized<br class=""> sim_rhoAmbient is 1.<br class=""> iteration, no. not moved = 2*0<br class=""> refined: total leaf blocks = 1<br class=""> refined: total blocks = 1<br class=""> [amr_morton_process]: Initializing surr_blks using standard orrery implementation<br class=""> INFO: Grid_fillGuardCells is ignoring masking.<br class=""> iteration, no. not moved = 2*0<br class=""> refined: total leaf blocks = 4<br class=""> refined: total blocks = 5<br class=""> iteration, no. not moved = 0, 3<br class=""> iteration, no. not moved = 2*1<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 16<br class=""> refined: total blocks = 21<br class=""> iteration, no. not moved = 0, 6<br class=""> iteration, no. not moved = 1, 0<br class=""> refined: total leaf blocks = 28<br class=""> refined: total blocks = 37<br class=""> iteration, no. not moved = 0, 9<br class=""> iteration, no. not moved = 1, 2<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 40<br class=""> refined: total blocks = 53<br class=""> iteration, no. not moved = 0, 16<br class=""> iteration, no. not moved = 1, 2<br class=""> iteration, no. not moved = 2, 0<br class=""> refined: total leaf blocks = 52<br class=""> refined: total blocks = 69<br class=""> Finished with Grid_initDomain, no restart<br class=""> Ready to call Hydro_init<br class=""> Info: Hydro_init has set hy_specialFluxVars to 3<br class=""> Hydro initialized<br class=""> Gravity initialized<br class=""> Initial dt verified<br class=""> *** Wrote checkpoint file to sedov_hdf5_chk_0000 ****<br class=""> *** Wrote plotfile to sedov_hdf5_plt_cnt_0000 ****<br class=""> Initial plotfile written<br class=""> Driver init all done<br class=""> n t dt ( x, y, z) | dt_hydro <br class=""> 1 2.0000E-10 2.0000E-10 ( 0.498 , 0.502 , 0.00 ) | 7.969E-05<br class="">WARNING after gc filling: min. unk(EINT_VAR)=9.9999999735241242E-11 PE=4 block=6 <br class=""> type=1 <br class=""> 16 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 15 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 14 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 13 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 12 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 11 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 10 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 9 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 8 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 7 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.26E-04 0.<br class="">10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 6 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.26E-04 0.<br class="">10E-09 0.25E-04 0.25E-04 0.25E-04 0.18E-04<br class=""> 5 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.26E-04 0.<br class="">10E-09 0.25E-04 0.25E-04 0.25E-04 0.22E-04<br class=""> 4 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">15E-04 0.25E-04 0.25E-04 0.25E-04 0.13E-04<br class=""> 3 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">15E-04 0.25E-04 0.25E-04 0.25E-04 0.17E-04<br class=""> 2 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">15E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 1 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">23E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class="">WARNING after gc filling: min. unk(EINT_VAR)=9.9999999735241242E-11 PE=5 block=3 <br class=""> type=1 <br class=""> 16 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 15 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 14 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 13 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 12 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 11 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 10 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 9 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 8 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 7 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 6 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 5 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 4 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 3 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 2 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 1 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class="">WARNING after gc filling: min. unk(EINT_VAR)=9.9999999384891323E-11 PE=4 block=6 <br class=""> type=1 <br class=""> 16 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 15 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 14 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 13 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 12 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 11 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 10 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 9 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 8 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.26E-04 0.<br class="">10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 7 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.34E-04 0.<br class="">10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 6 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.34E-04 0.<br class="">10E-09 0.25E-04 0.25E-04 0.25E-04 0.50E-04<br class=""> 5 0.25E-04 0.25E-04 0.10E-09 0.10E-09 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.34E-04 0.<br class="">10E-09 0.25E-04 0.25E-04 0.25E-04 0.81E-04<br class=""> 4 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">28E-05 0.25E-04 0.25E-04 0.25E-04 0.13E-04<br class=""> 3 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">28E-05 0.25E-04 0.25E-04 0.25E-04 0.15E-04<br class=""> 2 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">28E-05 0.24E-04 0.25E-04 0.25E-04 0.25E-04<br class=""> 1 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.25E-04 0.<br class="">21E-04 0.24E-04 0.25E-04 0.25E-04 0.25E-04<br class="">WARNING after gc filling: min. unk(EINT_VAR)=9.9999999384891323E-11 PE=5 block=3 <br class=""> type=1 <br class=""><br class=""><br class="">Finally, here are warnings.<br class=""><br class=""><br class="">Several things like this:<br class=""><br class="">USE_16_API -O0 -c -DMAXBLOCKS=1000 -DNXB=8 -DNYB=8 -DNZB=1 -DN_DIM=2 io_attribute.c<br class="">io_attribute.c: In function ‘io_attribute_create_’:<br class="">io_attribute.c:66:5: warning: implicit declaration of function ‘Driver_abortFlashC’ [-Wimplicit-function-d<br class="">eclaration]<br class=""> Driver_abortFlashC("[io_attribute_create]: Unknown I/O");<br class=""> ^~~~~~~~~~~~~~~~~~<br class=""><br class=""><br class="">And this one:<br class=""><br class="">/lustre/projects/global/software/a64fx/openmpi/4.0.5/bin/mpicc -I/cm/shared/apps/hdf5/1.10.1/include -DH5_<br class="">USE_16_API -O0 -c -DMAXBLOCKS=1000 -DNXB=8 -DNYB=8 -DNZB=1 -DN_DIM=2 io_h5write_generic_real_arr.c<br class="">io_h5write_generic_int_arr.c: In function ‘io_h5write_generic_int_arr_’:<br class="">io_h5write_generic_int_arr.c:82:31: warning: implicit declaration of function ‘malloc’ [-Wimplicit-functio<br class="">n-declaration]<br class=""> dataset_name_new = (char *) malloc((*name_len) + 1 * sizeof(char));<br class=""> ^~~~~~<br class="">io_h5write_generic_int_arr.c:82:31: warning: incompatible implicit declaration of built-in function ‘mallo<br class="">c’<br class="">io_h5write_generic_int_arr.c:82:31: note: include ‘<stdlib.h>’ or provide a declaration of ‘malloc’<br class="">io_h5write_generic_int_arr.c:6:1:<br class="">+#include <stdlib.h><br class=""> <br class="">io_h5write_generic_int_arr.c:82:31:<br class=""> dataset_name_new = (char *) malloc((*name_len) + 1 * sizeof(char));<br class=""> ^~~~~~<br class="">io_h5write_generic_int_arr.c:87:3: warning: implicit declaration of function ‘strncpy’ [-Wimplicit-functio<br class="">n-declaration]<br class=""> strncpy(dataset_name_new, dataset_name, *name_len);<br class=""> ^~~~~~~<br class="">io_h5write_generic_int_arr.c:87:3: warning: incompatible implicit declaration of built-in function ‘strncp<br class="">y’<br class="">io_h5write_generic_int_arr.c:87:3: note: include ‘<string.h>’ or provide a declaration of ‘strncpy’<br class="">io_h5write_generic_int_arr.c:6:1:<br class="">+#include <string.h><br class=""> <br class="">io_h5write_generic_int_arr.c:87:3:<br class=""> strncpy(dataset_name_new, dataset_name, *name_len);<br class=""> ^~~~~~~<br class="">io_h5write_generic_int_arr.c:187:3: warning: implicit declaration of function ‘free’ [-Wimplicit-function-<br class="">declaration]<br class=""> free(dataset_name_new);<br class=""> ^~~~<br class="">io_h5write_generic_int_arr.c:187:3: warning: incompatible implicit declaration of built-in function ‘free’<br class="">io_h5write_generic_int_arr.c:187:3: note: include ‘<stdlib.h>’ or provide a declaration of ‘free’<br class="">/lustre/projects/global/software/a64fx/openmpi/4.0.5/bin/mpicc -I/cm/shared/apps/hdf5/1.10.1/include -DH5_<br class="">USE_16_API -O0 -c -DMAXBLOCKS=1000 -DNXB=8 -DNYB=8 -DNZB=1 -DN_DIM=2 io_h5write_generic_real_arr.c<br class="">io_h5write_generic_real_arr.c: In function ‘io_h5write_generic_real_arr_’:<br class="">io_h5write_generic_real_arr.c:33:31: warning: implicit declaration of function ‘malloc’ [-Wimplicit-functi<br class="">on-declaration]<br class=""> dataset_name_new = (char *) malloc((*name_len) + 1 * sizeof(char));<br class=""> ^~~~~~<br class="">io_h5write_generic_real_arr.c:33:31: warning: incompatible implicit declaration of built-in function ‘mall<br class="">oc’<br class="">io_h5write_generic_real_arr.c:33:31: note: include ‘<stdlib.h>’ or provide a declaration of ‘malloc’<br class="">io_h5write_generic_real_arr.c:6:1:<br class="">+#include <stdlib.h><br class=""> <br class="">io_h5write_generic_real_arr.c:33:31:<br class=""> dataset_name_new = (char *) malloc((*name_len) + 1 * sizeof(char));<br class=""> ^~~~~~<br class="">io_h5write_generic_real_arr.c:38:3: warning: implicit declaration of function ‘strncpy’ [-Wimplicit-functi<br class="">on-declaration]<br class=""> strncpy(dataset_name_new, dataset_name, *name_len);<br class=""> ^~~~~~~<br class="">io_h5write_generic_real_arr.c:38:3: warning: incompatible implicit declaration of built-in function ‘strnc<br class="">py’<br class="">io_h5write_generic_real_arr.c:38:3: note: include ‘<string.h>’ or provide a declaration of ‘strncpy’<br class="">io_h5write_generic_real_arr.c:6:1:<br class="">+#include <string.h><br class=""> <br class="">io_h5write_generic_real_arr.c:38:3:<br class=""> strncpy(dataset_name_new, dataset_name, *name_len);<br class=""> ^~~~~~~<br class="">io_h5write_generic_real_arr.c:139:3: warning: implicit declaration of function ‘free’ [-Wimplicit-function<br class="">-declaration]<br class=""> free(dataset_name_new);<br class=""> ^~~~<br class="">io_h5write_generic_real_arr.c:139:3: warning: incompatible implicit declaration of built-in function ‘free<br class="">’<br class="">io_h5write_generic_real_arr.c:139:3: note: include ‘<stdlib.h>’ or provide a declaration of ‘free’<br class=""><br class=""><br class=""><br class="">Thanks for any advice or suggestions!<br class=""><br class="">Alan Calder<br class=""><br clear="all" class=""><br class="">-- <br class=""><div dir="ltr" data-smartmail="gmail_signature" class=""><div dir="ltr" class="">Alan C. Calder<br class="">Department of Physics and Astronomy<br class="">State University of New York at Stony Brook<br class="">Stony Brook, NY 11794-3800<br class=""><br class="">office: ESS 438<br class="">phone: (631) 632-1176<br class="">fax: (631) 632-1745<br class="">web: <a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.astro.sunysb.edu_acalder&d=DwMFaQ&c=qKdtBuuu6dQK9MsRUVJ2DPXW6oayO8fu4TfEHS8sGNk&r=D67MpwQXy8oi2wblxhDSww&m=WYqObZU87Lx3v_TqEQKNMv0UxGqG13upy_pgPEhPtpU&s=4sZXrGGf2UvD3DP_qbYGk2gp3k5EE-qxhehkqcCgXEI&e=" target="_blank" class="">http://www.astro.sunysb.edu/acalder</a><br class=""></div></div></div>
</div></blockquote></div><br class=""></div></body></html>