[FLASH-USERS] hangup with laser2Din3D

Norbert Flocke flocke at flash.uchicago.edu
Thu Apr 21 16:15:03 EDT 2016


Hi Manuel,

Are you sure you are setting up the beams correctly for this 3D in 2D 
simulation? The reason I am asking is because it is easy to get confused
between the cylindrical FLASH coordinates (x,y) -> (R,z) and the 3D beam 
coordinates you need to use. In your application (cylindrical) the FLASH y 
coordinate corresponds to the beam 3D z coordinate.

Best,
Norbert


On Thu, 21 Apr 2016, Mario Manuel wrote:

> Hello FLASH users,
>
> I am running a FLASH4.2.2 simulation that is a combination of the LaserSlab and FieldLoop
> example simulations. It is a laser-matter interaction (multi-material, 
> 3T, tabulated EOSs) with MHD as well.  I recently implemented a more 
> complex laser setup with multiple beams and wanted to use the 
> ed_laser3Din2D = .true. for a more accurate ray tracing in the R-Z 
> geometry that I am using.  After fixing all the initialization errors, I 
> got it to run, but it never gets in to the first step. The simulation 
> hangs up, but doesn't throw an error. The output looks like:
>
>
> -------------------------------------------------------------------------------------------------------------------------------
> -------------------------------------------------------------------------------------------------------------------------------
> Wed Apr 20 20:57:51 PDT 2016
> NODES= 40
> NTASKS= 1280
> [Driver_initParallel]: Called MPI_Init_thread - requested level   2, given level   2
> [Driver_initParallel]: Number of OpenMP threads in each parallel region  2
> NOTE: Enabling curvilinear, cartesian_pm/cylindrical_pm/spherical_pm/polar_pm  so far was F T F F
> MaterialProperties initialized
> Cosmology initialized
> [eos_tabBrowseIonmix4Tables] IONMIX4 file found: he-imx-005.cn4
> in eos_inittabulated, tableName = he-imx-005.cn4
> in eos_inittabulated, tableName = he-imx-005.cn4
> in eos_inittabulated, groupName = -none-
> in eos_inittabulated, groupName = -none-
> in eos_inittabulated, tableName = he-imx-005.cn4
> in eos_inittabulated, groupName = -none-
> [eos_tabBrowseIonmix4Tables] IONMIX4 file found: polystyrene-imx-002.cn4
> in eos_inittabulated, tableName = he-imx-005.cn4
> in eos_inittabulated, groupName = -none-
> in eos_inittabulated, tableName = polystyrene-imx-002.cn4
> in eos_inittabulated, tableName = polystyrene-imx-002.cn4
> in eos_inittabulated, groupName = -none-
> in eos_inittabulated, groupName = -none-
> in eos_inittabulated, tableName = polystyrene-imx-002.cn4
> in eos_inittabulated, groupName = -none-
> in eos_inittabulated, tableName = polystyrene-imx-002.cn4
> in eos_inittabulated, groupName = -none-
> Source terms initialized
>  iteration, no. not moved =  0 0
> refined: total leaf blocks =  3
> refined: total blocks =  3
> INFO: Grid_fillGuardCells is ignoring masking.
>  iteration, no. not moved =  0 2
>  iteration, no. not moved =  1 0
> refined: total leaf blocks =  12
> refined: total blocks =  15
>  iteration, no. not moved =  0 13
>  iteration, no. not moved =  1 2
>  iteration, no. not moved =  2 0
> refined: total leaf blocks =  48
> refined: total blocks =  63
>  iteration, no. not moved =  0 60
>  iteration, no. not moved =  1 13
>  iteration, no. not moved =  2 0
> refined: total leaf blocks =  192
> refined: total blocks =  255
>  iteration, no. not moved =  0 251
>  iteration, no. not moved =  1 60
>  iteration, no. not moved =  2 0
> refined: total leaf blocks =  768
> refined: total blocks =  1023
>  iteration, no. not moved =  0 283
>  iteration, no. not moved =  1 101
>  iteration, no. not moved =  2 0
> refined: total leaf blocks =  216
> refined: total blocks =  287
>  iteration, no. not moved =  0 50
>  iteration, no. not moved =  1 12
>  iteration, no. not moved =  2 0
> refined: total leaf blocks =  96
> refined: total blocks =  127
>  Finished with Grid_initDomain, no restart
> Ready to call Hydro_init
> [Hydro_init] The upwind electric field construction is NOT allowed for diffusion.
> Hydro initialized
> Gravity initialized
> Initial dt verified
> *** Wrote checkpoint file to /p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_chk_0000 ****
> *** Wrote plotfile to /p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_plt_cnt_0000 ****
> Initial plotfile written
> Driver init all done
> srun: got SIGCONT
> srun: forcing job termination
> -------------------------------------------------------------------------------------------------------------------------------
> -------------------------------------------------------------------------------------------------------------------------------
>
> and the last lines of the log file look like:
>
> -------------------------------------------------------------------------------------------------------------------------------
> -------------------------------------------------------------------------------------------------------------------------------
> [ 04-20-2016  21:18:56.632 ] [GRID amr_refine_derefine]: redist. phase.  tot blks requested: 287
> [GRID amr_refine_derefine] min blks 0    max blks 1    tot blks 287
> [GRID amr_refine_derefine] min leaf blks 0    max leaf blks 1    tot leaf blks 216
> [ 04-20-2016  21:18:56.654 ] [GRID amr_refine_derefine]: refinement complete
> [ 04-20-2016  21:18:56.847 ] [GRID gr_expandDomain]: iteration=6, create level=5
> [ 04-20-2016  21:18:56.891 ] [GRID amr_refine_derefine]: initiating refinement
> [ 04-20-2016  21:18:56.896 ] [GRID amr_refine_derefine]: redist. phase.  tot blks requested: 127
> [GRID amr_refine_derefine] min blks 0    max blks 1    tot blks 127
> [GRID amr_refine_derefine] min leaf blks 0    max leaf blks 1    tot leaf blks 96
> [ 04-20-2016  21:18:56.919 ] [GRID amr_refine_derefine]: refinement complete
> [ 04-20-2016  21:18:57.110 ] [GRID gr_expandDomain]: iteration=7, create level=5
> [ 04-20-2016  21:18:57.116 ] [gr_ensureValidNeighborInfo] found mpi_pattern_id: -10
> [ 04-20-2016  21:18:57.124 ] [mpi_amr_comm_setup]: buffer_dim_send=157, buffer_dim_recv=1
> [ 04-20-2016  21:18:57.130 ] [gr_hypreInit]: HYPRE_RELEASE_NAME=hypre, HYPRE_RELEASE_VERSION=2.8.0b, HYPRE_RELEASE_DATE=2011/11/14
> [ 04-20-2016  21:18:57.136 ] memory: bg heap use    (MB):      126.46 (min)        135.21 (max)        131.85 (avg)
> [ 04-20-2016  21:18:57.141 ] memory: bg heap peak   (MB):      126.46 (min)        135.21 (max)        131.85 (avg)
> [ 04-20-2016  21:18:57.145 ] memory: bg heap free   (MB):      324.20 (min)        332.95 (max)        327.56 (avg)
> [ 04-20-2016  21:18:57.155 ] memory: bg heap use    (MB):      126.46 (min)        135.21 (max)        131.85 (avg)
> [ 04-20-2016  21:18:57.169 ] memory: bg heap peak   (MB):      126.46 (min)        135.21 (max)        131.85 (avg)
> [ 04-20-2016  21:18:57.263 ] memory: bg heap free   (MB):      324.20 (min)        332.95 (max)        327.56 (avg)
> [ 04-20-2016  21:18:58.199 ] memory: bg heap use    (MB):      126.46 (min)        135.21 (max)        131.85 (avg)
> [ 04-20-2016  21:18:58.205 ] memory: bg heap peak   (MB):      126.46 (min)        135.21 (max)        131.85 (avg)
> [ 04-20-2016  21:18:58.209 ] memory: bg heap free   (MB):      324.26 (min)        333.01 (max)        327.63 (avg)
> [ 04-20-2016  21:18:58.407 ] [IO_writeCheckpoint] open: type=checkpoint name=/p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_chk_0000
> [ 04-20-2016  21:18:59.943 ] [io_writeData]: wrote     127          blocks
> [ 04-20-2016  21:19:00.596 ] [IO_writeCheckpoint] close: type=checkpoint name=/p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_chk_0000
> [ 04-20-2016  21:19:00.682 ] [IO_writePlotfile] open: type=plotfile name=/p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_plt_cnt_0000
> [ 04-20-2016  21:19:01.269 ] [io_writeData]: wrote     127          blocks
> [ 04-20-2016  21:19:01.695 ] [IO_writePlotfile] close: type=plotfile name=/p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_plt_cnt_0000
> [ 04-20-2016  21:19:01.706 ] memory: bg heap use    (MB):      134.27 (min)        135.21 (max)        134.74 (avg)
> [ 04-20-2016  21:19:01.711 ] memory: bg heap peak   (MB):      134.27 (min)        151.21 (max)        134.77 (avg)
> [ 04-20-2016  21:19:01.716 ] memory: bg heap free   (MB):      324.26 (min)        325.20 (max)        324.73 (avg)
> [ 04-20-2016  21:19:01.722 ] [Driver_evolveFlash]: Entering evolution loop
> [ 04-20-2016  21:19:01.727 ] step: n=1 t=0.000000E+00 dt=1.000000E-15
> [ 04-20-2016  21:19:01.746 ] [mpi_amr_comm_setup]: buffer_dim_send=27933, buffer_dim_recv=1
> [ 04-20-2016  21:19:01.783 ] [hy_uhd_unsplit]: gcNeed(MAGI_FACE_VAR,MAG_FACE_VAR) - FACES
> [ 04-20-2016  21:19:01.792 ] [mpi_amr_comm_setup]: buffer_dim_send=2333, buffer_dim_recv=1
> [ 04-20-2016  21:19:01.886 ] [mpi_amr_comm_setup]: buffer_dim_send=27933, buffer_dim_recv=1
> [ 04-20-2016  21:19:01.913 ] [mpi_amr_comm_setup]: buffer_dim_send=25757, buffer_dim_recv=1
> -------------------------------------------------------------------------------------------------------------------------------
> -------------------------------------------------------------------------------------------------------------------------------
>
> Everything runs fine when I switch the flag to ed_laser2Din3D = .false.
>
> Has anyone come across this type of thing before? Are there issues with the 2Din3D package and some other packages I may have implemented? Any thoughts are much welcomed.
>
> Cheers,
> Mario
>
> ______________________________________
>
> Dr. Mario Manuel
> Einstein Postdoctoral Fellow, Smithsonian Astrophysical Observatory
> mmanuel at umich.edu
> 617-899-8381
>
> University of Michigan
> Space Research Building
> 2455 Hayward Street
> Ann Arbor, MI 48109
> Office: 734-764-4585
> ______________________________________
>
>



More information about the flash-users mailing list