[FLASH-USERS] hangup with laser2Din3D
Mario Manuel
mmanuel at umich.edu
Thu Apr 21 09:53:42 EDT 2016
Hello FLASH users,
I am running a FLASH4.2.2 simulation that is a combination of the LaserSlab and FieldLoop example simulations. It is a laser-matter interaction (multi-material, 3T, tabulated EOSs) with MHD as well. I recently implemented a more complex laser setup with multiple beams and wanted to use the ed_laser3Din2D = .true. for a more accurate ray tracing in the R-Z geometry that I am using. After fixing all the initialization errors, I got it to run, but it never gets in to the first step. The simulation hangs up, but doesn't throw an error. The output looks like:
-------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------
Wed Apr 20 20:57:51 PDT 2016
NODES= 40
NTASKS= 1280
[Driver_initParallel]: Called MPI_Init_thread - requested level 2, given level 2
[Driver_initParallel]: Number of OpenMP threads in each parallel region 2
NOTE: Enabling curvilinear, cartesian_pm/cylindrical_pm/spherical_pm/polar_pm so far was F T F F
MaterialProperties initialized
Cosmology initialized
[eos_tabBrowseIonmix4Tables] IONMIX4 file found: he-imx-005.cn4
in eos_inittabulated, tableName = he-imx-005.cn4
in eos_inittabulated, tableName = he-imx-005.cn4
in eos_inittabulated, groupName = -none-
in eos_inittabulated, groupName = -none-
in eos_inittabulated, tableName = he-imx-005.cn4
in eos_inittabulated, groupName = -none-
[eos_tabBrowseIonmix4Tables] IONMIX4 file found: polystyrene-imx-002.cn4
in eos_inittabulated, tableName = he-imx-005.cn4
in eos_inittabulated, groupName = -none-
in eos_inittabulated, tableName = polystyrene-imx-002.cn4
in eos_inittabulated, tableName = polystyrene-imx-002.cn4
in eos_inittabulated, groupName = -none-
in eos_inittabulated, groupName = -none-
in eos_inittabulated, tableName = polystyrene-imx-002.cn4
in eos_inittabulated, groupName = -none-
in eos_inittabulated, tableName = polystyrene-imx-002.cn4
in eos_inittabulated, groupName = -none-
Source terms initialized
iteration, no. not moved = 0 0
refined: total leaf blocks = 3
refined: total blocks = 3
INFO: Grid_fillGuardCells is ignoring masking.
iteration, no. not moved = 0 2
iteration, no. not moved = 1 0
refined: total leaf blocks = 12
refined: total blocks = 15
iteration, no. not moved = 0 13
iteration, no. not moved = 1 2
iteration, no. not moved = 2 0
refined: total leaf blocks = 48
refined: total blocks = 63
iteration, no. not moved = 0 60
iteration, no. not moved = 1 13
iteration, no. not moved = 2 0
refined: total leaf blocks = 192
refined: total blocks = 255
iteration, no. not moved = 0 251
iteration, no. not moved = 1 60
iteration, no. not moved = 2 0
refined: total leaf blocks = 768
refined: total blocks = 1023
iteration, no. not moved = 0 283
iteration, no. not moved = 1 101
iteration, no. not moved = 2 0
refined: total leaf blocks = 216
refined: total blocks = 287
iteration, no. not moved = 0 50
iteration, no. not moved = 1 12
iteration, no. not moved = 2 0
refined: total leaf blocks = 96
refined: total blocks = 127
Finished with Grid_initDomain, no restart
Ready to call Hydro_init
[Hydro_init] The upwind electric field construction is NOT allowed for diffusion.
Hydro initialized
Gravity initialized
Initial dt verified
*** Wrote checkpoint file to /p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_chk_0000 ****
*** Wrote plotfile to /p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_plt_cnt_0000 ****
Initial plotfile written
Driver init all done
srun: got SIGCONT
srun: forcing job termination
-------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------
and the last lines of the log file look like:
-------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------
[ 04-20-2016 21:18:56.632 ] [GRID amr_refine_derefine]: redist. phase. tot blks requested: 287
[GRID amr_refine_derefine] min blks 0 max blks 1 tot blks 287
[GRID amr_refine_derefine] min leaf blks 0 max leaf blks 1 tot leaf blks 216
[ 04-20-2016 21:18:56.654 ] [GRID amr_refine_derefine]: refinement complete
[ 04-20-2016 21:18:56.847 ] [GRID gr_expandDomain]: iteration=6, create level=5
[ 04-20-2016 21:18:56.891 ] [GRID amr_refine_derefine]: initiating refinement
[ 04-20-2016 21:18:56.896 ] [GRID amr_refine_derefine]: redist. phase. tot blks requested: 127
[GRID amr_refine_derefine] min blks 0 max blks 1 tot blks 127
[GRID amr_refine_derefine] min leaf blks 0 max leaf blks 1 tot leaf blks 96
[ 04-20-2016 21:18:56.919 ] [GRID amr_refine_derefine]: refinement complete
[ 04-20-2016 21:18:57.110 ] [GRID gr_expandDomain]: iteration=7, create level=5
[ 04-20-2016 21:18:57.116 ] [gr_ensureValidNeighborInfo] found mpi_pattern_id: -10
[ 04-20-2016 21:18:57.124 ] [mpi_amr_comm_setup]: buffer_dim_send=157, buffer_dim_recv=1
[ 04-20-2016 21:18:57.130 ] [gr_hypreInit]: HYPRE_RELEASE_NAME=hypre, HYPRE_RELEASE_VERSION=2.8.0b, HYPRE_RELEASE_DATE=2011/11/14
[ 04-20-2016 21:18:57.136 ] memory: bg heap use (MB): 126.46 (min) 135.21 (max) 131.85 (avg)
[ 04-20-2016 21:18:57.141 ] memory: bg heap peak (MB): 126.46 (min) 135.21 (max) 131.85 (avg)
[ 04-20-2016 21:18:57.145 ] memory: bg heap free (MB): 324.20 (min) 332.95 (max) 327.56 (avg)
[ 04-20-2016 21:18:57.155 ] memory: bg heap use (MB): 126.46 (min) 135.21 (max) 131.85 (avg)
[ 04-20-2016 21:18:57.169 ] memory: bg heap peak (MB): 126.46 (min) 135.21 (max) 131.85 (avg)
[ 04-20-2016 21:18:57.263 ] memory: bg heap free (MB): 324.20 (min) 332.95 (max) 327.56 (avg)
[ 04-20-2016 21:18:58.199 ] memory: bg heap use (MB): 126.46 (min) 135.21 (max) 131.85 (avg)
[ 04-20-2016 21:18:58.205 ] memory: bg heap peak (MB): 126.46 (min) 135.21 (max) 131.85 (avg)
[ 04-20-2016 21:18:58.209 ] memory: bg heap free (MB): 324.26 (min) 333.01 (max) 327.63 (avg)
[ 04-20-2016 21:18:58.407 ] [IO_writeCheckpoint] open: type=checkpoint name=/p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_chk_0000
[ 04-20-2016 21:18:59.943 ] [io_writeData]: wrote 127 blocks
[ 04-20-2016 21:19:00.596 ] [IO_writeCheckpoint] close: type=checkpoint name=/p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_chk_0000
[ 04-20-2016 21:19:00.682 ] [IO_writePlotfile] open: type=plotfile name=/p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_plt_cnt_0000
[ 04-20-2016 21:19:01.269 ] [io_writeData]: wrote 127 blocks
[ 04-20-2016 21:19:01.695 ] [IO_writePlotfile] close: type=plotfile name=/p/lscratchv/manuel3/ACSEL15B_CH/ACSEL15B_hdf5_plt_cnt_0000
[ 04-20-2016 21:19:01.706 ] memory: bg heap use (MB): 134.27 (min) 135.21 (max) 134.74 (avg)
[ 04-20-2016 21:19:01.711 ] memory: bg heap peak (MB): 134.27 (min) 151.21 (max) 134.77 (avg)
[ 04-20-2016 21:19:01.716 ] memory: bg heap free (MB): 324.26 (min) 325.20 (max) 324.73 (avg)
[ 04-20-2016 21:19:01.722 ] [Driver_evolveFlash]: Entering evolution loop
[ 04-20-2016 21:19:01.727 ] step: n=1 t=0.000000E+00 dt=1.000000E-15
[ 04-20-2016 21:19:01.746 ] [mpi_amr_comm_setup]: buffer_dim_send=27933, buffer_dim_recv=1
[ 04-20-2016 21:19:01.783 ] [hy_uhd_unsplit]: gcNeed(MAGI_FACE_VAR,MAG_FACE_VAR) - FACES
[ 04-20-2016 21:19:01.792 ] [mpi_amr_comm_setup]: buffer_dim_send=2333, buffer_dim_recv=1
[ 04-20-2016 21:19:01.886 ] [mpi_amr_comm_setup]: buffer_dim_send=27933, buffer_dim_recv=1
[ 04-20-2016 21:19:01.913 ] [mpi_amr_comm_setup]: buffer_dim_send=25757, buffer_dim_recv=1
-------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------
Everything runs fine when I switch the flag to ed_laser2Din3D = .false.
Has anyone come across this type of thing before? Are there issues with the 2Din3D package and some other packages I may have implemented? Any thoughts are much welcomed.
Cheers,
Mario
______________________________________
Dr. Mario Manuel
Einstein Postdoctoral Fellow, Smithsonian Astrophysical Observatory
mmanuel at umich.edu
617-899-8381
University of Michigan
Space Research Building
2455 Hayward Street
Ann Arbor, MI 48109
Office: 734-764-4585
______________________________________
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://flash.rochester.edu/pipermail/flash-users/attachments/20160421/0c10694c/attachment.htm>
More information about the flash-users
mailing list