<div dir="ltr">Supplementing the ideas around increasing MAXBLOCKS:<div><br></div><div>If you're running a convergence study, I would increase nblockx and nblocky instead of lrefinemax. lrefinemax will (hopefully) add more resolution near interesting features, which might be a computationally efficient way to increase resolution near the largest discretization errors, but to get increased resolution throughout your problem and ensure convergence everywhere you should just increase the number of zones on the lowest level by increasing the number of blocks on the lowest level via nblockx and nblocky. </div><div><br></div><div>Additionally, you probably want to add more processors as you're adding more blocks. For good performance, you probably want a similar number of zones per processor throughout your convergence study. So I would e.g. double nblockx, double nblocky, and quadruple the number of processors and you shouldn't run into issues with number of blocks per processor this way.</div><div><br></div><div>Best,</div><div>Lee Ellison</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Aug 1, 2023 at 5:15 PM Kaldawi, Thomas <<a href="mailto:Tkal@lle.rochester.edu">Tkal@lle.rochester.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="auto">
Not sure if it would fix the other issues, but just keep increasing the max blocks in setup until you cannot run the simulation anymore. I run it on a supercomputer, but I usually cap it around 10,000 blocks. <br>
<br>
<div dir="ltr">Sincerely,
<div><br>
</div>
<div>Thomas Kaldawi </div>
</div>
<div dir="ltr"><br>
<blockquote type="cite">On Aug 1, 2023, at 18:39, Sharma, Divyanshu Raj <<a href="mailto:sharma22@llnl.gov" target="_blank">sharma22@llnl.gov</a>> wrote:<br>
<br>
</blockquote>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>
<p class="MsoNormal">Hi Flash Users,<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I am trying to increase lrefinemax and see where the solution converges on the LaserSlab example. When doing this and taking lrefinemax from 9 to 16 I ran into a bunch of inconsistent errors. The main errors are shown below. It is just
weird because I know that MAXBLOCKS is set to 1000 by default and I can increase it but would that take care of the other errors. I also was wondering if there was any intuition on how much should MAXBLOCKS be changed by and if that would have an impact on
the runtime of the simulations or is it just once in allocating the memory.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Lrefine_max = 9:<u></u><u></u></p>
<p class="MsoNormal">ERROR: could not move all blocks in amr_redist_blk<u></u><u></u></p>
<p class="MsoNormal"> Try increasing maxblocks or use more processors<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Lrefine_max = 10:<u></u><u></u></p>
<p class="MsoNormal">Time limit exceeded (weird cause it didn’t burnout like 9)<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Lrefine_max = 11:<u></u><u></u></p>
<p class="MsoNormal">Same as 10<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Lrefine_max = 12:<u></u><u></u></p>
<p class="MsoNormal">Same as 10<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Lrefine_max = 13:<u></u><u></u></p>
<p class="MsoNormal">[hy_uhd_unsplitUpdateMultiTemp] Negative 3T internal energy, CHECK LOG<u></u><u></u></p>
<p class="MsoNormal">application called MPI_Abort(MPI_COMM_WORLD, 1) - process 46<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Lrefine_max = 14:<u></u><u></u></p>
<p class="MsoNormal">Too many blocks! Increase MAXBLOCKS or use more processors.<u></u><u></u></p>
<p class="MsoNormal">application called MPI_Abort(comm=0x84000006, 32767) - process 140<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Lrefine_max = 15:<u></u><u></u></p>
<p class="MsoNormal">[hy_uhd_unsplitUpdateMultiTemp] Negative 3T internal energy, CHECK LOG<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Lrefine_max = 16:<u></u><u></u></p>
<p class="MsoNormal">Too many blocks! Increase MAXBLOCKS or use more processors.<u></u><u></u></p>
<p class="MsoNormal">application called MPI_Abort(comm=0x84000006, 32767) - process 117<u></u><u></u></p>
</div>
<span>_______________________________________________</span><br>
<span>flash-users mailing list</span><br>
<span><a href="mailto:flash-users@flash.rochester.edu" target="_blank">flash-users@flash.rochester.edu</a></span><br>
<span></span><br>
<span>For list info, including unsubscribe:</span><br>
<span><a href="https://flash.rochester.edu/mailman/listinfo/flash-users" target="_blank">https://flash.rochester.edu/mailman/listinfo/flash-users</a></span><br>
</div>
</blockquote>
</div>
_______________________________________________<br>
flash-users mailing list<br>
<a href="mailto:flash-users@flash.rochester.edu" target="_blank">flash-users@flash.rochester.edu</a><br>
<br>
For list info, including unsubscribe:<br>
<a href="https://flash.rochester.edu/mailman/listinfo/flash-users" rel="noreferrer" target="_blank">https://flash.rochester.edu/mailman/listinfo/flash-users</a><br>
</blockquote></div>