[FLASH-USERS] Problems with parallelisation

[Hansen, Eddie]

Hi Arthur,

Some of the threading options are not well-supported. Do you have the same issues if you setup without threadBlockList, and perhaps also without multi-threading in your submission script?

--
Eddie Hansen
Applications Group Leader
Flash Center for Computational Science


From: flash-users <flash-users-bounces at flash.rochester.edu> on behalf of Dr. Arthur Hirsch-Passicos <a.hirsch at hzdr.de>
Date: Friday, February 7, 2025 at 3:35 AM
To: flash-users at flash.rochester.edu <flash-users at flash.rochester.edu>
Subject: [FLASH-USERS] Problems with parallelisation

Dear FLASH Users,

I am in the process of trying to parallelise my simulations so they run faster but I'm facing some issues in the calculations when I'm running the calculations with more than one task. Indeed, I see calculation artifacts at the junction of the tasks for all values saved. Here is an example with my initial electronic temperature and the same after some time step when I use two tasks:



[cid:part1.JzLavzce.opZCm3Bl at hzdr.de][cid:part2.rQmrC3EC.CeJ0GMbY at hzdr.de]

Here is my setup line:

./setup $currentSim -auto -2d +cartesian -maxblocks=300000 -nxb=16 -nyb=16 +hdf5typeio species=cham,targ +mtmmmt +uhd3t +mgd mgd_meshgroups=1 threadBlockList=True



My submission to the cluster, the par file for the boundaries and the Makefile.h I'm using are joined in the message.



Has anyone met similar issues and if so, how did you fix that issue? Thank you in advance for your help.



Best regards,

--

Dr. Arthur Hirsch-Passicos

Post-doctoral Researcher



Laser Particle Acceleration Division

Institute of Radiation Physics

Helmholtz-Zentrum Dresden-Rossendorf e.V.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://flash.rochester.edu/pipermail/flash-users/attachments/20250207/a9c6ee61/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: visit0001.png
Type: image/png
Size: 34950 bytes
Desc: visit0001.png
URL: <http://flash.rochester.edu/pipermail/flash-users/attachments/20250207/a9c6ee61/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: visit0002.png
Type: image/png
Size: 45160 bytes
Desc: visit0002.png
URL: <http://flash.rochester.edu/pipermail/flash-users/attachments/20250207/a9c6ee61/attachment-0003.png>