[FLASH-USERS] Open MPI error during refinement

[Ryan Farber]

Hi Claude,

It may help to see your log file (or at least the last few lines of it).
Typically when I have a run crash during refinement with no apparent cause,
I increase available memory (increase nodes, reduce cores per node) and
that fixes it.

Best,
--------
Ryan


On Tue, Oct 8, 2019 at 8:51 AM Claude Cournoyer-Cloutier <
cournoyc at mcmaster.ca> wrote:

> Dear FLASH users,
>
> I am using FLASH, coupled with the astrophysics code AMUSE, to model star
> formation in clusters and cluster formation. I am able to run a test
> version of my simulation, but encounter some issues with refinement when I
> am trying to run a more involved version — with the same parameters, but a
> higher possible refinement.
>
> During refinement, I get the following output (truncated) and error
> message:
>
>  refined: total blocks =          585
>   iteration, no. not moved =            0         323
>   iteration, no. not moved =            1          27
>   iteration, no. not moved =            2           0
>  refined: total leaf blocks =         2311
>  refined: total blocks =         2641
> --------------------------------------------------------------------------
> MPI_ABORT was invoked on rank 45 in communicator MPI COMMUNICATOR 4 SPLIT
> FROM 0
> with errorcode 4.
>
> NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
> You may or may not see output from other processes, depending on
> exactly when Open MPI kills them.
>
> From a few discussions I’ve had, I think the issue might have something to
> do with the spreading of the blocks on different processors — but I cannot
> find anything useful online. Have any of you encountered that error, or a
> similar error in the past ?
>
> Best regards,
>
> Claude
>
> —
>
> Claude Cournoyer-Cloutier
> Master’s Candidate, McMaster University
> Department of Physics & Astronomy
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://flash.rochester.edu/pipermail/flash-users/attachments/20191008/6a927035/attachment-0001.htm>