<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">Hi Marco,<br>
<br>
You should increase maxblocks because a value of maxblocks=4 is
too<br>
low. You are using large blocks (32^3) and so memory usage
prevents<br>
you setting maxblocks too high, but I would suggest for this
problem<br>
you need a value of at least 10 for maxblocks.<br>
<br>
The specific error you show is happening because data cannot be
found<br>
in a array of size maxblocks_alloc, where the default value of<br>
maxblocks_alloc is maxblocks * 10. Internally Paramesh has many<br>
arrays of size maxblocks_alloc which hold e.g. various information<br>
about the local view of the oct-tree. A technique we have used in
the<br>
past when there is insufficient memory to make maxblocks much
larger<br>
and we need to avoid errors like you show is to make
maxblocks_alloc<br>
larger in amr_initialize.F90, e.g. maxblocks_alloc = maxblocks *
20.<br>
You should also change maxblocks_tr to be the same size as<br>
maxblocks_alloc.<br>
<br>
Finally, if you don't need AMR then you should use the FLASH
uniform<br>
grid (you have a fully refined domain at level 5). Memory usage
will<br>
be less and guard cell fills will be much faster.<br>
<br>
Chris<br>
<br>
<br>
On 01/18/2013 10:47 AM, Marco Mazzuoli wrote:<br>
</div>
<blockquote cite="mid:DUB108-W535B507143171AD47DE77CAB120@phx.gbl"
type="cite">
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 10pt;
font-family:Tahoma
}
--></style>
<div dir="ltr">
Dear Flash users,<br>
<br>
I am trying to run Flash on a bluegene-type supercomputer.<br>
The details of the present run are:<br>
<br>
#procs=1024 on #64 nodes (#16procs per node).<br>
<br>
The domain is rectangular.<br>
Block size = 32x32x32 computational points<br>
Max refinement level = 5<br>
The whole domain is refined at level = 5 such that
N°blocks=1+8+64+512+4096=4681<br>
Max_blocks per core = 4<br>
<br>
Do you know what the initialization error visualized in the
standard output and proposed in the following, could depend on?<br>
<br>
-----------------------------------------------------------------------------------------------------------------------<br>
RuntimeParameters_read: ignoring unknown parameter "igrav"...<br>
RuntimeParameters_read: ignoring unknown parameter
"mgrid_max_iter_change"...<br>
RuntimeParameters_read: ignoring unknown parameter
"mgrid_solve_max_iter"...<br>
RuntimeParameters_read: ignoring unknown parameter
"mgrid_print_norm"...<br>
RuntimeParameters_read: ignoring unknown parameter
"msgbuffer"...<br>
RuntimeParameters_read: ignoring unknown parameter
"eint_switch"...<br>
RuntimeParameters_read: ignoring unknown parameter "order"...<br>
RuntimeParameters_read: ignoring unknown parameter
"slopeLimiter"...<br>
RuntimeParameters_read: ignoring unknown parameter
"LimitedSlopeBeta"...<br>
RuntimeParameters_read: ignoring unknown parameter
"charLimiting"...<br>
RuntimeParameters_read: ignoring unknown parameter
"use_avisc"...<br>
RuntimeParameters_read: ignoring unknown parameter
"use_flattening"...<br>
RuntimeParameters_read: ignoring unknown parameter
"use_steepening"...<br>
RuntimeParameters_read: ignoring unknown parameter
"use_upwindTVD"...<br>
RuntimeParameters_read: ignoring unknown parameter
"RiemannSolver"...<br>
RuntimeParameters_read: ignoring unknown parameter
"entropy"...<br>
RuntimeParameters_read: ignoring unknown parameter
"shockDetect"...<br>
MaterialProperties initialized<br>
Cosmology initialized<br>
Source terms initialized<br>
Cosmology initialized<br>
Source terms initialized<br>
iteration, no. not moved = 0 0<br>
refined: total leaf blocks = 1<br>
refined: total blocks = 1<br>
starting MORTON ORDERING<br>
tot_blocks after 1<br>
max_blocks 2 1<br>
min_blocks 2 0<br>
Finished initialising block: 1<br>
INFO: Grid_fillGuardCells is ignoring masking.<br>
iteration, no. not moved = 0 0<br>
refined: total leaf blocks = 8<br>
refined: total blocks = 9<br>
iteration, no. not moved = 0 7<br>
iteration, no. not moved = 1 0<br>
refined: total leaf blocks = 64<br>
refined: total blocks = 73<br>
iteration, no. not moved = 0 70<br>
iteration, no. not moved = 1 7<br>
iteration, no. not moved = 2 0<br>
refined: total leaf blocks = 512<br>
refined: total blocks = 585<br>
ERROR in mpi_morton_bnd_prol : guard block
starting index -3 not larger than lnblocks 1 processor no. 8
maxblocks_alloc 40<br>
ERROR in mpi_morton_bnd_prol : guard block
starting index -3 not larger than lnblocks 1 processor no.
496 maxblocks_alloc 40<br>
ERROR in mpi_morton_bnd_prol : guard block
starting index -3 not larger than lnblocks 1 processor no.
569 maxblocks_alloc 40<br>
ERROR in mpi_morton_bnd_prol : guard block
starting index -3 not larger than lnblocks 1 processor no.
172 maxblocks_alloc 40<br>
ERROR in mpi_morton_bnd_prol : guard block
starting index -12 not larger than lnblocks 1 processor no.
368 maxblocks_alloc 40<br>
ERROR in mpi_morton_bnd_prol : guard block
starting index -12 not larger than lnblocks 1 processor no.
189 maxblocks_alloc 40<br>
...<br>
...<br>
...<br>
Abort(1076419107) on node 442 (rank 442 in comm -2080374784):
application called MPI_Abort(comm=0x84000000, 1076419107) -
process 442<br>
-----------------------------------------------------------------------------------------------------------------------<br>
<br>
Thank you in advance.<br>
<br>
Sincerely,<br>
<br>
Marco Mazzuoli<br>
<pre><font style="font-size:10pt" color="#002060" size="2">
Ing. Marco Mazzuoli</font><font style="font-size:10pt" color="#002060" size="2">
</font><font style="font-size:10pt" color="#002060" size="2">Dipartimento di Ingegneria</font><font style="font-size:10pt" color="#002060" size="2">
</font><font style="font-size:10pt" color="#002060" size="2">delle Costruzioni, dell'Ambiente e</font><font style="font-size:10pt" color="#002060" size="2">
</font><font style="font-size:10pt" color="#002060" size="2">del Territorio (DICAT)</font><font style="font-size:10pt" color="#002060" size="2">
</font><font style="font-size:10pt" color="#002060" size="2">via Montallegro 1</font><font style="font-size:10pt" color="#002060" size="2">
</font><font style="font-size:10pt" color="#002060" size="2">16145 GENOVA-ITALY</font><font style="font-size:10pt" color="#002060" size="2">
</font><font style="font-size:10pt" color="#002060" size="2">tel. +39 010 353 2497</font><font style="font-size:10pt" color="#002060" size="2">
cell. +39 338 7142904
</font><font style="font-size:10pt" color="#002060" size="2">e-mail <a class="moz-txt-link-abbreviated" href="mailto:marco.mazzuoli@unige.it">marco.mazzuoli@unige.it</a></font><font style="font-size:10pt" color="#002060" size="2">
</font><font style="font-size:10pt" color="#002060" size="2"> <a class="moz-txt-link-abbreviated" href="mailto:marco.mazzuoli84@gmail.com">marco.mazzuoli84@gmail.com</a>
</font><font style="font-size:10pt" size="2"><img moz-do-not-send="true" alt=""></font>
</pre>
</div>
</blockquote>
<br>
</body>
</html>