[FLASH-USERS] 3D simulation

[Mousumi Das]

Hello,

  The details of the nodes the job ran on are:

amd Opteron 250's  each node has 4 GB ram,
The compiler used was pgi/6.1
The MPI library is OpenMPI-1.0.2

We had to recompile flash+hdf5 with the option -mcmodel=medium because of 
the following  error:
relocation truncated to fit: R_X86_64_PC32

but fftw and openmpi were NOT compiled with the option -mcmodel=medium

thanks,
Mousumi

On Thu, 29 Nov 2007, Anshu Dubey wrote:

> Please tell us the specifics of the machine you are running on,
> specifically what kind of platform is it and what is the memory
> per processor. My suspicion is that you are still very close to
> exhausting the available memory on the machine with the sizes
> you are using.
>
> Anshu
>
>> Hello All,
>>
>>     I was trying to build up the set up for 3D simulation with smaller
>> maxblocks.
>>
>>   ./setup example -auto -3d -maxblocks=400 -nxb=36 -nyb=36 -nzb=36
>>   with refinement-level =6 so that the executable starts to run.
>>
>> It was running over 16 processors for one and half days and goes up to
>> the follwoing point, suddenly it stops showing no error mesg , even
>> amr_log file did not show any error mesg. Can anybody has any idea
>> what was gone wrong.
>> regards,
>> Mousumi
>>
>>   [ 11-27-2007  19:16.58 ] [AMR_REFINE_DEREFINE]: refinement complete
>>   [ 11-27-2007  19:17.00 ] [INIT_FROM_SCRATCH]: create level=6
>>   [ 11-28-2007  11:42.21 ] [AMR_REFINE_DEREFINE]: refinement initiated at
>> 11:42.21
>>   [ 11-28-2007  11:44.00 ] [AMR_REFINE_DEREFINE] blocks   all:  min=169
>> max=172 tot=2729
>>   [ 11-28-2007  11:44.01 ] [AMR_REFINE_DEREFINE] blocks valid:  min=148
>> max=151 tot=2388
>>   [ 11-28-2007  11:44.01 ] [AMR_REFINE_DEREFINE]: refinement complete
>>   [ 11-28-2007  11:44.08 ] [INIT_FROM_SCRATCH]: create level=6
>>
>>
>>
>>
>> On Tue, 27 Nov 2007, Anshu Dubey wrote:
>>
>>> That is probably just too big for the loader on the machine. I don't
>>> know of any platform on which that size problem will load. You should
>>> try to build it with fewer maxblocks.
>>>
>>> Anshu
>>>
>>>> Hello All,
>>>>     I am using FLASH 2.4 and trying to run 3-dimensional simulation
>>>> with
>>>> higher
>>>> resolution by increasing zones in setup.
>>>>
>>>>   ./setup example -auto -3d -maxblocks=1500 -nxb=36 -nyb=36 -nzb=36
>>>> with refinement-level =6
>>>>
>>>> The code compiles and generate excutable flash2.
>>>>
>>>> But when I am trying to run it came with an error:
>>>>
>>>> "2 processes killed (possibly by Open MPI)"
>>>>
>>>> It happens when I am trying to run high resolution zones stated above..
>>>> If I use the following set up:
>>>>
>>>> ./setup example -auto -3d -maxblocks=2500 -nxb=16 -nyb=16 -nzb=16
>>>>
>>>> It compiles and runs well.
>>>> For higher number of zones set up it came out with the above error
>>>> message.
>>>> Can anyone of you came accross with such thing, can you help me or
>>>> giving
>>>> an
>>>> idea what could be the possible reason for the above error mesg.
>>>>
>>>> regards,
>>>> Mousumi Das
>>>> Research Associate
>>>> University of Michigan
>>>>
>>>
>>>
>>>
>>>
>>
>
>
>
>