segmentation fault

Questions and other topics related to UEMS 18.
Post Reply
airace69
Posts: 1
Joined: Mon May 11, 2020 9:24 am

segmentation fault

Post by airace69 » Mon May 11, 2020 9:35 am

Dear all,
it's my first post here so, first of all, I'd like to greet you all!
I am running WRFEMS for hobby purpose for a few years now without any glitch. Yesterday, all of a sudden, after a system reboot, the standard routines are all giving me a segmentation fault (ungrib, metgrid, etc.). I have tried almost everything but without success. I have changed all the executables to the .intel ones and everthing works BUT the last, most important thing is still not working, that is the emsupp routine which still gives me segfault. I haven't found an intel compiled one.

I am pasting here the output of

ems_post --ncpus 1 --debug

I am really clueless

ciao
Andrea

Code: Select all

Starting UEMS Program ems_post (V19.8.1) on xeon-server at Mon May 11 09:32:37 2020 UTC


    I.   Translating your configuration into something ems_post can understand

         ========================================================================
            dbg: &PostFlagConfiguration - Final command-line flag values:

               Note: Some values have defined defaults

                 afwa       = 0
                 autopost   = 0
                 autoupp    = 
                 auxhist    = 0
                 bfinfo     = 0
                 bufkit     = 0
                 bufr       = 0
                 domains    = 1
                 emscwd     = /home/irace/uems/runs/quiberon
                 emspost    = 0
                 gempak     = 0
                 gemsnd     = 0
                 grads      = 0
                 grib       = 0
                 hailcast   = 0
                 index      = 0
                 info       = 0
                 ncpus      = 1
                 nobufr     = 0
                 noexport   = 0
                 nogrib     = 0
                 noupp      = 0
                 rundir     = /home/irace/uems/runs/quiberon
                 scour      = 0
                 summary    = 0
                 wrfout     = 0
         ========================================================================


         ========================================================================
           dbg: &PostFinalConfiguration - Final ems_post configuration values:

                accaux_grib = 360
                acchai_grib = 360
                accwrf_grib = 60
                append_date = 1
                ascisnd    = 0
                autopost   = 
                bfinfo     = 0
                bufkit     = 0
                bufkitlibs = 
                bufr       = 0
                bufr_style = 1
                domains    = 1
                emspost    = 1:wrfout
                exports    = 0
                filename_bufr = emsbufr_CORE_dWD
                filename_gempak = YYYYMMDDHHMN_CORE_KEY_dWD.gem
                filename_grib = YYMMDDHHMN_KEY_CORE_dWD.grb2fFXFMFS
                frqaux_gempak = 360:0:360
                frqaux_grads = 360:0:360
                frqaux_grib = 360:0:360
                frqhai_gempak = 360:0:360
                frqhai_grads = 360:0:360
                frqhai_grib = 360:0:360
                frqwrf_bufr = 60:0:360
                frqwrf_gempak = 60:0:360
                frqwrf_grads = 60:0:360
                frqwrf_grib = 60:0:360
                gempak     = 0
                gempaklibs = 
                gemsnd     = 0
                grads      = 0
                gradslibs  = 
                grbcntrl_aux = /home/irace/uems/runs/quiberon/static/emsupp_auxcntrl.parm
                grbcntrl_hai = /home/irace/uems/runs/quiberon/static/emsupp_hailcntrl.parm
                grbcntrl_wrf = /home/irace/uems/runs/quiberon/static/emsupp_cntrl.parm
                grib       = 1
                index      = 0
                info       = 0
                mdlid      = 116
                monofile_gempak = 1
                monofile_grads = 1
                mpicheck   = 1
                nodecpus   = local:1
                noupp      = 0
                ocntr      = 7
                pmap       = ARRAY(0x2261938)
                rundir     = /home/irace/uems/runs/quiberon
                scntr      = 21
                scour      = 0
                scraux_gempak = 0
                scraux_grads = 0
                scrhai_gempak = 0
                scrhai_grads = 0
                scrwrf_gempak = 0
                scrwrf_grads = 0
                station_list = 
                summary    = 0
                zipit      = 0
         ========================================================================



    II.  Begin post-processing domain 1 primary simulation output


         *  Creating domain 01 primary GRIB 2 files every 60 minutes between May 11 03:00 2020 UTC & May 11 09:00 2020 UTC

              GRIB file process information:
              
                Process (Model) ID : 116
                Originating Center : 7
                SubCenter ID       : 21


    III. Gathering system information for running UEMS UPP

            Checking "xeon-server"       - 

            dbg: Following isHostnameOrIP     : xeon-server | 0
            dbg: Following IP Hostname Match  : xeon-server | X
            dbg: Following Long Hostname Match: xeon-server | X
            dbg: Following Interface IP Match : xeon-server | X | ens8f3



       dbg: The %Puems Hash After &SetProcessResources (Netcdf2GribMultiFile):

       TOP LEVEL OF HASH CALLED FROM  ():  

           SCALAR:   {reqcores}                        1
           SCALAR:   {totalcores}                      1
           SCALAR:   {totalnodes}                      1
           ARRAY :   {nodeorder}                       localhost

           HASH:  nodes


               HASH:  localhost

                   SCALAR:   {localhost}{address}              127.0.0.1
                   SCALAR:   {localhost}{headnode}             1
                   SCALAR:   {localhost}{hostname}             xeon-server
                   SCALAR:   {localhost}{iface}                lo
                   SCALAR:   {localhost}{localhost}            1
                   SCALAR:   {localhost}{maxcores}             88
                   SCALAR:   {localhost}{reqcores}             1
                   SCALAR:   {localhost}{sockets}              4
                   SCALAR:   {localhost}{usecores}             1






       dbg: The %Proc Hash Leaving &ConfigureProcess (Netcdf2GribMultiFile):

       TOP LEVEL OF HASH CALLED FROM  ():  

           SCALAR:   {dompath}                         /home/irace/uems/runs/quiberon/emsprd/grib
           SCALAR:   {error}                           
           SCALAR:   {faildir}                         /home/irace/uems/runs/quiberon/log/failed_emsupp
           SCALAR:   {hostsfile}                       
           SCALAR:   {hydra}                           0
           SCALAR:   {logdir}                          ../../log
           SCALAR:   {ncores}                          1
           SCALAR:   {process}                         emsupp
           SCALAR:   {procexe}                         /home/irace/uems/bin/emsupp
           SCALAR:   {procsfile}                       
           SCALAR:   {totalcores}                      1
           SCALAR:   {totalnodes}                      1
           SCALAR:   {uemsexec}                        /home/irace//uems/util/mpich2/bin/mpiexec.gforker    -n 1  /home/irace/uems/bin/emsupp > ../../log/post_emsupp1_wrfoutd01.log 2>&1
           SCALAR:   {workdir}                         /home/irace/uems/runs/quiberon/emsprd/grib

           HASH:  nodes

                   SCALAR:   {address}                         127.0.0.1
                   SCALAR:   {headnode}                        1
                   SCALAR:   {hostname}                        xeon-server
                   SCALAR:   {iface}                           lo
                   SCALAR:   {localhost}                       1
                   SCALAR:   {maxcores}                        88
                   SCALAR:   {reqcores}                        1
                   SCALAR:   {sockets}                         4
                   SCALAR:   {usecores}                        1




         *  Using 1 processors to drive the UEMS UPP - Failed

            While perusing the log files, I found the following:

              post_emsupp2_wrfoutd01.log - [0]0:Return code = 0, signaled with Segmentation fault


         ☠  Failure (1) during GRIB file creation


    Your UEMS Post party was busted at Mon May 11 09:32:43 2020 UTC - Ya know, 'cause stuff just happens

  The UEMS Metaphysician says: "Think Globally, Model Locally!"

Post Reply