Changes needed for GFS Update 2017?

With soon inclusion of the NEMS NMM-B model into the EMS package, WRF EMS changes its name and becomes UEMS.
meteoadriatic
Posts: 1512
Joined: Wed Aug 19, 2009 10:05 am

Re: Changes needed for GFS Update 2017?

Post by meteoadriatic » Wed Jul 26, 2017 7:03 am

Giancarlo Modugno wrote:
Wed Jul 26, 2017 6:18 am
meteoadriatic wrote:
Tue Jul 25, 2017 4:50 pm
Can you check contents of these ptiles? They might not have "landn" variable.
sorry, I don't find the ptiles files and then the landn variable; I have tried to find in conf/grib_info but with "locate *ptile*" command with terminal

Can you indicate me, please?
Downloaded files are in domain directory, subdirectory "grib". Go there, use any of them like this:
g2ctl -verf nameofptile > nameofptile.ctl

Open nameofptile.ctl and see if there is landn variable. That should be easiest way.

Giancarlo Modugno
Posts: 59
Joined: Tue Jun 05, 2012 5:25 pm

Re: Changes needed for GFS Update 2017?

Post by Giancarlo Modugno » Wed Jul 26, 2017 7:43 am

meteoadriatic wrote:
Wed Jul 26, 2017 7:03 am
Giancarlo Modugno wrote:
Wed Jul 26, 2017 6:18 am
meteoadriatic wrote:
Tue Jul 25, 2017 4:50 pm
Can you check contents of these ptiles? They might not have "landn" variable.
sorry, I don't find the ptiles files and then the landn variable; I have tried to find in conf/grib_info but with "locate *ptile*" command with terminal

Can you indicate me, please?
Downloaded files are in domain directory, subdirectory "grib". Go there, use any of them like this:
g2ctl -verf nameofptile > nameofptile.ctl

Open nameofptile.ctl and see if there is landn variable. That should be easiest way.
Ah ok that's simple. No landn variable both in gfs50 and gfs25 :!:

meteoadriatic
Posts: 1512
Joined: Wed Aug 19, 2009 10:05 am

Re: Changes needed for GFS Update 2017?

Post by meteoadriatic » Wed Jul 26, 2017 8:17 am

Strange, huh. LANDNsfc maybe? I have LANDsfc and LANDNsfc from STRC 0.25 deg. Didn't tried 0.5 deg...

Giancarlo Modugno
Posts: 59
Joined: Tue Jun 05, 2012 5:25 pm

Re: Changes needed for GFS Update 2017?

Post by Giancarlo Modugno » Wed Jul 26, 2017 9:02 am

I see only LANDsfc in both

However, I see 53 rows in 0.50 and 57 rows in 0.25, with these difference

(MISSING in 0.50)

PRES80m 0,103,80 0,3,0 ** 80 m above ground Pressure [Pa]
TMP80m 0,103,80 0,0,0 ** 80 m above ground Temperature [K]
UGRD80m 0,103,80 0,2,2 ** 80 m above ground U-Component Of Wind [m/s]
VGRD80m 0,103,80 0,2,3 ** 80 m above ground V-Component Of Wind [m/s]


GFS 0.50
dset ^17072500.gfs.t00z.0p50.pgrb2f003
index ^17072500.gfs.t00z.0p50.pgrb2f003.idx
undef 9.999E+20
title 17072500.gfs.t00z.0p50.pgrb2f003
* produced by g2ctl v0.0.8.8
* command line options: -verf 17072500.gfs.t00z.0p50.pgrb2f003
* griddef=1:0:(43 x 32):grid_template=0:winds(N/S): lat-lon grid:(43 x 32) units 1e-06 input WE:SN output WE:SN res 48 lat 34.000000 to 49.500000 by 0.500000 lon 2.000000 to 23.000000 by 0.500000 #points=1376:winds(N/S)

dtype grib2
ydef 32 linear 34.000000 0.5
xdef 43 linear 2.000000 0.5
tdef 1 linear 03Z25jul2017 1mo
* PROFILE hPa
zdef 31 levels 100000 97500 95000 92500 90000 85000 80000 75000 70000 65000 60000 55000 50000 45000 40000 35000 30000 25000 20000 15000 10000 7000 5000 3000 2000 1000 700 500 300 200 100
options pascals
vars 36
HGTsfc 0,1,0 0,3,5 ** surface Geopotential Height [gpm]
HGTprs 31,100 0,3,5 ** (1000 975 950 925 900.. 7 5 3 2 1) Geopotential Height [gpm]
HGTmwl 0,6,0 0,3,5 ** max wind Geopotential Height [gpm]
HGTtrop 0,7,0 0,3,5 ** tropopause Geopotential Height [gpm]
ICECsfc 0,1,0 10,2,0 ** surface Ice Cover [Proportion]
LANDsfc 0,1,0 2,0,0 ** surface Land Cover (0=sea [1=land)]
MSLETmsl 0,101,0 0,3,192 ** mean sea level MSLP (Eta Model Reduction) [Pa]
PRESsfc 0,1,0 0,3,0 ** surface Pressure [Pa]
PRESmwl 0,6,0 0,3,0 ** max wind Pressure [Pa]
PREStrop 0,7,0 0,3,0 ** tropopause Pressure [Pa]
PRMSLmsl 0,101,0 0,3,1 ** mean sea level Pressure Reduced To MSL [Pa]
RHprs 31,100 0,1,1 ** (1000 975 950 925 900.. 7 5 3 2 1) Relative Humidity [%]
RH2m 0,103,2 0,1,1 ** 2 m above ground Relative Humidity [%]
SNODsfc 0,1,0 0,1,11 ** surface Snow Depth [m]
SOILW0_10cm 0,106,0,0.1 2,0,192 ** 0-0.1 m below ground Volumetric Soil Moisture Content [Proportion]
SOILW10_40cm 0,106,0.1,0.4 2,0,192 ** 0.1-0.4 m below ground Volumetric Soil Moisture Content [Proportion]
SOILW40_100cm 0,106,0.4,1 2,0,192 ** 0.4-1 m below ground Volumetric Soil Moisture Content [Proportion]
SOILW100_200cm 0,106,1,2 2,0,192 ** 1-2 m below ground Volumetric Soil Moisture Content [Proportion]
TMPsfc 0,1,0 0,0,0 ** surface Temperature [K]
TMPprs 31,100 0,0,0 ** (1000 975 950 925 900.. 7 5 3 2 1) Temperature [K]
TMP2m 0,103,2 0,0,0 ** 2 m above ground Temperature [K]
TMPmwl 0,6,0 0,0,0 ** max wind Temperature [K]
TMPtrop 0,7,0 0,0,0 ** tropopause Temperature [K]
TSOIL0_10cm 0,106,0,0.1 2,0,2 ** 0-0.1 m below ground Soil Temperature [K]
TSOIL10_40cm 0,106,0.1,0.4 2,0,2 ** 0.1-0.4 m below ground Soil Temperature [K]
TSOIL40_100cm 0,106,0.4,1 2,0,2 ** 0.4-1 m below ground Soil Temperature [K]
TSOIL100_200cm 0,106,1,2 2,0,2 ** 1-2 m below ground Soil Temperature [K]
UGRDprs 31,100 0,2,2 ** (1000 975 950 925 900.. 7 5 3 2 1) U-Component Of Wind [m/s]
UGRD10m 0,103,10 0,2,2 ** 10 m above ground U-Component Of Wind [m/s]
UGRDmwl 0,6,0 0,2,2 ** max wind U-Component Of Wind [m/s]
UGRDtrop 0,7,0 0,2,2 ** tropopause U-Component Of Wind [m/s]
VGRDprs 31,100 0,2,3 ** (1000 975 950 925 900.. 7 5 3 2 1) V-Component Of Wind [m/s]
VGRD10m 0,103,10 0,2,3 ** 10 m above ground V-Component Of Wind [m/s]
VGRDmwl 0,6,0 0,2,3 ** max wind V-Component Of Wind [m/s]
VGRDtrop 0,7,0 0,2,3 ** tropopause V-Component Of Wind [m/s]
WEASDsfc 0,1,0 0,1,13 ** surface Water Equivalent Of Accumulated Snow Depth [kg/m^2]
ENDVARS

GFS 0.25
dset ^17072500.gfs.t00z.0p25.pgrb2f003
index ^17072500.gfs.t00z.0p25.pgrb2f003.idx
undef 9.999E+20
title 17072500.gfs.t00z.0p25.pgrb2f003
* produced by g2ctl v0.0.8.8
* command line options: -verf 17072500.gfs.t00z.0p25.pgrb2f003
* griddef=1:0:(83 x 59):grid_template=0:winds(N/S): lat-lon grid:(83 x 59) units 1e-06 input WE:SN output WE:SN res 48 lat 34.500000 to 49.000000 by 0.250000 lon 2.250000 to 22.750000 by 0.250000 #points=4897:winds(N/S)

dtype grib2
ydef 59 linear 34.500000 0.25
xdef 83 linear 2.250000 0.25
tdef 1 linear 03Z25jul2017 1mo
* PROFILE hPa
zdef 31 levels 100000 97500 95000 92500 90000 85000 80000 75000 70000 65000 60000 55000 50000 45000 40000 35000 30000 25000 20000 15000 10000 7000 5000 3000 2000 1000 700 500 300 200 100
options pascals
vars 40
HGTsfc 0,1,0 0,3,5 ** surface Geopotential Height [gpm]
HGTprs 31,100 0,3,5 ** (1000 975 950 925 900.. 7 5 3 2 1) Geopotential Height [gpm]
HGTmwl 0,6,0 0,3,5 ** max wind Geopotential Height [gpm]
HGTtrop 0,7,0 0,3,5 ** tropopause Geopotential Height [gpm]
ICECsfc 0,1,0 10,2,0 ** surface Ice Cover [Proportion]
LANDsfc 0,1,0 2,0,0 ** surface Land Cover (0=sea [1=land)]
MSLETmsl 0,101,0 0,3,192 ** mean sea level MSLP (Eta Model Reduction) [Pa]
PRESsfc 0,1,0 0,3,0 ** surface Pressure [Pa]
PRES80m 0,103,80 0,3,0 ** 80 m above ground Pressure [Pa]
PRESmwl 0,6,0 0,3,0 ** max wind Pressure [Pa]
PREStrop 0,7,0 0,3,0 ** tropopause Pressure [Pa]
PRMSLmsl 0,101,0 0,3,1 ** mean sea level Pressure Reduced To MSL [Pa]
RHprs 31,100 0,1,1 ** (1000 975 950 925 900.. 7 5 3 2 1) Relative Humidity [%]
RH2m 0,103,2 0,1,1 ** 2 m above ground Relative Humidity [%]
SNODsfc 0,1,0 0,1,11 ** surface Snow Depth [m]
SOILW0_10cm 0,106,0,0.1 2,0,192 ** 0-0.1 m below ground Volumetric Soil Moisture Content [Proportion]
SOILW10_40cm 0,106,0.1,0.4 2,0,192 ** 0.1-0.4 m below ground Volumetric Soil Moisture Content [Proportion]
SOILW40_100cm 0,106,0.4,1 2,0,192 ** 0.4-1 m below ground Volumetric Soil Moisture Content [Proportion]
SOILW100_200cm 0,106,1,2 2,0,192 ** 1-2 m below ground Volumetric Soil Moisture Content [Proportion]
TMPsfc 0,1,0 0,0,0 ** surface Temperature [K]
TMPprs 31,100 0,0,0 ** (1000 975 950 925 900.. 7 5 3 2 1) Temperature [K]
TMP2m 0,103,2 0,0,0 ** 2 m above ground Temperature [K]
TMP80m 0,103,80 0,0,0 ** 80 m above ground Temperature [K]
TMPmwl 0,6,0 0,0,0 ** max wind Temperature [K]
TMPtrop 0,7,0 0,0,0 ** tropopause Temperature [K]
TSOIL0_10cm 0,106,0,0.1 2,0,2 ** 0-0.1 m below ground Soil Temperature [K]
TSOIL10_40cm 0,106,0.1,0.4 2,0,2 ** 0.1-0.4 m below ground Soil Temperature [K]
TSOIL40_100cm 0,106,0.4,1 2,0,2 ** 0.4-1 m below ground Soil Temperature [K]
TSOIL100_200cm 0,106,1,2 2,0,2 ** 1-2 m below ground Soil Temperature [K]
UGRDprs 31,100 0,2,2 ** (1000 975 950 925 900.. 7 5 3 2 1) U-Component Of Wind [m/s]
UGRD10m 0,103,10 0,2,2 ** 10 m above ground U-Component Of Wind [m/s]
UGRD80m 0,103,80 0,2,2 ** 80 m above ground U-Component Of Wind [m/s]
UGRDmwl 0,6,0 0,2,2 ** max wind U-Component Of Wind [m/s]
UGRDtrop 0,7,0 0,2,2 ** tropopause U-Component Of Wind [m/s]
VGRDprs 31,100 0,2,3 ** (1000 975 950 925 900.. 7 5 3 2 1) V-Component Of Wind [m/s]
VGRD10m 0,103,10 0,2,3 ** 10 m above ground V-Component Of Wind [m/s]
VGRD80m 0,103,80 0,2,3 ** 80 m above ground V-Component Of Wind [m/s]
VGRDmwl 0,6,0 0,2,3 ** max wind V-Component Of Wind [m/s]
VGRDtrop 0,7,0 0,2,3 ** tropopause V-Component Of Wind [m/s]
WEASDsfc 0,1,0 0,1,13 ** surface Water Equivalent Of Accumulated Snow Depth [kg/m^2]
ENDVARS

meteoadriatic
Posts: 1512
Joined: Wed Aug 19, 2009 10:05 am

Re: Changes needed for GFS Update 2017?

Post by meteoadriatic » Wed Jul 26, 2017 9:10 am

Really really interesting. This is my stuff:

Code: Select all

vars 41
HGTsfc   0,1,0   0,3,5 ** surface Geopotential Height [gpm]
HGTprs    31,100  0,3,5 ** (1000 975 950 925 900.. 7 5 3 2 1) Geopotential Height [gpm]
HGTmwl   0,6,0   0,3,5 ** max wind Geopotential Height [gpm]
HGTtrop   0,7,0   0,3,5 ** tropopause Geopotential Height [gpm]
ICECsfc   0,1,0   10,2,0 ** surface Ice Cover [Proportion]
LANDsfc   0,1,0   2,0,0 ** surface Land Cover (0=sea, 1=land) [Proportion]
LANDNsfc   0,1,0   2,0,218 ** surface Land-sea coverage (nearest neighbor) [land=1,sea=0] [-]
MSLETmsl   0,101,0   0,3,192 ** mean sea level MSLP (Eta model reduction) [Pa]
PRESsfc   0,1,0   0,3,0 ** surface Pressure [Pa]
PRES80m   0,103,80   0,3,0 ** 80 m above ground Pressure [Pa]
PRESmwl   0,6,0   0,3,0 ** max wind Pressure [Pa]
PREStrop   0,7,0   0,3,0 ** tropopause Pressure [Pa]
PRMSLmsl   0,101,0   0,3,1 ** mean sea level Pressure Reduced to MSL [Pa]
RHprs    31,100  0,1,1 ** (1000 975 950 925 900.. 7 5 3 2 1) Relative Humidity [%]
RH2m   0,103,2   0,1,1 ** 2 m above ground Relative Humidity [%]
SNODsfc   0,1,0   0,1,11 ** surface Snow Depth [m]
SOILW0_10cm  0,106,0,0.1   2,0,192 ** 0-0.1 m below ground Volumetric Soil Moisture Content [Fraction]
SOILW10_40cm  0,106,0.1,0.4   2,0,192 ** 0.1-0.4 m below ground Volumetric Soil Moisture Content [Fraction]
SOILW40_100cm  0,106,0.4,1   2,0,192 ** 0.4-1 m below ground Volumetric Soil Moisture Content [Fraction]
SOILW100_200cm  0,106,1,2   2,0,192 ** 1-2 m below ground Volumetric Soil Moisture Content [Fraction]
TMPsfc   0,1,0   0,0,0 ** surface Temperature [K]
TMPprs    31,100  0,0,0 ** (1000 975 950 925 900.. 7 5 3 2 1) Temperature [K]
TMP2m   0,103,2   0,0,0 ** 2 m above ground Temperature [K]
TMP80m   0,103,80   0,0,0 ** 80 m above ground Temperature [K]
TMPmwl   0,6,0   0,0,0 ** max wind Temperature [K]
TMPtrop   0,7,0   0,0,0 ** tropopause Temperature [K]
TSOIL0_10cm  0,106,0,0.1   2,0,2 ** 0-0.1 m below ground Soil Temperature [K]
TSOIL10_40cm  0,106,0.1,0.4   2,0,2 ** 0.1-0.4 m below ground Soil Temperature [K]
TSOIL40_100cm  0,106,0.4,1   2,0,2 ** 0.4-1 m below ground Soil Temperature [K]
TSOIL100_200cm  0,106,1,2   2,0,2 ** 1-2 m below ground Soil Temperature [K]
UGRDprs    31,100  0,2,2 ** (1000 975 950 925 900.. 7 5 3 2 1) U-Component of Wind [m/s]
UGRD10m   0,103,10   0,2,2 ** 10 m above ground U-Component of Wind [m/s]
UGRD80m   0,103,80   0,2,2 ** 80 m above ground U-Component of Wind [m/s]
UGRDmwl   0,6,0   0,2,2 ** max wind U-Component of Wind [m/s]
UGRDtrop   0,7,0   0,2,2 ** tropopause U-Component of Wind [m/s]
VGRDprs    31,100  0,2,3 ** (1000 975 950 925 900.. 7 5 3 2 1) V-Component of Wind [m/s]
VGRD10m   0,103,10   0,2,3 ** 10 m above ground V-Component of Wind [m/s]
VGRD80m   0,103,80   0,2,3 ** 80 m above ground V-Component of Wind [m/s]
VGRDmwl   0,6,0   0,2,3 ** max wind V-Component of Wind [m/s]
VGRDtrop   0,7,0   0,2,3 ** tropopause V-Component of Wind [m/s]
WEASDsfc   0,1,0   0,1,13 ** surface Water Equivalent of Accumulated Snow Depth [kg/m^2]
ENDVARS
What is a server you download them from? I use http://ems1.comet.ucar.edu

BTW those 80m winds that are missing shoud not make a reason for model to crash.

meteoadriatic
Posts: 1512
Joined: Wed Aug 19, 2009 10:05 am

Re: Changes needed for GFS Update 2017?

Post by meteoadriatic » Wed Jul 26, 2017 9:22 am

Whatever... you should investigate other things now.

If I get situation like you, I would compare met_em*.nc file (first one is enough) that gets created after you run ems_prep with 0.25 to the one that gets created when you run ems_prep with 0.50 GFS.

You can open those .nc files with ncview application. You can open them in parallel on your screen (just run 2 separate instances of ncview for each file). Then on each instance open same variable and search for differences. Something must be different there.

I can explain more in details if you need let me know.

j0nes2k
Posts: 53
Joined: Wed Feb 03, 2010 5:06 pm

Re: Changes needed for GFS Update 2017?

Post by j0nes2k » Thu Jul 27, 2017 12:22 pm

Here is another thing I saw after the latest UEMS / GFS Update: I am running autopost on the same server as my main model and I am generating Grib and GrADS files. Before the update, this was not a problem at all, the load on the server was quite constant. After the update, it seems the autopost tasks (especially wgrib2) are running slower than before which in turn causes a higher load.

Can anyone confirm this?

meteo60
Posts: 96
Joined: Tue Apr 17, 2012 4:50 pm

Re: Changes needed for GFS Update 2017?

Post by meteo60 » Mon Jul 31, 2017 7:00 am

I have none of these problems but I test debian 9 (kernel 4.9) and some runs crash with segmentation error. I'm trying with GFS 0.5 ptiles but same problem... I'll reinstall debian 8 (kernel 3.16)

meteoadriatic
Posts: 1512
Joined: Wed Aug 19, 2009 10:05 am

Re: Changes needed for GFS Update 2017?

Post by meteoadriatic » Mon Jul 31, 2017 9:45 am

There is no way that crashes are anyhow dependent on OS/kernel.

meteo60
Posts: 96
Joined: Tue Apr 17, 2012 4:50 pm

Re: Changes needed for GFS Update 2017?

Post by meteo60 » Mon Jul 31, 2017 8:35 pm

So Debian 9 does not seem to be the cause of segmentation fault. Only the runs of 2017073018Z and 2017073100Z crash the run from the start either with GFS 0.25 or 0.5, the previous and following runs are ok... Probably an error in the GFS data ?! I keep watching...

Post Reply

Who is online

Users browsing this forum: No registered users and 3 guests