download of gfs .25 a and b failing

[theocarter2911]

Hi all,

I have been using a script from one of the users in order to download the gfs .25 a and b files, then combining them, to have a smaller area download for our office use of .25 degree gfs.

Since yesterday, this is not working anymore. Below is a sample of the script which fetches from nomads.

I just get a read error "connection timed out" due to headers when I try to run it manually.

Has anyone else had a similar problem, have the file names or location upstream changed perhaps?

Best regards,
Theo

# "A" file
wget --retry-connrefused --waitretry=5 --read-timeout=90 --timeout=90 --tries=inf "http://nomads.ncep.noaa.gov/cgi-bin/fil ... F${DATADIR}" -O gfs.${TZ}.pgrb2.0p25.f${ZERO_SUFFIX}${HOUR_OF_PRODUCTION}
# "B" file
wget --retry-connrefused --waitretry=5 --read-timeout=90 --timeout=90 --tries=inf "http://nomads.ncep.noaa.gov/cgi-bin/fil ... F${DATADIR}" -O gfs.${TZ}.pgrb2b.0p25.f${ZERO_SUFFIX}${HOUR_OF_PRODUCTION}
# Append the "B" file to the "A" file

[oib]

Problems also for me.
Peraphs it deals with this:

Code: Select all

Due to the government shutdown the scheduled NOMADS/ftpprd site failover did not occur on January 22. 

The site failovers are rescheduled for Today, January 29 and Wednesday, January 31; on these days we will be conducting a major site failover and backup test of our entire data center. Site failovers of NOMADS/ftpprd occur often and without notification to this listserv, but this announcement is to alert users that it will be on a larger scale. We do not expect any impacts, and the failover as always, should be seamless to all of our users. If you do notice any unexplained behavior please contact our helpdesk at ncep.pmb.dataflow@noaa.gov

Thanks,

Justin Cooke
NCEP Central Operations

[theocarter2911]

Brilliant, thank you! That should be it!
Theo

[theocarter2911]

Hi Oib,

The gfs files have been coming in, but it is terribly slow, the first forecast file F03 takes about an hour before it is in, then the rest seem to come in ok'ish. Are you also experiencing this?

Best regards,
Theo

[surgeon]

I have same problem here. 2 Mb file takes 3-6 mnutes. Sometimes longer.

[Gabriel Cassol]

# "A" file
wget --retry-connrefused --waitretry=5 --read-timeout=90 --timeout=90 --tries=inf "http://nomads.ncep.noaa.gov/cgi-bin/fil ... F${DATADIR}" -O gfs.${TZ}.pgrb2.0p25.f${ZERO_SUFFIX}${HOUR_OF_PRODUCTION}
# "B" file
wget --retry-connrefused --waitretry=5 --read-timeout=90 --timeout=90 --tries=inf "http://nomads.ncep.noaa.gov/cgi-bin/fil ... F${DATADIR}" -O gfs.${TZ}.pgrb2b.0p25.f${ZERO_SUFFIX}${HOUR_OF_PRODUCTION}
# Append the "B" file to the "A" file

Theo, are your attributes used in conjunction with wget to prevent GFS data download failures? I ask why I am currently experiencing this kind of problem, and I am looking for a possible solution.

[theocarter2911]

Hi Gabriel,

Sorry for the 9 month late reply! Did you get this sorted?

This system of mine runs so very well that I almost never end up looking on this forum. My apologies.

Best regards,
Theo