GFS grib download from soostrc.comet.ucar.edu

Forum dedicated to older versions of EMS package (WRFEMS v3.2, v3.1 or older). Support is user-to-user based, so please help others if you can.
aeolis
Posts: 3
Joined: Thu Jun 24, 2010 3:22 pm

GFS grib download from soostrc.comet.ucar.edu

Post by aeolis » Thu Jun 24, 2010 3:45 pm

Hello WRF users,
If for some reason I'm not able to run my system with the data from ftp.ncep.noaa.gov, I rerun the model the next day with the option --date to force a run with the GFS data from yesterday. Today I noticed it was not working as normally, until today it just downloaded the GFS files from soostrc.comet.ucar.edu and the model would run without problems. Today the GFS files couldn't be found.I got a notice

--> Attempting to acquire /data/grib/20100623/gfs/grib.t00z/10062300.gfs.t00z.pgrb2f00 - Not available

After some surfing on the soostrc.comet.ucar.edu site I found that the data structure of the site has changed. I found the data located in: /data/grib/gfs/20100623/grib.t00z and I could do a manual download.

I would like to correct my configuration files so I could restore the automatic process. Where should I change the paths for the download.

Best regards,
Kees

maxpowers
Posts: 9
Joined: Wed May 26, 2010 10:17 pm

Re: GFS grib download from soostrc.comet.ucar.edu

Post by maxpowers » Fri Jun 25, 2010 5:44 pm

Hey,

I have encountered the same problem on two different machines running WRF EMS. It is strange because the last month I've been running it fine everyday, but now it doesn't seem to work for me from June 20ish - June 23ish.

Strange, I'll let you know if I find anything out.

wrfems
Posts: 8
Joined: Mon Jun 07, 2010 7:36 pm
Location: Boulder, Colorado - USA
Contact:

Re: GFS grib download from soostrc.comet.ucar.edu

Post by wrfems » Tue Jun 29, 2010 5:45 pm

Hello All,

Last week we moved our offices into another building. During that time the soostrc machine was
brought down for the move, and while we were at it, update the OS since it was rather old and
the IT security would no longer allow the machine on UCAR's network.

Unfortunately, there was a drive failure during the update, which forced me to put into operation a
new server that I was testing and give it the soostrc hostname.

There are a few issues:

1. The "new" soostrc does not support EMS V2 personal tiles. EMS V3 only
2. Only http access is available. No anonymous ftp.
3. The location of the GRIB (GFS and others) have changed from the original
soostrc location

4. The entry in the gfs_gribinfo.conf files should read:

SERVER-HTTP = STRC:/data/grib/gfs/YYYYMMDD/grib.tCCz/YYMMDDCC.gfs.tCCz.pgrb2fFF

5. Remove the SERVER-FTP entry for SOOSTRC

6. You should be using the GFS personal tiles, in which case you have three servers at your disposal


Contact me with further problems/questions.

Robert
Last edited by wrfems on Thu Jul 01, 2010 1:40 pm, edited 1 time in total.

aeolis
Posts: 3
Joined: Thu Jun 24, 2010 3:22 pm

Re: GFS grib download from soostrc.comet.ucar.edu

Post by aeolis » Thu Jul 01, 2010 10:10 am

Hello Robert,

I made the changes and everything is working again. Thanks for the help.

Kees

dolesi_beni
Posts: 7
Joined: Tue Jul 13, 2010 6:55 am

Re: GFS grib download from soostrc.comet.ucar.edu

Post by dolesi_beni » Tue Jul 13, 2010 7:11 am

Guys, I am not very familiar with Linux but through trials I am able to do basic command. I want to switch form WRF-EMS version 2 to version 3 and I was advised to change change values to "soostrc.comet.ucar.edu" but I dont know where I am supposed to make these changes. How can I do this? Which file do I need to change?

Below is the error message not all of it.

! WRF EMS Inspirational Message #257 - Help Me, Help You

There appears to be a problem connecting to:

128.117.110.214,

which is the EMS update server. Maybe the server has changed and nobody
told you or maybe you don't have a connection to the outside world?
Either way, you are not getting anything from me until the problem is
resolved.


"All generalizations are false, including this one"
- Mark Twain


Your Installation is Incomplete - Now go forth and fix the problem!

Nigel Says - "WRF EMS, It's taking mesoscale modeling to 11"
Last edited by dolesi_beni on Fri Jul 23, 2010 12:17 pm, edited 1 time in total.

meteoadriatic
Posts: 1567
Joined: Wed Aug 19, 2009 10:05 am

Re: GFS grib download from soostrc.comet.ucar.edu

Post by meteoadriatic » Tue Jul 13, 2010 8:24 am

Hello,

Tell us first, what is the command you issue when you get this error?

Thx.

wrfems
Posts: 8
Joined: Mon Jun 07, 2010 7:36 pm
Location: Boulder, Colorado - USA
Contact:

Re: GFS grib download from soostrc.comet.ucar.edu

Post by wrfems » Wed Jul 21, 2010 4:54 pm

In the ems_install.pl routine you will find that 128.117.110.214 is hardcoded; however, I have since updated the soostrc server and the IP has changed. You can simply replace the IP with "soostrc.comet.ucar.edu" and all should be well.

Robert

dolesi_beni wrote:Guys, I am not very familiar with Linux but through trials I am able to do basic command. I want to switch form WRF-EMS version 2 to version 3 and I was advised to change change values to "soostrc.comet.ucar.edu" but I dont know where I am supposed to make these changes. How can I do this? Which file do I need to change?

Below is the error message not all of it.

! WRF EMS Inspirational Message #257 - Help Me, Help You

There appears to be a problem connecting to:

128.117.110.214,

which is the EMS update server. Maybe the server has changed and nobody
told you or maybe you don't have a connection to the outside world?
Either way, you are not getting anything from me until the problem is
resolved.


"All generalizations are false, including this one"
- Mark Twain


Your Installation is Incomplete - Now go forth and fix the problem!

Nigel Says - "WRF EMS, It's taking mesoscale modeling to 11"

dolesi_beni
Posts: 7
Joined: Tue Jul 13, 2010 6:55 am

Re: GFS grib download from soostrc.comet.ucar.edu

Post by dolesi_beni » Fri Jul 23, 2010 12:02 pm

These are the command I used,
===========================================================================
[root@WRF08 emsfiles]# ./ems_install.pl --install --locdir /usr1/emsfiles/3.1.1.5.1
and I got this...
==================================================================

Greetings clearly intelligent and devastatingly good-looking WRF EMS user!

Welcome to the SOO Science and Training Resource Center (SOO/STRC) Weather
Research and Forecasting (WRF) Environmental Modeling System (EMS)
installation and update routine.

Phew! That's more than a mouthful.


* Start with the Initial User Interrogation

Before we begin this rather painless installation process I will need to ask you a few
questions regarding the location and ownership of the distribution.

Since you are installing the release as root, the process should go smoothly. You will
be asked for a user name to assign the ownership of the files and a location for the
installation. If the user does not exist then an account will be created.

Note that running the EMS currently requires that users run tcsh or csh as their shell.
This requirement may change someday but it won't be by tomorrow unless you are doing all
the work.

Do you wish to continue? [Yes] Yes

So let us continue this forbidden EMS dance...


* Finding that Perfect Home for the WRF EMS

So, where would you like to install your WRF EMS? [/usr1] /usr1

The WRF EMS distribution will be located in /usr1/wrfems


* Checking if T|Cshell is installed on the system

! IMPORTANT: The user assigned ownership of the WRF EMS must be running either a T
or C shell environment. These shells must also be installed on all systems
running the EMS.

* Is T shell installed? - Yes
* Is C shell installed? - Yes

* Enough About Me. What About ... YOU?

To whom shall I assign guardianship of the EMS? [emsuser] emsuser

* Collecting system information so I can determine which binaries are best for you

! Unknown host WRF08
It appears that your system is not familiar with hostname WRF08. This may be due
to it being a stand alone system with no IP address assigned to WRF08. You can
correct this potential problem by placing an entry in the /etc/hosts file;
however, for now I will use the "localhost" IP address.

System Information for WRF08

System Date : Fri Jul 23 11:52:16 2010 UTC
Alternate Hostname : localhost
Machine Address : 127.0.0.1
Alternate Address : 48791
Machine OS : Linux
Kernel : 2.6.18-1.2798.fc6xen
Linux Distribution : Fedora Core release 6 (Zod)
CPU Name : Intel(R) Xeon(R) CPU E5320 @ 1.86GHz
CPU Type : x86_64
CPU Instructions : x64
Physical CPUs : 8
Cores per CPU : 1
Total Processors : 8
Hyper-Threading : Off
CPU Speed (MHz) : 1862.603
System Memory : 3895 Mb
System Target : x64



! WRF EMS Inspirational Message #416 - Help Me, Help You

There appears to be a possible problem in that either there are no
releases available on the EMS server or that there was a problem getting
the list of releases.

Either way, I am unable to continue with your request.


"We have the best government that money can buy."
- Mark Twain


Your Installation is Incomplete - Now go forth and fix the problem!

Nigel Says - "WRF EMS, It's taking mesoscale modeling to 11"
=================================================================================
Robert advised me to copy the IP address and replace it by the following soostrc.comet.ucar.edu and I did this in the ems_install.pl file and replace it by 128.117.110.214. However the outcome was the same.

Since it is not working how do I follow or do Robert's instuction? Here is what he told me : "In the ems_install.pl routine you will find that 128.117.110.214 is hardcoded; however, I have since updated the soostrc server and the IP has changed. You can simply replace the IP with "soostrc.comet.ucar.edu" and all should be well."

meteoadriatic
Posts: 1567
Joined: Wed Aug 19, 2009 10:05 am

Re: GFS grib download from soostrc.comet.ucar.edu

Post by meteoadriatic » Fri Jul 23, 2010 12:52 pm

Hello,

but now you don't have the same error?

Do you really have all needed files in /usr1/emsfiles/3.1.1.5.1 directory?

Did you tried to start installer like this:

Code: Select all

./ems_install.pl --install
That way installer will look for files on the server not locally and eventually find them all there. It should at least :) If it does not, you might try another installer script (in case you screwed up something there). I can send my installer file to you if you wish (corrected for this IP issue).

dolesi_beni
Posts: 7
Joined: Tue Jul 13, 2010 6:55 am

Re: GFS grib download from soostrc.comet.ucar.edu

Post by dolesi_beni » Wed Jul 28, 2010 6:24 am

meteoadriatic wrote:Hello,

but now you don't have the same error?

Do you really have all needed files in /usr1/emsfiles/3.1.1.5.1 directory?

Did you tried to start installer like this:

Code: Select all

./ems_install.pl --install
That way installer will look for files on the server not locally and eventually find them all there. It should at least :) If it does not, you might try another installer script (in case you screwed up something there). I can send my installer file to you if you wish (corrected for this IP issue).
Hello,
Iam grateful for your advice. Would you please send me your installer script with the corrected IP issue. Please I will be very happy if you do this.

if you need an email please send to: dolesi_beni@yahoo.com
Thanks in advance

Post Reply