Submit Hint Search The Forums LinksStatsPollsHeadlinesRSS
14,000 hints and counting!

Create customized weather satellite movies Internet
The NOAA Geostationary Satellite Server stores three weeks' worth of images on their website. They have a menu-based image server to browse through the archives, but for batch downloading images, you need to use other tools -- I found the Unix utility curl to be useful. It performs basic wildcarding and brace expansion, so you can download an entire day's worth of images using this feature. For instance, here's how you'd grab all the images of Hurricane Wilma crossing Florida on Monday. In Terminal (and probably in a new directory, just to keep the images separated from your other files), type this command:
curl -O "http://www.goes-arch.noaa.gov/HUIR05297[00-23]{15,45}.GIF"
This will grab all 48 images from Monday, and download them into the new directory. From there, it's easy to assemble these images into spectacular time-lapse movies of any length you want. Use Quicktime Player (Pro version only) and choose File: Open Image Sequence, and just select the first image in the folder. Set a frame rate, click OK, and watch your movie magically appear.

[robg adds: I've modified the curl command quite a bit from what was submitted so as to only grab the 48 images that exist for a given day. There are also some third-party apps that can assemble images into a QuickTime movie; check VersionTracker or MacUpdate and try searching on QuickTime movie or somesuch. Read the rest of the hint if you'd like to know more about how this particular trick works, and how to grab images from different satellites and/or days. The 'addendum' is my writing, not that of rjbailey...]

First, a bit about how that curl command works. I'll break it down into its component pieces for an easier explanation:
  • curl -O: The -O option tells curl to write the local file with the same name as the remote file.
  • "http://www.goes-arch.noaa.gov/: This is just the first part of the URL from where we'll grab the images.
  • HUIR05297: This is the first part of the image's name; HUIR varies depending on which satellite you're using (more on that later). 05 is the year, and 297 is the day of the year.
  • [00-23]: Characters in square brackets in curl are expanded automatically to fill the possible range. In this case, that means that curl will put the digits 00, 01, 02, 03, ..., 21, 22, 23 in the filename.
  • {15,45}: Using curly brackets in curl, only those specifically listed values will be inserted -- 15 and 45 in this case.
  • .GIF": This is just the end of the image's name
So when curl runs, it will expand the [ ] and { } sections as appopriate, and then grab those files from the server:
  • HUIR052970015.GIF
  • HUIR052970045.GIF
  • HUIR052970115.GIF
  • HUIR052970145.GIF
  • etc...
  • HUIR052972345.GIF
That's how you wind up with just the 48 images from Monday's hurricane satellite on your drive. But how do you actually find the images' URL in the first place? That part's a bit trickier. On the NOAA Geostationary Satellite Server homepage, there are a series of links on the left-hand side of the page. Two of these are for archives; the GOES East Archive and the GOES West Archive. Clicking either of these links will take you to a search page where you can specify the exact sector (satellite), channel (image type), day, week, and time for an image you'd like to retrieve. To work backwards through our hurricane example, select the GOES East Archive, and then search for:
  • Sector: GOES East Hurricane Sector
  • Channel: Infrared
  • Day: Monday
  • Week: This week -- note that this only applies if you're trying this hint prior to 10/31/2005! The archive only keeps three weeks' of images on file, so you won't be able to go back indefinitely.
  • Time: Pick the first one in the list, 0015Z
  • Click Submit Choice
When the search is done, you should be looking at a satellite image on your screen, along with some explanatory text. Control-click on the image and choose Copy Image Address (in Safari; other browsers have a similar option in their contextual menus). Open a new tab or window, and paste the address. You should see:

http://www.goes-arch.noaa.gov/HUIR052970015.GIF

Presto; that's exactly the URL we used for our first image. The next step is to go back to the search screen, and see exactly what times images are available. In the case of the hurricane images the Times search field shows them coming out every 30 minutes, on the 15 and the 45. Based on that, I built the above curl syntax using a bit of trial and error. Other satellites will have different times, so you'll have to modify the curl code somewhat to only grab the pictures you wish to see. The satellite that covers the west coast, for instance, takes pictures at 00 and 30.

You can also modify the curl code to grab more than one day's worth of images:
curl -O "http://www.goes-arch.noaa.gov/HUIR05[295-298][00-23]{15,45}.GIF"
That command will grab the images for a four-day period, covering Saturday through Tuesday.

Note: Grabbing hundreds of images at a time from a given server can be considered a Bad Thing To Do. Treat the servers nicely, and try not to put a huge load on them by grabbing lots and lots and lots of images ... otherwise, you may discover that your IP address no longer works on a given server (when the sys admin blocks it).

You can really do a lot with curl and its character replacement abilities; just make sure you construct your queries carefully so that you're not requesting a ton of files that don't exist -- otherwise, you'll get a 4KB 'empty' file for each non-existent file you try to download.
    •    
  • Currently 2.50 / 5
  You rated: 5 / 5 (4 votes cast)
 
[12,052 views]  

Create customized weather satellite movies | 1 comments | Create New Account
Click here to return to the 'Create customized weather satellite movies' hint
The following comments are owned by whoever posted them. This site is not responsible for what they say.
Create customized weather satellite movies
Authored by: Bigc on Oct 28, '05 09:26:52AM

or you can just go to this page and get west coast satellite weather movies...

http://www.nrlmry.navy.mil:80/sat-bin/epac_westcoast.cgi

or the main page for other satellites:

http://www.nrlmry.navy.mil:80/projects/sat_products.html



[ Reply to This | # ]