I/O error 32 on data retrieval

This is the place to get help with Digital Atmosphere, suggest improvements, and get tips.
packman
Member
Posts: 38
Joined: Tue Jul 27, 2004 9:39 am

Post by packman »

I suspect this is a date formatting problem. The Fleetcode data source gives an error about 08/23/03 11:33:00 being an invalid date. The first object that the downloader directory scanner will see is the parent directory for the Fleetcode data. This is dated 23 Aug 2002 11:33:00. I think the server is sending the date back in DD/MM/YY format and the downloader is expecting MM/DD/YY.
packman
Member
Posts: 38
Joined: Tue Jul 27, 2004 9:39 am

Post by packman »

Sorry, I forgot to add that I'm getting this error with v1.1c.

Also having now looked at the Fleetcode data, picking the latest dated file isn't going to work reliably. Taking today as an example, it's currently 0830 GMT and the files are time stamped:

ASXX21.290000 - 29 Jul 2004 04:11
ASXX21.290600 - 29 Jul 2004 00:54 (contains no data)
ASXX21.291200 - 29 Jul 2004 06:54 (contains no data)
ASXX21.291800 - 29 Jun 2004 22:29

Using @S to pick the latest synoptic hour (06) doesn't work because the data file only seems to get updated 4-6 hours after the synoptic period it represents.

The only way I can see to get the latest valid data is to download the latest file for the current month that has a size bigger than 1k.

Chris
TimWest
Member
Posts: 23
Joined: Sun Nov 23, 2003 9:22 pm
Location: UK

Post by TimWest »

You could just make up four entries in your data retrieval screen and then use the right one at the right time of day. The format would be
...ASXX21.@D0000
...ASXX21.@D0600
...ASXX21.@D1200
...ASXX21.@D1800
packman
Member
Posts: 38
Joined: Tue Jul 27, 2004 9:39 am

Post by packman »

That works manually, although having tried something similar today it's messy because you've got to remember to change to a different data retrieval setting approx 4 hours after the synoptic hour change, i.e. approx 1000 for the 0600 data. Looking back at the data files for the last months, the timestamps are sometimes up to 6 hours after the relevant time, i.e. 1200 for the 0600 data.

I can't see any way of doing this in a script though. Even if you scripted the downloaded of all four files (which always exist because there's no month or year in the filename) you will often get a file saying 'no data' as the last one downloaded for the day or worse still the data from the same date last month :-(
Post Reply