Author Topic: Any way to download old data (2009) submitted to CWOP?  (Read 1424 times)

0 Members and 1 Guest are viewing this topic.

Offline longmire

  • Contributor
  • ***
  • Posts: 123
  • WD (latest) GRL3_2 WF TWI WR-25e Win10Pro
Any way to download old data (2009) submitted to CWOP?
« on: September 24, 2014, 02:09:43 PM »
As I continue to obsessively gather all my station data together on my new home server - I notice the one and only YYYYdbase.csv file missing is 2009  :sad: I looked at my stuff on wunderground, and the thought of pulling it a day at a time and then rearranging to fit VWSql field order made me look for other options.

So I thought - I have been sending to CWOP the whole time - maybe????????

Is there any way to get a csv file of the 2009 data for CW6132? It may well be less than the whole year - since that was after Hurricane Ike and IIRC we had about six months of work done after that.

Steve

Offline Beaudog

  • Forecaster
  • *****
  • Posts: 1217
Re: Any way to download old data (2009) submitted to CWOP?
« Reply #1 on: September 24, 2014, 03:07:10 PM »
I think this may do it.  Maybe not  You will need to do the join Meso west thing and then when you click the download tab you have an option to download by year and month.


http://mesowest.utah.edu/cgi-bin/droman/download_ndb.cgi?stn=C6132&year1=2014&day1=24&month1=9&hour1=&timetype=GMT&unit=0

Offline longmire

  • Contributor
  • ***
  • Posts: 123
  • WD (latest) GRL3_2 WF TWI WR-25e Win10Pro
Re: Any way to download old data (2009) submitted to CWOP?
« Reply #2 on: September 24, 2014, 06:20:33 PM »
Thank you so much Beaudog! They actually had all but 5 days of 2009 there - way more rescued than would have been the case from WU.

You've taught me something new - and I appreciate it!

Steve

Offline Beaudog

  • Forecaster
  • *****
  • Posts: 1217
Re: Any way to download old data (2009) submitted to CWOP?
« Reply #3 on: September 24, 2014, 06:36:39 PM »
Could you get the whole year at one time?  when I tried it I got some type of file to big error.   I wasn't really interested so did not try 6 months or what ever.

Offline longmire

  • Contributor
  • ***
  • Posts: 123
  • WD (latest) GRL3_2 WF TWI WR-25e Win10Pro
Re: Any way to download old data (2009) submitted to CWOP?
« Reply #4 on: September 24, 2014, 07:12:57 PM »
I had to play around a bit with their sort of reverse Polish style - To download whole year you enter the END DATE, but the BEGINNING HOUR so for 2009

2009 31 December
Hour 0000

Days 365

Then specify what kind of file (Excel xls, TXT CSV, etc.) If you specify CSV it just opens in Chrome browser and you have to cut and paste. xls downloads to your download directory.

When I read their little tutorial somewhere on the site it was very specific about entering 365 days for a year download to avoid oversize file errors - when I did that I actually cot December 31, 2008 0000 through December 31, 2009 2352. My VWSAPRS is set to 10 minute uploads.

I downloaded 3 or 4 times in different formats with different settings until I got a usable csv without the Quality field in the middle (row of variable check boxes to verify before downloads) - but everything I uploaded seems to have downloaded. Now to reform the RECDATE VWS field and get the others lined up in a new artificial 2009dbase.csv....