Author Topic: Imported Data from Wunderground  (Read 8452 times)

0 Members and 1 Guest are viewing this topic.

Offline Dal

  • Senior Member
  • **
  • Posts: 82
  • Climbing the cliffs of Moher in my sleep
    • The Sanctuary Weather Station
Imported Data from Wunderground
« on: June 09, 2010, 05:52:29 PM »
Due to a catastrophic hd failure, I lost more than 2 years worth of data. I've now downloaded the data from Wunderground in csv format to import into WD. As I understand it (limited knowledge), WD imports the data into a log file.
What I'm hoping to do is somehow utilise that imported data in order to create comparisons in weather over the past couple of years, using either Brian's new charts or possibly the warming and rainfall scripts from relay Weather.

What I need now, if someone would be kind enough, are the precise steps to be taken to a) import the .csv files into WD and then b) convert that into usuable data.

The very last thing I want to do is screw up all this effort :)

Any help will be very greatly appreciated.
Gun tigeadh Solas nan Solas
dha m’ dhridhe doilleir o t’aite.
Gun tigeadh ais an Spioraid Air mo chridhe

Offline Cleofide

  • Orange, FR
  • Senior Member
  • **
  • Posts: 50
    • METEOrange
Re: Imported Data from Wunderground
« Reply #1 on: June 12, 2010, 02:03:45 PM »
Quite interesting. I almost have the same problem (yes, I know, I DO have a lot of troubles with my weather things): I used to work with WeatherLink but the .WLK archive files contain errors which twist the global results, high/low records, etc. So my question is: how did you download the whole .csv file from wunderground? I have two computers so I will try to figure out how to add these old data to my new ones. If it works, I shall of course describe the comprehensive procedure to you.

By the way, we will never say it enough: do backups!

Thanks,
« Last Edit: June 12, 2010, 02:12:39 PM by Cleofide »
Florian-Pierre Zanardi,
http://www.meteorange.fr/
Wireless VP2, double solar-paneled daytime FARS, Anemometer Transmitter Kit.

Offline Bashy

  • brecklandweather.com/meteo
  • Forecaster
  • *****
  • Posts: 1465
  • brecklandweather.com/index.php
    • Breckland Weather
Re: Imported Data from Wunderground
« Reply #2 on: June 12, 2010, 04:08:27 PM »
There is an option to import from WU in to WD, go to the action menu, then Import log from
 other software, then WU is 2nd from bottom, downside is, if you want detailed data then you
have to do it day by day
Kind regards
Bashy

Offline Cleofide

  • Orange, FR
  • Senior Member
  • **
  • Posts: 50
    • METEOrange
Re: Imported Data from Wunderground
« Reply #3 on: June 12, 2010, 06:17:53 PM »
Thanks Bashy. I tried with a file generated by WU and it screwed up all the June data  =D>
So I don't know if I took the right file, but it didn't work here. Be warned.
Florian-Pierre Zanardi,
http://www.meteorange.fr/
Wireless VP2, double solar-paneled daytime FARS, Anemometer Transmitter Kit.

Offline Weather Display

  • Forecaster
  • *****
  • Posts: 2611
    • West Coast Road Weather Data
Re: Imported Data from Wunderground
« Reply #4 on: June 12, 2010, 08:15:02 PM »
it should work OK
but note that you will need to download a month at a time,as comma separated, and import just that month at a time
also make sure to back up your data first

(and always a good idea to back up your data regurlarly, as hard drives do fail)

also make sure to be using a recent version of WD to do this routine
Brian
info@weather-display.com
http://www.weather-display.com

Offline Cleofide

  • Orange, FR
  • Senior Member
  • **
  • Posts: 50
    • METEOrange
Re: Imported Data from Wunderground
« Reply #5 on: June 13, 2010, 11:28:47 AM »
Where do you download your files? Are you using the Comma Delimited File? Because when I do so, WD doesn't read the file properly:


   Averages\Extremes for day :June 2010
-----------------------------------------------------------------------------------------------------------------------------------
Day     Temp      Wind       Gust       Rain        Max Temp    Min Temp   Av Hum   Av Baro       Av Dir       Wind run   Windchill
----------------------------------------------------------------------------------------------------------------------------------
 30     -6.7°C    30.9kmh    75.9kmh    00.0mm      -4.8°C      -9.5°C     048%     33922.2 hPa     334 ° (NNW)  478.6km   -19.3°C               


And I'm following the procedure you indicated me: Wundergroun combined daily .csv...
Florian-Pierre Zanardi,
http://www.meteorange.fr/
Wireless VP2, double solar-paneled daytime FARS, Anemometer Transmitter Kit.

Offline Dal

  • Senior Member
  • **
  • Posts: 82
  • Climbing the cliffs of Moher in my sleep
    • The Sanctuary Weather Station
Re: Imported Data from Wunderground
« Reply #6 on: June 13, 2010, 01:54:55 PM »
What you want is each day's file. At the bottom of each day is a "Comma Delimited File" link. Save each day and then import it one day at a time into WD. Be warned though.... I downloaded over two years of data from WU (1 day at a time), imported it all into WD (1 month at a time), converted it..... and wound up with an unholy mess.

This is what I did:
1) Saved each day's "Comma Delimited File" into a folder titled for that month.
2) Imported each day's file for that month only into WD.
3) Went to the logfile WD had created and converted it.

Now I don't know if it's WU or WD that causes the problems but my results bore no relationship to reality. -140 degrees C, Pressure readings of 33415 hpa.... and so on.
« Last Edit: June 13, 2010, 02:02:27 PM by Dal »
Gun tigeadh Solas nan Solas
dha m’ dhridhe doilleir o t’aite.
Gun tigeadh ais an Spioraid Air mo chridhe

Offline serowe

  • Member
  • *
  • Posts: 11
Re: Imported Data from Wunderground
« Reply #7 on: August 02, 2010, 11:28:10 PM »
Check the data exported by WU very carefully - it is NOT exporting correctly (for instance I kept getting Daily Rainfall as some ridiculous figure of -2539.7 for every entry and a constant WindSpeed entry of -999.

Offline Cleofide

  • Orange, FR
  • Senior Member
  • **
  • Posts: 50
    • METEOrange
Re: Imported Data from Wunderground
« Reply #8 on: August 21, 2010, 07:10:56 PM »
Yes I noticed this too and actually gave up the idea of relying only upon WD. I now use WeatherLink for everything where I need graphics and extensive data reports, and WD for updating the Saratoga script. To me WL is the best way to backup the data of the Vantage.
Florian-Pierre Zanardi,
http://www.meteorange.fr/
Wireless VP2, double solar-paneled daytime FARS, Anemometer Transmitter Kit.

Offline Axelvold

  • Forecaster
  • *****
  • Posts: 1704
    • Axelvold's weather and photo
Re: Imported Data from Wunderground
« Reply #9 on: August 22, 2010, 02:26:50 AM »
What version of WD are you using?

You will need to use version 50 or higher, because those earlier version did not import metric data as metric.
Lars Magnusson
Axelvold / Sweden
55° 57' 41" N / 13° 6' 1" E
WX Station: Davis Vantage Pro2 Plus

Offline Cleofide

  • Orange, FR
  • Senior Member
  • **
  • Posts: 50
    • METEOrange
Re: Imported Data from Wunderground
« Reply #10 on: August 22, 2010, 04:35:46 AM »
I am running WD 10.37P build 41. The latest version available is 10.37P build 44, therefore I think you meant '40' and not '50', am I right? Thank you anyway, I am still willing to use WD for more tasks if it can decipher the metric data properly.
« Last Edit: August 22, 2010, 04:40:23 AM by Cleofide »
Florian-Pierre Zanardi,
http://www.meteorange.fr/
Wireless VP2, double solar-paneled daytime FARS, Anemometer Transmitter Kit.

Offline Axelvold

  • Forecaster
  • *****
  • Posts: 1704
    • Axelvold's weather and photo
Re: Imported Data from Wunderground
« Reply #11 on: August 22, 2010, 04:50:32 AM »
I am running WD 10.37P build 41. The latest version available is 10.37P build 44, therefore I think you meant '40' and not '50', am I right? Thank you anyway, I am still willing to use WD for more tasks if it can decipher the metric data properly.

No I meant 50, see here http://www.weather-watch.com/smf/index.php/topic,46966.0.html
Lars Magnusson
Axelvold / Sweden
55° 57' 41" N / 13° 6' 1" E
WX Station: Davis Vantage Pro2 Plus

Offline Cleofide

  • Orange, FR
  • Senior Member
  • **
  • Posts: 50
    • METEOrange
Re: Imported Data from Wunderground
« Reply #12 on: August 22, 2010, 07:54:35 AM »
Sorry!! The main page of WD isn't up to date. The latest version is indeed 10.37P Build 53. Doing the update right now and let you know.
Florian-Pierre Zanardi,
http://www.meteorange.fr/
Wireless VP2, double solar-paneled daytime FARS, Anemometer Transmitter Kit.

Offline Axelvold

  • Forecaster
  • *****
  • Posts: 1704
    • Axelvold's weather and photo
Re: Imported Data from Wunderground
« Reply #13 on: August 22, 2010, 08:52:27 AM »
Sorry!! The main page of WD isn't up to date. The latest version is indeed 10.37P Build 53. Doing the update right now and let you know.

Be careful, it's an Beta version.  ;)
Lars Magnusson
Axelvold / Sweden
55° 57' 41" N / 13° 6' 1" E
WX Station: Davis Vantage Pro2 Plus

 

anything