Author Topic: Download historical data  (Read 3556 times)

0 Members and 1 Guest are viewing this topic.

Offline CamShep

  • Member
  • *
  • Posts: 5
Download historical data
« on: January 14, 2020, 01:53:32 AM »
Hi I'm a bit of newbie with regard to all things weather station, so I really appreciate any advice received.  I have a Davis Vantage Pro2 running through a meteobridge uploading to WU.  Ive had this running a couple of years and each January I pull historical data (from the year before) from WU to run weather data analysis for our farm....until now.  It appears WU do not allow download of historical data anymore.  Can anyone suggest a meteobridge supported service that does allow download of historical data?  Or a work around for my current situation? I know nothing about APIs.  Again any help is much appreciated.

Offline hymrog

  • Senior Member
  • **
  • Posts: 52
    • Gahanna Weather
Re: Download historical data
« Reply #1 on: January 15, 2020, 06:01:22 AM »
Hello

A couple of things you could do:

Upload your data to Meteoplug which is run by the developer of Meteobrige. There is a subscription fee with this choice. http://wiki.meteoplug.com/Main_Page

You can utilize the MySQL service on your Meteobrige.  Nice tutorial here to get you started
https://www.stevejenkins.com/blog/2015/02/storing-weather-station-data-mysql-meteobridge/

g

Online wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Download historical data
« Reply #2 on: January 15, 2020, 06:15:39 AM »
Hi I'm a bit of newbie with regard to all things weather station, so I really appreciate any advice received.  I have a Davis Vantage Pro2 running through a meteobridge uploading to WU.  Ive had this running a couple of years and each January I pull historical data (from the year before) from WU to run weather data analysis for our farm....until now.  It appears WU do not allow download of historical data anymore.  Can anyone suggest a meteobridge supported service that does allow download of historical data?  Or a work around for my current situation? I know nothing about APIs.  Again any help is much appreciated.

WU still allows download of historical data, but in a new format .JSON and for shorter periods.

In the pasty, to retrieve the old-year data, did you click on the link at the bottom  of your stations-page.
Or did you use in this link?
Code: [Select]
https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=XXXXXXXX&month&day&year=2019&format=1&graphspan=year
If so, there are scripts which still support this old link by using the new API to deliver the same data in the old format.
Check out Ken Trues version at https://github.com/ktrue/WU-History/blob/master/README.md
This is the topic on this forum https://www.wxforum.net/index.php?topic=37006.0

If you install this script on your webserver, and request an API-key at your WU-stations page, you can then pull your data with a link like this http://yourwebsite.xyz/WXDailyHistory.php?&year=2019&graphspan=year

Wim

Offline galfert

  • Global Moderator
  • Forecaster
  • *****
  • Posts: 6822
Re: Download historical data
« Reply #3 on: January 15, 2020, 09:58:54 AM »
For 2019 data you'll have to resort to one of the methods mentioned.

Going forward to make things easier, you could use the Meteobridge to upload to WeatherCloud. A free account lets you easily download the past 12 months. If you need more then sign up for a premium plan.

But ultimately things change. If you rely on this data for your farm (a business) then only having one option is a risk, as a cloud service could be here today and gone tomorrow or even change as WU did. Therefore I would employ more than one method of weather data storage. What you could do is also not rely on anyone else and send data to mysql as mentioned, but setting that up is not trivial and requires some computing skills, or at least ability to follow technical write-up. I agree with hymrog that Steve Jenkin's blog is the most referenced for setting this up.
https://www.stevejenkins.com/blog/2015/02/storing-weather-station-data-mysql-meteobridge/

Another option for local storage is to use some other weather software program like Cumulus MX, Weather-Display, or WeeWx. So as to not mess with your existing Meteobridge I would recommend adding a WeatherLink Live device and pairing it up with one of these software.

« Last Edit: January 15, 2020, 10:01:17 AM by galfert »
Ecowitt GW1000 | Meteobridge on Raspberry Pi
WU: KFLWINTE111  |  PWSweather: KFLWINTE111
CWOP: FW3708  |  AWEKAS: 14814
Windy: pws-f075acbe
Weather Underground Issue Tracking
Tele-Pole

Offline CamShep

  • Member
  • *
  • Posts: 5
Re: Download historical data
« Reply #4 on: January 16, 2020, 02:03:58 AM »
Thanks all for your responses.  I have little (ie no) programming capabilities and certainly no experience with API's, so wvdkuil's advice, while gratefully received, doesn't help me as I don't understand it!
I do not have a computer running 24/7 attached to the meteobridge (or the Davis console), so therefore using Weather-Display, Cumulus etc is not possible.  So am I correct in saying my options are:
1. Use WeatherCloud?  I have a free account with them and see the free 12-month database, but when i download the excel file i don't know how to convert it to a useful spreadsheet (the data is all in one cell separated by semi-colons)
2. Subscribe to Meteoplug?
3. Buy Weatherlink Live and subscribe to Weatherlink (the new version of it)?
4. Install MySQL service (although this requires some tech skills I don't have!)?

Is that a fair summary of my options?  Many thanks again.

Online wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Download historical data
« Reply #5 on: February 02, 2020, 08:45:46 AM »
. . . shortened . .
1. Use WeatherCloud?  I have a free account with them and see the free 12-month database, but when i download the excel file i don't know how to convert it to a useful spreadsheet (the data is all in one cell separated by semi-colons)
. . . shortened . .

To import a .CSV file with semi-colomns you need to tell Excel to use the ";" and not the "," as the separator
"Google-is-your-friend" =>|"import CSV with semi-colons in excel"
One of the results:  https://www.copytrans.net/support/how-to-open-a-csv-file-in-excel/

Wim
« Last Edit: February 02, 2020, 08:48:05 AM by wvdkuil »

 

anything