Author Topic: Retrieving data locally.  (Read 1043 times)

0 Members and 1 Guest are viewing this topic.

Offline gdicarlo

  • Member
  • *
  • Posts: 12
Retrieving data locally.
« on: March 14, 2021, 03:25:26 PM »
I am considering purchasing a Davis VP2. Is it possible to store the data on a data logger and download it to your computer about once a week, without going online and having to upload it to weatherlink?

Offline johnd

  • Forecaster
  • *****
  • Posts: 4128
    • www.weatherstations.co.uk
Re: Retrieving data locally.
« Reply #1 on: March 14, 2021, 03:35:17 PM »
I am considering purchasing a Davis VP2. Is it possible to store the data on a data logger and download it to your computer about once a week, without going online and having to upload it to weatherlink?

Yes. (Assuming you're talking about a VP2-compatible logger like the Davis Weatherlink USB logger or the WiFi Logger as a couple of examples.) The API uses binary data so you need to be comfortable with that, but it's all well-documented. There are of course several programs that will do this for you, but it sounds like you want to write your own software.
« Last Edit: March 14, 2021, 03:45:20 PM by johnd »
Prodata Weather Systems
Prodata's dedicated Davis EnviroMonitor website
UK Davis Premier Dealer - All Davis stations, accessories and spares
Littleport, Ely, Cambs UK

Sorry, but I can't help with individual issues by email. Please post your issue in the relevant forum section here & I will comment there if I have anything useful to add.

Offline gdicarlo

  • Member
  • *
  • Posts: 12
Re: Retrieving data locally.
« Reply #2 on: March 14, 2021, 03:50:16 PM »
I don't wish to write my own software. I just don't want to pay the subscription fee to weatherlink to download my own historical data. I just want to store and view it on my own computer without going online.

« Last Edit: March 14, 2021, 03:55:02 PM by gdicarlo »

Offline BigOkie

  • Forecaster
  • *****
  • Posts: 1357
  • Tulsa, OK
    • KOKTULSA13
Re: Retrieving data locally.
« Reply #3 on: March 14, 2021, 04:01:40 PM »
There are other solutions.  If you're familiar with Raspberry Pi that can be a (low power) always-on solution, but can also serve to download data periodically instead.  Cumulus MX can afford you the ability to store the data in a database, but even without the database Cumulus MX will store it in monthly named data files.  Perhaps this could serve your purpose?  This solution can be a little time consuming to get started initially but is incredibly reliable and largely maintenance free once it is set up.

Also, it's free (well, the Raspberry PI isn't, but...).  CumulusMX can also be run on a regular Windows machine.


Current setup: Davis Vantage Pro 2 Plus Wireless
Weather radios:
Reecom R-1650
Sangean CL-100
Uniden Home Patrol I

Offline gdicarlo

  • Member
  • *
  • Posts: 12
Re: Retrieving data locally.
« Reply #4 on: March 14, 2021, 05:08:01 PM »
I'm not familiar with raspberry pi. The Cumulous solution sounds good. Which is a better logger to use, the wifi or the usb?


Offline Storm017

  • Contributor
  • ***
  • Posts: 140
Re: Retrieving data locally.
« Reply #5 on: March 14, 2021, 05:17:02 PM »
You could also use WeeWx to interface with the VP2. With WeeWx, you can view and store data locally; upload data to various sites . If planning to use a RPI, ensure to use a good micro SD card and power supply. I'm using a RPI 3B+ with the WeatherLink  USB Data Logger.

Offline ocala

  • Forecaster
  • *****
  • Posts: 4028
Re: Retrieving data locally.
« Reply #6 on: March 14, 2021, 05:36:28 PM »
I'm not familiar with raspberry pi. The Cumulous solution sounds good. Which is a better logger to use, the wifi or the usb?
I do exactly what you describe once a week. Download to the weatherlink software and to Cumulus. I would go with the wifi logger myself. It's what I use. The wifi logger will upload your data to several sites so you can access it during the week but don't have to run your PC 24/7.
I should add that  both the usb and wifi logger have storage limits based on your archive interval. They are as follows.
1 minute-42 hours.
5 minute-8 days
10 minute-17 days
15 minute-26 days
30 minute-53 days
60 minte-106 days
120 minute-213 days.
« Last Edit: March 14, 2021, 05:40:26 PM by ocala »
The blues had a baby and they named it Rock & Roll

Offline Mattk

  • Forecaster
  • *****
  • Posts: 1569
Re: Retrieving data locally.
« Reply #7 on: March 14, 2021, 07:17:37 PM »
This hasn't got to be complicated. Simply download and install Davis's free WeatherPC which can be found on WeatherLink.com and you will achieve what you require.

WeatherLinkIP logger would be the suggestion but since Davis has discontinued these (for their own benefit) you may be hard pressed to still find one otherwise my second choice would be a serial version. There are other options but this keeps things straight forward and simple
« Last Edit: March 14, 2021, 07:21:31 PM by Mattk »

Offline gdicarlo

  • Member
  • *
  • Posts: 12
Re: Retrieving data locally.
« Reply #8 on: March 20, 2021, 03:16:23 PM »
I am looking to store my archive data in 5 minute intervals. I would download the data a couple times a week. I would like to store that data in csv files, so that I can view the data in excel.  Can I do this this without using weatherlink? I was thinking using wifilogger2 and Cumulous.
« Last Edit: March 20, 2021, 03:34:43 PM by gdicarlo »

Offline PaulMy

  • Forecaster
  • *****
  • Posts: 4969
    • KomokaWeather
Re: Retrieving data locally.
« Reply #9 on: March 20, 2021, 08:51:18 PM »
Hi,
Yes you can use CumulusMX without using Weatherlink.  CumulusMX saves the monthly log in MmmYYlog.txt format which can be read/opened by most programs including Excel, and at whatever logging increment you set, i.e. 1 min, or 5, 10, 15, 30 minutes.  Be careful, don't reverse save from Excel to .txt as then the files may not be valid in CumulusMX.  5 minute interval gives about 17 days before the logger overwrites so twice a week is well within a 5 min interval and your twice a week download.


You set the logging interval for CumulusMX data files in CumulusMX and that interval should be the same as the Console/logger is set.  Otherwise Cumulus won't know where to start in doing the archive catch up and therefore will download the full logger each time you start CumulusMX.  Console/logger interval is set in Weatherlink.


Enjoy,
Paul




Offline Asbee

  • Member
  • *
  • Posts: 2
Re: Retrieving data locally.
« Reply #10 on: June 18, 2021, 10:56:37 PM »
Hey!

This is my first post here and i dont mean to hijack this thread, but when this thread seems to handle same thing that i wanna achieve i thought it would be probably fine to post my problem here.

So i have Vantage pro2 and i got davis instruments serial data logger that is connected to my raspberry pi serial port.
I want to use my raspberry pi to read weather data from the logger and send it to my server which uses influxdb.
Im having hard time finding any help how to do this. It seems that i always need to use weatherlink app to get my data, but i dont wanna do that.

I've tried to read data using python pyserial, but i dont seem to get anything out.
Im very new with raspberry pi and python so im having hard time figuring this out.
So if anyone could direct me to right direction i would be very happy.

Online vreihen

  • El Niņo chaser
  • Forecaster
  • *****
  • Posts: 1132
  • K2BIG
Re: Retrieving data locally.
« Reply #11 on: June 19, 2021, 07:50:25 AM »
WeeWX is the answer.  What was the question????? ;)

WU Gold Stars for everyone! :lol:

Offline Asbee

  • Member
  • *
  • Posts: 2
Re: Retrieving data locally.
« Reply #12 on: June 19, 2021, 09:54:31 PM »
WeeWX is the answer.  What was the question????? ;)

My question is how i can read data from the data logger using python?
And i wanna send my data to my server which uses InfluxDB.
How do i achieve this?

Is WeeWX the perfect tool for this?
What i read from the WeeWX site it says it only supports sqlite and MYsql.
So i dont know if it is the right program for me.

Offline Storm017

  • Contributor
  • ***
  • Posts: 140
Re: Retrieving data locally.
« Reply #13 on: June 19, 2021, 11:58:59 PM »
There are drivers for influx: https://github.com/matthewwall/weewx-influx

Offline vinceskahan

  • Senior Member
  • **
  • Posts: 64
    • home site
Re: Retrieving data locally.
« Reply #14 on: July 01, 2021, 11:35:22 PM »
Is WeeWX the perfect tool for this?
What i read from the WeeWX site it says it only supports sqlite and MYsql.
So i dont know if it is the right program for me.

You need to understand what a 'driver' is versus what an 'extension' is.

A driver can feed either of the two databases weewx supports natively.  Just go with sqlite3 for simplicity.

An extension 'extends' the functionality to do other things.  The weewx-influx extension would 'also' feed a influxdb server.

Another way is to run weewx with the MQTT extension to feed a MQTT broker, and have telegraf subscribe to that and feed your influxdb....but just going weewx->influxdb in one step is cleaner.

(I use the MQTT path because I use Home Assistant for a display and have that pi3 also subscribe to the MQTT feed).
WeeWX sites:
  Davis VP2+DFARS to a Seagate Dockstar (pogoplug)
  EcoWitt GW1000, WH32 outdoor T+H, multiple WH31 indoor T+H, WH51 soilMoisture (pi3)
Home site:        http://www.skahan.net/
Wunderground: KWAFEDER15
PWS:                KWFEDER15
CWOP:             CW6881

Offline johnd

  • Forecaster
  • *****
  • Posts: 4128
    • www.weatherstations.co.uk
Re: Retrieving data locally.
« Reply #15 on: July 02, 2021, 04:09:02 AM »
My question is how i can read data from the data logger using python?

The API for retrieving  data from a serial logger is described in the first section of the Davis Serial Tech Ref document (see Davis Support website for a download). You'll need to work out how to implement the API commands and responses in Python, but many developers and users have done this over the years, including I'm sure with Python, so it's relatively straightforward for anyone with basic programming skills. Indeed there seem to be some libraries available to do this like at https://pypi.org/project/PyVantagePro/ .

Getting the data into Influxdb is obviously another step, but again there seem to be Python libraries for Influxdb, so it shouldn't be too difficult.

Prodata Weather Systems
Prodata's dedicated Davis EnviroMonitor website
UK Davis Premier Dealer - All Davis stations, accessories and spares
Littleport, Ely, Cambs UK

Sorry, but I can't help with individual issues by email. Please post your issue in the relevant forum section here & I will comment there if I have anything useful to add.

Offline cmelby76

  • Member
  • *
  • Posts: 11
Re: Retrieving data locally.
« Reply #16 on: July 03, 2021, 08:41:49 PM »
Hi,

So I have a WeatherLink IP windows software with data logger for sale along my vantage Vue. But, I am willing to sell the weatherlinkIP separately if you are interested in it?  Let me know

 

anything