Author Topic: How frequent do you upload weather data to your site?  (Read 1662 times)

0 Members and 1 Guest are viewing this topic.

Offline geno

  • Senior Contributor
  • ****
  • Posts: 165
How frequent do you upload weather data to your site?
« on: December 09, 2016, 12:59:25 PM »
When I originally set up my weather station, I got the help of a nice young man on this forum.  I was (and still feel like) a complete novice.  During my setup, it was recommended that I update my site about every minute or so.  That seems a bit too frequent to me, since the weather doesn't seem to change that rapidly.

Anyway, how often does your VWS update your site?  I changed mine to every 10 minutes.

Thanks for your time to comment.

-gene
Geno

Davis 6323 Wireless Vantage Pro2 ISS
with 24-Hr Fan Aspirated Radiation Shield and Aerocone
VWS 15.0  p03
www.genesweather.info

Offline chief-david

  • Educational Weather
  • Forecaster
  • *****
  • Posts: 2846
  • Space Academy for Educators
    • Benilde-St. Margaret's Weather
Re: How frequent do you upload weather data to your site?
« Reply #1 on: December 09, 2016, 01:08:34 PM »
WU-1 minute
Website with Weather link-5 minutes
Website with Weather display-live data



You can't phase me-I teach Middle School.
It's not you-It's WU.

Offline Jáchym

  • Meteotemplate Developer
  • Forecaster
  • *****
  • Posts: 8605
    • Meteotemplate
Re: How frequent do you upload weather data to your site?
« Reply #2 on: December 09, 2016, 01:29:39 PM »
Hi Gene,
this depends.
For example the way this works with WU is this:
- it logs (saves) your data every 5 minutes.
However, you have the option of the so-called "rapid fire update". This can be set I think as often as you like, eg. 5 seconds. And this will display as "realtime conditions", but it will not be all saved.
In my template I sort of did similar thing.
The template current conditions file can be updated as frequently as the user likes and this is used to view the current conditions.
Then, I created a script which caches these. Then once a specific time interval elapses, it takes this cache file, processes it and saves it to the database and clears the cache.

In the particular case of meteotemplate it works like this:
- current conditions update (as frequently as you like) -> last time database updated is checked, if it is not yet time to update, it takes the values and adds them to the cache file -> the default interval for db update is 5 minutes -> once 5 minutes elapse, it takes the cached values and then:

Some parameters make sense to log often, others not so (humidity, pressure).
So for some values it takes averages (pressure, humidity, wind speed), for some it takes the maximum value out of those cached data sets (solar radiation, wind gust) and for temperature, it saves avg, min and max into 3 columns in the db.

Offline tbrasel

  • Contributor
  • ***
  • Posts: 141
    • Northwest Arkansas Weather.com
Re: How frequent do you upload weather data to your site?
« Reply #3 on: December 09, 2016, 03:21:47 PM »
When I originally set up my weather station, I got the help of a nice young man on this forum.  I was (and still feel like) a complete novice.  During my setup, it was recommended that I update my site about every minute or so.  That seems a bit too frequent to me, since the weather doesn't seem to change that rapidly.

Anyway, how often does your VWS update your site?  I changed mine to every 10 minutes.

Thanks for your time to comment.

-gene

I upload my VWS file every 30 seconds.
Best Regards
tbrasel

Bentonville Arkansas, USA
Hardware: Davis 6153 - Wireless Vantage Pro2 with FARS
Software: VWS V15.00
Website: https://www.nwarwx.com

Offline Cutty Sark Sailor

  • WxElement panel
  • Forecaster
  • *****
  • Posts: 3394
    • Frankfort Weather - TwinHollies WeatherCenter
Re: How frequent do you upload weather data to your site?
« Reply #4 on: December 09, 2016, 03:27:58 PM »
Ny Goal is current, accurate real-time.information ...
What's the point otherwise?  :-"

It certainly didn't come about instantly, as I was a novice also..
but, my hodge-podge developed over time, and as I watched and learned,
from the many super folks on WxForum, et. al......
... as of the moment:
Realistically,..
it depends on network and internet traffic,..
my current upload bandwidth limit of 3 megs...
and the applications, site structure, and hardware I use

Something like this:
First, a little light came on couple of years ago,
and today I DO NOT waste my upload BW limits,
mental energy, patience quoto, or resources on any commercial service, such as WunderWeenies.
and if they try scraping my site, I will block them if catch it and if I can.
I DO send to CWOP/MESONET, some parameters at 5 minutes, some at 15.
Let the tapeworms suck that if they want.

For the website:
Live variables to website as fast as can...
2-5 seconds is possible... but usually 15-40...
..data is sent to server only if a sample parameter has changed,
and server only updates a 'changed' parameter.

Webcam overlay data currently one minute from VWS on 3 cameras,
3 other cameras use Banner Image overlay, which is typically 2 Minutes.

6 Weather/Environment cams stream live...
at usable 1 to 10 fps depending on network traffic
and my available upload bandwidth limits.
However latest still images update at 10 or 15 seconds.
 
NWS Weather Radio streams Live...
with streamer/server processing and network delay about 5 seconds.

Additionaly up to 4 "event" radar displays, only active in specific
situations in areas of interest.. these usually stream  effectievely
as a webcam, and the data can be as near as a minute or so to real-time...
depending on source server and its data and speed, and my limitations.

"Whisper": sssshhhh!- The tongue-in-cheek "Weather Tracks" server works as fast
as your network speed and browser can handle it,..
but it works on server and your browser

...
 
« Last Edit: December 09, 2016, 03:30:20 PM by Cutty Sark Sailor »
 


Offline geno

  • Senior Contributor
  • ****
  • Posts: 165
Re: How frequent do you upload weather data to your site?
« Reply #5 on: December 09, 2016, 04:48:41 PM »
Okay, now I'm really embarrassed. :oops:
You guys are really way ahead of me.  Of course, all I ever wanted to do was get my station up and running with links to a few weather maps.
I live in FL and we get a fair number of summer storms, tropical depressions, hurricanes, etc.  The maps really help me and others see what's coming.  The one thing I wish I could find is a nice simple 5 or 7-day forecast for my area that I could embed on my page rather than a link (like I now have).  I'm not very proficient at programming, so I use serious caution before making even small changes.
Sure appreciate those of you who are willing to help people like me who need a good deal of "hand-holding"
-gene
Geno

Davis 6323 Wireless Vantage Pro2 ISS
with 24-Hr Fan Aspirated Radiation Shield and Aerocone
VWS 15.0  p03
www.genesweather.info

Offline Jáchym

  • Meteotemplate Developer
  • Forecaster
  • *****
  • Posts: 8605
    • Meteotemplate
Re: How frequent do you upload weather data to your site?
« Reply #6 on: December 09, 2016, 04:49:46 PM »
See my PM

Offline LFWX

  • Forecaster
  • *****
  • Posts: 1089
  • Liberty Township, Butler County, Ohio
    • Liberty Fairfield Weather Center
Re: How frequent do you upload weather data to your site?
« Reply #7 on: December 10, 2016, 11:34:39 PM »
Mine also updates every 5 minutes and I'm perfectly fine leaving it that way.

If someone really needs to see more frequent data, I upload to WeatherUnderground every 3 seconds.
Station: Davis Vantage Pro2 Fan Aspirated
Software: Virtual Weather Station V14.00p64
www.LFWeatherCenter.com
CWOP: DW1039
CoCoRaHS: OH-BT-1
Weather Underground: KOHHAMIL7
Weather For You: DW1039
Midwestern Weather Network