Author Topic: Generate NOAA reports using Meteobridge uploaded data?  (Read 15623 times)

0 Members and 1 Guest are viewing this topic.

Offline wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #75 on: January 05, 2019, 02:36:45 AM »
Seems it is OK now?
The data of January is in the table visible again: https://wx.ctreno.com/wsreports/startReports.php
Thanks for letting me know. However, the last half of December is still missing from the coloured tables - but it looks like the Daily Summarys are again available on the WU site. I should be able to easily manually download the .csv file and add the missing data to the file on the website.

Crisis averted.
When you rename the 2018 cached file, the scripts will reload the complete file for you,
Wim

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #76 on: September 13, 2019, 08:58:04 AM »
Here we go again. As of this writing my data hasn't updated since August 18: https://wx.ctreno.com/wsreports/startReports.php
But this site is current: https://www.weerstation-herent.be/wsreports/_test1.php
What could be the problem?
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

Offline wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #77 on: September 13, 2019, 09:26:15 AM »
Here we go again. As of this writing my data hasn't updated since August 18: https://wx.ctreno.com/wsreports/startReports.php
But this site is current: https://www.weerstation-herent.be/wsreports/_test1.php
What could be the problem?
I do not check much other sites. My own site, until yesterday evening showed no updated WU-data after August 25.
Today (important, see below, it is after 14:00 CEST, 12:00 UTC here) the data is up-to-date https://weer.sluispark.be/index.php?p=mnu_reports&lang=en#data-area

So  as long as there is no definite answer from WU, we have to wait and see.  But all stations I checked have data till Sept 13.
WU-url: https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=IVLAAMSG47&graphspan=year&year&month&day&units=english&format=1
Data until  Sept 13
Herent url  https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=IVLBRABA2&graphspan=year&year&month&day&units=english&format=1
Data until  Sept 13
Your station: ???? https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=KNVRENO97&graphspan=year&year&month&day&units=english&format=1
Data also until Sept 13

Your cache https://wx.ctreno.com/wsreports/wuData/KNVRENO97-year-2019.txt  has data until Aug 18.
The cache is refreshed up to twice day, last time after 14:00 (2 pm) local time

Maybe you should  delete that file and run the scripts again. 
If WU returns an incomplete or outdated/old file (often happens, also with API) , simply deleting  that cache file is for now the only thing we can do.

Wim

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #78 on: September 13, 2019, 09:56:08 AM »

Maybe you should  delete that file and run the scripts again. 
If WU returns an incomplete or outdated/old file (often happens, also with API) , simply deleting  that cache file is for now the only thing we can do.

Wim

Deleting the .txt file fixed the issue. Oddly the file modification date before I deleted it was yesterday evening, so the scripts were trying to write new data to the file but failing somehow. Thank you for the reply and easy fix!
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #79 on: November 05, 2019, 02:26:13 AM »
Here we go again. As of this writing my data hasn't updated since August 18: https://wx.ctreno.com/wsreports/startReports.php
But this site is current: https://www.weerstation-herent.be/wsreports/_test1.php
What could be the problem?
I do not check much other sites. My own site, until yesterday evening showed no updated WU-data after August 25.
Today (important, see below, it is after 14:00 CEST, 12:00 UTC here) the data is up-to-date https://weer.sluispark.be/index.php?p=mnu_reports&lang=en#data-area

So  as long as there is no definite answer from WU, we have to wait and see.  But all stations I checked have data till Sept 13.
WU-url: https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=IVLAAMSG47&graphspan=year&year&month&day&units=english&format=1
Data until  Sept 13
Herent url  https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=IVLBRABA2&graphspan=year&year&month&day&units=english&format=1
Data until  Sept 13
Your station: ???? https://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=KNVRENO97&graphspan=year&year&month&day&units=english&format=1
Data also until Sept 13

Your cache https://wx.ctreno.com/wsreports/wuData/KNVRENO97-year-2019.txt  has data until Aug 18.
The cache is refreshed up to twice day, last time after 14:00 (2 pm) local time

Maybe you should  delete that file and run the scripts again. 
If WU returns an incomplete or outdated/old file (often happens, also with API) , simply deleting  that cache file is for now the only thing we can do.

Wim

It seems we have a problem with WU data again. All sites (including yours) only have this years data since October 21. I tried deleting this year's .txt file and I get the same result. Did they delete all data prior to October 21, or are they only storing 2 weeks of data history? If so, where do we go from here?
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

Offline wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #80 on: November 05, 2019, 03:30:53 AM »
. . . shortened . . .
It seems we have a problem with WU data again. All sites (including yours) only have this years data since October 21. I tried deleting this year's .txt file and I get the same result. Did they delete all data prior to October 21, or are they only storing 2 weeks of data history? If so, where do we go from here?

Yes a new "feature" , or are they  cleaning up  of the database?

Aggregated data available from  Oct 21, 2019  only, affects  .CSV requests for any year or month before November 2019

On the other hand, the data for this month is now correctly returned, has been errors  or empty in the past

The uploaded data for any day in one's WU history is correctly there also. For me from day one I started uploading in 2011.

Wim

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #81 on: November 05, 2019, 09:17:06 AM »
Yes a new "feature" , or are they  cleaning up  of the database?...

I've emailed support about the outdated instructions at "How to Get a Copy of My Personal Weather Station Data": https://feedback.weather.com/customer/en/portal/articles/2939273-how-to-get-a-copy-of-my-personal-weather-station-data-?b_id=17298 - since a download icon is no longer present. I'll pass along any information that I find out.

On another subject, after upgrading PHP on my website (5.6 to 7.2), I'm now getting an error "Warning: A non-numeric value encountered in [omitted] wsReportsDaily.php on line 136"

Line 136 in that file is:
Code: [Select]
$value = 1.0*$arrResults[$i][$k];
Is there an easy fix for that? Sorry, my PHP programming skills are very basic.

Thank you.
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

Offline wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #82 on: November 05, 2019, 09:37:01 AM »
Yes a new "feature" , or are they  cleaning up  of the database?...

I've emailed support about the outdated instructions at "How to Get a Copy of My Personal Weather Station Data": https://feedback.weather.com/customer/en/portal/articles/2939273-how-to-get-a-copy-of-my-personal-weather-station-data-?b_id=17298 - since a download icon is no longer present. I'll pass along any information that I find out.

On another subject, after upgrading PHP on my website (5.6 to 7.2), I'm now getting an error "Warning: A non-numeric value encountered in [omitted] wsReportsDaily.php on line 136"

Line 136 in that file is:
Code: [Select]
$value = 1.0*$arrResults[$i][$k];
Is there an easy fix for that? Sorry, my PHP programming skills are very basic.

Thank you.

Multiply a value with 1.0  was a correct way to change the value from  "unknown" to float/numeric.
But it generates a warning in release 7.x onwards

To solve it, change that line to
Code: [Select]
$value = (float) $arrResults[$i][$k];
As there are more "1.0*" in the old version, you better download a more recent version from the wsreports topic on this forum
https://www.wxforum.net/index.php?topic=36473.msg374472#msg374472

But it will not solve the current issues with WU, only the 7.2 warnings
Wim

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #83 on: November 05, 2019, 12:05:24 PM »
Thanks. I've downloaded the latest version from the other threads...

I got a response back from WU: "There is no longer a way to download csv data. You can copy-paste from the table view into a spreadsheet program, or use the PWS API to download the data in JSON format." I have requested more information about the API and JSON format download. Would this be an easy conversion to the scripts?
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
RE: WU csv data coloured table
« Reply #84 on: April 13, 2020, 02:38:55 AM »
Update: Late last year I noticed that the coloured table generated from WU csv data stopped updating for me. I just had a chance in the past few weeks to look into a solution, and was happy to discover that a fix/update has been posted at the bottom of the following webpage: https://www.weerstation-herent.be/wsreports/_test1.php Thank you to the authors.

Since the scripts have nothing to do with Meteohub/Meteobridge, I will following any future updates at the following thread and parent forum: https://www.wxforum.net/index.php?topic=36473.msg374472
« Last Edit: April 13, 2020, 03:01:32 AM by mjc775 »
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

 

anything