Author Topic: Generate NOAA reports using Meteobridge uploaded data?  (Read 15677 times)

0 Members and 1 Guest are viewing this topic.

Offline wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #25 on: June 16, 2014, 01:58:19 AM »
Ok I got it installed on my test site.
But on my header my banner seems to show incorrect when I go to the page.
It shows ok on all of my other pages but with this one the size is not kicking in.
IE:  <a href="index.php" title="Browse to homepage"><img src="banner.jpg" title="www.txweather.org" height="108" hspace="0" vspace=
"3" border="0"</img><?php echo langtransstr($SITE['organ']); ?></a>

Any ideas?

Regards.
Probably a CSS thing. But to check it out I need to browse to that page.
Can you please post the link to the test-site? And the page with the error on it?
Thanks, Wim

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #26 on: June 16, 2014, 09:47:20 AM »
@wvdkuil I just wanted to make sure you saw this, and is there an easy fix?

...I noticed an minor error in the Color key. Currently the numbers overlap. For example in the temperature color key it shows "50-60", "60-70", "70-80", etc. It should show "51-60", "61-70", "71-80", etc. The overlap in numbers is present for all weather values. I searched the script files for where those numbers are generated, but couldn't find it.
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

Offline txweather.org

  • Forecaster
  • *****
  • Posts: 1597
    • Texas Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #27 on: June 16, 2014, 10:08:18 AM »
Ok I got it installed on my test site.
But on my header my banner seems to show incorrect when I go to the page.
It shows ok on all of my other pages but with this one the size is not kicking in.
IE:  <a href="index.php" title="Browse to homepage"><img src="banner.jpg" title="www.txweather.org" height="108" hspace="0" vspace=
"3" border="0"</img><?php echo langtransstr($SITE['organ']); ?></a>

Any ideas?

Regards.
Probably a CSS thing. But to check it out I need to browse to that page.
Can you please post the link to the test-site? And the page with the error on it?
Thanks, Wim

As requested:

http://www.txweather.org/wxStartReports.php

Thanks for the help!
Regards.

----
Davis Vantage Pro2 Plus +FARS|Meteobridge Nano SD|Meteohub|Meteobridge MR-3020|WU KTXSPRIN75/PWS JRARGWX75/CWOP EW2972/WBB TXWDVUE75/Blitzortung ID: 1142|AWEKAS: 12095
Donations are welcome: https://paypal.me/ffuentesb

Offline wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #28 on: June 16, 2014, 10:18:48 AM »
Ok I got it installed on my test site.
But on my header my banner seems to show incorrect when I go to the page.
It shows ok on all of my other pages but with this one the size is not kicking in.
IE:  <a href="index.php" title="Browse to homepage"><img src="banner.jpg" title="www.txweather.org" height="108" hspace="0" vspace=
"3" border="0"</img><?php echo langtransstr($SITE['organ']); ?></a>

Any ideas?

Regards.
Probably a CSS thing. But to check it out I need to browse to that page.
Can you please post the link to the test-site? And the page with the error on it?
Thanks, Wim

As requested:

http://www.txweather.org/wxStartReports.php

Thanks for the help!
Regards.
The wsreport pages are wider than the smallest setting for the saratoga template.
To make sure that the reports do not "stick out" (is that English?), the report pages set the minimum wide for the enclosing div
Code: [Select]
#page {min-width: 950px;} /*just to make sure that the wide of the page is sufficient  */And because the page is now wider than the style settings for the picture in the heading it looks distorted. This is the current code for the image
Code: [Select]
<a href="index.php" title="Browse to homepage">
<img src="banner.jpg" title="www.txweather.org" height="108" hspace="0" vspace="3" border="0"</img>Villages of Bridgestone.</a>
If you change that to
Code: [Select]
<a href="index.php" title="Browse to homepage">
<img src="banner.jpg" title="www.txweather.org" height="108" hspace="0" vspace="3" border="0" style="width: 100%;"</img>Villages of Bridgestone.</a>
, the image will adapt itself to any width of the page.

Succes, Wim
« Last Edit: June 16, 2014, 10:24:49 AM by wvdkuil »

Offline wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #29 on: June 16, 2014, 10:23:43 AM »
@wvdkuil I just wanted to make sure you saw this, and is there an easy fix?

...I noticed an minor error in the Color key. Currently the numbers overlap. For example in the temperature color key it shows "50-60", "60-70", "70-80", etc. It should show "51-60", "61-70", "71-80", etc. The overlap in numbers is present for all weather values. I searched the script files for where those numbers are generated, but couldn't find it.
The votes are not in yet.  Most people I asked say it is from 1-9.9999999999 then from 10.000000 to 19.999999
Changing 1-10,10-20  for 1-10 and 11-20 and so on, were are the values between 10.x and 11.0 gone?
Other people tell me:  "set one value so 1   11    21   31"
The original NOAA wxreports from Murry Conarroe of Wildwood Weather work the same way.
I will take a look today how to make some alternatives.

Wim

Offline txweather.org

  • Forecaster
  • *****
  • Posts: 1597
    • Texas Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #30 on: June 16, 2014, 11:26:05 AM »
wvdkuil,

The 950px did the trick.

My page is now live under almanac.

Thanks!

----
Davis Vantage Pro2 Plus +FARS|Meteobridge Nano SD|Meteohub|Meteobridge MR-3020|WU KTXSPRIN75/PWS JRARGWX75/CWOP EW2972/WBB TXWDVUE75/Blitzortung ID: 1142|AWEKAS: 12095
Donations are welcome: https://paypal.me/ffuentesb

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #31 on: June 16, 2014, 11:31:47 AM »
@wvdkuil: I hadn't thought about the chart and color coding so in-depth. After thinking about it a little more, in my opinion the values should be 0-9, 10-19, 20-29, etc. because people generally round to the nearest 10. For example having a high temperature or wind gust in the 10-19 range vs. the 20-29 range seems like a significant difference, and thus should be color coded differently. That should also solve the rounding dilemma that some are having since everything up to x9.9999999 would be coded as the lower range.

So what should be done with the number "0" exactly? For Rain however, a "0" day should definitely be color coded to be distinguishable from anything > 0. For Temperature it's still in the 0-9 range so I don't think it needs its own color. What about "0" Wind - calm? Some may want to have a perfectly calm day stand out from a 1-9 day. However I think a perfectly calm day is highly unlikely, so I say just keep it grouped with the 0-9s.

This all sounds like a coding nightmare. It should be interesting how the jury decides on this. Thank you.
« Last Edit: June 16, 2014, 11:47:20 AM by mjc775 »
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

Offline josecmorales

  • Senior Contributor
  • ****
  • Posts: 294
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #32 on: June 19, 2014, 11:52:26 AM »
I would like to try it, when is work fine, im going to translate to spanish!
Vantage Pro2 + UV, Airlink, Purpleair, Meteobridge.
Twitter: ClimaGuayana
Blitzortung station: 2934
Weatherlink: ClimaGuayana

Offline txweather.org

  • Forecaster
  • *****
  • Posts: 1597
    • Texas Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #33 on: June 22, 2014, 11:28:17 AM »
Just wanted to report that mine stop working.
No data sense the 14 and the first time you go the page you get a "No Data Error" It use to work so not sure what happened.

Ideas?

----
Davis Vantage Pro2 Plus +FARS|Meteobridge Nano SD|Meteohub|Meteobridge MR-3020|WU KTXSPRIN75/PWS JRARGWX75/CWOP EW2972/WBB TXWDVUE75/Blitzortung ID: 1142|AWEKAS: 12095
Donations are welcome: https://paypal.me/ffuentesb

Offline wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #34 on: June 22, 2014, 11:41:42 AM »
Just wanted to report that mine stop working.
No data sense the 14 and the first time you go the page you get a "No Data Error" It use to work so not sure what happened.

Ideas?
Somedays the WU servers are loaded to the max. We request in the scripts the data twice a day, the first time at the first run of the day and a second time after 14:00 hours. Both request are assumed to be finished in 10 seconds.
As long as WU is rearranging things it happens that the request is not finished in 10 seconds. And the "error" message is displayed once for that day-part.

So if you set the request time to 60 seconds it will always be finished. The wait time will be longer but normally it should not be that whole 60 seconds long. Your situation is the exeption, I hope, as you were not able to retrieve the data sinde June 14.

Script wsreports/wsReportsFunctions.php
Line  approx 217 reads now
Code: [Select]
curl_setopt ($ch, CURLOPT_TIMEOUT, 10);change to
Code: [Select]
curl_setopt ($ch, CURLOPT_TIMEOUT, 60);
Wim

Offline txweather.org

  • Forecaster
  • *****
  • Posts: 1597
    • Texas Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #35 on: June 22, 2014, 12:49:28 PM »
Thanks that fixed the issue where I get the "No Data Error"
But my data displays only goes back to the 14th of June.
I don't see anything after that for this month.

Any ideas?

Thanks!

----
Davis Vantage Pro2 Plus +FARS|Meteobridge Nano SD|Meteohub|Meteobridge MR-3020|WU KTXSPRIN75/PWS JRARGWX75/CWOP EW2972/WBB TXWDVUE75/Blitzortung ID: 1142|AWEKAS: 12095
Donations are welcome: https://paypal.me/ffuentesb

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #36 on: June 22, 2014, 01:55:51 PM »
I wish I had the programming knowledge to make the script use Meteobridge data instead of the sometimes unreliable Weather Underground data.
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

Offline txweather.org

  • Forecaster
  • *****
  • Posts: 1597
    • Texas Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #37 on: June 22, 2014, 01:57:00 PM »
I wish I had the programming knowledge to make the script use Meteobridge data instead of the sometimes unreliable Weather Underground data.

That would be nice, Would it? :D

----
Davis Vantage Pro2 Plus +FARS|Meteobridge Nano SD|Meteohub|Meteobridge MR-3020|WU KTXSPRIN75/PWS JRARGWX75/CWOP EW2972/WBB TXWDVUE75/Blitzortung ID: 1142|AWEKAS: 12095
Donations are welcome: https://paypal.me/ffuentesb

Offline wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #38 on: June 22, 2014, 02:31:01 PM »
Thanks that fixed the issue where I get the "No Data Error"
But my data displays only goes back to the 14th of June.
I don't see anything after that for this month.

Any ideas?

Thanks!
The scripts are since June 14 not allowed to save the data they read from WU.

It seems that the wsreports/wuData folder does not has the correct permissions.
http://www.txweather.org/wxStartReports.php   
results this error:  <!-- Weather data loaded from url: http://www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=KTXSPRIN75&month=01&day=01&year=2014&format=1&graphspan=year  -->
<!-- ERROR: Data could not be saved  ./wsreports/wuData/KTXSPRIN75-year-2014.txt -->

Running the default download script: http://www.txweather.org/wsreports/startReports.php
returns this error:
Warning: file_put_contents(./wuData/IVLAAMSG47-year-2014.txt): failed to open stream: Permission denied in /virtual/users/e17715-19776/web/wsreports/wsReports1part.php on line 490

So first (re)set the permissions for the folder  wsreports  AND its contents to 777.

Some webhosting companies do not like 777 and they sometimes reset them. So if you did not change anything at June 14, please write down the current permissions, change them to 777 and see if they stay that way.

Wim

Offline txweather.org

  • Forecaster
  • *****
  • Posts: 1597
    • Texas Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #39 on: June 22, 2014, 02:41:11 PM »
Wim,

Thanks for the help.

Done.
Looks like they are getting reset it.
I will work on it.

Thanks again.

----
Davis Vantage Pro2 Plus +FARS|Meteobridge Nano SD|Meteohub|Meteobridge MR-3020|WU KTXSPRIN75/PWS JRARGWX75/CWOP EW2972/WBB TXWDVUE75/Blitzortung ID: 1142|AWEKAS: 12095
Donations are welcome: https://paypal.me/ffuentesb

Offline wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #40 on: June 22, 2014, 02:41:34 PM »
I wish I had the programming knowledge to make the script use Meteobridge data instead of the sometimes unreliable Weather Underground data.
To what Meteobridge data are you refering?

I am not aware of any facilities in Meteobrdige to have multi-year historical data available. Only the add_on Meteoplug could do that more or less, I think, but that service costs 29 Euro / year.  And WeatherUnderground is free of charge.

Wim

P.S.
And very important to me, one sometimes has to switch weather stations or weather programs. But all weatherprograms can upload to WeatherUnderground.  So over the years one builds a huge database with historical data which is stored and accessible in one way over all those years. For those of us who have switched from weatherprogram1 to weatherprogram2 and lost all weather history, it is comfortable to have WU as a backup.





Offline txweather.org

  • Forecaster
  • *****
  • Posts: 1597
    • Texas Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #41 on: June 22, 2014, 02:43:33 PM »
I wish I had the programming knowledge to make the script use Meteobridge data instead of the sometimes unreliable Weather Underground data.
To what Meteobridge data are you refering?

I am not aware of any facilities in Meteobrdige to have multi-year historical data available. Only the add_on Meteoplug could do that more or less, I think, but that service costs 29 Euro / year.  And WeatherUnderground is free of charge.

Wim

P.S.
And very important to me, one sometimes has to switch weather stations or weather programs. But all weatherprograms can upload to WeatherUnderground.  So over the years one builds a huge database with historical data which is stored and accessible in one way over all those years. For those of us who have switched from weatherprogram1 to weatherprogram2 and lost all weather history, it is comfortable to have WU as a backup.






I actually would like meteohub not meteobridge as it's limited in data dumps.
But you make a good point!

----
Davis Vantage Pro2 Plus +FARS|Meteobridge Nano SD|Meteohub|Meteobridge MR-3020|WU KTXSPRIN75/PWS JRARGWX75/CWOP EW2972/WBB TXWDVUE75/Blitzortung ID: 1142|AWEKAS: 12095
Donations are welcome: https://paypal.me/ffuentesb

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #42 on: June 23, 2014, 01:47:14 AM »
I wish I had the programming knowledge to make the script use Meteobridge data instead of the sometimes unreliable Weather Underground data.
To what Meteobridge data are you refering?

I am not aware of any facilities in Meteobrdige to have multi-year historical data available. Only the add_on Meteoplug could do that more or less, I think, but that service costs 29 Euro / year.  And WeatherUnderground is free of charge.

Wim

P.S.
And very important to me, one sometimes has to switch weather stations or weather programs. But all weatherprograms can upload to WeatherUnderground.  So over the years one builds a huge database with historical data which is stored and accessible in one way over all those years. For those of us who have switched from weatherprogram1 to weatherprogram2 and lost all weather history, it is comfortable to have WU as a backup.
Perhaps historical WU data could be used as a base for the data as a txt/csv file or SQL database, then switched over to a daily Meteobridge upload that would update the initial historical data.

Agreed that WU has lots of benefits, however the inconsistent daily CSV update time and discrepancies in wind data make Meteobridge preferable.
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

Offline lrosenman

  • Contributor
  • ***
  • Posts: 148
    • Siena Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #43 on: August 01, 2014, 08:59:18 PM »
Thank You, GREAT stuff....

http://weather.lerctr.org/wxStartReports.php

or in the menu :)


Offline josecmorales

  • Senior Contributor
  • ****
  • Posts: 294
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #44 on: August 02, 2014, 09:35:05 PM »
Can i help to make a translation in spanish?
Vantage Pro2 + UV, Airlink, Purpleair, Meteobridge.
Twitter: ClimaGuayana
Blitzortung station: 2934
Weatherlink: ClimaGuayana

Offline wvdkuil

  • Wim van der kuil
  • Forecaster
  • *****
  • Posts: 1986
    • My PWS at Leuven Belgium Europe
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #45 on: August 03, 2014, 03:17:35 AM »
Can i help to make a translation in spanish?
@josecmorales
Thanks for the offer, I did not update the readme files when adding the Spanish language some time ago.
But the standard download already contains the Spanish language.
If you run it with ?lang=es the spanish translation is shown.
Example:
http://www.weerstation-leuven.be/wsreports/startReports.php?lang=es

Succes in using this script,
Wim

@ALL
Supported languages in the download English(en), Spanish(es), German(de), Dutch(nl) and French(fr).
If you want to add another language, a short how-to description is in the lang folder. Be aware that the scripts DO NOT use the Saratoga or Leuven translation routines. If you add a language, please post it here and send me a pm so those languages will benefit  others.



Offline josecmorales

  • Senior Contributor
  • ****
  • Posts: 294
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #46 on: September 07, 2014, 04:47:13 PM »
Is works now, but only have a issues with the special characters, i changed to UTF-8 but still showns errors

http://climaguayana.com.ve/wxStartReports.php
Vantage Pro2 + UV, Airlink, Purpleair, Meteobridge.
Twitter: ClimaGuayana
Blitzortung station: 2934
Weatherlink: ClimaGuayana

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #47 on: April 12, 2016, 11:28:43 AM »
It looks like Weather Underground changed something in the past month with retrieving data. Instead of the 2016 chart, I'm now getting an error "Error file for 2016 has unknown uom's" See: http://wx.ctreno.com/wsreports/startReports.php My KNVRENO97-year-2016.txt file no longer lists data but rather "Redirect page There is nothing to see here, please move along..." I looked around in the php files, but couldn't figure out where the problem might be or how to fix it.

Checking out the other reports links in this thread, it looks like I'm not the only one affected by this. Has anyone figured out a fix?
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

Offline mjc775

  • Senior Member
  • **
  • Posts: 58
    • Reno NW Weather
I had a Heathkit anemometer and barometer in the 1980s.  After a hiatus, in 2014 I purchased a cabled Davis Vantage Pro2.
WeatherLink IP, MeteoBridge, Meteoplug Cloud.
WU: KNVRENO97, CWOP: N7FEQ, MESOWEST/MADIS ID: AU849
Reno NW Weather

Offline WessexWeather

  • Senior Member
  • **
  • Posts: 83
    • WessexWeather
Re: Generate NOAA reports using Meteobridge uploaded data?
« Reply #49 on: April 21, 2016, 04:30:20 AM »
Firstly, hank you for this fantastic script!

Due to rounding of temperature decimals, the highs, lows, average and mean temperatures are quite different to those actually reported.

Is there any way to preserve the decimals throughout the script, as with the rainfall?

Secondly I notice the rainfall figures are also slightly different from those recorded. For example 0.2mm shows as 0.3mm. I presume this is a WU issue, converting from inches to mm?

Finally is there any way to ADD historical data to Weather Underground? I know that you can delete bad historical data but I am missing four days in April due to hardware failure, which will skew the April and seasonal averages.

Thanks in advance,

Simon
Cheers,

Simon (WessexWeather)