Author Topic: Meteobridge uploads  (Read 1702 times)

0 Members and 1 Guest are viewing this topic.

Offline xcom

  • Forecaster
  • *****
  • Posts: 988
    • Texas Weather
Meteobridge uploads
« on: July 13, 2016, 01:25:02 AM »
For some time now I am unable to upload to open weather map. I get:

2016-07-13 00:18:57 Error: http://openweathermap.org/data/post: 2016-07-13 00:18:58 ERROR 500: Internal Server Error

Any Ideas why?
Am I the only one?

Regards,
-

----
Davis Vantage Vue|Meteohub 5.0l (Build 7293) Running on Debian 7.9 x86 (oVirt)|WU KTXSPRIN75/PWS JRARGWX75/CWOP EW2972/WBB TXWDVUE75/Blitzortung ID: 1142|AWEKAS: 12095

Offline kevink619

  • Senior Member
  • **
  • Posts: 94
    • My G+
Re: Meteobridge uploads
« Reply #1 on: September 07, 2016, 02:19:12 AM »
For some time now I am unable to upload to open weather map. I get:

2016-07-13 00:18:57 Error: http://openweathermap.org/data/post: 2016-07-13 00:18:58 ERROR 500: Internal Server Error

Any Ideas why?
Am I the only one?

Regards,
-

You're not the only one. I'm seriously considering dropping support for OpenWeatherMap from my app. They seemed to have quietly abandoned support for the uploading of PWS data to their servers - yet the still have invalid instructions on how to upload your weather data. I don't know what is up with them these days.

Offline xcom

  • Forecaster
  • *****
  • Posts: 988
    • Texas Weather
Re: Meteobridge uploads
« Reply #2 on: September 08, 2016, 08:32:57 AM »
For some time now I am unable to upload to open weather map. I get:

2016-07-13 00:18:57 Error: http://openweathermap.org/data/post: 2016-07-13 00:18:58 ERROR 500: Internal Server Error

Any Ideas why?
Am I the only one?

Regards,
-

You're not the only one. I'm seriously considering dropping support for OpenWeatherMap from my app. They seemed to have quietly abandoned support for the uploading of PWS data to their servers - yet the still have invalid instructions on how to upload your weather data. I don't know what is up with them these days.

That's what I did, I completely drop them.

----
Davis Vantage Vue|Meteohub 5.0l (Build 7293) Running on Debian 7.9 x86 (oVirt)|WU KTXSPRIN75/PWS JRARGWX75/CWOP EW2972/WBB TXWDVUE75/Blitzortung ID: 1142|AWEKAS: 12095

Offline docbee

  • Moderator
  • Forecaster
  • *****
  • Posts: 669
    • smartbedded
Re: Meteobridge uploads
« Reply #3 on: September 11, 2016, 08:14:26 AM »
They are much focused on selling data via their APIs. They never took reasonable care to make sending data easy and stable. Asking them to mention Meteobridge as a solution being able to send data in their list of supported SW/devices was never answered. Dropping them looks like a good idea. I can't see much that matches the "Open" phrase in their name.
founder of smartbedded.com - home of meteohub, meteoplug, meteobridge, meteostick

Offline SpringHillWeather

  • Weather Hobbyist
  • Forecaster
  • *****
  • Posts: 533
  • Spring Hill, Florida
    • Spring Hill
Re: Meteobridge uploads
« Reply #4 on: September 11, 2016, 01:41:03 PM »
Agreed.  I can login but can't find my Station Data on their site anymore.   They did make changes and as you mentioned they went to the 'API' model.   

One less service I'll be sending data to now.

Saratoga
HomeWeatherStation
Meteotemplate
Homebrew
Ambient 1001 | ObserverIP | Meteobridge | MeteoPlug

Offline Jáchym

  • Meteotemplate Developer
  • Forecaster
  • *****
  • Posts: 8572
    • Meteotemplate
Re: Meteobridge uploads
« Reply #5 on: September 11, 2016, 02:27:16 PM »
I did not include OWM in Meteotemplate at all. I used to have a script for it on my personal page before I created MT and I remember that it was down every other week, and I remember many people complained on their FB site and they never even responded to anything. Very unreliable service.

Offline kevink619

  • Senior Member
  • **
  • Posts: 94
    • My G+
Re: Meteobridge uploads
« Reply #6 on: September 11, 2016, 02:46:46 PM »
I did not include OWM in Meteotemplate at all. I used to have a script for it on my personal page before I created MT and I remember that it was down every other week, and I remember many people complained on their FB site and they never even responded to anything. Very unreliable service.

I was finally able to get a reply from OWM when they responded to my tweets. They basically said that they plan on fixing things "soon".

Offline galfert

  • Forecaster
  • *****
  • Posts: 863
Re: Meteobridge uploads
« Reply #7 on: September 13, 2018, 01:21:42 PM »
In December 2016 OpenWeatherMap updated their API protocol to version 3.0 I believe.

Has anyone tried to upload and see their data with OpenWeatherMap recently since the new API 3.0 version was introduced?

I'm using a Meteobridge. I got my station ID created using a Json Chrome add-on app called ARC (Adavanced REST Client). I think it is similar to the Postman app...but I think ARC is simpler and easier to use. The instructions on OpenWeatherMap are still terrible. But I'm able to query with the ARC app and see that my station got created and exists. I don't see a place in their website under your account settings for the station to even show up on though. Still I'm uploading wx data successfully according to the Meteobridge.

One confusing thing in the Meteobridge is that I wasn't sure if to use my Station ID name (that I created called external_ID), or the station ID that got generated when I created the station. But upon looking at the documentation of the format to send weather data it seems that they want the station ID that got generated. I have the Meteobridge set to upload every 5 minutes and I get the green check marks on both Weather Network and Live Data tabs. But I don't see the data on OpenWeatherMaps websites anywhere yet. I'll give it a few days and see what happens. I was just curious if anyone else has attempted this recently.

There is a Json query to GET published data from your station. So I used the ARC app to query. But after figuring out my Epoch date range and entering the query I get no weather data and just a rather basic with no error response of:  [array[0]],

The Meteobridge should really change that field name to something better than "Station Name." It should be called instead "Generated ID" I think, to clear up the confusion and so that the user doesn't use the "external_ID" to identify the station. Maybe part of the problem is that the Meteobridge has not been updated to support this new API??? But I think it has because I think one of the new things in the 3.0 API is that it now includes a way of identifying a specific station which was not possible before. I suppose it could be possible that the Meteobridge is still not fully supporting OpenWeatherMap or has some bugs. Please share if you've had any success or insight.
« Last Edit: September 13, 2018, 05:22:50 PM by galfert »
WS-2902A | ObserverIP | WeatherBridge (Meteobridge)
WU: KFLWINTE111  |  PWSweather: KFLWINTE111
CWOP: FW3708  |  AWEKAS: 14814
Tele-Pole flag pole is here (not installed yet)

Offline docbee

  • Moderator
  • Forecaster
  • *****
  • Posts: 669
    • smartbedded
Re: Meteobridge uploads
« Reply #8 on: September 13, 2018, 06:52:48 PM »
I can change the upload format to the new API v3, modern JSON style but very poor on content (no solar radiation, no UV, unclear what kind of pressure they like, etc). Only question is how the user generates a station_id before starting the upload by giving alt/long/lat etc. Do these OWM guys provide a web formular for the user to define a station? Or don't they care as usual?

I am not much interested to have setting up a station in their network being part of the Meteobridge interface.
« Last Edit: September 13, 2018, 06:55:01 PM by docbee »
founder of smartbedded.com - home of meteohub, meteoplug, meteobridge, meteostick

Offline galfert

  • Forecaster
  • *****
  • Posts: 863
Re: Meteobridge uploads
« Reply #9 on: September 13, 2018, 09:13:39 PM »
I read that OWM now only supports the new API v3. If the Meteobridge is currently using the old format then it wont work.

Since they are based out of the UK they want the weather data in metric units. They list the weather units on this basic information page on how to connect a weather station. They list the pressure type as hpa. Their example page lists an upload pressure of 1021. That is hpa and probably station pressure because they ask for altitude when setting up the station. They just call it Atmospheric pressure, and since they aren’t calling it Relative pressure or Sea Level Pressure is another clue that they want station pressure.

The other weird part (for me anyway, but I’m not a programmer) is that they want the weather uploaded where the time is in Epoch (Unix timestamp). It is a 10 digit number. I remember reading that Unix started counting seconds from 0 on January 1 at 12AM GMT in 1970.

The only way to create a station is with any JSON client software. OWM does not guide you nor recommend a software to use. I will create some documentation on using the JSON client app that I used in Chrome (ARC app) with steps on how to set up a station (and how to change static parameters of the station, and how to query it for test data). It was a bit tedious to copy and past IDs and API keys to create the custom URL and give it the data that it needs to generate the station ID (it generates the ID and creates the station in one step). Then you can use a different query in the JSON client app and the site responds back confirming that your station got created. Their website mentions that new tools are coming soon to make it easier to do more. But who knows when that will be.

To modify the created station you also need to use the JSON client app. You would need to do this to correct or change any station static parameter like Latitude, Longitude, altitude, external_id, station name.

The Meteobridge does not need to pass Latitude and Longitude. They get Lat & Long when the station ID was generated (via JSON client app). This example below (plus some recommended extra variables) is the only thing the Meteobridge needs to send (I would remove the clouds section from their example):

Code: [Select]
[
  {
    "station_id": "583436dd9643a9000196b8d6",
    "dt": 1479817340,
    "temperature": 18.7,
    "wind_speed": 1.2,
    "wind_gust": 3.4,
    "pressure": 1021,
    "humidity": 87,
    "rain_1h": 2,
    "clouds": [
        {
            "condition": "NSC"
        }
    ]
  }
]

…and I would add some variables to the Meteobridge if possible that they omitted in the example above (at least wind direction should be no problem):

“wind_deg”:                                 (0 to 360)
“rain_6h”:                                    (using mm for amount in last 6 hours)
“rain_24h”:                                  (using mm for amount in last 24 hours or last day)
“dew_point”:                                (using Celsius)
“heat_index”:                               (using Celsius)

Here is where all this is documented:
https://openweathermap.org/stations

I don’t know what the variable “humidex” even means. It is described as Index of temperature and humidity. I thought oh like heat index. But they already have a different variable for that called “heat_index.”

If the Meteobridge could get updated to support this new API v3 then I can check with the JSON client app to tell it to retrieve weather data. If I get data back then and the weather data numbers look good then I would let everyone know that it is working. Then I would see if the data shows up on their weather maps. It should. Unless their weather maps are only a basic overview of specific spots with aggregated data from different weather sources. Then that would mean that the only way to get your weather data would be by creating a website that called the JSON API to then publish to your website. If that is the case then OpenWeatherMap I’d say is pretty useless and they are only interested in selling weather data rather than hosting individual weather stations. If that happens then I would probably recommend removing OWM from the Meteobridge.  I’m willing to do any testing if the Meteobrige gets updated and I’ll report back.

« Last Edit: September 13, 2018, 09:29:08 PM by galfert »
WS-2902A | ObserverIP | WeatherBridge (Meteobridge)
WU: KFLWINTE111  |  PWSweather: KFLWINTE111
CWOP: FW3708  |  AWEKAS: 14814
Tele-Pole flag pole is here (not installed yet)

Offline Bushman

  • Forecaster
  • *****
  • Posts: 7074
    • Eagle Bay Weather
Re: Meteobridge uploads
« Reply #10 on: September 14, 2018, 10:25:18 AM »
Humidex is a Canadian invention!  :)   https://simple.wikipedia.org/wiki/Humidex

 

anything