Author Topic: GW1100 & wunderground and strange temperature fluctuations.  (Read 2039 times)

0 Members and 1 Guest are viewing this topic.

Offline Jiveborn

  • Jan
  • Member
  • *
  • Posts: 27
    • Jiveborn
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #25 on: November 26, 2021, 12:33:16 PM »
I added my GW1100 to my devices on WU, once it starts registering data I'll follow to see if I can duplicate.

I do ask this question. How many of those experiencing an issue had multiple devices on WU when they experienced the issue. (Not what they have done since, just the initial count)

I have 3 Ecowitt GW1100 with Froggit HP1000SE PRO Single Sensor Edition with DP40, DP50, DP80, DP300, DP1500 and DP60.

Best regards Jan

Offline Rover1822

  • Forecaster
  • *****
  • Posts: 2017
    • Mini Wind and Solar Data project
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #26 on: November 26, 2021, 12:37:47 PM »
Cool.

Yep, also depends on the OS etc. i built a custom server on .Net that allows me to do that without a webserver. It is actually its own little mini webserver with one purpose, just receive requests on one port. Obviously this is for doze.

In this instance though, you will probably want a redirect on your router to your server on the LAN using the WU upload, as opposed to using the custom server. This is to make sure that there is no difference between what the WU send does, versus the WU protocol under custom server. There probably is no difference, but best to be as close as possible

On you code. If it is not huge, you may want to post it in here using the code brackets code /code


I think that you need a logger/forwarder script ( like the attached one ) that sits between your weather station and wu ( to understand if the spikes are also present in the data sent by gw1000 ).
You need to use the custom upload feature ( in wu format ) to send data to the logger.

1) extract the script in your server
2) verify that the script works correctly ( call the script from the browser, the log is available in the file params.txt )
3) configure the custom upload to upload to the script
4) if everything works as expected the file params.txt should grow every time a 'record' is received and your wu station should also be updated.

Wait for a spike in wu and verify if is also present in the log.

 [ You are not allowed to view attachments ]
Ambient:
  WS-2000
  PM 2.5(2)
  WH31B(2)
  WH40E
  WH31P
EcoWitt:
  GW1100
  GW1000(4)
  WH31(2)
  WH57
  WH51(12),
  WH40
  WH5360B
  WN34S
  WittBoy WS90 + GW2000
  WS90 (other one) + GW1100
Personal Sites: Weather Cam

Offline davidefa

  • Forecaster
  • *****
  • Posts: 436
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #27 on: November 26, 2021, 01:19:41 PM »
Not super sexy ( even in this 'nude look' ; - )

Code: (php) [Select]
<?php

// params v1.1 2020-11-24 added GET forwarder
//

// server to forward the POST data received ( full url including index.php for ecowitt ), leave empty if not used ( used by ECOWITT )
$forward_server_1 "";

// server to forward the GET data received ( full url ), leave empty if not used ( used by WU, WINDY, AMBIENT... )
//$forward_server_2 = "";
$forward_server_2 "https://weatherstation.wunderground.com/weatherstation/updateweatherstation.php";    // forward to WU
//$forward_server_2 = "https://stations.windy.com/pws/update/INSERT-YOUR-API-KEY";    // forward to Windy

$logFile __DIR__."/params.txt";

  function 
emu_getallheaders() {
    foreach (
$_SERVER as $name => $value)
       {
           if (
substr($name05) == 'HTTP_')
           {
               
$name str_replace(' ''-'ucwords(strtolower(str_replace('_'' 'substr($name5)))));
               
$headers[$name] = $value;
           } else if (
$name == "CONTENT_TYPE") {
               
$headers["Content-Type"] = $value;
           } else if (
$name == "CONTENT_LENGTH") {
               
$headers["Content-Length"] = $value;
           }
       }
       return 
$headers;
    }
    
$h emu_getallheaders();
echo 
date("Y-m-d H:i:s");
echo 
"<br>headers:<br>\n";
print_r($h);
file_put_contents($logFiledate("Y-m-d H:i:s"), FILE_APPEND);
file_put_contents($logFile"\nheaders:\n"FILE_APPEND);
file_put_contents($logFileprint_r($h,true), FILE_APPEND);
echo 
"<br>\nGET params:<br>\n";
print_r($_GET);
file_put_contents($logFile"GET params:\n"FILE_APPEND);
file_put_contents($logFileprint_r($_GET,true), FILE_APPEND);
echo 
"<br>\nPOST params:<br>\n";
print_r($_POST);
file_put_contents($logFile"POST params:\n"FILE_APPEND);
file_put_contents($logFileprint_r($_POST,true), FILE_APPEND);

/*$fields = $_GET;                       // get fields
$getvars = http_build_query($fields);  // build the urlencoded data
echo "<br>";
echo "getvars=$getvars<br>";
$getvars=str_replace("%3A",":",$getvars);
echo "getvars=$getvars<br>";*/

if ($forward_server_1 != "")
    {
    
$url $forward_server_1;
    echo 
"fw1 POST to -> $url<br>";
    
$fields $_POST;                       // post fields
    
$postvars http_build_query($fields);  // build the urlencoded data
    
$postvars=str_replace("%3A",":",$postvars);
    
$ch curl_init();

    
// set the url, number of POST vars, POST data
    
curl_setopt($chCURLOPT_URL$url);
    
curl_setopt($chCURLOPT_POSTcount($fields));
    
curl_setopt($chCURLOPT_POSTFIELDS$postvars);
    
$result curl_exec($ch);   // execute post
    
curl_close($ch);
    echo 
"fw1 result=$result<br>";
    
file_put_contents($logFile"fw1 result=".$result."\n"FILE_APPEND);
    }

if (
$forward_server_2 != "")
    {
    
$url $forward_server_2;
    echo 
"fw2 GET to -> $url<br>";
    
$wdf "";
    foreach(
$_GET as $key => $value
{$wdf .= '&' $key '=' $value;}
    
$wdf=str_replace(":","%3A",$wdf);
    
$wdf=str_replace(" ","+",$wdf);
    
$result file_get_contents($url  "?" substr($wdf,1));
    
file_put_contents($logFile"fw2 url=".$url  "?" substr($wdf,1)."\n"FILE_APPEND);
    echo 
"fw2 result=$result<br>";
    
file_put_contents($logFile"fw2 result=".$result."\n"FILE_APPEND);
    }

http_response_code(200);
?>
« Last Edit: November 26, 2021, 01:21:44 PM by davidefa »

Offline Jibster

  • Member
  • *
  • Posts: 43
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #28 on: November 27, 2021, 08:37:18 AM »
No spikes that past 24 hours! Maybe they will go away as mysteriously as they appeared  :-)
ECOWITT GW1000 | WH32 | WS68 | WH40 | WH57
KNCRALEI888

Online olicat

  • Forecaster
  • *****
  • Posts: 1522
  • GWxx00, HPx5x1C, WN1900C, WN1980C & WS3xx0C
    • FOSHKplugin
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #29 on: November 27, 2021, 05:04:15 PM »
Hi!

Are these peaks only in the graph or also in the table?
For me, peaks are sometimes displayed in the graph, but they cannot be seen in the data in the table.
Look in the graph of the temperature - around 07:00 am there is a peak of 21.4°C:

https://www.wunderground.com/dashboard/pws/IHOHEN41/graph/2021-11-17/2021-11-17/daily

However, if you look at the numerical values by clicking on Table, no such peak can be seen.
I'm also pretty sure that these incorrect values were not carried over. But I can't say for sure and now I explicitly log the data as well.
Whereby the temperatures at 06:54 with 10.4°C and at 6:59 with 9.7°C cannot be correct either.
Strange ...

So far I have no idea what is actually going on. But I have set traps and I will pursue it.

Oliver

Offline Jiveborn

  • Jan
  • Member
  • *
  • Posts: 27
    • Jiveborn
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #30 on: November 28, 2021, 07:07:48 AM »
Hi!

Are these peaks only in the graph or also in the table?
For me, peaks are sometimes displayed in the graph, but they cannot be seen in the data in the table.
Look in the graph of the temperature - around 07:00 am there is a peak of 21.4°C:

https://www.wunderground.com/dashboard/pws/IHOHEN41/graph/2021-11-17/2021-11-17/daily

However, if you look at the numerical values by clicking on Table, no such peak can be seen.
I'm also pretty sure that these incorrect values were not carried over. But I can't say for sure and now I explicitly log the data as well.
Whereby the temperatures at 06:54 with 10.4°C and at 6:59 with 9.7°C cannot be correct either.
Strange ...

So far I have no idea what is actually going on. But I have set traps and I will pursue it.

Oliver

My data only has peaks in the graph. The table does not include these maximum values. However, in the summary of the day, the maximum value is included, see picture. Good luck with the hunt!
Best regards Jan.

Offline Jibster

  • Member
  • *
  • Posts: 43
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #31 on: November 28, 2021, 09:11:43 AM »
Some of the spikes do show on the table. Check out the solar entries on my graph at 1214, 1224, etc. Sunrise is around 0700 EST.

Note: the spikes seemed to have stopped suddenly on Nov 26. I have not had any since so maybe it is resolved - I hope  :-)
« Last Edit: November 28, 2021, 10:33:13 AM by Jibster »
ECOWITT GW1000 | WH32 | WS68 | WH40 | WH57
KNCRALEI888

Offline Rover1822

  • Forecaster
  • *****
  • Posts: 2017
    • Mini Wind and Solar Data project
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #32 on: November 28, 2021, 10:04:35 AM »
So Jibster, based on your data we see data aberrations in your temp, pressure and solar radiation. The solar being the easiest one to spot, as based on your data, should be "0" during the times your peaks are happening.
Ambient:
  WS-2000
  PM 2.5(2)
  WH31B(2)
  WH40E
  WH31P
EcoWitt:
  GW1100
  GW1000(4)
  WH31(2)
  WH57
  WH51(12),
  WH40
  WH5360B
  WN34S
  WittBoy WS90 + GW2000
  WS90 (other one) + GW1100
Personal Sites: Weather Cam

Offline Jibster

  • Member
  • *
  • Posts: 43
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #33 on: November 28, 2021, 10:35:48 AM »
So Jibster, based on your data we see data aberrations in your temp, pressure and solar radiation. The solar being the easiest one to spot, as based on your data, should be "0" during the times your peaks are happening.

Yes
ECOWITT GW1000 | WH32 | WS68 | WH40 | WH57
KNCRALEI888

Offline davidefa

  • Forecaster
  • *****
  • Posts: 436
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #34 on: November 28, 2021, 11:26:47 AM »
As Oliver pointed out the graphs and the table data are 'out of sync'.
For example last 23th on jiveborn wu page:
table data 5:04 t=-1.1°C graph t=9.3
table data 6:24 t=-1.6°C graph t=9.3
table data 9:14 t=-1.7°C graph t=9.3
Table data show a small 0.7°C peak while graph shows a peak > 10°C
Also the total precipitation show unreasonable data

 [ You are not allowed to view attachments ]

P.S.
I have no peaks in my wu page, but I do not upload to wu via gw1000/wh2650
« Last Edit: November 28, 2021, 11:34:11 AM by davidefa »

Offline Jibster

  • Member
  • *
  • Posts: 43
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #35 on: November 29, 2021, 08:08:36 AM »
Three days with NO spikes!

They seemed to have stopped as mysteriously as they started.
ECOWITT GW1000 | WH32 | WS68 | WH40 | WH57
KNCRALEI888

Offline OldAlaskaGuy

  • Alaska, The Last American Frontier
  • Forecaster
  • *****
  • Posts: 399
  • Living in the "Last American Frontier"
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #36 on: November 29, 2021, 03:58:37 PM »
More than one aspect affected, may be some source of RFI? Appliance malfunction?


Offline Jibster

  • Member
  • *
  • Posts: 43
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #38 on: November 30, 2021, 04:18:48 PM »
Ambient says that this is a known bug of wu: https://help.ambientweather.net/help/i-am-getting-discontinuity-in-the-temperature-data-and-graph-on-weather-underground/

Yes, I saw that last week, and I went ahead and created a new station but it did not help - the spikes were as bad as ever. Fortunately there have not been any spikes the past few days, and aside from a 5 hour power failure today, all is well  :-)
ECOWITT GW1000 | WH32 | WS68 | WH40 | WH57
KNCRALEI888

Offline mcrossley

  • Forecaster
  • *****
  • Posts: 1140
    • Wilmslow Astro
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #39 on: December 01, 2021, 06:39:46 AM »
Interesting that they say it is a WeatherUnderground bug - I haven't seen uploads from any other stations/software behaving like that?
Mark

Offline broadstairs

  • Forecaster
  • *****
  • Posts: 861
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #40 on: December 01, 2021, 12:27:46 PM »
Not familiar with the WU protocols but if it has a CRC check perhaps they are not checking it correctly and accepting bad data?

Stuart
Ecowitt GW1003 with ultrasonic wind gauge, lightning sensor and PM2.5 sensor with Personal Weather Tablet as a console.

Online olicat

  • Forecaster
  • *****
  • Posts: 1522
  • GWxx00, HPx5x1C, WN1900C, WN1980C & WS3xx0C
    • FOSHKplugin
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #41 on: December 01, 2021, 12:36:42 PM »
Hi!

Quote
if it has a CRC check
There's nothing like that. It's just an ASCII-string.
Have a look here.

Oliver

Offline broadstairs

  • Forecaster
  • *****
  • Posts: 861
Re: GW1100 & wunderground and strange temperature fluctuations.
« Reply #42 on: December 01, 2021, 01:38:03 PM »
Hi!

Quote
if it has a CRC check
There's nothing like that. It's just an ASCII-string.
Have a look here.

Oliver

Perhaps it should have!

Stuart
Ecowitt GW1003 with ultrasonic wind gauge, lightning sensor and PM2.5 sensor with Personal Weather Tablet as a console.

 

anything