WXforum.net
Weather Station Hardware => Ambient Weather and Ecowitt and other Fine Offset clones => Topic started by: Jiveborn on November 21, 2021, 12:35:36 PM
-
Has anyone encountered these incorrect peaks in the temperature graph? I use the Ecowitt GW1100 and let it feed the wunderground directly. I have the latest firmware and restarted it several times, it still continues.
https://www.wunderground.com/dashboard/pws/IWESTUPP2
Best regards Jan.
-
1. need not be the console, could be the sensor - the WH32 (DP40)
2. is your DP40 also registered to yout HP2551 console (HP1000SE Pro console) ?
If so, what does the HP2551 console show ?
If not, register the WH32/DP40 to the HP2551 console and see what it gives on ecowitt.net and the other sites.
3. which console(s) post(s) to the other weather sites ? (PWS, WC)
as they don't show this behaviour.
4. Is your GW1100 closely located to a potential source of interference ?
-
1. need not be the console, could be the sensor - the WH32 (DP40)
2. is your DP40 also registered to yout HP2551 console (HP1000SE Pro console) ?
If so, what does the HP2551 console show ?
If not, register the WH32/DP40 to the HP2551 console and see what it gives on ecowitt.net and the other sites.
3. which console(s) post(s) to the other weather sites ? (PWS, WC)
as they don't show this behaviour.
4. Is your GW1100 closely located to a potential source of interference ? Not really
#3: I use two GW1100 and the Console. :oops: EasyWeather consol feeds WOW and and https://www.wunderground.com/dashboard/pws/IUPPHR3 with normal graphs, GW1100-1 feeds https://www.ecowitt.net/home/index?id=56422 and https://www.wunderground.com/dashboard/pws/IUPPHR2 and https://app.weathercloud.net/map#8191310659. The GW1100-2 feeds https://www.wunderground.com/dashboard/pws/IWESTUPP2.
Best regards Jan
-
what is important to know is to which console(s) the WH32/DP40 outdoor T/H sensor is registered and which output these consoles (the WH32 is connected to) produce. From there we can find out who/what the "culprit" might be.
You can register all three of your consoles at ecowitt.net - and I suggest you do so.
-
what is important to know is to which console(s) the WH32/DP40 outdoor T/H sensor is registered and which output these consoles (the WH32 is connected to) produce. From there we can find out who/what the "culprit" might be.
You can register all three of your consoles at ecowitt.net - and I suggest you do so.
I will register the other two (GW1100-1 and GW1100-2) on ecowitt.net - will return when this is done. Thank you very much for your suggestions. Unfortunately, I am far from professionals so I learn something new every day.
Best regards Jan
-
Hello again! Now I have all three registered on Ecowitt: https://www.ecowitt.net/home/index?id=56422
It will probably take a day before we can see the history on the graphs.
I can also admit that I let GW1100-2 feed WeatherDisplay (https://www.jiveborn.se/WeatherDisplay/Jiveborn.htm) and, there, all graphs are perfectly ok.
Best regards Jan.
-
Hello again.
I can only state that the graphs on Ecowitt do not contain any abnormal peaks in temperature. It seems like it only appears in the graphs of wunderground. I have changed places on the Easy Weather console and GW1100-1 to see if anything changes. Otherwise, I can live with the fact that it only occurs in wunderground.
Best regards Jan.
-
one more idea - as wunderground has a different transmission protocol and there were recently issues with the GW1100 posting to WoW:
have you upgraded your GW1100 to firmware V2.0.7 ? (latest firmware with some improvements - see https://www.wxforum.net/index.php?topic=40730.0 ).
-
one more idea - as wunderground has a different transmission protocoll and there were recently issues with the GW1100 posting to WoW:
have you upgraded your GW1100 to firmware V2.0.7 ? (latest firmware with some improvements - see https://www.wxforum.net/index.php?topic=40730.0 ).
Yes i have upgraded to V2.0.7.
Best regards Jan
-
Hi again!
Guess what! I moved the GW1100 that controlled https://www.wunderground.com/dashboard/pws/IWESTUPP2 to another room, about 8 meters from the router. Now all graphs at wunderground are ok. :grin: The distance between the GW1100 and the router can be significant.
Best regards Jan.
-
I am glad that worked. It does strike me as unusual that this solved a "peak" issue. I would have expected that if distance where to come to play between the GW1100 and the router , that one would see data drop outs as opposed to peaks in the data.
Regardless, as you say it worked , there must be something I don't understand.
-
I am glad that worked. It does strike me as unusual that this solved a "peak" issue. I would have expected that if distance where to come to play between the GW1100 and the router , that one would see data drop outs as opposed to peaks in the data.
Regardless, as you say it worked , there must be something I don't understand.
Hello again!
Yes, I do not know what happened. The process of changing location and restarting the GW1100 in combination with restarting the router was all I did. In fact, the graphs in the wunderground remain ok again. However, it is possible that it has not solved the problem of peaks in the long run. It should be as you say the opposite, caused dips. I'm happy as long as it works.
Best regards Jan.
-
I am glad that worked. It does strike me as unusual that this solved a "peak" issue. I would have expected that if distance where to come to play between the GW1100 and the router , that one would see data drop outs as opposed to peaks in the data.
Regardless, as you say it worked , there must be something I don't understand.
Hello again!
Yes, I do not know what happened. The process of changing location and restarting the GW1100 in combination with restarting the router was all I did. In fact, the graphs in the wunderground remain ok again. However, it is possible that it has not solved the problem of peaks in the long run. It should be as you say the opposite, caused dips. I'm happy as long as it works.
Best regards Jan.
Sometimes signal dropouts don't appear on the graphs if they are short duration.
Ecowitt and WU data points are 5 minutes apart and unless you got a droupout exactly on the interval it might be missed.
My GW1000 continues to be problematic ( stopped 3 times in the last 7 days) so I will often use something like pwsweather.com which uses 1 minute data intervals. Sometimes best to use the tables instead of graphs.
Curiously my GW1100 will show my WH32E as full bars but at the same time my GW1000 shows 1 bar or less!
Next step is to move the WH32E closer to the two consoles and see what happens...
-
Sometimes signal dropouts don't appear on the graphs if they are short duration.
Ecowitt and WU data points are 5 minutes apart and unless you got a droupout exactly on the interval it might be missed.
My GW1000 continues to be problematic ( stopped 3 times in the last 7 days) so I will often use something like pwsweather.com which uses 1 minute data intervals. Sometimes best to use the tables instead of graphs.
Curiously my GW1100 will show my WH32E as full bars but at the same time my GW1000 shows 1 bar or less!
Next step is to move the WH32E closer to the two consoles and see what happens...
I don't argue this, what I have a problem with is "peaks", that means the addition or interpretation of something to make it a peak. Going back and looking at the data , and seeing that the peaks seem to all reach the same level, not a variance , but the same peak level, seems to point to something else. Where? Cause?... I don't know, but it does seem to be artificial.
-
Don't know if this is relative to the issue or not. I found using a usb extension cord helps tremendously with the gw1000 and a must have for the gw1100 to work properly.
Being to close electrical stuff (computers / surge protectors /batter back-ups and other) can interfere with sensor signal strength and/or cause them to stop working all together. That said, I never seen spikes in data.
-
Sometimes signal dropouts don't appear on the graphs if they are short duration.
Ecowitt and WU data points are 5 minutes apart and unless you got a droupout exactly on the interval it might be missed.
My GW1000 continues to be problematic ( stopped 3 times in the last 7 days) so I will often use something like pwsweather.com which uses 1 minute data intervals. Sometimes best to use the tables instead of graphs.
Curiously my GW1100 will show my WH32E as full bars but at the same time my GW1000 shows 1 bar or less!
Next step is to move the WH32E closer to the two consoles and see what happens...
I don't argue this, what I have a problem with is "peaks", that means the addition or interpretation of something to make it a peak. Going back and looking at the data , and seeing that the peaks seem to all reach the same level, not a variance , but the same peak level, seems to point to something else. Where? Cause?... I don't know, but it does seem to be artificial.
I agree - the peaks are highly unusual and you may be entirely correct in that they might be an artificial artifact maybe generated in a software script.
I am pretty sure now that I am losing signal from the WH32E and the GW1000 that I have is not receiving properly. In my case the GW1000 is closer to the WH32E than the GW1100 but the GW1000 drops out and the GW1100 doesn't. I've moved it(the GW1000) around a bit put a longer USB extension and put new lithium batteries in the WH32E. Still unstable as ever.
Here are some dew point peaks from by pwsdashboard website that I am sure is a result of no signal from the WH32E (or not received by the GW1000). When no signal is present the dewpoint jumps to 0C. In ecowitt the graph doesn't show any artifacts but in the ecowitt table you will see the empty line - no temp, no humidity, etc.
--
-
Yes it was probably too early to celebrate. :-( Now they are back again, but only on the graphs in wunderground. We will probably have to continue and look for where the fault lies.
Best regards
Jan
-
I have the same problem with GW1000 reporting to WU - ecowitt.net and weathercloud reporting looks fine. It started a couple weeks ago. Spikes are showing up across multiple sensors. I changed my WU station ID and I had good reporting for about a day, but then spikes again. At least I am not the only one :roll:
[ You are not allowed to view attachments ]
-
Ok this is interesting, 1 having a problem is OK, 1, 2 having it, still a low number , but adds credence to the first to not being for that specific setup.
Now, what is in common between 1 & 2. And could be the problem for 1 & 2?
I have a bunch of GW100Os and GW1100, but I don't have any reporting to WU, which seems to be entire issue area.
We kind of know that WU did some work on their stuff around October 20 something , I forget the exact date but that is when they dropped the web cameras. I am not for an instant saying that is the cause or related to the cause. Just strikes me as something to look at as , as , I believe , this started happening a few weeks ago for those affected approximate to the timeline. Possible other things were done?. No idea.
I do know my data to WU doesn't show the issue, but that is from WS-2000 console, which I send out at 16 sec intervals (I should recheck that , I may have changed it)
...Another thing, how many look at their graph data on WU? I can tell you I very rarely do. Maybe, this will encourage others to have a look, as the issues reported are short duration, you might not notice if not looking at the graph data.
-
Ok this is interesting, 1 having a problem is OK, 1, 2 having it, still a low number , but adds credence to the first to not being for that specific setup.
Now, what is in common between 1 & 2 and could be the problem for 1 & 2.
I have a bunch of GW100Os and GW1100, but I don't have any reporting to WU, which seems to be entire issue area.
We kind of know that WU did some work on their stuff around October 20 something , I forget the exact date but that is when they dropped the web cameras. I am not for an instant saying that is the cause or related to the cause. Just strikes me as something to look at as , as , I believe , this started happening a few weeks ago for those affected approximate to the timeline. Possible other things were done?. No idea.
I do know my data to WU doesn't show the issue, but that is from WS-2000 console, which I send out at 16 sec intervals (I should recheck that , I may have changed it)
The problematic GW1000 that is dropping the WH32E signal also uploads to WU but there are no spikes so that would seem to eliminate me from this contest. [ You are not allowed to view attachments ]
-
Drop outs, I expect to see when there is a data issue from lost connections, either from sensor to console, or console to router to site (WU). Peaks, that is something different. Especially when they seem to have the same max level, or similar.
For a break in data, that is making up data in the form of the peak, what I called artificial.
-
The spikes started showing up for me on Nov. 17 on WU graphs - station ID KNCRALEI465. On Nov. 23rd I setup my new station ID because I saw on an old post here that it might fix the problem, but after one day of good graphs, the new ID KNCRALEI888 started showing the spikes too - in fact, they seem worse than ever now :???:
I was going to buy a new GW1000, but seeing that I am not the only one with this issue, I will hold off. I did not delete my old WU ID if anyone wants to do some forensics :grin:
Old ID:
https://www.wunderground.com/dashboard/pws/KNCRALEI465
-
I added my GW1100 to my devices on WU, once it starts registering data I'll follow to see if I can duplicate.
I do ask this question. How many of those experiencing an issue had multiple devices on WU when they experienced the issue. (Not what they have done since, just the initial count)
-
I think that you need a logger/forwarder script ( like the attached one ) that sits between your weather station and wu ( to understand if the spikes are also present in the data sent by gw1000 ).
You need to use the custom upload feature ( in wu format ) to send data to the logger.
1) extract the script in your server
2) verify that the script works correctly ( call the script from the browser, the log is available in the file params.txt )
3) configure the custom upload to upload to the script
4) if everything works as expected the file params.txt should grow every time a 'record' is received and your wu station should also be updated.
Wait for a spike in wu and verify if is also present in the log.
P.S.
My guess is that the custom upload ( in wu format ) misbehaves when a data is not received from the outdoor main sensor ( or something like this )
[ You are not allowed to view attachments ]
-
How many of those experiencing an issue had multiple devices on WU when they experienced the issue. (Not what they have done since, just the initial count)
I just have one: ECOWITT GW1000 | WH32 | WS68 | WH40 | WH57
-
I added my GW1100 to my devices on WU, once it starts registering data I'll follow to see if I can duplicate.
I do ask this question. How many of those experiencing an issue had multiple devices on WU when they experienced the issue. (Not what they have done since, just the initial count)
I have 3 Ecowitt GW1100 with Froggit HP1000SE PRO Single Sensor Edition with DP40, DP50, DP80, DP300, DP1500 and DP60.
Best regards Jan
-
Cool.
Yep, also depends on the OS etc. i built a custom server on .Net that allows me to do that without a webserver. It is actually its own little mini webserver with one purpose, just receive requests on one port. Obviously this is for doze.
In this instance though, you will probably want a redirect on your router to your server on the LAN using the WU upload, as opposed to using the custom server. This is to make sure that there is no difference between what the WU send does, versus the WU protocol under custom server. There probably is no difference, but best to be as close as possible
On you code. If it is not huge, you may want to post it in here using the code brackets code /code
I think that you need a logger/forwarder script ( like the attached one ) that sits between your weather station and wu ( to understand if the spikes are also present in the data sent by gw1000 ).
You need to use the custom upload feature ( in wu format ) to send data to the logger.
1) extract the script in your server
2) verify that the script works correctly ( call the script from the browser, the log is available in the file params.txt )
3) configure the custom upload to upload to the script
4) if everything works as expected the file params.txt should grow every time a 'record' is received and your wu station should also be updated.
Wait for a spike in wu and verify if is also present in the log.
[ You are not allowed to view attachments ]
-
Not super sexy ( even in this 'nude look' ; - )
<?php
// params v1.1 2020-11-24 added GET forwarder
//
// server to forward the POST data received ( full url including index.php for ecowitt ), leave empty if not used ( used by ECOWITT )
$forward_server_1 = "";
// server to forward the GET data received ( full url ), leave empty if not used ( used by WU, WINDY, AMBIENT... )
//$forward_server_2 = "";
$forward_server_2 = "https://weatherstation.wunderground.com/weatherstation/updateweatherstation.php"; // forward to WU
//$forward_server_2 = "https://stations.windy.com/pws/update/INSERT-YOUR-API-KEY"; // forward to Windy
$logFile = __DIR__."/params.txt";
function emu_getallheaders() {
foreach ($_SERVER as $name => $value)
{
if (substr($name, 0, 5) == 'HTTP_')
{
$name = str_replace(' ', '-', ucwords(strtolower(str_replace('_', ' ', substr($name, 5)))));
$headers[$name] = $value;
} else if ($name == "CONTENT_TYPE") {
$headers["Content-Type"] = $value;
} else if ($name == "CONTENT_LENGTH") {
$headers["Content-Length"] = $value;
}
}
return $headers;
}
$h = emu_getallheaders();
echo date("Y-m-d H:i:s");
echo "<br>headers:<br>\n";
print_r($h);
file_put_contents($logFile, date("Y-m-d H:i:s"), FILE_APPEND);
file_put_contents($logFile, "\nheaders:\n", FILE_APPEND);
file_put_contents($logFile, print_r($h,true), FILE_APPEND);
echo "<br>\nGET params:<br>\n";
print_r($_GET);
file_put_contents($logFile, "GET params:\n", FILE_APPEND);
file_put_contents($logFile, print_r($_GET,true), FILE_APPEND);
echo "<br>\nPOST params:<br>\n";
print_r($_POST);
file_put_contents($logFile, "POST params:\n", FILE_APPEND);
file_put_contents($logFile, print_r($_POST,true), FILE_APPEND);
/*$fields = $_GET; // get fields
$getvars = http_build_query($fields); // build the urlencoded data
echo "<br>";
echo "getvars=$getvars<br>";
$getvars=str_replace("%3A",":",$getvars);
echo "getvars=$getvars<br>";*/
if ($forward_server_1 != "")
{
$url = $forward_server_1;
echo "fw1 POST to -> $url<br>";
$fields = $_POST; // post fields
$postvars = http_build_query($fields); // build the urlencoded data
$postvars=str_replace("%3A",":",$postvars);
$ch = curl_init();
// set the url, number of POST vars, POST data
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt($ch, CURLOPT_POST, count($fields));
curl_setopt($ch, CURLOPT_POSTFIELDS, $postvars);
$result = curl_exec($ch); // execute post
curl_close($ch);
echo "fw1 result=$result<br>";
file_put_contents($logFile, "fw1 result=".$result."\n", FILE_APPEND);
}
if ($forward_server_2 != "")
{
$url = $forward_server_2;
echo "fw2 GET to -> $url<br>";
$wdf = "";
foreach($_GET as $key => $value)
{$wdf .= '&' . $key . '=' . $value;}
$wdf=str_replace(":","%3A",$wdf);
$wdf=str_replace(" ","+",$wdf);
$result = file_get_contents($url . "?" . substr($wdf,1));
file_put_contents($logFile, "fw2 url=".$url . "?" . substr($wdf,1)."\n", FILE_APPEND);
echo "fw2 result=$result<br>";
file_put_contents($logFile, "fw2 result=".$result."\n", FILE_APPEND);
}
http_response_code(200);
?>
-
No spikes that past 24 hours! Maybe they will go away as mysteriously as they appeared :-)
-
Hi!
Are these peaks only in the graph or also in the table?
For me, peaks are sometimes displayed in the graph, but they cannot be seen in the data in the table.
Look in the graph of the temperature - around 07:00 am there is a peak of 21.4°C:
https://www.wunderground.com/dashboard/pws/IHOHEN41/graph/2021-11-17/2021-11-17/daily
However, if you look at the numerical values by clicking on Table, no such peak can be seen.
I'm also pretty sure that these incorrect values were not carried over. But I can't say for sure and now I explicitly log the data as well.
Whereby the temperatures at 06:54 with 10.4°C and at 6:59 with 9.7°C cannot be correct either.
Strange ...
So far I have no idea what is actually going on. But I have set traps and I will pursue it.
Oliver
-
Hi!
Are these peaks only in the graph or also in the table?
For me, peaks are sometimes displayed in the graph, but they cannot be seen in the data in the table.
Look in the graph of the temperature - around 07:00 am there is a peak of 21.4°C:
https://www.wunderground.com/dashboard/pws/IHOHEN41/graph/2021-11-17/2021-11-17/daily
However, if you look at the numerical values by clicking on Table, no such peak can be seen.
I'm also pretty sure that these incorrect values were not carried over. But I can't say for sure and now I explicitly log the data as well.
Whereby the temperatures at 06:54 with 10.4°C and at 6:59 with 9.7°C cannot be correct either.
Strange ...
So far I have no idea what is actually going on. But I have set traps and I will pursue it.
Oliver
My data only has peaks in the graph. The table does not include these maximum values. However, in the summary of the day, the maximum value is included, see picture. Good luck with the hunt!
Best regards Jan.
-
Some of the spikes do show on the table. Check out the solar entries on my graph at 1214, 1224, etc. Sunrise is around 0700 EST.
Note: the spikes seemed to have stopped suddenly on Nov 26. I have not had any since so maybe it is resolved - I hope :-)
-
So Jibster, based on your data we see data aberrations in your temp, pressure and solar radiation. The solar being the easiest one to spot, as based on your data, should be "0" during the times your peaks are happening.
-
So Jibster, based on your data we see data aberrations in your temp, pressure and solar radiation. The solar being the easiest one to spot, as based on your data, should be "0" during the times your peaks are happening.
Yes
-
As Oliver pointed out the graphs and the table data are 'out of sync'.
For example last 23th on jiveborn wu page:
table data 5:04 t=-1.1°C graph t=9.3
table data 6:24 t=-1.6°C graph t=9.3
table data 9:14 t=-1.7°C graph t=9.3
Table data show a small 0.7°C peak while graph shows a peak > 10°C
Also the total precipitation show unreasonable data
[ You are not allowed to view attachments ]
P.S.
I have no peaks in my wu page, but I do not upload to wu via gw1000/wh2650
-
Three days with NO spikes!
They seemed to have stopped as mysteriously as they started.
-
More than one aspect affected, may be some source of RFI? Appliance malfunction?
-
Ambient says that this is a known bug of wu: https://help.ambientweather.net/help/i-am-getting-discontinuity-in-the-temperature-data-and-graph-on-weather-underground/
-
Ambient says that this is a known bug of wu: https://help.ambientweather.net/help/i-am-getting-discontinuity-in-the-temperature-data-and-graph-on-weather-underground/
Yes, I saw that last week, and I went ahead and created a new station but it did not help - the spikes were as bad as ever. Fortunately there have not been any spikes the past few days, and aside from a 5 hour power failure today, all is well :-)
-
Interesting that they say it is a WeatherUnderground bug - I haven't seen uploads from any other stations/software behaving like that?
-
Not familiar with the WU protocols but if it has a CRC check perhaps they are not checking it correctly and accepting bad data?
Stuart
-
Hi!
if it has a CRC check
There's nothing like that. It's just an ASCII-string.
Have a look here (https://ear.phantasoft.de/index.php?mac=Station-ID).
Oliver
-
Hi!
if it has a CRC check
There's nothing like that. It's just an ASCII-string.
Have a look here (https://ear.phantasoft.de/index.php?mac=Station-ID).
Oliver
Perhaps it should have!
Stuart