Topic: Help - Not able to send data from GW1000 to Apache server

[Rover1822]

Sorry for the many edits I made to my last post.

However, if you are able to see the IP of the GW1000 in the access logs , but not the data , and if you are using Ecowitt protocol expect to see the data, you won't. Ecowitt protocol uses "post" and the data will be in the body of the request, not the URL .

I cannot see the IP of the GW1000 in the access log.

OK... well that would be a start. Means the GW1000 is not getting there... now why?

[saback]

Configuration screenshot:

 [ You are not allowed to view attachments ]

Ecowitt screenshot:

 [ You are not allowed to view attachments ]

[Rover1822]

I have , weirdly, the same 68U router you have. It is the  gateway on my setup at the house to WAN and I have 2 other Wifi APs  that point to the 68U. I am not using the 68U as an AP pointing to a server that is the gateway as you are. But it reality non of that should matter.

OK.. back one step. In the logs when you mirrored the settings on WiFi wit another system, did you see the the entries, with IP in the access logs of Apache?

[Rover1822]

The other thing that is different in my setup is that my GW1000 is only sending to my customized server. Might be a bug if the GW1000 can't sent to the other servers "and" the local customized server... just a far reaching guess. Might try turning off the other server pushes and only run the customized

[Rover1822]

Also, is your Apache server running under TLS with a mod  of some kind? (HTTPS), or straight?

[saback]

I have , weirdly, the same 68U router you have. It is the  gateway on my setup at the house to WAN and I have 2 other Wifi APs  that point to the 68U. I am not using the 68U as an AP pointing to a server that is the gateway as you are. But it reality non of that should matter.

OK.. back one step. In the logs when you mirrored the settings on WiFi wit another system, did you see the the entries, with IP in the access logs of Apache?

Yes.

I also run a tcpdump and I can see it reaching the Ecowitt and Wundegroung but no package to local server 

Code: [Select]

sudo tcpdump -i eno1 src host 10.0.0.14
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eno1, link-type EN10MB (Ethernet), capture size 262144 bytes


10:00:36.710473 IP 10.0.0.14.1425 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [S], seq 859340, win 5840, options [mss 1460], length 0
10:00:36.900220 IP 10.0.0.14.1425 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [.], ack 3246687929, win 5840, length 0
10:00:36.960314 IP 10.0.0.14.1425 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [P.], seq 0:511, ack 1, win 5840, length 511: HTTP: GET /weatherstation/updateweatherstation.php?ID=IMELxxxxx&PASSWORD=xxxxxxxxx&tempf=-9999&humidity=-9999&dewptf=-9999&windchillf=-9999&winddir=-9999&windspeedmph=-9999&windgustmph=-9999&solarradiation=-9999&UV=-9999&indoortempf=64.2&indoorhumidity=82&baromin=29.914&soilmoisture=37&soilmoisture2=37&soilmoisture3=44&soilmoisture4=37&soilmoisture5=44&lowbatt=0&dateutc=now&softwaretype=GW1000_V1.5.6&action=updateraw&realtime=1&rtfreq=5 HTTP/1.0
10:00:37.149231 IP 10.0.0.14.1425 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [.], ack 145, win 5696, length 0
10:00:37.162937 IP 10.0.0.14.1425 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [F.], seq 511, ack 145, win 5696, length 0

10:00:53.810992 IP 10.0.0.14.34058 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [S], seq 864856, win 5840, options [mss 1460], length 0
10:00:53.997282 IP 10.0.0.14.34058 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [.], ack 961917002, win 5840, length 0
10:00:54.059084 IP 10.0.0.14.34058 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [P.], seq 0:511, ack 1, win 5840, length 511: HTTP: GET /weatherstation/updateweatherstation.php?ID=IMELxxxxx&PASSWORD=xxxxxtempf=-9999&humidity=-9999&dewptf=-9999&windchillf=-9999&winddir=-9999&windspeedmph=-9999&windgustmph=-9999&solarradiation=-9999&UV=-9999&indoortempf=64.4&indoorhumidity=82&baromin=29.914&soilmoisture=37&soilmoisture2=37&soilmoisture3=44&soilmoisture4=36&soilmoisture5=44&lowbatt=0&dateutc=now&softwaretype=GW1000_V1.5.6&action=updateraw&realtime=1&rtfreq=5 HTTP/1.0

10:00:54.247580 IP 10.0.0.14.34058 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [.], ack 145, win 5696, length 0
10:00:54.261324 IP 10.0.0.14.34058 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [F.], seq 511, ack 145, win 5696, length 0

10:01:10.714153 IP 10.0.0.14.43786 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [S], seq 870376, win 5840, options [mss 1460], length 0
10:01:11.205126 IP 10.0.0.14.43786 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [.], ack 1500433357, win 5840, length 0
10:01:11.267353 IP 10.0.0.14.43786 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [P.], seq 0:511, ack 1, win 5840, length 511: HTTP: GET /weatherstation/updateweatherstation.php?ID=IMELxxxxx&PASSWORD=xxxxxxx&tempf=-9999&humidity=-9999&dewptf=-9999&windchillf=-9999&winddir=-9999&windspeedmph=-9999&windgustmph=-9999&solarradiation=-9999&UV=-9999&indoortempf=64.4&indoorhumidity=82&baromin=29.914&soilmoisture=37&soilmoisture2=39&soilmoisture3=44&soilmoisture4=36&soilmoisture5=44&lowbatt=0&dateutc=now&softwaretype=GW1000_V1.5.6&action=updateraw&realtime=1&rtfreq=5 HTTP/1.0
10:01:11.513895 IP 10.0.0.14.43786 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [.], ack 145, win 5696, length 0
10:01:11.529905 IP 10.0.0.14.43786 > ec2-52-24-209-34.us-west-2.compute.amazonaws.com.http: Flags [F.], seq 511, ack 145, win 5696, length 0

10:01:21.714993 IP 10.0.0.14.64253 > 47.102.253.116.http: Flags [S], seq 875900, win 5840, options [mss 1460], length 0
10:01:22.264475 IP 10.0.0.14.64253 > 47.102.253.116.http: Flags [.], ack 2292408145, win 5840, length 0
10:01:22.320453 IP 10.0.0.14.64253 > 47.102.253.116.http: Flags [P.], seq 0:482, ack 1, win 5840, length 482: HTTP: POST /data/report/ HTTP/1.1
10:01:22.357204 IP 10.0.0.14.49154 > 255.255.255.255.59387: UDP, length 34
10:01:22.781143 IP 10.0.0.14.64253 > 47.102.253.116.http: Flags [.], ack 260, win 5581, length 0
10:01:22.782527 IP 10.0.0.14.64253 > 47.102.253.116.http: Flags [.], ack 261, win 5580, length 0
10:01:22.809095 IP 10.0.0.14.64253 > 47.102.253.116.http: Flags [F.], seq 482, ack 261, win 5580, length 0
10:01:24.410385 IP 10.0.0.14.49154 > 255.255.255.255.59387: UDP, length 34
10:01:26.407418 IP 10.0.0.14.49154 > 255.255.255.255.59387: UDP, length 34


[Rover1822]

Show me the access logs with the other system hitting "your" apache

[saback]

The other thing that is different in my setup is that my GW1000 is only sending to my customized server. Might be a bug if the GW1000 can't sent to the other servers "and" the local customized server... just a far reaching guess. Might try turning off the other server pushes and only run the customized

As a last resort I may reset the configuration to the factory configuration and only configure the customized server to see what happens.

[saback]

Show me the access logs with the other system hitting "your" apache

Code: [Select]

10.0.1.42 - - [07/Mar/2020:08:17:12 +1100] "GET /data/report/index.php HTTP/1.1" 200 433 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_3) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.5 Safari/605.1.15"
10.0.0.15 - - [07/Mar/2020:09:11:20 +1100] "GET /data/report/index.php HTTP/1.1" 200 418 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_3) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.5 Safari/605.1.15"
10.0.0.14 - - [07/Mar/2020:10:13:20 +1100] "GET /data/report/index.php HTTP/1.1" 200 418 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_3) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/13.0.5 Safari/605.1.15"
This is my laptop using IP 10.0.0.14 and accessing http://10.0.0.1/data/report/index.php

[Rover1822]

That may be worth the attempt

[saback]

Also, is your Apache server running under TLS with a mod  of some kind? (HTTPS), or straight?

No TLS.

[saback]

That may be worth the attempt

I just did a factory reset and reconnect it to my network. No change

[Rover1822]

Hmm.. this makes no sense

Can you flatten your network.. drop it down to /24 as was suggested?

Because I'm really out of ideas, other than being insulting and going with checking firmware etc

I know it works.. a lot of us know it works.

There is something probably minute and trivial that we are missing.

[saback]

New fact...

After reseting and disabling the Ecowitt.net I could see the packages trying 0.0.0.0 http what I couldn't see before but it is trying 0.0.0.0 instead of 10.0.0.1.
I also try using a name and it resolves to my server by keep trying 0.0.0.0

Code: [Select]

10:39:31.904460 IP 10.0.0.16.49960 > 0.0.0.0.http: Flags [S], seq 25488, win 5840, options [mss 1460], length 0
10:39:32.846801 IP 10.0.0.16.49154 > 255.255.255.255.59387: UDP, length 34
10:39:34.900372 IP 10.0.0.16.49960 > 0.0.0.0.http: Flags [S], seq 25488, win 5840, options [mss 1460], length 0
10:39:34.905252 IP 10.0.0.16.49154 > 255.255.255.255.59387: UDP, length 34
10:39:36.907590 IP 10.0.0.16.49154 > 255.255.255.255.59387: UDP, length 34
10:39:37.905275 IP 10.0.0.16.49960 > 0.0.0.0.http: Flags [S], seq 25488, win 5840, options [mss 1460], length 0
10:39:38.917064 IP 10.0.0.16.49154 > 255.255.255.255.59387: UDP, length 34
10:39:40.904409 IP 10.0.0.16.49960 > 0.0.0.0.http: Flags [S], seq 25488, win 5840, options [mss 1460], length 0
No entry at the apache access log.

[saback]

Hmm.. this makes no sense

Can you flatten your network.. drop it down to /24 as was suggested?

Because I'm really out of ideas, other than being insulting and going with checking firmware etc

I know it works.. a lot of us know it works.

There is something probably minute and trivial that we are missing.

Already did. It is now at a 10.0.0.0/24 - No change in behaviour when I changed it

[saback]

The moment I enable the Ecowitt.net the entry to 0.0.0.0 http disappears from the tcpdump log.

It all points to a bug somewhere.

[Rover1822]

You may not like this... Can you set your 68U as the gateway to your WAN/LAN interface.. I know it can handle it (other words switch from AP mode to router mode)
Take your local server out of the equation as the gateway? (why ... I'm looking for a phone home, you may have blocked)
I know means putting your server on another static IP, and repointing a bunch of stuff, ugghhh ....


after doing the changes, let it settle for 5 or minutes.. or reboot stuff to get rid of lease times

[Rover1822]

Also , while keeping your subnet down to /24 .. place the router LAN IP a the xxx.xxx.xxx.001 position
Yes I know this messes up your network

But .. its back to basics

[saback]

Also , while keeping your subnet down to /24 .. place the router LAN IP a the xxx.xxx.xxx.001 position
Yes I know this messes up your network

But .. its back to basics

Well, I can’t change it on “production” because I have a lot of other things hanging on it but I can create a separate lab network just to test it but it will take some time.

[Rover1822]

I know.

And I'm just grasping at straws. But having a extremely common baseline is a good place to start.

Now, would I do this .... probably not in my server environment. However , you have raised my curiosity level

My bottom line issue is that your Apache server is not seeing requests.. don't know why . I'm not going to duplicate your network to find out, that would be silly

but somewhere in that mess is the reason.


Scott

[Rover1822]

I know you are running a nix environment. But another possibility for diagnosis is to attempt to run the .Net simple program that I have in the other post on another machine (that is running Doze) and see if you get anything through the console after pointing your custom server settings to it as I outlined. I have the binary as a download in one of the posts , with the instructions. Pretty simple, unzip on a Doze machine, run the exe as an Administrator (or it will just fall over as it can't open the port to listen) . WS View... set to go to the IP of the box and port 8085 ..  instructions in that post. 

I know there is a hate wall on doze, unfortunately, I didn't have a need to write a cross platform Java version.

[saback]

My honest bet at the moment is here:

Code: [Select]

10:39:34.900372 IP 10.0.0.16.49960 > 0.0.0.0.http: Flags [S], seq 25488, win 5840, options [mss 1460], length
For some reason the GW1000 instead of sending the package to 10.0.0.1 is sending to 0.0.0.0 and because this doesn’t exists the package is lost. Some bug in it is not getting the correct IP information from the config.

[Rover1822]

reset it?... back into AP mode reconfigure?

[galfert]

How about throwing up an instance of WeeWX just to see if the Interceptor driver for WeeWX can get data?

[saback]

reset it?... back into AP mode reconfigure?

Already done!