Author Topic: "Ecowitt.net outage on 09/24/2021"  (Read 1708 times)

0 Members and 1 Guest are viewing this topic.

Offline Platokidd

  • top side land of Lincoln
  • Forecaster
  • *****
  • Posts: 636
"Ecowitt.net outage on 09/24/2021"
« on: September 24, 2021, 09:01:34 AM »
Anybody else getting the Ecowitt.net -  network is busy? This has been going on all morning.
« Last Edit: September 24, 2021, 01:31:16 PM by Platokidd »
Ambient
1-WS-5000 1-WS-2902A 2-WS40/RAIN 1-WH31L 
1-METEOBRIDGE 1-PM2.5 (WH41B) 3-WH31 1-SRX100LX

ECOWITT
2-HP2550 2-HP2560 2-GW2000 2-GW1100
2-WS68 1-WS80 1-WH32EP 10-WH31 1-WH40
1-HP10 2-WH45 4-WH55 5-WH51
1-WN30 1-WH41

1-DAVIS 7714
1-STRATUS
1-Fisher Barometer 1436R-22
PWS at 2 locations.
1- Storm Sensor-Zelda the dog ;)

Online Rover1822

  • Forecaster
  • *****
  • Posts: 1989
    • Mini Wind and Solar Data project
Re: ecowitt.net busy
« Reply #1 on: September 24, 2021, 09:11:43 AM »
Yes. So it appears not to be just you
I have mine running 24/7 in the background, I just noticed it hadn't updated for 29 minutes, so I refreshed the page and got the message.


Ambient:
  WS-2000
  PM 2.5(2)
  WH31B(2)
  WH40E
  WH31P
EcoWitt:
  GW1100
  GW1000(4)
  WH31(2)
  WH57
  WH51(12),
  WH40
  WH5360B
  WN34S
  WittBoy WS90 + GW2000
  WS90 (other one) + GW1100
Personal Sites: Weather Cam

Offline Gyvate

  • Forecaster
  • *****
  • Posts: 3298
Re: ecowitt.net busy
« Reply #2 on: September 24, 2021, 10:33:48 AM »
same here - since a couple hours and still ongoing
WS2350 1.6.7, GW1000(3) 1.7.7,WH2650 WiFi (2) 1.7.7 (test/backup), GW1100 2.3.1, GW2000(3) 3.1.1, HP2551 1.9.5,5.1.5;HP3500 1.7.2,WS3800 1.2.8, WN1910 1.2.3,WN1980 1.2.3;
Ecowitt WS90(2)1.3.5/1.4.0, WS80(2)1.2.5, WS68, WS69, WH40, WH31, WH31-EP, WN30, WN34L, WN35, WH32, WH32-EP, WH32B, WH57 [Lightning], WH41 [PM2.5], WH51, WH45, WH55
MeteobridgePro(2)[test,prod] 5.8 Mar 01 2024, 15185 - Blake-Larsen Sun Recorder - RPi4/weewx 4.8.0/4.10.2/CumulusMX 3283/Meteobridge RPi4B-2GB(3169)
Barani Meteoshield Pro, MetSpec Rad02 - Ecowitt 5763,34418;WU ISAARB3(WH4000SE),ISAARB22(HP2553), http://meshka.eu

Online Rover1822

  • Forecaster
  • *****
  • Posts: 1989
    • Mini Wind and Solar Data project
Re: ecowitt.net busy
« Reply #3 on: September 24, 2021, 10:37:09 AM »
Since the main site does come up, have to assume they have something going on in the back end.
Anyone post on the Ecowitt forum?. I know it takes a while for those to get validated but don't know any other way to notify them of the issue.
Ambient:
  WS-2000
  PM 2.5(2)
  WH31B(2)
  WH40E
  WH31P
EcoWitt:
  GW1100
  GW1000(4)
  WH31(2)
  WH57
  WH51(12),
  WH40
  WH5360B
  WN34S
  WittBoy WS90 + GW2000
  WS90 (other one) + GW1100
Personal Sites: Weather Cam

Offline plunet

  • Member
  • *
  • Posts: 44
Re: ecowitt.net busy
« Reply #4 on: September 24, 2021, 11:05:48 AM »
Those who are seeing the issue (I am), are we all being loadbalanced to the same IP?

nslookup www.ecowitt.net
Server:  Router.lan
Address:  fd54:8739:e7a5::1

Non-authoritative answer:
Name:    www.ecowitt.net.w.cdngslb.com
Address:  163.181.57.213
Aliases:  www.ecowitt.net

Online Rover1822

  • Forecaster
  • *****
  • Posts: 1989
    • Mini Wind and Solar Data project
Re: ecowitt.net busy
« Reply #5 on: September 24, 2021, 11:58:20 AM »
nope

Non-authoritative answer:
Name:    www.ecowitt.net.w.cdngslb.com
Address:  47.246.23.144
Aliases:  www.ecowitt.net

As I said this looks like a backend issue, anyway, guess we wait
Ambient:
  WS-2000
  PM 2.5(2)
  WH31B(2)
  WH40E
  WH31P
EcoWitt:
  GW1100
  GW1000(4)
  WH31(2)
  WH57
  WH51(12),
  WH40
  WH5360B
  WN34S
  WittBoy WS90 + GW2000
  WS90 (other one) + GW1100
Personal Sites: Weather Cam

Offline Gyvate

  • Forecaster
  • *****
  • Posts: 3298
Re: ecowitt.net busy
« Reply #6 on: September 24, 2021, 12:24:46 PM »
I sent an email to support@ecowitt.com 2 hours ago - but as they are on UTC +8 (and weekend has started) not sure when they will read it
WS2350 1.6.7, GW1000(3) 1.7.7,WH2650 WiFi (2) 1.7.7 (test/backup), GW1100 2.3.1, GW2000(3) 3.1.1, HP2551 1.9.5,5.1.5;HP3500 1.7.2,WS3800 1.2.8, WN1910 1.2.3,WN1980 1.2.3;
Ecowitt WS90(2)1.3.5/1.4.0, WS80(2)1.2.5, WS68, WS69, WH40, WH31, WH31-EP, WN30, WN34L, WN35, WH32, WH32-EP, WH32B, WH57 [Lightning], WH41 [PM2.5], WH51, WH45, WH55
MeteobridgePro(2)[test,prod] 5.8 Mar 01 2024, 15185 - Blake-Larsen Sun Recorder - RPi4/weewx 4.8.0/4.10.2/CumulusMX 3283/Meteobridge RPi4B-2GB(3169)
Barani Meteoshield Pro, MetSpec Rad02 - Ecowitt 5763,34418;WU ISAARB3(WH4000SE),ISAARB22(HP2553), http://meshka.eu

Online Rover1822

  • Forecaster
  • *****
  • Posts: 1989
    • Mini Wind and Solar Data project
Re: ecowitt.net busy
« Reply #7 on: September 24, 2021, 12:33:02 PM »
Platokidd or Galfert., or anyone that can change the topic

Can we change the topic to something like "ecowitt.net busy on 09/24/2021", or "Ecowitt.net outage on 09/24/2021"

This is to signify a specific event as opposed to previous posts/threads where people get the message , but it is not a generalized outage in those cases

Thanks,

Rover
Ambient:
  WS-2000
  PM 2.5(2)
  WH31B(2)
  WH40E
  WH31P
EcoWitt:
  GW1100
  GW1000(4)
  WH31(2)
  WH57
  WH51(12),
  WH40
  WH5360B
  WN34S
  WittBoy WS90 + GW2000
  WS90 (other one) + GW1100
Personal Sites: Weather Cam

Offline Platokidd

  • top side land of Lincoln
  • Forecaster
  • *****
  • Posts: 636
Re: ecowitt.net busy
« Reply #8 on: September 24, 2021, 01:32:04 PM »
Platokidd or Galfert., or anyone that can change the topic

Can we change the topic to something like "ecowitt.net busy on 09/24/2021", or "Ecowitt.net outage on 09/24/2021"

This is to signify a specific event as opposed to previous posts/threads where people get the message , but it is not a generalized outage in those cases

Thanks,

Rover



Done
Ambient
1-WS-5000 1-WS-2902A 2-WS40/RAIN 1-WH31L 
1-METEOBRIDGE 1-PM2.5 (WH41B) 3-WH31 1-SRX100LX

ECOWITT
2-HP2550 2-HP2560 2-GW2000 2-GW1100
2-WS68 1-WS80 1-WH32EP 10-WH31 1-WH40
1-HP10 2-WH45 4-WH55 5-WH51
1-WN30 1-WH41

1-DAVIS 7714
1-STRATUS
1-Fisher Barometer 1436R-22
PWS at 2 locations.
1- Storm Sensor-Zelda the dog ;)

Offline OldAlaskaGuy

  • Alaska, The Last American Frontier
  • Forecaster
  • *****
  • Posts: 399
  • Living in the "Last American Frontier"
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #9 on: September 24, 2021, 01:42:47 PM »
Busy also in Alaska.

Offline plunet

  • Member
  • *
  • Posts: 44
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #10 on: September 24, 2021, 02:25:40 PM »
Depending what has gone wrong might have to be prepared that their systems might not be capturing or processing any data. Just a guess, hopefully it's not the case.

Offline Gyvate

  • Forecaster
  • *****
  • Posts: 3298
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #11 on: September 24, 2021, 02:28:09 PM »
Ecowitt's reply:
"Did you try with the webpage via browser or ecowitt APP?
Can you try both to see if there is any difference? I can open the page normal here. So I think it is related with the CDN deployment from the service provider."

CDN = content delivery network

The Ecowitt app works well with me - only the web browser not. So that's probably it. From China, locally it works.
I replied to them that the app works and the browser not.
« Last Edit: September 24, 2021, 02:31:03 PM by Gyvate »
WS2350 1.6.7, GW1000(3) 1.7.7,WH2650 WiFi (2) 1.7.7 (test/backup), GW1100 2.3.1, GW2000(3) 3.1.1, HP2551 1.9.5,5.1.5;HP3500 1.7.2,WS3800 1.2.8, WN1910 1.2.3,WN1980 1.2.3;
Ecowitt WS90(2)1.3.5/1.4.0, WS80(2)1.2.5, WS68, WS69, WH40, WH31, WH31-EP, WN30, WN34L, WN35, WH32, WH32-EP, WH32B, WH57 [Lightning], WH41 [PM2.5], WH51, WH45, WH55
MeteobridgePro(2)[test,prod] 5.8 Mar 01 2024, 15185 - Blake-Larsen Sun Recorder - RPi4/weewx 4.8.0/4.10.2/CumulusMX 3283/Meteobridge RPi4B-2GB(3169)
Barani Meteoshield Pro, MetSpec Rad02 - Ecowitt 5763,34418;WU ISAARB3(WH4000SE),ISAARB22(HP2553), http://meshka.eu

Online Rover1822

  • Forecaster
  • *****
  • Posts: 1989
    • Mini Wind and Solar Data project
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #12 on: September 24, 2021, 02:36:37 PM »
You did mention that a lot of us just use the web page?
Ambient:
  WS-2000
  PM 2.5(2)
  WH31B(2)
  WH40E
  WH31P
EcoWitt:
  GW1100
  GW1000(4)
  WH31(2)
  WH57
  WH51(12),
  WH40
  WH5360B
  WN34S
  WittBoy WS90 + GW2000
  WS90 (other one) + GW1100
Personal Sites: Weather Cam

Offline plunet

  • Member
  • *
  • Posts: 44
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #13 on: September 24, 2021, 02:39:45 PM »
I didn't know there was an ecowitt app.
Just installed it, logged in, and it can see my live data.

In that case it's probably the API or middleware that sits behind the ecowitt.net website that permits it to access the backend data that has fallen over. But it's fallen over in more than one global region as it doesn't matter where we get sent by the CDN, it's down for all of us.

Offline OldAlaskaGuy

  • Alaska, The Last American Frontier
  • Forecaster
  • *****
  • Posts: 399
  • Living in the "Last American Frontier"
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #14 on: September 24, 2021, 02:42:46 PM »
Using my Android phone via browser and app, no data showing. I push to WU and Weathercloud  through Ecowitt, data current. Message comes up stating Certificate error: date of the certificate is invalid
Update: The phone app is now working for me the web page is not through the browser.
« Last Edit: September 24, 2021, 02:51:24 PM by Weatheroger »

Offline plunet

  • Member
  • *
  • Posts: 44
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #15 on: September 24, 2021, 02:56:36 PM »
Ah, probably an expired certificate. A frequent cause for high profile technology snafus these days.  ](*,) Someone will be annoyed with themselves at HQ.

Offline MacGarage

  • SW Ohio
  • Senior Contributor
  • ****
  • Posts: 184
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #16 on: September 24, 2021, 03:22:47 PM »
I am getting the invalid certificate error as well
« Last Edit: September 24, 2021, 03:25:06 PM by MacGarage »
Ecowitt WH2320E
AcuRite Atlas

Offline Gyvate

  • Forecaster
  • *****
  • Posts: 3298
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #17 on: September 24, 2021, 03:29:15 PM »
You did mention that a lot of us just use the web page?
the way I read their response is that at the (origin) server end everything seems to be ok.
When their service provider is rolling out new content to a CDN, this may take some time, depending on the CDN provider, and can create these busy network messages.
It will also depend on the request routing system of the CDN and whether all works out smoothly there. This is not under Ecowitt control. At best they can issue a trouble ticket with their service provider
and depending on their SLA (service level agreement) get some response within the agreed time frame.

Regarding the invalid certificate, this may come only if you try to connect directly to the server IP (which is usually not catered for if you use a CDN provider, because there you only connect (are re-directed) to the replica servers - but a replica server could also have an expired certificate issue).
« Last Edit: September 24, 2021, 03:37:29 PM by Gyvate »
WS2350 1.6.7, GW1000(3) 1.7.7,WH2650 WiFi (2) 1.7.7 (test/backup), GW1100 2.3.1, GW2000(3) 3.1.1, HP2551 1.9.5,5.1.5;HP3500 1.7.2,WS3800 1.2.8, WN1910 1.2.3,WN1980 1.2.3;
Ecowitt WS90(2)1.3.5/1.4.0, WS80(2)1.2.5, WS68, WS69, WH40, WH31, WH31-EP, WN30, WN34L, WN35, WH32, WH32-EP, WH32B, WH57 [Lightning], WH41 [PM2.5], WH51, WH45, WH55
MeteobridgePro(2)[test,prod] 5.8 Mar 01 2024, 15185 - Blake-Larsen Sun Recorder - RPi4/weewx 4.8.0/4.10.2/CumulusMX 3283/Meteobridge RPi4B-2GB(3169)
Barani Meteoshield Pro, MetSpec Rad02 - Ecowitt 5763,34418;WU ISAARB3(WH4000SE),ISAARB22(HP2553), http://meshka.eu

Offline OldAlaskaGuy

  • Alaska, The Last American Frontier
  • Forecaster
  • *****
  • Posts: 399
  • Living in the "Last American Frontier"
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #18 on: September 24, 2021, 03:38:04 PM »
Thank you GYvate for being on top of this. We will move on to other things and let this all process. At least data is being ingested and viewable (verified using the phone app) and being pushed to other services.  [tup]

Offline plunet

  • Member
  • *
  • Posts: 44
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #19 on: September 24, 2021, 03:47:35 PM »
As far as I am aware, data is pushed from your own console to the other services (WU, weathercloud), it doesn't go via Ecowitt.

Offline Gyvate

  • Forecaster
  • *****
  • Posts: 3298
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #20 on: September 24, 2021, 04:01:01 PM »
As far as I am aware, data is pushed from your own console to the other services (WU, weathercloud), it doesn't go via Ecowitt.
yes, true - but this was not the question here afaik. And I'm not aware that somebody claimed that this road would be taken.
The CDN is how data from an origin server are propagated via replica servers for load balancing, access speed, prioritization etc. purposes.
In this thread the issue is that you cannot view the data in your web browser which your console has pushed to ecowitt.net and get the "network busy" message.
This pushing obviously still works as this can be verified by using the ecowitt app.
Other weather networks are not considered.
WS2350 1.6.7, GW1000(3) 1.7.7,WH2650 WiFi (2) 1.7.7 (test/backup), GW1100 2.3.1, GW2000(3) 3.1.1, HP2551 1.9.5,5.1.5;HP3500 1.7.2,WS3800 1.2.8, WN1910 1.2.3,WN1980 1.2.3;
Ecowitt WS90(2)1.3.5/1.4.0, WS80(2)1.2.5, WS68, WS69, WH40, WH31, WH31-EP, WN30, WN34L, WN35, WH32, WH32-EP, WH32B, WH57 [Lightning], WH41 [PM2.5], WH51, WH45, WH55
MeteobridgePro(2)[test,prod] 5.8 Mar 01 2024, 15185 - Blake-Larsen Sun Recorder - RPi4/weewx 4.8.0/4.10.2/CumulusMX 3283/Meteobridge RPi4B-2GB(3169)
Barani Meteoshield Pro, MetSpec Rad02 - Ecowitt 5763,34418;WU ISAARB3(WH4000SE),ISAARB22(HP2553), http://meshka.eu

Offline Daali

  • weather n00b
  • Senior Contributor
  • ****
  • Posts: 223
    • The weather in Jefferson, GA
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #21 on: September 24, 2021, 04:43:16 PM »
This really is an important service since WU is so unstable. For my friends roll out tomorrow, his neighbors are going to rely on that "share link" to see river temps.

I hope it comes back up tonight!

Offline plunet

  • Member
  • *
  • Posts: 44
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #22 on: September 24, 2021, 05:11:36 PM »
I push to WU and Weathercloud  through Ecowitt, data current.

yes, true - but this was not the question here afaik. And I'm not aware that somebody claimed that this road would be taken.

I was responding to Weatheroger who from what he wrote appeared to think that for data to be sent to WU and weathercloud it needed to go via Ecowitt, which isn't the case

Offline davidefa

  • Forecaster
  • *****
  • Posts: 436
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #23 on: September 24, 2021, 05:20:48 PM »
Yes, the certificate for webapi.www.ecowitt.net/user/site/login expired 24/09/2021

I could login correctly to ecowitt.net setting the computer date to 23/09/2021


 [ You are not allowed to view attachments ]

Offline Daali

  • weather n00b
  • Senior Contributor
  • ****
  • Posts: 223
    • The weather in Jefferson, GA
Re: "Ecowitt.net outage on 09/24/2021"
« Reply #24 on: September 24, 2021, 08:28:46 PM »
seems to be back on line! yay!