Topic: NWS Weather Forecast with Leaflet Map not working (gridpoint forecast)

[rrrick8]

Last few days my NWS-forecast-map has not been working. It was on/off for a couple days now just off.
Before when it stopped working I'd change HOME coordinates a bit and it would work. No more. Nothing works. Keep getting the error response "Oops... unable to fetch the gridpoint forecast data RC=503.
Please try again later".
Anyone else using this old Curly script that Ken adopted? Love the ability to get a forecast anywhere in USA with it.
Here is link to page it's on.... https://vermilionweather.com/forecast.php
and link to script itself (standalone version) .... https://vermilionweather.com/NWS-forecast-maptest.php

 [ You are not allowed to view attachments ]

Thanks in advance for any assistance.
Rick

[rrrick8]

Lol. The thing hasn't worked for over 2 days and 10 minutes after I post... it's working now.  Go figure.

[mkutche]

mine isnt working.. http://gosportwx.com/wxforecastmap.php

[saratogaWX]

It's an NWS issue with api.weather.gov.  They've been having fairly persistent 503 server errors for 3 days now.. when they fix api.weather.gov, the script should work fine again.
Same issue is happening with advforecast2 V5.x for the same NWS problem.

[rrrick8]

Thanks Ken. That's what I figured but wanted to see if others were having same problem.
 

[mkutche]

Thanks Ken ya I kinda figured it was on their end as well when force=1 didn't help.

[saratogaWX]

From the NWS-NCO feed:

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
2250Z TUE DEC 27 2022


...ERRORS WITH API.WEATHER.GOV GRIDPOINT FORECASTS - UPDATE...

API users continue to see frequent errors when trying to retreive
forecast data from api.weather.gov/gridpoints/. NCO IDP
Onboarding Team worked with developers today, but they could not
identify a problem. Troubleshooting efforts will resume tomorrow.


Gerhardt/SDM/NCO/NCEP

[saratogaWX]

Another update:

2022-12-27 18:52:04 EST - John Percy

At 2345z, To All concerned customers:
API gridpoint fcst data is timing out frequently for everyone since Saturday.
We do not have a fix for this issue, ATT.
We are working to resolve it and it has the attention of Sr Management and programmer/engineers, Fix-It-Teams, NWS Forecast offices nation-wide as well as customers from coast to coast.
we hear you. We all want the same thing. And as soos as we have a handle on a fix, we will let you know. Please continue to bear with us.
//JOHN//

and

2022-12-27 23:29:46 EST - Iva Talley

NCO updated the due date to allow time for continuous troubleshooting/investigation for this event. (idt)

Due date:   2022-12-30 18:00:54 EST

[saratogaWX]

And.. another update:

2022-12-28 13:19:10 EST - John Percy
Additional comments
At 1805z, Branch chief Carissa updated:

Good Afternoon,
The NCO tier2 and tier3 teams have been continuing to troubleshoot but still don't have root cause for the API issue you've been experiencing.
-- We can confirm for you all that no changes were made on the system or software that introduced this issue.
-- The problem occurs at both sites, and is load induced. The team is planning to bring forward a change shortly to help troubleshoot this further.
--- We appreciate your assistance and suggestions, as well as your patience during this trying period.
//JOHN//

[Jasiu]

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
2258Z WED DEC 28 2022

...ERRORS WITH API.WEATHER.GOV GRIDPOINT FORECASTS - UPDATE...

API users continue to see frequent errors when trying to retrieve
forecast data from api.weather.gov/gridpoints/. NCO teams are
standing down for the night and will resume troubleshooting with
3rd party vendors in the morning. 


Gerhardt/SDM/NCO/NCEP

[saratogaWX]

given that the responses all seem to be like

Code: [Select]

{
  "correlationId": "44595235",
  "title": "Service Unavailable",
  "type": "https://api.weather.gov/problems/ServiceUnavailable",
  "status": 503,
  "detail": "An upstream data source is temporarily unavailable. Please try again later.",
  "instance": "https://api.weather.gov/requests/44595235"
} I suspect the root problem is the connections between the Akamai cache servers and the NWS data source servers.  A prior post on the NWS problem thread said that 3rd level support and the 3rd party vendor (likely Akamai) are working it on a daytime basis and have adjourned debugging for the evening.  Even the testbed for the API at
https://www.weather.gov/documentation/services-web-api#/default/gridpoint_forecast
is returning the same 503 errors.

[saratogaWX]

Ahh.. getting a bit stranger.  Now gridpoint requests for MTR (Monterey WFO) returns 404 -- Office not found.    

Code: [Select]

{
  "correlationId": "1393edef",
  "title": "Office Does Not Exist",
  "type": "https://api.weather.gov/problems/InvalidOffice",
  "status": 404,
  "detail": "Office mtr does not exist",
  "instance": "https://api.weather.gov/requests/1393edef"
}

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
1523Z THU DEC 29 2022

...ERRORS WITH API.WEATHER.GOV GRIDPOINT FORECASTS - UPDATE...

API users continue to see frequent errors when trying to retrieve
forecast data from api.weather.gov/gridpoints/. NCO teams are
resuming troubleshooting this morning.


Shruell/SDM/NCO/NCEP

I'm not sure their debugging is helping so far.

[Saunookweather]

Thank you Ken for keeping us updated.

[rrrick8]

Wonder if they just tried unplugging it, then plugging it back in? 
Works for me on occasion.   

[saratogaWX]

That's kinda what they did today and the 404s for WFO gridpoints was the result 

My gridpoint forecast is back, but I don't trust it to be fixed quite yet.  No additional news on the NCO feed or on the problem thread.

One person is now plotting the failures here by checking every 15 minutes for 6 random WFO gridpoint forecasts and logging the results.

[Jasiu]

SENIOR DUTY METEOROLOGIST NWS ADMINISTRATIVE MESSAGE
NWS NCEP CENTRAL OPERATIONS COLLEGE PARK MD
0112Z FRI DEC 30 2022


...ERRORS WITH API.WEATHER.GOV GRIDPOINT FORECASTS - UPDATE...

NCO support teams worked to stabilize the API gridpoints forecast
service by increasing the amount of resources needed for the
service to function properly...users should now be able to access
the API gridpoints forecast service.  Root cause for this issue
was believed to be due to higher than normal user traffic during
last week's winter storm event, that correlated to when the
service became degraded and couldn't fully recover.  If users
continue to experience issues, please contact Tech Control at
nco.ops@noaa.gov or by phone at (301) 683-1518.