Author Topic: Point Forecast Down?  (Read 5900 times)

0 Members and 1 Guest are viewing this topic.

Offline AWL

  • Forecaster
  • *****
  • Posts: 727
    • Ardmore Weather Live
Re: Point Forecast Down?
« Reply #50 on: February 27, 2018, 04:13:30 PM »
Is this NWS change also stopping the"forecast discussion" from working?

Offline DaculaWeather

  • WxElement panel
  • Forecaster
  • *****
  • Posts: 3206
    • North Georgia Weather
Re: Point Forecast Down?
« Reply #51 on: February 27, 2018, 04:15:26 PM »
On mine it did, I added the "s" and all is good.

Offline ValentineWeather

  • Forecaster
  • *****
  • Posts: 6364
    • Valentine Nebraska's Real-Time Weather
Re: Point Forecast Down?
« Reply #52 on: February 27, 2018, 04:37:27 PM »
Also not working are.
wxnoaadiscuss.php
wxnoaaproducts.php

I changed all the http to https in.... inc-show-wfo-discuss.php..... and made no difference.
Randy

Offline chief-david

  • Educational Weather
  • Forecaster
  • *****
  • Posts: 2846
  • Space Academy for Educators
    • Benilde-St. Margaret's Weather
Re: Point Forecast Down?
« Reply #53 on: February 27, 2018, 04:39:59 PM »
good here after the new change.
Looks like I had not updated since 4.01

usually when things like that happen it is the schools fault
« Last Edit: February 27, 2018, 04:43:18 PM by chief-david »



You can't phase me-I teach Middle School.
It's not you-It's WU.

Offline saratogaWX

  • Administrator
  • Forecaster
  • *****
  • Posts: 9257
  • Saratoga, CA, USA Weather - free PHP scripts
    • Saratoga-Weather.org
Re: Point Forecast Down?
« Reply #54 on: February 27, 2018, 05:02:00 PM »
Is this NWS change also stopping the"forecast discussion" from working?
Yes.. forecast-discussion.php V1.06 is now working with https

Download from the script page at https://saratoga-weather.org/scripts-NWSmisc.php

Busy day.  Never thought the NWS would just engage https only w/o a note to that effect on the NWS notification list.
Sigh. 
Ken True/Saratoga, CA, USA main site: saratoga-weather.org
Davis VP1+ FARS, Blitzortung RED, GRLevel3, WD, WL, VWS, Cumulus, Meteobridge
Free weather PHP scripts/website templates - update notifications on Twitter saratogaWXPHP

Offline lddaly

  • Forecaster
  • *****
  • Posts: 490
Re: Point Forecast Down?
« Reply #55 on: February 27, 2018, 05:23:21 PM »
Thank you, Ken!

Offline ValentineWeather

  • Forecaster
  • *****
  • Posts: 6364
    • Valentine Nebraska's Real-Time Weather
Re: Point Forecast Down?
« Reply #56 on: February 27, 2018, 05:28:46 PM »
Never mind its working now. Must of been something in cache still. Thanks

Ken I was going to try forecast-discussion.php but for some reason I'm getting SF office even though I changed line 48 to
Code: [Select]
$myNWS = 'LBF'; So what am I doing wrong here? I did a ctr-f5 to clear browser cache and no change.
[/s]
https://www.valentinenebraska.net/forecast-discussion.php
« Last Edit: February 27, 2018, 05:54:56 PM by ValentineWeather »
Randy

Offline tshattuck

  • Forecaster
  • *****
  • Posts: 337
    • Your Local Weather - Clay, NY
Re: Point Forecast Down?
« Reply #57 on: February 27, 2018, 05:48:56 PM »
Ken:
I just updated advforecast2 v.4.02 to v.4.03 and the NWS forecasts are all working again.

Just wanted to say thanks for all your efforts. Your the best!  =D> =D> =D>

Tom

Offline DaculaWeather

  • WxElement panel
  • Forecaster
  • *****
  • Posts: 3206
    • North Georgia Weather
Re: Point Forecast Down?
« Reply #58 on: February 27, 2018, 06:08:52 PM »
It was a  pretty sudden change, this is NWS Birmingham:
----------------
Just an FYI to all customers, our web server now defaults to an HTTPS address by default when you load it. Therefore, there may be some links and other items that are currently not working due to this global change. We apologize for the inconvenience, and will do our best to get things back working - such as the obs table on our frontpage - which is the most notable item not currently working. You can still click on the city name to get an obs table for that location in the meantime.

Offline ValentineWeather

  • Forecaster
  • *****
  • Posts: 6364
    • Valentine Nebraska's Real-Time Weather
Re: Point Forecast Down?
« Reply #59 on: February 27, 2018, 06:20:47 PM »
It was a  pretty sudden change, this is NWS Birmingham:
----------------
Just an FYI to all customers, our web server now defaults to an HTTPS address by default when you load it. Therefore, there may be some links and other items that are currently not working due to this global change. We apologize for the inconvenience, and will do our best to get things back working - such as the obs table on our frontpage - which is the most notable item not currently working. You can still click on the city name to get an obs table for that location in the meantime.

Wouldn't be surprised from the suddenness of going to secure addresses it had something to do with what malwarbytes was seeing yesterday. Might as well blame the Russians, it was probably China but we don't want to upset our trade allies.
Randy

Offline saratogaWX

  • Administrator
  • Forecaster
  • *****
  • Posts: 9257
  • Saratoga, CA, USA Weather - free PHP scripts
    • Saratoga-Weather.org
Re: Point Forecast Down?
« Reply #60 on: February 27, 2018, 06:28:40 PM »
Or.. it could be due to a Symantec cert that is to expire soon, and this https://blog.qualys.com/ssllabs/2017/09/26/google-and-mozilla-deprecating-existing-symantec-certificates
« Last Edit: February 27, 2018, 06:32:55 PM by saratogaWX »
Ken True/Saratoga, CA, USA main site: saratoga-weather.org
Davis VP1+ FARS, Blitzortung RED, GRLevel3, WD, WL, VWS, Cumulus, Meteobridge
Free weather PHP scripts/website templates - update notifications on Twitter saratogaWXPHP

Offline Weather Goat

  • Member
  • *
  • Posts: 12
  • Peet Bros. Ultimeter 2100 Pro
    • New Milford CT Weather
Re: Point Forecast Down?
« Reply #61 on: February 27, 2018, 06:31:52 PM »
Wow!  Thanks, Ken!
I was racking my brain this morning why the AFD pages worked but not in a script.  Great fix.
Roger

Offline saratogaWX

  • Administrator
  • Forecaster
  • *****
  • Posts: 9257
  • Saratoga, CA, USA Weather - free PHP scripts
    • Saratoga-Weather.org
Re: Point Forecast Down?
« Reply #62 on: February 27, 2018, 06:35:11 PM »
Never mind its working now. Must of been something in cache still. Thanks

Ken I was going to try forecast-discussion.php but for some reason I'm getting SF office even though I changed line 48 to
Code: [Select]
$myNWS = 'LBF'; So what am I doing wrong here? I did a ctr-f5 to clear browser cache and no change.
[/s]
https://www.valentinenebraska.net/forecast-discussion.php
It's working now.. you probably needed to wait for the bad cache to expire on your website.  You can force it to reload by forecast-discussion.php?cache and it will reload from the URL
Ken True/Saratoga, CA, USA main site: saratoga-weather.org
Davis VP1+ FARS, Blitzortung RED, GRLevel3, WD, WL, VWS, Cumulus, Meteobridge
Free weather PHP scripts/website templates - update notifications on Twitter saratogaWXPHP

Offline saratogaWX

  • Administrator
  • Forecaster
  • *****
  • Posts: 9257
  • Saratoga, CA, USA Weather - free PHP scripts
    • Saratoga-Weather.org
Re: Point Forecast Down?
« Reply #63 on: February 27, 2018, 06:36:24 PM »
It was a  pretty sudden change, this is NWS Birmingham:
----------------
Just an FYI to all customers, our web server now defaults to an HTTPS address by default when you load it. Therefore, there may be some links and other items that are currently not working due to this global change. We apologize for the inconvenience, and will do our best to get things back working - such as the obs table on our frontpage - which is the most notable item not currently working. You can still click on the city name to get an obs table for that location in the meantime.
Ahh.. at least one office commented about it.  The elves supporting the main forecast.weather.gov site just had a poorly-communicated http->https conversion.
Ken True/Saratoga, CA, USA main site: saratoga-weather.org
Davis VP1+ FARS, Blitzortung RED, GRLevel3, WD, WL, VWS, Cumulus, Meteobridge
Free weather PHP scripts/website templates - update notifications on Twitter saratogaWXPHP

Offline SLOweather

  • Global Moderator
  • Forecaster
  • *****
  • Posts: 3456
    • Weatherelement Moline IL
Re: Point Forecast Down?
« Reply #64 on: February 27, 2018, 08:43:32 PM »
Thanks, Ken.... :)

Grrr.  They changed the forecast.weather.gov site to force HTTPS.

So.. I've updated the OLD advforecast2.php to V4.03 and switched to curl for doing the access.

Use:  https://saratoga-weather.org/advforecast2-V4.03.php?sce=view to have the OLD script work again.

Dang 'em

Offline metzeric

  • Contributor
  • ***
  • Posts: 110
    • www.niagaracountyweatherwire.com
Re: Point Forecast Down?
« Reply #65 on: February 27, 2018, 08:58:04 PM »
I got my forecast discussion page working using the 1.06 version  however   my main page has a forecast summary box   and that still shows  "forecast discussion unavailable, please try later."      that box uses a file called  "forecast-summary.php"  version 1.03
i am not sure what the fix for that is though

thanks
Eric

Is this NWS change also stopping the"forecast discussion" from working?
Yes.. forecast-discussion.php V1.06 is now working with https

Download from the script page at https://saratoga-weather.org/scripts-NWSmisc.php

Busy day.  Never thought the NWS would just engage https only w/o a note to that effect on the NWS notification list.
Sigh.

Offline saratogaWX

  • Administrator
  • Forecaster
  • *****
  • Posts: 9257
  • Saratoga, CA, USA Weather - free PHP scripts
    • Saratoga-Weather.org
Re: Point Forecast Down?
« Reply #66 on: February 27, 2018, 09:23:48 PM »
More busy... I've updated the advforecast2.php (JSON Version) to V5.05 and it has extra code to better handle redirects and failover to zone forecasts when needed.

It really irritates me that they've set the API for a point forecast to ALWAYS return a 301 to a gridpoint forecast instead of just returning the JSON requested.  Grrrr...  I've enabled curl to follow one redirect, set the timeout longer (6 seconds) and handle the muddled headers returning from a curl-fetch-with-redirect.  Also set the point forecast life to be 18 hrs (instead of 12) to be 'stale' and fail over to the zone forecast.

Hopefully these mods will make our sites more stable while the api.weather.gov is still having flaky responses.

I've also decided to dual post the V4.04 and V5.05 versions of the script on the script page so there will be a durable link to the old (page scraper) script while the cutover to the new forecast.weather.gov is still pending.

Template users can pick up the updates at update tool page with a query of Base-USA, Plugin-*, 27-Feb-2018

I think I'll rest up a bit.. it's been a busy day for NWS-related changes.
Ken True/Saratoga, CA, USA main site: saratoga-weather.org
Davis VP1+ FARS, Blitzortung RED, GRLevel3, WD, WL, VWS, Cumulus, Meteobridge
Free weather PHP scripts/website templates - update notifications on Twitter saratogaWXPHP

Offline SoMDWx

  • Forecaster
  • *****
  • Posts: 1015
    • Southern Maryland Weather
Re: Point Forecast Down?
« Reply #67 on: February 28, 2018, 07:42:59 AM »
Thanks Ken again for the updates! Forecast discussion and advforecast went south on me as probably with everyone else... Back to working this morning...

Awesome job keeping up with these changes....   =D>

Jim

Offline Jasiu

  • Forecaster
  • *****
  • Posts: 947
    • LexMAWeather
Re: Point Forecast Down?
« Reply #68 on: February 28, 2018, 08:53:06 AM »
Thank you for the hard work, Ken. I think it's time for me to pony up some $$ in appreciation again. (Anyone can do so at http://saratoga-weather.org/wxtemplates/).

Wondering as I was looking at the code yesterday... might it be time for one common "fetchURL" routine to include rather than the half-dozen or so versions that are in the various files? Would probably need additional parameters for things like accepted data type, timeouts, follow redirects, etc. But at least a fix in the common routine wouldn't have to be applied in so many places. Just a thought...

https://lexmaweather.info
On Mastodon: @LexMAWeather@toot.community

Offline cospringswx

  • Forecaster
  • *****
  • Posts: 4136
    • Colorado Springs Weather
Re: Point Forecast Down?
« Reply #69 on: February 28, 2018, 09:38:50 PM »
Thanks for the update Ken. Working here. =D>

http://cospringsweather.com/wxforecast.php




Ryan 

Colorado Springs, CO
www.cospringsweather.com
Davis Vantage Vue
Weather Display Software
Amcrest HD IP Camera

Offline Jasiu

  • Forecaster
  • *****
  • Posts: 947
    • LexMAWeather
Re: Point Forecast Down?
« Reply #70 on: March 01, 2018, 07:46:02 AM »
Well, this is..... interesting??

As of this morning, 4.03 is working. 5.05 is acting rather weird on NWS's side.

Here is the comment stream from the code:

Code: [Select]
<!-- File Name:  https://forecast.weather.gov/MapClick.php?CityName=Lexington&state=MA&site=MTR&textField1=42.4399&textField2=-71.2405&e=1&TextType=2 -->
<!-- advforecast2.php (JSON) - V5.05 - 27-Feb-2018 on PHP 7.2.1-->
<!-- RAW NWS URL: https://forecast.weather.gov/MapClick.php?CityName=Lexington&state=MA&site=MTR&textField1=42.4399&textField2=-71.2405&e=1&TextType=2 -->
<!-- zone=MAZ014 -->
<!-- corrected NWS API URL='https://api.weather.gov/points/42.4399,-71.2405/forecast' -->
<!-- curl fetching 'https://api.weather.gov/points/42.4399,-71.2405/forecast' -->
<!-- note: fetched 'https://api.weather.gov/gridpoints/BOX/64,79/forecast' after redirect was followed. -->
<!-- HTTP stats:  RC=404 dest=104.72.62.193 port=443 (from sce=74.208.114.109)
      Times: dns=0.000 conn=0.031 pxfer=0.063 get=0.775 total=0.837 secs -->
<!-- headers returned:
HTTP/1.1 404 Not Found
Server: nginx/1.10.2
Content-Type: application/problem+json
Access-Control-Allow-Origin: *
Pragma: no-cache
X-Server-ID: vm-bldr-nids-apiapp22.ncep.noaa.gov
X-Correlation-ID: 99795aeb-e0cb-4d16-af5e-254f3f8ff3a8
X-Request-ID: 99795aeb-e0cb-4d16-af5e-254f3f8ff3a8
Cache-Control: private, must-revalidate, max-age=600
Expires: Thu, 01 Mar 2018 12:47:06 GMT
Date: Thu, 01 Mar 2018 12:37:06 GMT
Content-Length: 364
Connection: keep-alive
Vary: Accept
Strict-Transport-Security: max-age=15768000 ; includeSubDomains
 -->
<!-- Oops.. point forecast unavailable RC=404 - using Zone instead -->

After this, the zone forecast loads fine.  So... Why the 404?  I tried loading the redirected URL in a browser and got this:

Code: [Select]
{
    "correlationId": "2442b844-33f9-4e85-a3b4-f0b8316473c4",
    "title": "Data Unavailable For Requested Point",
    "type": "https://api.weather.gov/problems/InvalidPoint",
    "status": 404,
    "detail": "Unable to provide data for requested point 90,120.55176052112",
    "instance": "https://api.weather.gov/requests/2442b844-33f9-4e85-a3b4-f0b8316473c4"
}

So the API thinks I'm trying to get the forecast for the North Pole? Hmmm.
https://lexmaweather.info
On Mastodon: @LexMAWeather@toot.community

Offline DaculaWeather

  • WxElement panel
  • Forecaster
  • *****
  • Posts: 3206
    • North Georgia Weather
Re: Point Forecast Down?
« Reply #71 on: March 01, 2018, 10:12:49 AM »
Jasiu, I sent your code on to the NWS to have them look at it.

Offline saratogaWX

  • Administrator
  • Forecaster
  • *****
  • Posts: 9257
  • Saratoga, CA, USA Weather - free PHP scripts
    • Saratoga-Weather.org
Re: Point Forecast Down?
« Reply #72 on: March 01, 2018, 11:19:54 AM »
The API acts a bit strange (and has for months).  A point query now always results in a 301 redirect to a gridpoint query.

The gridpoint query either returns the data (RC=200) or if the data is not available, a 404-Not Found.  That is usually because (I think) the underlying GFS data for that gridpoint is being refreshed.  Their site (and the V5 script) both try a Zone forecast instead and display that data (less accurate) until the gridpoint data is again available.
Ken True/Saratoga, CA, USA main site: saratoga-weather.org
Davis VP1+ FARS, Blitzortung RED, GRLevel3, WD, WL, VWS, Cumulus, Meteobridge
Free weather PHP scripts/website templates - update notifications on Twitter saratogaWXPHP

Offline Jasiu

  • Forecaster
  • *****
  • Posts: 947
    • LexMAWeather
Re: Point Forecast Down?
« Reply #73 on: March 09, 2018, 10:47:51 AM »
Quick note to those who are in the Boston NWS office area: They know that point forecasts are down and are working on it...

Zone loads fine.
https://lexmaweather.info
On Mastodon: @LexMAWeather@toot.community

Offline DaculaWeather

  • WxElement panel
  • Forecaster
  • *****
  • Posts: 3206
    • North Georgia Weather
Re: Point Forecast Down?
« Reply #74 on: March 09, 2018, 10:56:42 AM »
Had a problem here yesterday with the Atlanta NWS and they told me this:
"Working an issue now where our grid files aren't making it up to the server."

Once they fixed that mine started working.