Author Topic: WU - Let us know your issues  (Read 184223 times)

0 Members and 2 Guests are viewing this topic.

Offline ValentineWeather

  • Forecaster
  • *****
  • Posts: 6364
    • Valentine Nebraska's Real-Time Weather
Re: WU - Let us know your issues
« Reply #125 on: January 17, 2018, 06:52:22 AM »
I have a feeling the new crew is overwhelmed and under staffed by the complexity of running such a enormous data heavy website.
Until they have a full understanding exactly how its put together it won't get much better especially if they lost original programmers, this process will take time and a lot of effort.

Randy

Offline ConligWX

  • Forecaster
  • *****
  • Posts: 836
  • #conligwx
    • conligwx.org
Re: WU - Let us know your issues
« Reply #126 on: January 17, 2018, 07:16:59 AM »
I have a feeling the new crew is overwhelmed and under staffed by the complexity of running such a enormous data heavy website.

Indeed...
Regards Simon
Davis Vantage Pro2 Plus (6162UK) • Daytime FARS • WeatherLink Live • AirLink • PurpleAir PA-II-SD • CumulusMX •


Offline antstrafer

  • Contributor
  • ***
  • Posts: 125
Re: WU - Let us know your issues
« Reply #127 on: January 17, 2018, 07:27:43 AM »
I have a feeling the new crew is overwhelmed and under staffed by the complexity of running such a enormous data heavy website.
Until they have a full understanding exactly how its put together it won't get much better especially if they lost original programmers, this process will take time and a lot of effort.

lot of money

Updated: 11:14 AM GMT on January 17, 2018 (1 hour ago) webcam
« Last Edit: January 17, 2018, 07:29:32 AM by antstrafer »
Davis Vantage Pro2 plus     Meteobridge

CWOP FW5142    PWS THAI817    MADIS F5142
WU KTXTHALI2    AWEKAS           weatherobs

Offline edje1205

  • Member
  • *
  • Posts: 6
Re: WU - Let us know your issues
« Reply #128 on: January 17, 2018, 08:19:34 AM »
Hello, good idea starting this Topic !

Google Search Console gives me a ton of server/site errors 503,404/ not found since months; i.e.:

http://www.weersverwachtingen.eu/clientraw/wd-ajax-ml/wxwuhistory.php?ID=rzkfpxtzomgokbqc&month=10&day=4&year=2020&units=B&mode=4
http://www.weersverwachtingen.eu/clientraw/wd-ajax-ml/wxwuhistory.php?ID=pspuklgeykqcop&month=6&day=6&year=2017&units=E&mode=5
http://www.weersverwachtingen.eu/clientraw/wd-ajax-ml/wxwuhistory.php?ID=ykmrtsxcebd&month=6&day=13&year=2016&units=B&mode=4

I'm on INHOOSTZ1 since 2004 the only right one is:
http://www.weersverwachtingen.eu/clientraw/wd-ajax-ml/wxwuhistory.php?ID=INHOOSTZ1&month=10&day=4&year=2017&units=B&mode=4

Googles Search Console assures me: There are currently no security issues with the content of your site.

No idea where this data comes from.

Thank you !
« Last Edit: January 17, 2018, 08:22:19 AM by edje1205 »

Offline ConligWX

  • Forecaster
  • *****
  • Posts: 836
  • #conligwx
    • conligwx.org
Re: WU - Let us know your issues
« Reply #129 on: January 17, 2018, 08:28:36 AM »
I'm not quite sure how or what WU can do for your own website calling a URL  with a Station ID of: pspuklgeykqcop or rzkfpxtzomgokbqc or ykmrtsxcebd when they obviously don't exist.

looks like Googlebot is scraping from other WU pages for those IDs.  do people actually search "google" for a Weather Station site's history, rather than goto the website to start with and then click on the Weather history link?

I've check my Google Search Console to my Site (running Saratoga template) from main url, and have no issues with WU history.


Hello, good idea starting this Topic !

Google Search Console gives me a ton of server/site errors 503,404/ not found since months; i.e.:

http://www.weersverwachtingen.eu/clientraw/wd-ajax-ml/wxwuhistory.php?ID=rzkfpxtzomgokbqc&month=10&day=4&year=2020&units=B&mode=4
http://www.weersverwachtingen.eu/clientraw/wd-ajax-ml/wxwuhistory.php?ID=pspuklgeykqcop&month=6&day=6&year=2017&units=E&mode=5
http://www.weersverwachtingen.eu/clientraw/wd-ajax-ml/wxwuhistory.php?ID=ykmrtsxcebd&month=6&day=13&year=2016&units=B&mode=4

I'm on INHOOSTZ1 since 2004 the only right one is:
http://www.weersverwachtingen.eu/clientraw/wd-ajax-ml/wxwuhistory.php?ID=INHOOSTZ1&month=10&day=4&year=2017&units=B&mode=4

Googles Search Console assures me: There are currently no security issues with the content of your site.

No idea where this data comes from.

Thank you !
« Last Edit: January 17, 2018, 08:35:45 AM by Toxic »
Regards Simon
Davis Vantage Pro2 Plus (6162UK) • Daytime FARS • WeatherLink Live • AirLink • PurpleAir PA-II-SD • CumulusMX •


Offline rormeister

  • Senior Contributor
  • ****
  • Posts: 222
Re: WU - Let us know your issues
« Reply #130 on: January 17, 2018, 08:42:31 AM »
I've been pushing data to WU for 2 years now (I know...a noob), but the wind max values have never been totally accurate on the graph since the day I started. I figured close enough for government work would suffice.

I'm not sure what is going on now, but there's an issue with wind speeds.

https://www.wunderground.com/personal-weather-station/dashboard?ID=IDORSETW12#history

It says my highest gust is 60 km/h - which is correct, but the graph doesn't show it. It also says my highest wind speed is 55 km/h, but that's impossible, I have never recorded a wind speed that high, since owning the station.

The only comfort I can take from this, is that I have to accept that things get worse before they get better?!

Offline daman

  • Forecaster
  • *****
  • Posts: 520
Re: WU - Let us know your issues
« Reply #131 on: January 17, 2018, 08:50:16 AM »

I gotta tell you Sean & Ben & the rest of the Tiger Team members, if this is your top priority and apparently can't be fixed relatively quickly
The point is it's not there top priority and it should not be, WU is about weather data not web cams things will get fix when they get fixed.
KMIBADAX38
AcuRite Iris/AcuRite Access

Offline sinan0310

  • Senior Member
  • **
  • Posts: 60
Re: WU - Let us know your issues
« Reply #132 on: January 17, 2018, 09:35:45 AM »
Daily record table does not show right wind and wind gust, It was 61 km and now It is 51 km
WU ID: IISTANBU111
Location: Istanbul/Catalca

Offline NanoWx

  • Member
  • *
  • Posts: 35
Re: WU - Let us know your issues
« Reply #133 on: January 17, 2018, 11:45:15 AM »
Precip, discrepancies w/ cwop.  KORHEPPN4 is cwop D5434.
www.wunderground.com/weatherstation/WXDailyHistory.asp?ID=KORHEPPN4...
  returns (leaving out the header)
2018-1-1,25.1,24.0,23.0,24.0,23.0,21.0,94,93,93,30.70,30.46,5,2,6,0.00
2018-1-2,23.2,22.7,22.1,22.0,21.0,20.0,94,93,93,30.74,30.55,3,1,4,0.00
2018-1-3,24.2,23.2,22.3,23.0,21.8,21.0,94,94,93,30.54,30.40,0,0,1,0.00
2018-1-4,27.8,25.3,22.8,27.0,23.7,21.0,95,94,94,30.38,30.28,1,0,2,0.00
2018-1-5,36.3,31.2,26.1,36.0,27.7,25.0,97,96,95,30.29,30.22,8,2,14,0.00
2018-1-6,43.7,39.1,34.4,38.0,33.9,30.0,97,81,70,30.33,30.23,13,8,16,0.00
2018-1-7,47.2,41.8,36.5,35.0,33.2,32.0,86,74,60,30.23,30.04,13,5,15,0.00
2018-1-8,50.7,41.7,32.6,35.0,32.0,30.0,93,74,52,29.98,29.76,17,7,21,0.00
2018-1-9,36.8,36.8,36.8,30.0,30.0,30.0,77,77,77,29.83,29.83,10,10,13,0.00
2018-1-10,43.2,31.9,31.9,27.0,27.0,27.0,82,82,82,30.11,29.91,12,3,21,0.02
2018-1-11,47.9,44.1,40.3,41.0,37.0,34.0,81,78,76,30.09,29.82,27,11,34,0.04
2018-1-12,47.8,45.0,42.2,35.0,34.2,33.0,73,67,59,30.43,30.26,8,7,10,0.00
2018-1-13,60.2,46.0,46.0,32.0,32.0,32.0,59,59,59,30.48,30.40,16,13,22,0.00
2018-1-14,34.9,32.0,31.6,31.0,30.5,30.0,94,94,94,30.43,30.38,4,0,7,0.00
2018-1-15,34.8,32.6,32.4,32.0,31.7,31.0,96,96,96,30.37,30.17,7,3,8,0.00
2018-1-16,48.4,41.1,33.7,39.0,36.0,32.0,97,83,69,30.37,30.22,11,4,13,0.22
2018-1-17,45.8,43.0,40.2,35.0,33.5,32.0,76,71,67,30.27,30.13,15,8,26,0.00

http://mesowest.utah.edu/cgi-bin/droman/time_chart_dyn.cgi?stn=d5434&unit=0&hours=392&past=0&day1=01&month1=01&year1=2018&hour1=07&time=LOCAL&var=P24I
  produces a chart that shows there was precip during the 6th, and 8th - 10th.
While wu table only showed precip during the 10th. For the month through the 16th, wu tallied 0.28", yet 0.54 is what the cwop chart shows.

Offline NanoWx

  • Member
  • *
  • Posts: 35
Re: WU - Let us know your issues
« Reply #134 on: January 17, 2018, 11:50:13 AM »
,,,
Until they have a full understanding exactly how its put together it won't get much better especially if they lost original programmers, ...
Depends on how good the originals were about leaving documentation, or at least breadcrumbs, to be able to track down intent.

Offline ConligWX

  • Forecaster
  • *****
  • Posts: 836
  • #conligwx
    • conligwx.org
Re: WU - Let us know your issues
« Reply #135 on: January 17, 2018, 11:53:48 AM »
While wu table only showed precip during the 10th. For the month through the 16th, wu tallied 0.28", yet 0.54 is what the cwop chart shows.

This is all because WU has been loosing data whilst they suffered multiple issues over the last few months. Unless you have Weewx (wunderfixer) and can resend data back to WU, I guess you will have missing data like the rest of us.
Regards Simon
Davis Vantage Pro2 Plus (6162UK) • Daytime FARS • WeatherLink Live • AirLink • PurpleAir PA-II-SD • CumulusMX •


Offline ConligWX

  • Forecaster
  • *****
  • Posts: 836
  • #conligwx
    • conligwx.org
Re: WU - Let us know your issues
« Reply #136 on: January 17, 2018, 11:56:02 AM »
Depends on how good the originals were about leaving documentation, or at least breadcrumbs, to be able to track down intent.
And is also dependent on, whether WU refilled the fire Extinguishers from the last outage  \:D/
Regards Simon
Davis Vantage Pro2 Plus (6162UK) • Daytime FARS • WeatherLink Live • AirLink • PurpleAir PA-II-SD • CumulusMX •


Offline Felix1

  • Member
  • *
  • Posts: 49
  • PhD Engineering Physics
Re: WU - Let us know your issues
« Reply #137 on: January 17, 2018, 01:08:14 PM »

The point is it's not there top priority and it should not be, WU is about weather data not web cams things will get fix when they get fixed.



Au contraire Senior Contributor. I call your attention to Reply #68 in this thread: "We were able to fix the wundermap tonight. Somehow we broke it when we pushed a fix for the subscribed users who were still seeing ads. We’ll continue with the webcams tomorrow. Just to let you know what impact you had, webcams was not even a priority before today and now it is our top priority."


Emphasis mine.


Now I agree with you that data preservation should be high on the priority list but the question was asked early on what people wanted fixed first and it was webcams overwhelmingly. That's a hot button issue which brought lots of lurkers out of the shadows. Plus I think WU data preservation wasn't at the forefront since most of us archive our own weather data before it ever gets sent to WU or any of the other agencies. If WU went away tomorrow, I'm certainly not going to lose 20+ years of station data since it's all redundantly backed up. And if someone wants it for research, they'll go to my website; they won't depend upon WU which has already demonstrated there are no sacred cows when it comes to making a buck. Look at the other popular parts of the website which just went away with no dialog with the users. Poof.


BTW, "there" = "their" I presume?


Offline daman

  • Forecaster
  • *****
  • Posts: 520
Re: WU - Let us know your issues
« Reply #138 on: January 17, 2018, 01:31:53 PM »

The point is it's not there top priority and it should not be, WU is about weather data not web cams things will get fix when they get fixed.



Au contraire Senior Contributor. I call your attention to Reply #68 in this thread: "We were able to fix the wundermap tonight. Somehow we broke it when we pushed a fix for the subscribed users who were still seeing ads. We’ll continue with the webcams tomorrow. Just to let you know what impact you had, webcams was not even a priority before today and now it is our top priority."


Emphasis mine.


Now I agree with you that data preservation should be high on the priority list but the question was asked early on what people wanted fixed first and it was webcams overwhelmingly. That's a hot button issue which brought lots of lurkers out of the shadows. Plus I think WU data preservation wasn't at the forefront since most of us archive our own weather data before it ever gets sent to WU or any of the other agencies. If WU went away tomorrow, I'm certainly not going to lose 20+ years of station data since it's all redundantly backed up. And if someone wants it for research, they'll go to my website; they won't depend upon WU which has already demonstrated there are no sacred cows when it comes to making a buck. Look at the other popular parts of the website which just went away with no dialog with the users. Poof.


BTW, "there" = "their" I presume?
I know what they said along with weather data that is top priority. Weather data not web cam data. :roll:
KMIBADAX38
AcuRite Iris/AcuRite Access

Offline azchrisf

  • Cobra Weather Dominator Operator
  • Forecaster
  • *****
  • Posts: 455
Re: WU - Let us know your issues
« Reply #139 on: January 17, 2018, 02:39:10 PM »
I'd like to see support for the Purpleair sensor values on your Weather Station page.
And support for Davis additional temp/hum sensors like you do the Soil/Leaf sensors.
Davis Vantage Pro 2 Plus 6163 w/ 8 Transmitters!
Also doing Soil and Leaf 4x
WU: KAZGLEND106 CWOP: FW1398 (F1398) Purpleair: 98793/LAZGLEND8
My setup:
https://www.wxforum.net/index.php?topic=41867.0

Offline jquagga

  • Member
  • *
  • Posts: 5
Re: WU - Let us know your issues
« Reply #140 on: January 17, 2018, 03:11:42 PM »
Well I think everyone else has commented on my list of short term, please fix this now issues.  I think my questions now (which you might not be able to answer) are, how did you get into this situation and what are WU's long term plans for keeping this from happening again / the future?

I've used WU for what seems like forever and you were great until you weren't.  Pages didn't load, the mobile apps locked up, or started showing ads (which I'm a paying subscriber) so I started going elsewhere.  I'm a recent PWS owner / data provider starting this month and I came into it during the "your data has not posted, giving up" phase.  At the moment, it seems like WU is acknowledging receipt of everything but only posting say, every other record.  I send in every 5 minutes; WU seems to only get every 10 minutes or so.  I can use wunderfixer to repost but even that takes multiple runs to get the data in there.  The major website issues seem to be better so I can at least get to data.  I don't have or look at webcams on the site so am out of the loop if they're working or not. 

I get the overall sense that the AWS "Meltdown" reboots were the straw that really broke something that wasn't being as maintained as it should.  You have a plan for triage, but I don't know why it was let to get to this point.  Does management know the state of things?  Are they willing to comment on them (because this wxforum post seems to be the only place there is discussion of the problems)?  Is management planning on giving the resources now and long term to fix this?  What's the plan for the future?  What does "Migration to a new sensor data ingestion platform" mean for those of us providing data?  That coupled with "redesign for performance, stability, etc ..." kinda sounds like "yeah, we're just going to have to rebuild everything".  That doesn't sound like something that can be done overnight ...

Normally when companies have issues like this there is a blog post or etc from someone of authority to say "X Y and Z happened'.  We're going to fix it with "A B and C" and our long term plans are "1 2 3". 

I can't speak for anyone else here (this is only my first post here!) but I really like your service as it was.  If you can get back to that, you'd have a paying subscriber and you'd be my primary source of weather data and where I send people who want to look at the weather in our backyard.  But I'm worried.  I guess we will see what happens.  Good luck!

Offline noraval

  • Member
  • *
  • Posts: 14
Re: WU - Let us know your issues
« Reply #141 on: January 17, 2018, 03:37:32 PM »

I gotta tell you Sean & Ben & the rest of the Tiger Team members, if this is your top priority and apparently can't be fixed relatively quickly
The point is it's not there top priority and it should not be, WU is about weather data not web cams things will get fix when they get fixed.

I 100% agree, I do not see why people are making this out to be the top priority but maybe it is because I don't have one.  :roll:

Offline n4khq

  • Member
  • *
  • Posts: 41
Re: WU - Let us know your issues
« Reply #142 on: January 17, 2018, 05:19:43 PM »
The hosting of my PWS was a service for which I have paid nothing. I hope WU (IBM) is making money from web traffic and will/can continue the service. It is probably going to take a large investment for equipment upgrades to get everything working. When it comes to technology, I don't think many companies upgrade their servers before you sell the farm. I appreciate Sean and Ben posting here and working to fix what they can. I would not be surprised if it was easier to build a new and modern portal than patching what they have inherited.

Offline WUpm

  • Member
  • *
  • Posts: 5
    • Weather Underground
Re: WU - Let us know your issues
« Reply #143 on: January 17, 2018, 05:34:56 PM »
Just wanted to hop in and give an update to you guys. 

- Rapidfire should be more stable now, so please let us know if you have any issues with it going forward.
- Paid subscribers should no longer see ads.  We made a fix that caused unforeseen consequences, but we have since worked through it and believe that the issue has been completely resolved. 

I completely understand the concern some users have had over our priorities (webcam vs data).  Both those items have been at the top of our priority list.  Webcams are definitely a feature that many users care about very strongly, as we quickly found the last few days in soliciting opinions from the forum.  That has not caused us to lose sight of the PWS data issues.

As for the PWS data issues, it is complex, and our goal is to get it to a "good enough" state; to alleviate the immediate issues.  Our long term solution (which may take through Q2) is a much more modern and robust solution that will be substantially better than what we currently have.

Again, thanks so much for your criticism, your feedback, and your engagement.  This process is not going to be easy, or fast, but we have a small team of passionate engineers who are doing all they can for a product they also care deeply about.

Sean

Offline azchrisf

  • Cobra Weather Dominator Operator
  • Forecaster
  • *****
  • Posts: 455
Re: WU - Let us know your issues
« Reply #144 on: January 17, 2018, 05:50:09 PM »

The point is it's not there top priority and it should not be, WU is about weather data not web cams things will get fix when they get fixed.



Au contraire Senior Contributor. I call your attention to Reply #68 in this thread: "We were able to fix the wundermap tonight. Somehow we broke it when we pushed a fix for the subscribed users who were still seeing ads. We’ll continue with the webcams tomorrow. Just to let you know what impact you had, webcams was not even a priority before today and now it is our top priority."


Emphasis mine.


Now I agree with you that data preservation should be high on the priority list but the question was asked early on what people wanted fixed first and it was webcams overwhelmingly. That's a hot button issue which brought lots of lurkers out of the shadows. Plus I think WU data preservation wasn't at the forefront since most of us archive our own weather data before it ever gets sent to WU or any of the other agencies. If WU went away tomorrow, I'm certainly not going to lose 20+ years of station data since it's all redundantly backed up. And if someone wants it for research, they'll go to my website; they won't depend upon WU which has already demonstrated there are no sacred cows when it comes to making a buck. Look at the other popular parts of the website which just went away with no dialog with the users. Poof.


BTW, "there" = "their" I presume?

In the back of my mind I think this all is just damage control by WU, saying they are fixing this and that, they are on it, etc. - when in reality nothing is really getting done. Old corporate trick.

I hope I'm not proven right.
Davis Vantage Pro 2 Plus 6163 w/ 8 Transmitters!
Also doing Soil and Leaf 4x
WU: KAZGLEND106 CWOP: FW1398 (F1398) Purpleair: 98793/LAZGLEND8
My setup:
https://www.wxforum.net/index.php?topic=41867.0

Offline TJHuot

  • Member
  • *
  • Posts: 7
Re: WU - Let us know your issues
« Reply #145 on: January 17, 2018, 06:10:28 PM »
As a contributor and uploader for many years. 2004-2008 in Santa Fe, NM and from 2010 to present in Catonsville (Baltimore area) MD, I have been extremely disappointed in the fact that I have not had any kind of response to my support emails over the last few months. This morning I looked at my weather data from KMDCATON5 and I see a couple of bogus entries. It appears from those entries that the high temp today at 5 am was 77 degrees. I tried to edit out the bad entries and nothing happens. I know this did not come from my weather station as I went to the local data, and there were no such errors. I have many other concerns, but the fact that my data is being corrupted up there bothers me tremendously. If something doesn't happen soon to correct this and many other issues soon, I may just go local and quit contributing data to your site. I have copied and highlighted the obviously erroneous entries in the PDF attached.
 [ You are not allowed to view attachments ]

Offline konz

  • Senior Contributor
  • ****
  • Posts: 172
    • ArlingtonWX
Re: WU - Let us know your issues
« Reply #146 on: January 17, 2018, 07:10:14 PM »
While wu table only showed precip during the 10th. For the month through the 16th, wu tallied 0.28", yet 0.54 is what the cwop chart shows.

This is all because WU has been loosing data whilst they suffered multiple issues over the last few months. Unless you have Weewx (wunderfixer) and can resend data back to WU, I guess you will have missing data like the rest of us.

The Davis WeatherLink software will also upload missing data to WU using a date range - but you need a Davis PWS.

Offline TJHuot

  • Member
  • *
  • Posts: 7
Re: WU - Let us know your issues
« Reply #147 on: January 17, 2018, 08:01:02 PM »
I have a Davis PWS, and may be able to upload from there. I didn't realize that I could link to WU from the Davis software. I will look into it. Otherwise, I have been using an old product called Virtual Weather from Ambient to continuously upload. That software has been abandoned for quite some time but seems to run OK on an old laptop that I upgraded to Windows 10.

Offline TJHuot

  • Member
  • *
  • Posts: 7
Re: WU - Let us know your issues
« Reply #148 on: January 17, 2018, 08:07:49 PM »
Actually, if they could remove the two bad records it would be fine since my upload was every 15 minutes. All of the 15-minute records are fine. The two bad records can't be deleted by me. If I could delete them the way I used to be able to I would.

Offline konz

  • Senior Contributor
  • ****
  • Posts: 172
    • ArlingtonWX
Re: WU - Let us know your issues
« Reply #149 on: January 17, 2018, 08:52:25 PM »
Just wanted to hop in and give an update to you guys. 
.
.
.
Again, thanks so much for your criticism, your feedback, and your engagement.  This process is not going to be easy, or fast, but we have a small team of passionate engineers who are doing all they can for a product they also care deeply about.

Sean

You're welcome.  Thank you, too, Sean. 

 

anything