Author Topic: Station webcam improved updating  (Read 15799 times)

0 Members and 2 Guests are viewing this topic.

Offline dcsmith

  • Member
  • *
  • Posts: 36
Re: Station webcam improved updating
« Reply #100 on: December 12, 2017, 05:19:48 PM »
Helping reduce load on server by not updating more than 4-5 minutes and keep image size reduced may work toward keeping WU accepting images and everyone happy. Then it may not matter as more and more jump on board and server can't handle the traffic.

You hit the nail on the head.  I update every five minutes.  I'd be willing to go to 10 minutes to prevent the lack of updates for over an hour because the FTP servers were congested.

Offline dcsmith

  • Member
  • *
  • Posts: 36
Re: Station webcam improved updating
« Reply #101 on: December 12, 2017, 05:22:54 PM »
Running an FTP test each server seems to be limited to 2,000 simultaneous connections.  I don't know how many FTP servers they have though.

Offline ValentineWeather

  • Forecaster
  • *****
  • Posts: 6377
    • Valentine Nebraska's Real-Time Weather
Re: Station webcam improved updating
« Reply #102 on: December 12, 2017, 05:24:23 PM »
Helping reduce load on server by not updating more than 4-5 minutes and keep image size reduced may work toward keeping WU accepting images and everyone happy. Then it may not matter as more and more jump on board and server can't handle the traffic.

You hit the nail on the head.  I update every five minutes.  I'd be willing to go to 10 minutes to prevent the lack of updates for over an hour because the FTP servers were congested.

 [ You are not allowed to view attachments ]
Randy

Online PaulMy

  • Forecaster
  • *****
  • Posts: 5521
    • KomokaWeather
Re: Station webcam improved updating
« Reply #103 on: December 12, 2017, 07:23:11 PM »
My Bloomsky https://www.wunderground.com/webcams/PaulMy/4/show.html is showing on WU,
however my other webcam https://www.wunderground.com/webcams/PaulMy/1/show.html is not  https://www.wunderground.com/personal-weather-station/dashboard?ID=IONTARIO226.  I have this using the URL method.

I have the webcam/yawcam set to FTP to my website www.komokaweather.com/weather/wu/image_wu.jpg
The webcam images are saved with date/time stamp on my computer, and after FTP as a static file name on by webserver.

I would like to try FTP to WU as well.  Since Yawcam does one FTP only how can I FTP?

I've looked at the WU instructions but haven't understood how to do that.
Quote
Step 2 - Use the following information to start sending your images to Weather Underground using FTP.
  • FTP SERVER: webcam.wunderground.com
  • Username: You will be provided with a Camera ID on the sign up page in the "Your Current Cameras" box.
  • Password: You will need to log in with the same password you use to access the Weather Underground site.
  • Directory: We actually move the file for you, so if your software requires a directory you should set it as '/', but otherwise leave it blank.
  • Filename: We also change the filename of your image, so a default name can be almost anything you'd like but 'image.jpg' is preferred.
  • Binary: Please make sure that you are uploading your images through FTP using the binary setting.
  • Image Resolution: There is no minimum or maximum resolution. However, the larger the resolution, the larger the file size, so please adjust your resolution and image quality settings to get the best image within the size limitations.[/l][/l]
Paul
[/list]

Offline jpk1018

  • Senior Contributor
  • ****
  • Posts: 202
  • http://www.madrussianweather.com/#
    • Mad Russian
Re: Station webcam improved updating
« Reply #104 on: December 13, 2017, 11:25:10 AM »
I was sending FTP I signed up for the http upload two days ago, lets see how long it takes to get it approved.

Offline dcsmith

  • Member
  • *
  • Posts: 36
Re: Station webcam improved updating
« Reply #105 on: December 13, 2017, 04:12:40 PM »
Running an FTP test each server seems to be limited to 2,000 simultaneous connections.  I don't know how many FTP servers they have though.

I just heard from Jeff Masters.  If everyone would reduce their update frequency to no less than 5 minutes, there would be much less network congestion and missed updates due to FTP Server loads.  I have always been updating every five minutes.

Offline jpk1018

  • Senior Contributor
  • ****
  • Posts: 202
  • http://www.madrussianweather.com/#
    • Mad Russian
Re: Station webcam improved updating
« Reply #106 on: December 13, 2017, 04:52:19 PM »
I was sending FTP I signed up for the http upload two days ago, lets see how long it takes to get it approved.

Maybe they are watching this forum, my webcam showed up after I posted this. Hope they can maintain it better then before.

Offline Aardvark

  • Forecaster
  • *****
  • Posts: 2305
  • Tonto to Lone Ranger : "never take off mask.
    • turned off
Re: Station webcam improved updating
« Reply #107 on: December 13, 2017, 05:29:14 PM »
Running an FTP test each server seems to be limited to 2,000 simultaneous connections.  I don't know how many FTP servers they have though.

I just heard from Jeff Masters.  If everyone would reduce their update frequency to no less than 5 minutes, there would be much less network congestion and missed updates due to FTP Server loads.  I have always been updating every five minutes.
I tried once an hour and still no dice.  I think Iwill continue to send them data, but as far as a picture, go fish.

Offline dcsmith

  • Member
  • *
  • Posts: 36
Re: Station webcam improved updating
« Reply #108 on: December 13, 2017, 05:30:47 PM »
Running an FTP test each server seems to be limited to 2,000 simultaneous connections.  I don't know how many FTP servers they have though.

I just heard from Jeff Masters.  If everyone would reduce their update frequency to no less than 5 minutes, there would be much less network congestion and missed updates due to FTP Server loads.  I have always been updating every five minutes.
I tried once an hour and still no dice.  I think Iwill continue to send them data, but as far as a picture, go fish.

Hang in there.  They just started up yesterday.

Offline ValentineWeather

  • Forecaster
  • *****
  • Posts: 6377
    • Valentine Nebraska's Real-Time Weather
Re: Station webcam improved updating
« Reply #109 on: December 13, 2017, 05:46:08 PM »
FTP side is working.  For those having WU grab image not sure. 
Just tested and results.
 [ You are not allowed to view attachments ]
Randy

Offline halifax

  • Senior Member
  • **
  • Posts: 54
Re: Station webcam improved updating
« Reply #110 on: December 14, 2017, 08:19:15 AM »
I was sending FTP I signed up for the http upload two days ago, lets see how long it takes to get it approved.

Maybe they are watching this forum, my webcam showed up after I posted this. Hope they can maintain it better then before.

I use FTP method and was updating every minute. Had about 50 or so successful uploads in the last 24 hours. Just dropped my update rate to every 5 minutes.

Maybe WU should do a blitz email asking that everyone limit the upload frequency to 5 or 10 minutes? Because if that's the problem, just tell the community.
Davis VP2+, NOAA POES Rx Station, SkyCam, Sandy Brook BrookCam. WU KCTCOLEB1. CWOP N1QVE. CoCoRaHS CT-LT-15. PurpleAir AQM Colebrook, CT.

Offline ValentineWeather

  • Forecaster
  • *****
  • Posts: 6377
    • Valentine Nebraska's Real-Time Weather
Re: Station webcam improved updating
« Reply #111 on: December 14, 2017, 08:32:55 AM »
They should but I don't have much faith in their ability of getting the word out.
Allowing the community to help out seems like the sensible way of doing business. Just asking would be a start and warning anyone violating the 5 minute (300 second) uploads get camera privileges revoked. 
Randy

Offline 92merc

  • BismarckWeather.net
  • Forecaster
  • *****
  • Posts: 1314
  • BismarckWeather.net
    • BismarckWeather.net
Re: Station webcam improved updating
« Reply #112 on: December 14, 2017, 09:29:23 AM »
I flipped my Bloomsky back on when I heard they were taking pictures again.  Only took a few minutes and that station was back.  IIRC, Bloomsky is sending every 10 minutes?   Good enough for me.

I just want my Bloomsky up so I can use the picture location of that image, and use it on a second camera that points back to WU's own picture location.  Then I can attach it to my Davis station.  So one camera supports 2 WU sites.  That picture I have set to 10 minutes.  But since it's pointing to their own site, you'd think that would be even better for traffic.
https://www.BismarckWeather.net
Davis VP2, Cumulus, WeatherDisplay, Blitzortung, Saratoga Scripts, NOAA Stream via PI

Offline dcsmith

  • Member
  • *
  • Posts: 36
Re: Station webcam improved updating
« Reply #113 on: December 24, 2017, 03:47:25 PM »
I'm back off the air again.  FTP Connection failures.

Offline casa manana

  • Senior Contributor
  • ****
  • Posts: 237
    • Sedona, AZ
Re: Station webcam improved updating
« Reply #114 on: December 24, 2017, 05:23:53 PM »
My webcams are off the air again too, been so for about a day or so.  I notice they are having trouble displaying archived weather data from the past few days too.

Situation "normal" again I guess.


Offline antstrafer

  • Contributor
  • ***
  • Posts: 125
Re: Station webcam improved updating
« Reply #115 on: December 24, 2017, 05:28:54 PM »
My webcams are off the air again too, been so for about a day or so.  I notice they are having trouble displaying archived weather data from the past few days too.

Situation "normal" again I guess.

yep mine working just fine   Updated: 1:09 PM GMT on December 24, 2017 (9 hours ago)
Davis Vantage Pro2 plus     Meteobridge

CWOP FW5142    PWS THAI817    MADIS F5142
WU KTXTHALI2    AWEKAS           weatherobs

Offline dcsmith

  • Member
  • *
  • Posts: 36
Re: Station webcam improved updating
« Reply #116 on: December 24, 2017, 05:30:12 PM »
Are you using FTP or HTTP?

Offline dcsmith

  • Member
  • *
  • Posts: 36
Re: Station webcam improved updating
« Reply #117 on: December 24, 2017, 05:55:08 PM »
I'm getting successful FTP tests now.  Still not up on WU.

Offline PDM1964

  • Member
  • *
  • Posts: 14
Re: Station webcam improved updating
« Reply #118 on: December 24, 2017, 05:57:26 PM »
About every 3rd ftp works here.  Mostly it is login failures...

Sent from my LGLS992 using Tapatalk


Offline zackdog

  • Forecaster
  • *****
  • Posts: 410
    • Winter Park Highlands Web cams
Re: Station webcam improved updating
« Reply #119 on: December 24, 2017, 06:21:14 PM »
My two cams are up, both have uploaded within the last five minutes.  Have been checking most of the day and they have not been longer than 20 minutes between uploads, when I checked.  Most of the time they had uploaded within the last ten minutes.

Mark
"You don't need a weatherman to know which way the wind blows." - Dylan

Vantage Pro2 Plus w/ 24 hr FARS and (2) VantageVues

VP2 uploading via Vue console to CWOP, WU, PWS, and Weathercloud.


Offline dcsmith

  • Member
  • *
  • Posts: 36
Re: Station webcam improved updating
« Reply #120 on: December 25, 2017, 09:08:13 AM »
Still not up on WU.  Getting intermittent login failures.

Offline zackdog

  • Forecaster
  • *****
  • Posts: 410
    • Winter Park Highlands Web cams
Re: Station webcam improved updating
« Reply #121 on: December 25, 2017, 09:13:13 AM »
Just checked mine.  One updated 4 minutes ago and the other 1 minute ago. \:D/

Mark
"You don't need a weatherman to know which way the wind blows." - Dylan

Vantage Pro2 Plus w/ 24 hr FARS and (2) VantageVues

VP2 uploading via Vue console to CWOP, WU, PWS, and Weathercloud.


Offline dcsmith

  • Member
  • *
  • Posts: 36
Re: Station webcam improved updating
« Reply #122 on: December 26, 2017, 10:53:20 AM »
My FTP client is built into the camera.  This is what I am receiving when I try a simple test using ftptest.net:

Status: Connected, waiting for welcome message...

Reply: 220---------- Welcome to Pure-FTPd [privsep] [TLS] ----------

Reply: 220-You are user number 527 of 10000 allowed.

Reply: 220-Local time is now 15:48. Server port: 21.

Reply: 220-This is a private system - No anonymous login

Reply: 220 You will be disconnected after 60 seconds of inactivity.

Command: CLNT https://ftptest.net on behalf of 24.117.152.36

Reply: 530 You aren't logged in

Command: USER DCSmithCAM1

Reply: 331 User DCSmithCAM1 OK. Password required

Command: PASS **********

Reply: 230-OK. Current directory is /

Reply: 230-0 files used (0%) - authorized: 100 files

Reply: 230 0 Kbytes used (0%) - authorized: 1024 Kb

Command: SYST

Reply: 215 UNIX Type: L8

Command: FEAT

Reply: 211-Extensions supported:

Reply: EPRT

Reply: IDLE

Reply: MDTM

Reply: SIZE

Reply: REST STREAM

Reply: MLST type*;size*;sizd*;modify*;UNIX.mode*;UNIX.uid*;UNIX.gid*;unique*;

Reply: MLSD

Reply: AUTH TLS

Reply: PBSZ

Reply: PROT

Reply: UTF8

Reply: ESTA

Reply: PASV

Reply: EPSV

Error: Carriage return without line feed received

I am logging in successfully.  However, webcam still offline.  I have notified WU Support AGAIN.

Offline gellenb

  • Member
  • *
  • Posts: 38
    • Weather Page
Re: Station webcam improved updating
« Reply #123 on: December 26, 2017, 11:31:19 AM »
For the most part, I've been ignoring the webcam...working or not, and it appears there are still problems.  Anyhow, I went out and did a complete ftp session.  I took the last image sent (or attempted) to WU and used that for my manual ftp session.   The first three I was able to connect, and then WU immediately disconnected.  (An after thought may be that the cam may have been sending a image at the same time as I was testing - causing the disconnected session for me shown below).  This is a copy of that session.  I also did a second session that went out the first time without issue to an older webcam no longer being updated to WU.


H:\>ftp webcam.wunderground.com
Connected to webcam.wunderground.com.
Connection closed by remote host.

H:\>ftp webcam.wunderground.com
Connected to webcam.wunderground.com.
Connection closed by remote host.

H:\>ftp webcam.wunderground.com
Connected to webcam.wunderground.com.
Connection closed by remote host.

H:\>ftp webcam.wunderground.com
Connected to webcam.wunderground.com.
220---------- Welcome to Pure-FTPd [privsep] [TLS] ----------
220-You are user number 585 of 10000 allowed.
220-Local time is now 16:15. Server port: 21.
220-This is a private system - No anonymous login
220 You will be disconnected after 60 seconds of inactivity.
User (webcam.wunderground.com:(none)): gellenbCAM3
331 User gellenbCAM3 OK. Password required
Password:
230-OK. Current directory is /
230-0 files used (0%) - authorized: 100 files
230 0 Kbytes used (0%) - authorized: 1024 Kb
ftp> bin
200 TYPE is now 8-bit binary
ftp> put z:\pictures\snapshot2.jpg
200 PORT command successful
150 Connecting to port 54865
226-1 files used (1%) - authorized: 100 files
226-160 Kbytes used (15%) - authorized: 1024 Kb
226-File successfully transferred
226 1.256 seconds (measured here), 128.03 Kbytes per second
ftp: 164611 bytes sent in 1.13Seconds 145.93Kbytes/sec.
ftp> bye
221-Goodbye. You uploaded 161 and downloaded 0 kbytes.
221 Logout.

H:\>

Offline dcsmith

  • Member
  • *
  • Posts: 36
Re: Station webcam improved updating
« Reply #124 on: December 26, 2017, 11:36:26 AM »
Good info.  What ae you using to upload your snapshot?  As I wrote, my FTP client is built into the camera.  I cannot expose the actual exchange as you have done.  Unless they have changed something at their end, I am dead in the water.