Author Topic: FOSHKplugin - brief introduction  (Read 39212 times)

0 Members and 1 Guest are viewing this topic.

Offline thunder.ky

  • Weathering all the things!
  • Senior Member
  • **
  • Posts: 56
  • GW2000B, WS90, WeeWX, FOSHKplugin
    • thunder.ky
Re: FOSHKplugin - brief introduction
« Reply #350 on: March 11, 2023, 02:46:35 PM »
Wow, Oli, you're really making FOSHKplugin more and more advanced.  [tup]

I'll take a look at the new TAGFILE functionality over the next week!
Ecowitt GW2000B v3.0.5 (Previous v2.2.4.8 )
Ecowitt WS90 v1.3.3
WeeWX v4.9.1
FOSHKplugin v0.10
https://wx.thunder.ky
  |  
  |  
  |  
  |  
  |  

Offline broadstairs

  • Forecaster
  • *****
  • Posts: 853
Re: FOSHKplugin - brief introduction
« Reply #351 on: March 13, 2023, 08:46:30 AM »
Oliver I was wondering if there was a setting in the plugin like there is in both Weather Display and CMX (and perhaps others) to limit wind gust values. My WS80 today sent a max gust value of 85.9mph which I think is unlikely yes it is windy here but I've never had a gust in excess of 65mph since I started recording in 2005. Obviously WD and CMX both will ignore this value as I've now set the limit to 65mph. Is this something you would consider adding in the plugin as it would then not send this bad data to my Android display  or anywhere else for that matter.

Stuart
Ecowitt GW1003 with ultrasonic wind gauge, lightning sensor and PM2.5 sensor with Personal Weather Tablet as a console.

Offline olicat

  • Forecaster
  • *****
  • Posts: 1515
  • GWxx00, HPx5x1C, WN1900C, WN1980C & WS3800C
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #352 on: March 13, 2023, 11:18:13 AM »
Hi Stuart!

Interesting approach. I wasn't aware that CMX and WD handled it that way.

No, so far there is no comparable possibility with FOSHKplugin - it stubbornly sends the values it has received from the weather station.
I also have a certain stomachache about reacting to the reported values in this way - after all, it is not impossible that there really are gusts of wind with this speed. Even without announcing them in advance.

But I am thinking about an optional cut-off function. However, this can only be value-related and does not consider the historical development (FOSHKplugin is event- and not database-based and has hardly any knowledge about the past - although: for wind speed, direction and gusts there is a 10-minute history).
If necessary, one could define the value from which onwards transmission does not take place:

cut_off = windgustmph=65

This would mean that the windgustmph key would not be processed further if the value is greater than or equal to the specified value (here: 65).
Would this be an acceptable approach?
Or should the history and/or the wind be taken into account? But in which way? After all, gusts can indeed occur suddenly and without notice.

Can anyone think of other sensor values that should also be protected in this way? Or does this only apply to wind gusts?

Oliver

Offline broadstairs

  • Forecaster
  • *****
  • Posts: 853
Re: FOSHKplugin - brief introduction
« Reply #353 on: March 13, 2023, 11:43:11 AM »
Oliver the issue today was 85.9 mph was so far above any other wind speed recorded today that it must have been an aberration. I have never seen anything near that recorded locally. As I said my highest ever gust recorded since 2005 was around 65mph. I'd suggest perhaps either capping it or I believe what CMX does is to ignore it and just not send it, I thinnk I'd prefer the latter so no value gets recorded for that interval. I believe this is a WS80 issue and possibly WS90.

Certainly wind gust is the only one I have had an issue.

Stuart
Ecowitt GW1003 with ultrasonic wind gauge, lightning sensor and PM2.5 sensor with Personal Weather Tablet as a console.

Offline Rover1822

  • Forecaster
  • *****
  • Posts: 1989
    • Mini Wind and Solar Data project
Re: FOSHKplugin - brief introduction
« Reply #354 on: March 13, 2023, 11:47:42 AM »
No chance someone aimed a leaf blower at it? :) . I am kidding
Ambient:
  WS-2000
  PM 2.5(2)
  WH31B(2)
  WH40E
  WH31P
EcoWitt:
  GW1100
  GW1000(4)
  WH31(2)
  WH57
  WH51(12),
  WH40
  WH5360B
  WN34S
  WittBoy WS90 + GW2000
  WS90 (other one) + GW1100
Personal Sites: Weather Cam

Offline broadstairs

  • Forecaster
  • *****
  • Posts: 853
Re: FOSHKplugin - brief introduction
« Reply #355 on: March 13, 2023, 11:48:46 AM »
No chance someone aimed a leaf blower at it? :) . I am kidding

 8-)  #-o  :roll:  =D>

Stuart
Ecowitt GW1003 with ultrasonic wind gauge, lightning sensor and PM2.5 sensor with Personal Weather Tablet as a console.

Offline olicat

  • Forecaster
  • *****
  • Posts: 1515
  • GWxx00, HPx5x1C, WN1900C, WN1980C & WS3800C
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #356 on: March 13, 2023, 01:36:14 PM »
Hi!

Quote
if there was a setting in the plugin like there is in both Weather Display and CMX (and perhaps others) to limit wind gust values
With FOSHKplugin v0.10 there will be such an option:

Export\LIMIT_WINDGUST = value            # ignore windgustmph if >= value (key will be renamed to _windgustmph) and use last "good" maxdailygust

I'll test this now ...

add:
testing done - works as expected

Oliver

Offline olicat

  • Forecaster
  • *****
  • Posts: 1515
  • GWxx00, HPx5x1C, WN1900C, WN1980C & WS3800C
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #357 on: March 13, 2023, 03:31:00 PM »
Stuart,

Quote
85.9 mph was so far above any other wind speed recorded today
doesn't maxdailygust then also show the wrong value?
And just to be sure:
We are talking about windgustmph and not windspeedmph?

Oliver

Offline broadstairs

  • Forecaster
  • *****
  • Posts: 853
Re: FOSHKplugin - brief introduction
« Reply #358 on: March 13, 2023, 06:05:11 PM »
Yes it does.....

Stuart
Ecowitt GW1003 with ultrasonic wind gauge, lightning sensor and PM2.5 sensor with Personal Weather Tablet as a console.

Offline broadstairs

  • Forecaster
  • *****
  • Posts: 853
Re: FOSHKplugin - brief introduction
« Reply #359 on: March 14, 2023, 04:40:52 AM »
Thinking about this some more I'm not sure if either CMX or WD actually ignore that max reading and just use the wind gust supplied value and use the max received from that. The max gust sent by the gateway is also in my case that 85.9mph which I believe to be invalid. So to be sure I think if either wind gust of max gust are in excess of the limit value both should be ignored. I noticed that CMX has a default value for max gust in settings of 999 so effectively allows anything, WD does something similar. I have no idea what other software does.

Stuart
Ecowitt GW1003 with ultrasonic wind gauge, lightning sensor and PM2.5 sensor with Personal Weather Tablet as a console.

Offline olicat

  • Forecaster
  • *****
  • Posts: 1515
  • GWxx00, HPx5x1C, WN1900C, WN1980C & WS3800C
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #360 on: March 14, 2023, 07:34:25 AM »
Hi!

Quote
I think if either wind gust of max gust are in excess of the limit value both should be ignored.
With the wind gust value, a wrong value can indeed be ignored - it comes again with the next interval - hopefully correct again.

However, maxdailygust is sent again and again by the console until 24:00 - so it does not make sense to completely dispense with this value for the rest of the day. Because this would mean that a real maximum wind gust would no longer be recorded and forwarded.

So in future FOSHKplugin will cache the last valid maxdailygust and output it as maxdailygust instead of the value >= IGNORE_WINDGUST.

Actually, I would expect this behaviour already in the firmware of the console ...

Oliver

Offline broadstairs

  • Forecaster
  • *****
  • Posts: 853
Re: FOSHKplugin - brief introduction
« Reply #361 on: March 14, 2023, 07:46:21 AM »
Hi!

Quote
I think if either wind gust of max gust are in excess of the limit value both should be ignored.
With the wind gust value, a wrong value can indeed be ignored - it comes again with the next interval - hopefully correct again.

However, maxdailygust is sent again and again by the console until 24:00 - so it does not make sense to completely dispense with this value for the rest of the day. Because this would mean that a real maximum wind gust would no longer be recorded and forwarded.

So in future FOSHKplugin will cache the last valid maxdailygust and output it as maxdailygust instead of the value >= IGNORE_WINDGUST.

Actually, I would expect this behaviour already in the firmware of the console ...

Oliver

I think your suggestion is a good one. I'm not sure there is anything in f/w to alter the max gust value, certainly I have found no options to allow capping of wind speeds max or otherwise on either GW1000 or GW1100 and I suspect it is unlikely to happen on anything other than a WS80 or WS90.

Stuart
Ecowitt GW1003 with ultrasonic wind gauge, lightning sensor and PM2.5 sensor with Personal Weather Tablet as a console.

Offline olicat

  • Forecaster
  • *****
  • Posts: 1515
  • GWxx00, HPx5x1C, WN1900C, WN1980C & WS3800C
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #362 on: May 21, 2023, 07:55:28 AM »
Hi!

In case anyone missed it.
I have started a poll here for future support of another database server.
The current results confirm my personal ideas. However, only very few users have participated so far.

However, I am always open to other improvements or requests.

Thanks, Oliver

Offline olicat

  • Forecaster
  • *****
  • Posts: 1515
  • GWxx00, HPx5x1C, WN1900C, WN1980C & WS3800C
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #363 on: May 23, 2023, 06:44:01 AM »
Hi!

The public beta test for FOSHKplugin v0.10 has begun.

There are - as usual - several bug fixes and tons of new features in this version.
Major new features are:

and much more ...

If you are interested - the complete changelog is available by clicking on Version History.

Users who do not urgently need the new functions can stay with the stable version v0.09 for the time being.
The public beta test is intended to find out any errors in use cases that are difficult to recreate by me and the internal test team. In addition, I recognise through enquiries where the documentation should still be completed or adapted.
This version has been running stable for a handful of people for a few weeks, so I don't expect any major problems.

To upgrade:
Change via ssh to the directory in which FOSHKplugin is running - according to my recommendations, it could be /opt/FOSHKplugin.
If you run FOSHKplugin as root, you can do the following commands without sudo - if you run FOSHKplugin in a certain user context, the specification of that user would be important so that the permissions are correct:

Code: [Select]
sudo -u username ./generic-FOSHKplugin-install.sh -upgrade generic-FOSHKplugin-0.0.10Beta.zip
sudo -u username ./generic-FOSHKplugin-install.sh -repair

The "repair" is important this time, because FOSHKplugin has to install a new package via apt/pip to get InfluxDB v2 support.
Let me know if there're any problems or you need some explanations of the new functions. Most things should already be described on the website.

For first time (or parallel) installation just use this link and the common installation procedure.
LoxBerry users should download and install this version the usual LoxBerry-installation-way instead.

Have fun!

Regards, Oliver

Offline KC5JIM

  • Senior Contributor
  • ****
  • Posts: 231
    • KC5JIM Weather
Re: FOSHKplugin - brief introduction
« Reply #364 on: May 23, 2023, 09:35:57 AM »
Updated with no issues.
Ecowitt Wittboy| FOSHKplugin on Pi 4


Offline thunder.ky

  • Weathering all the things!
  • Senior Member
  • **
  • Posts: 56
  • GW2000B, WS90, WeeWX, FOSHKplugin
    • thunder.ky
Re: FOSHKplugin - brief introduction
« Reply #365 on: May 23, 2023, 03:22:04 PM »
Still running well, and continuing to test the new features.
Ecowitt GW2000B v3.0.5 (Previous v2.2.4.8 )
Ecowitt WS90 v1.3.3
WeeWX v4.9.1
FOSHKplugin v0.10
https://wx.thunder.ky
  |  
  |  
  |  
  |  
  |  

Offline olicat

  • Forecaster
  • *****
  • Posts: 1515
  • GWxx00, HPx5x1C, WN1900C, WN1980C & WS3800C
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #366 on: June 19, 2023, 04:29:28 PM »
Hi!

Quote
The public beta test for FOSHKplugin v0.10 has begun.
Do any other users have the v0.10Beta running? Are there any problems, uncertainties, wishes or requests?
Feedback is welcome - only then I can estimate if the version is stable enough for a release or if I still have to work on the code or the documentation.
Thanks a lot!

Oliver

Offline KC5JIM

  • Senior Contributor
  • ****
  • Posts: 231
    • KC5JIM Weather
Re: FOSHKplugin - brief introduction
« Reply #367 on: June 19, 2023, 04:51:54 PM »
v0.10Beta still running with no issues.
Ecowitt Wittboy| FOSHKplugin on Pi 4


Offline navzptc

  • Member
  • *
  • Posts: 37
    • Lavant Down
Re: FOSHKplugin - brief introduction
« Reply #368 on: June 19, 2023, 06:57:53 PM »
All working here Oliver with no problems noted, for ages here  [tup]

Offline thunder.ky

  • Weathering all the things!
  • Senior Member
  • **
  • Posts: 56
  • GW2000B, WS90, WeeWX, FOSHKplugin
    • thunder.ky
Re: FOSHKplugin - brief introduction
« Reply #369 on: June 20, 2023, 02:12:43 PM »
All continuing to work well on my install of v0.10Beta.
Ecowitt GW2000B v3.0.5 (Previous v2.2.4.8 )
Ecowitt WS90 v1.3.3
WeeWX v4.9.1
FOSHKplugin v0.10
https://wx.thunder.ky
  |  
  |  
  |  
  |  
  |  

Offline Rover1822

  • Forecaster
  • *****
  • Posts: 1989
    • Mini Wind and Solar Data project
Re: FOSHKplugin - brief introduction
« Reply #370 on: July 13, 2023, 10:45:30 AM »
Although I don't use it, I just read some of the documentation for the plug in, from a link on another post in here. The documentation alone is outstanding and I know how much effort that takes.

Oliver, really awesome job on this whole project, I really should play with it rather than just buying another GW1X or GW2X when I need another custom server ;).

who knows, might get me into nix...

Rover
« Last Edit: July 13, 2023, 10:49:51 AM by Rover1822 »
Ambient:
  WS-2000
  PM 2.5(2)
  WH31B(2)
  WH40E
  WH31P
EcoWitt:
  GW1100
  GW1000(4)
  WH31(2)
  WH57
  WH51(12),
  WH40
  WH5360B
  WN34S
  WittBoy WS90 + GW2000
  WS90 (other one) + GW1100
Personal Sites: Weather Cam

Offline olicat

  • Forecaster
  • *****
  • Posts: 1515
  • GWxx00, HPx5x1C, WN1900C, WN1980C & WS3800C
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #371 on: September 11, 2023, 06:34:44 PM »
Hi!

For a comparison of my stations regarding the air pressure, I wrote a small script today that once again shows how useful the getvalue function of FOSHKplugin can be used.
The script queries a list of consoles and outputs the absolute and relative air pressure as CSV:
Code: [Select]
addr;model;abs;rel
192.168.15.236:8081;HP2551C;1007,72;1012,83
192.168.15.100:8084;HP3501C;1007,72;1012,83
192.168.15.100:8083;GW2000;1006,4;1011,51
192.168.15.100:8089;GW1100;1006,2;1011,31
192.168.15.236:8080;GW1000-1;1007,01;1012,09
192.168.15.237:8080;GW1000-2;1006,6;1011,72
192.168.15.100:8080;WN1900C;1007,11;1012,19
192.168.15.100:8082;WN1980C;1007,42;1012,5

I also included a function in FOSHKplugin to convert the decimal point into a comma, as this is necessary for the import into a German Excel version. The sed command could therefore be omitted if an additional &comma were specified in the URL (this internal beta is not yet published).

The script:
Code: [Select]
#!/bin/bash

# write CSV header
echo "addr;model;abs;rel"

# list of weather stations model,ipaddress:port
array="HP2551C,192.168.15.236:8081 HP3501C,192.168.15.100:8084 GW2000,192.168.15.100:8083 GW1100,192.168.15.100:8089 GW1000-1,192.168.15.236:8080 GW1000-2,192.168.15.237:8080 WN1900C,192.168.15.100:8080 WN1980C,192.168.15.100:8082"
for device in $array; do
  model=`echo ${device%%","*}`
  addr=`echo ${device##*,}`
  abs=`curl -s http://${addr}/getvalue?key=baromabshpa|sed 's/\./\,/g'`
  rel=`curl -s http://${addr}/getvalue?key=baromrelhpa|sed 's/\./\,/g'`
  echo "$addr;$model;$abs;$rel"
done

In this way, one could of course also write other values together in an Excel file for comparison purposes.
Perhaps one or the other idea for your own problem solutions will result from this ...

Oliver

Offline PartOne

  • Member
  • *
  • Posts: 13
Re: FOSHKplugin - brief introduction
« Reply #372 on: October 12, 2023, 12:13:46 PM »
Has anyone tried installing the plugin on a Synology NAS? I'm new to this and am asking for help.

Offline Gyvate

  • Forecaster
  • *****
  • Posts: 3298
Re: FOSHKplugin - brief introduction
« Reply #373 on: October 12, 2023, 12:43:07 PM »
there are several options - probably the simplest would be to install an Ubuntu VM (Virtual Machine) and run FOSHKplugin inside than VM.
It depends on the capabilities of your Synology NAS - not all come with the same features.

But if yours has the VMM (virual machine manager) or it can be optionally installed, that would be a way to go.
A Docker container could be another option, even though there is probably not a ready-made FOSHKplugin Docker "VM".
It also depends on your knowledge of Linux (derivates) etc.

I installed an Ubuntu VM (your choice if it's a VM with a desktop or a console only install) for someone on a Synology NAS to run CumulusMX in it. And then FOSHKplugin can of course also be run inside that VM. The creation of a (Linux, here Ubuntu) VM is a rather uncomplicated process and you can find lots of setup examples/instructions in the web.
WS2350 1.6.7, GW1000(3) 1.7.7,WH2650 WiFi (2) 1.7.7 (test/backup), GW1100 2.3.1, GW2000(3) 3.1.1, HP2551 1.9.5,5.1.5;HP3500 1.7.2,WS3800 1.2.8, WN1910 1.2.3,WN1980 1.2.3;
Ecowitt WS90(2)1.3.5/1.4.0, WS80(2)1.2.5, WS68, WS69, WH40, WH31, WH31-EP, WN30, WN34L, WN35, WH32, WH32-EP, WH32B, WH57 [Lightning], WH41 [PM2.5], WH51, WH45, WH55
MeteobridgePro(2)[test,prod] 5.8 Mar 01 2024, 15185 - Blake-Larsen Sun Recorder - RPi4/weewx 4.8.0/4.10.2/CumulusMX 3283/Meteobridge RPi4B-2GB(3169)
Barani Meteoshield Pro, MetSpec Rad02 - Ecowitt 5763,34418;WU ISAARB3(WH4000SE),ISAARB22(HP2553), http://meshka.eu

Offline broadstairs

  • Forecaster
  • *****
  • Posts: 853
Re: FOSHKplugin - brief introduction
« Reply #374 on: October 28, 2023, 09:22:23 AM »
I need to allow my PWTablet to be sent data having replaced the non-existent temp/hum from my WS80 (the sensor has failed again!) with the values from my WH31, however the export function specifically says it does not affect RAWEW which is what PWT uses. How can I achieve this with the plugin?

Stuart
Ecowitt GW1003 with ultrasonic wind gauge, lightning sensor and PM2.5 sensor with Personal Weather Tablet as a console.

 

anything