Author Topic: FOSHKplugin - brief introduction  (Read 20231 times)

0 Members and 1 Guest are viewing this topic.

Offline KC5JIM

  • Senior Contributor
  • ****
  • Posts: 201
    • KC5JIM Weather
Re: FOSHKplugin - brief introduction
« Reply #150 on: October 31, 2021, 01:11:27 PM »
APRS/CWOP is working perfectly for me. Thank you!
Ecowitt Wittboy| FOSHKplugin on Pi 4


Offline Gyvate

  • Forecaster
  • *****
  • Posts: 2060
Re: FOSHKplugin - brief introduction
« Reply #151 on: November 01, 2021, 05:49:11 AM »
...

  • new, improved sun hours calculation sunhours (according to https://github.com/Jterrettaz/sunduration) with dynamic, location-dependent threshold value (thank you Werner!), requires Coordinates\LAT and Coordinates\LON
....
Thanks.

Oliver
looks like this formula is much better than what's commonly used in stations, and it somehow (result-wise) seems to match with the findings and resulting table from an Austrian weather enthusiast: http://www.pete.at/wetter/Sonnenstunden_2021.htm (German only).

If the precision of this formula also used by Méteo France has really +/- 1% deviation only from a pyranometer, it's definitely much  better than the common general 120 or 200 W/m2 threshold values.

However, nothing beats the measurements of direct sun radiation with a pyranometer or e.g. the Blake-Larsen SunRecorder which I personally use and which seems to have a similar formula inbuilt regarding longitude, latitude and time and day dependent azimuth to translate the electrical current from the photo cell in µA into sunshine seconds. Its measurements over 1 1/2 years now match nicely with corresponding minute based photos of the local sky.

But no doubt, Oliver's implementation of the new sun hour formula is a great step ahead for all those who can use FOSHKplugin  =D>
WS2350 1.6.4, GW1000(3) 1.7.5, WH2650 WiFi (2) 1.7.5 (test/backup), GW1100 2.2.0, GW2000(3) 2.2.0, HP2551 1.6.4/1.8.6;
Ecowitt WS90(2), WS80, WH40, WH65, WH31(5), WH31-EP, WN30, WN34L, WN35, WH32, WH32-EP, WH32B, WH57 [Lightning], WH41 [PM2.5] (2), WH51 (4), WH45, WH55
MeteobridgePro(2)[test,prod] 5.5 Oct 27 2022, 14854 - Blake-Larsen Sun Recorder - RPi4/weewx 4.8.0/CumulusMX 3214/MB RPi4(2886)
Barani Meteoshield Pro, MetSpec Rad02 - Ecowitt 5763,34418;WU ISAARB3(WH4000SE), ISAARB22(HP2553), http://meshka.eu

Offline olicat

  • Forecaster
  • *****
  • Posts: 999
  • GWxx00, HP2551C, HP3501C, WN1900C & FOSHKplugin
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #152 on: November 01, 2021, 06:35:43 AM »
Hi!

Quote
nothing beats the measurements of direct sun radiation with a pyranometer or e.g. the Blake-Larsen SunRecorder
I have already prepared the implementation of the Blake-Larsen SunRecorder in FOSHKplugin. However, since the Blake-Larsen SunRecorder requires a Windows computer, I put this development on hold for the time being. I don't want to run a Windows computer (or VM) 24/7 - especially for just one measured value. And I'm still hoping for an embedded solution where the value is simply output. Or a Linux solution based on software.

But you can already use the FWD_EXEC function (modify outgoing data line (exec)), to add any values to the Ecowitt stream or replace values with other sensors.

Oliver

Offline wxwol

  • Member
  • *
  • Posts: 15
Re: FOSHKplugin - brief introduction
« Reply #153 on: November 02, 2021, 03:06:14 PM »
APRS/CWOP working well here too, now running for a few days with no hiccups.

Offline danitus13

  • Member
  • *
  • Posts: 6
Re: FOSHKplugin - brief introduction
« Reply #154 on: December 18, 2021, 11:57:29 AM »
Hi, I write from Italy.
I bought a waldbeck halley 6 in 1 with an additional indoor temperature sensor (clone hp1000 from froggit)
I installed weewx and used the gw1000 IP driver.
I want the indoor sensor which should be a Wh32, as the main outdoor sensor, what to change in weewx?

Offline wxwol

  • Member
  • *
  • Posts: 15
Re: FOSHKplugin - brief introduction
« Reply #155 on: December 18, 2021, 12:04:13 PM »
I have never used weewx, however with FOSHKplugin you just add a couple of parameters to the configuration file and you are in business. I used an WH31_EP sensor outside until yesterday, which is normally seen as an indoor unit, and FOSHKplugin effortlessly reported it as an external unit.

Offline olicat

  • Forecaster
  • *****
  • Posts: 999
  • GWxx00, HP2551C, HP3501C, WN1900C & FOSHKplugin
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #156 on: December 18, 2021, 12:59:52 PM »
Hi!

I'm not exactly sure what you're up to and what the starting position is.
If you really have a WH32, its value is taken automatically - a WH32 trumps the combination sensor.  However, if you mean the sensor included in the bundle: This is a WH32B and therefore an indoor sensor.
Perhaps you really have a WH31 additional sensor and want to use this as the outdoor sensor.
First you have to be sure of the model.

Beside that:
I don't know if there's a remap functionality in weewx.
But this thread is FOSHKplugin specific and not for discussion of configuration problems with WeeWX.

Oliver

Offline danitus13

  • Member
  • *
  • Posts: 6
Re: FOSHKplugin - brief introduction
« Reply #157 on: December 18, 2021, 01:38:20 PM »
Ho aperto un topic specifico qui, se potete aiutarmi. Grazie.

https://www.wxforum.net/index.php?topic=43157.new#new

Offline Gyvate

  • Forecaster
  • *****
  • Posts: 2060
WS2350 1.6.4, GW1000(3) 1.7.5, WH2650 WiFi (2) 1.7.5 (test/backup), GW1100 2.2.0, GW2000(3) 2.2.0, HP2551 1.6.4/1.8.6;
Ecowitt WS90(2), WS80, WH40, WH65, WH31(5), WH31-EP, WN30, WN34L, WN35, WH32, WH32-EP, WH32B, WH57 [Lightning], WH41 [PM2.5] (2), WH51 (4), WH45, WH55
MeteobridgePro(2)[test,prod] 5.5 Oct 27 2022, 14854 - Blake-Larsen Sun Recorder - RPi4/weewx 4.8.0/CumulusMX 3214/MB RPi4(2886)
Barani Meteoshield Pro, MetSpec Rad02 - Ecowitt 5763,34418;WU ISAARB3(WH4000SE), ISAARB22(HP2553), http://meshka.eu

Offline olicat

  • Forecaster
  • *****
  • Posts: 999
  • GWxx00, HP2551C, HP3501C, WN1900C & FOSHKplugin
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #159 on: December 24, 2021, 03:32:01 AM »
Hi!

The public beta test for the new version of FOSHKplugin v0.09 has started.
I think there are some really useful new things in there.
Highlights:
  • FWD_REMAP - output keys can now be defined with values of all known internal keys
  • APRS/CWOP support
  • new forward type EWUDP to convert incoming weather station data to UDP for Personal Weather Tablet/UDP broadcast listener
  • improved sunhours calculation
Have a look to the complete Version History.

Users who do not urgently need the new functions can stay with the stable version v0.08 for the time being.
The public beta test is intended to find out any errors in use cases that are difficult to recreate by me and the internal test team.
This version has been running stable for a handful of people for a few weeks, so I don't expect any major problems.

To upgrade:
Change via ssh to the directory in which FOSHKplugin is running - according to my recommendations, it could be /opt/FOSHKplugin/.
If you run FOSHKplugin as root, you can do the following commands without "sudo -u username" - if you run FOSHKplugin in a certain user context, the specification of that user would be important so that the permissions are correct:

Code: [Select]
sudo -u username ./generic-FOSHKplugin-install.sh -upgrade generic-FOSHKplugin-0.0.9Beta.zip

Let me know if there're any problems or you need some explanations of the new functions. Most things should already be described on the website.

For first time (or parallel) installation just use this link.
LoxBerry users should download and install this version the usual LoxBerry-installation-way instead.

Have fun and Merry Christmas!

Regards, Oliver


Offline KC5JIM

  • Senior Contributor
  • ****
  • Posts: 201
    • KC5JIM Weather
Resolved Re: FOSHKplugin - brief introduction
« Reply #160 on: December 24, 2021, 02:29:06 PM »
My Pi was weird so I just did a clean install and everything is working great!
« Last Edit: December 24, 2021, 07:43:42 PM by KC5JIM »
Ecowitt Wittboy| FOSHKplugin on Pi 4


Offline olicat

  • Forecaster
  • *****
  • Posts: 999
  • GWxx00, HP2551C, HP3501C, WN1900C & FOSHKplugin
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #161 on: December 24, 2021, 03:46:56 PM »
Hi Jim,

I have currently no clue what there's going on.
But first you could try a repair:
Code: [Select]
sudo ./generic-FOSHKplugin-install.sh -repairIf this still does not help, please send me the output of
Code: [Select]
ls -lah from the FOSHKplugin install dir via PM.

Oliver

Offline zoomx

  • Contributor
  • ***
  • Posts: 142
Re: FOSHKplugin - brief introduction
« Reply #162 on: December 31, 2021, 12:18:01 PM »
Can I ask if it is possible to add the upload to InfluxDB 2.0? The protocol seems different. I added the 1.0 compatibility but it seems that it doesn't work.
Happy New Year!

Offline olicat

  • Forecaster
  • *****
  • Posts: 999
  • GWxx00, HP2551C, HP3501C, WN1900C & FOSHKplugin
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #163 on: January 01, 2022, 03:27:26 AM »
Hi!

InfluxDB 2 should be backwards compatible with 1.x.  So it should work by now.
However, I am currently missing a corresponding test option.  Perhaps there is a hint on the internet as to what InfluxDB v2 needs to be adjusted in order for it to work.
I will try to test it with InfluxDB 2 and adapt FOSHKplugin if necessary. With InfluxDB 1.8, FOSHKplugin runs here in a productive environment.

Do you get any error message while uploading to InfluxDB v2?

Happy new year!

Oliver

Offline zoomx

  • Contributor
  • ***
  • Posts: 142
Re: FOSHKplugin - brief introduction
« Reply #164 on: January 03, 2022, 03:39:49 AM »
I checked and there is no error message on FOSHKplugin (or i was unable to find it).

But in Influxdb 2.0 they changed the interface. Now it has the web UI again (in 1.8 there is no web UI you should use Chronograph but previous versions had it) but  you can't do all thing in it, for example you cannot create new user or simply manage them. I didn't find a place where I can see wich database can be accessed by an user.
So, I believe, there is simply a permission issue.

I switched from 1.8 on a RaspberryPi to a 2.0 on Windows because a SD crash on the raspy.


Offline davidefa

  • Forecaster
  • *****
  • Posts: 394
Re: FOSHKplugin - brief introduction
« Reply #165 on: January 03, 2022, 05:07:19 AM »
If you switched from FOSHKplugin + db on same 'board' to FOSHKplugin an a 'board' and db to a different 'board' it may be a firewall problem

Offline olicat

  • Forecaster
  • *****
  • Posts: 999
  • GWxx00, HP2551C, HP3501C, WN1900C & FOSHKplugin
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #166 on: January 03, 2022, 05:09:03 AM »
Hi!

Quote
I checked and there is no error message on FOSHKplugin (or i was unable to find it).
You should have a look to the snd-foshkplugin.log log file and search for a message (for this specific forward FWD-xx) like:
Code: [Select]
03.01.2022 10:11:23.877 <ERROR> FWD-53: InfluxDB sending of 324 values to TestData@192.168.15.252:8086: 401: {"code":"unauthorized","message":"Unauthorized"} (3 tries)
In my example this is indeed a permission issue.
I just have installed the InfluxDB v2.1.1 on Windows but don't find the compatibility settings to configure nor the credentials for the database.
Have to investigate further ...

Quote
I switched from 1.8 on a RaspberryPi to a 2.0 on Windows because a SD crash on the raspy.
And there's no v1.8 for Windows available anymore?

Oliver

Offline zoomx

  • Contributor
  • ***
  • Posts: 142
Re: FOSHKplugin - brief introduction
« Reply #167 on: January 03, 2022, 06:52:36 AM »
If you switched from FOSHKplugin + db on same 'board' to FOSHKplugin an a 'board' and db to a different 'board' it may be a firewall problem

Yes, I checked this too because the web UI was not reachable from another PC but I have an ESP8266 thet upload data without problems using the influxdb official library. Now I reach the web UI but it refuses to log me in. I have to search.
Also Grafana, in the same PC, cannot access to InfluxDB. I have to study more!


Hi!

And there's no v1.8 for Windows available anymore?

I wish to test the new 2.0 avoiding future switching but I believe that will install it also.

Offline olicat

  • Forecaster
  • *****
  • Posts: 999
  • GWxx00, HP2551C, HP3501C, WN1900C & FOSHKplugin
    • FOSHKplugin
Re: FOSHKplugin - brief introduction
« Reply #168 on: January 22, 2022, 03:30:45 AM »
Hi!

There is another updated public beta of FOSHKplugin v0.09.
A few minor bugs have been fixed and the installation script of the generic version has been optimised regarding WSL (Windows Subsystem for Linux).
Additionally, a firmware problem with the current firmware version v2.1.0 of the GW2000 is bypassed - the key "runtime" is not transferred correctly from the GW2000.

As a new feature of this beta there is the display and output of the actual transmission interval and - if INTVL_WARNING = True - also a warning via Log/UDP/http/Pushover, if the actual (measured) transmission interval is 10% above the interval configured in the weather station (WS_INTERVAL).
The time interval in seconds between the current and the last transmission of the weather station is output as isintvl. The average value of the last 10 transmissions (without the largest and smallest interval) is output as isintvl10.
Using JSON, MQTT or InfluxDB, an analysis of the actual transmission rate of the weather station can thus be generated very easily.
Whether this function will be included in the final v0.09 release is not yet decided. I will gladly take your hints into account in my decision.
But now I urgently need such an analysis option - currently I have considerable (!) differences between configured and actual interval with both the HP3501 and the HP2551C.
An update from an existing public beta v0.09 is done by
Code: [Select]
sudo -u username ./generic-FOSHKplugin-install.sh -upgrade generic-FOSHKplugin-0.0.9Beta.zip
If there are problems or if you are upgrading from a previous version, you may need to run a one-time
Code: [Select]
sudo -u username ./generic-FOSHKplugin-install.sh -repair
should be executed. username is the name of the user in whose context FOSHKplugin is running.

Please test and report any problems or questions or wishes.
Thanks a lot and have a nice weekend!

Oliver

To the attachment:
The green and orange graphs show the measured interval of two GW1000s. This is set to 30 seconds and is also adhered to.
However, the yellow graph shows the measured interval of an HP3501, which is configured to 60 seconds. For unclear reasons, however, the interval is usually 90 seconds.
A similar behaviour is shown by an HP2551C (light blue) that is supposed to transmit every 30 seconds, but actually only does so every 40 seconds.
The red and dark blue curves show the interval over the last 10 transmissions.
For such graphics I needed the new key isintvl and isintvl10.
Maybe you can do something with them?

Offline Gyvate

  • Forecaster
  • *****
  • Posts: 2060
Re: FOSHKplugin - brief introduction
« Reply #169 on: January 22, 2022, 04:48:32 AM »
......
But now I urgently need such an analysis option - currently I have considerable (!) differences between configured and actual interval with both the HP3501 and the HP2551C.
.....
I had done tests myself after having noticed the discrepancy between the interval set in WSView and gaps between arrivals of the data packages - and compared to a GW1000 and a WS2320E.
Results: 
- the GW1000/WH2650/GW2000 post accurately (with one additional second: 16s set, 17s factual, but that negligable)
- the gaps between postings of the HP2551 are much bigger - double the time or more
- the gaps between postings of the WS2320E are also bigger, but not as big as with the HP2551

On enquiry with Ecowitt they stated that the differences come from the different hardware used:
the GW1000 uses a SoC for the WiFi module, i.e. the WiFi SoC has its own processing faculty, whereas the other consoles use a WiFi modem which is managed by the central (and only) processor of the console. Obviously the workload is too high to finish the transmissions in time (or the modem doesn't have sufficient throughput capacity).

The WS2320E is closer to the set values in WS View than the HP2551. This can be explained by the different payload of a post (in my case): the WS2320E sends only the classical sensors (T/H/P in/outside, rain, wind, solar), that's all it reads and can send, whereas my HP2551 sends data for all of my sensors (about 30 - 40 values more than the WS2320E including the battery status).

The time gaps between transmissions were measured with FOSHKplugin (raw-foshkplugin.log) and the weewx interceptor driver (for control).

Maybe someone else could also have a look into this phenomenon and report back here, even using @olicat's need (temporary) feature in the new 0.09 Beta.

If it is really hardware related, then, however, nothing much that can be done about it.
« Last Edit: January 22, 2022, 04:50:26 AM by Gyvate »
WS2350 1.6.4, GW1000(3) 1.7.5, WH2650 WiFi (2) 1.7.5 (test/backup), GW1100 2.2.0, GW2000(3) 2.2.0, HP2551 1.6.4/1.8.6;
Ecowitt WS90(2), WS80, WH40, WH65, WH31(5), WH31-EP, WN30, WN34L, WN35, WH32, WH32-EP, WH32B, WH57 [Lightning], WH41 [PM2.5] (2), WH51 (4), WH45, WH55
MeteobridgePro(2)[test,prod] 5.5 Oct 27 2022, 14854 - Blake-Larsen Sun Recorder - RPi4/weewx 4.8.0/CumulusMX 3214/MB RPi4(2886)
Barani Meteoshield Pro, MetSpec Rad02 - Ecowitt 5763,34418;WU ISAARB3(WH4000SE), ISAARB22(HP2553), http://meshka.eu

Offline davidefa

  • Forecaster
  • *****
  • Posts: 394
Re: FOSHKplugin - brief introduction
« Reply #170 on: January 22, 2022, 07:37:06 AM »
There is another post ( a few months back, don't remember exactly ) about this custom upload interval stability of gw1000.
It was noted that it may be related to uploading to different online weather services.
Since then I disabled uploading to wu, set custom upload interval to 59" and find the uploading interval more stable.
This is yestarday graph ( uploading to ecowitt.net, and custom upload to my meteotemplate site )

 [ You are not allowed to view attachments ]


This is last 1 June graph ( uploading to ecowitt.net, wu, and custom upload to my meteotemplate site, upload interval was set to 60 )

 [ You are not allowed to view attachments ]
« Last Edit: January 22, 2022, 07:39:14 AM by davidefa »

Offline Gyvate

  • Forecaster
  • *****
  • Posts: 2060
Re: FOSHKplugin - brief introduction
« Reply #171 on: January 22, 2022, 07:57:02 AM »
There is another post ( a few months back, don't remember exactly ) about this custom upload interval stability of gw1000.
It was noted that it may be related to uploading to different online weather services.
Since then I disabled uploading to wu, set custom upload interval to 59" and find the uploading interval more stable.
....
yes, but my tests were done inside the same local network and the receiving server has an i5-4 core processor and a SSD disk and a 1 Gbits/s network interface.
Unlike the weather servers of WU etc. there is no potential traffic congestion (locally or in the internet) or server overload.
Still the consoles show that time lag behaviour (except for GW1x00, GW2000, WH2650 - they show a constant interval on the sender and receiver end).
WS2350 1.6.4, GW1000(3) 1.7.5, WH2650 WiFi (2) 1.7.5 (test/backup), GW1100 2.2.0, GW2000(3) 2.2.0, HP2551 1.6.4/1.8.6;
Ecowitt WS90(2), WS80, WH40, WH65, WH31(5), WH31-EP, WN30, WN34L, WN35, WH32, WH32-EP, WH32B, WH57 [Lightning], WH41 [PM2.5] (2), WH51 (4), WH45, WH55
MeteobridgePro(2)[test,prod] 5.5 Oct 27 2022, 14854 - Blake-Larsen Sun Recorder - RPi4/weewx 4.8.0/CumulusMX 3214/MB RPi4(2886)
Barani Meteoshield Pro, MetSpec Rad02 - Ecowitt 5763,34418;WU ISAARB3(WH4000SE), ISAARB22(HP2553), http://meshka.eu

Offline hiljolodewijk

  • Contributor
  • ***
  • Posts: 131
    • Weerstation Marsdijk
Re: FOSHKplugin - brief introduction
« Reply #172 on: January 22, 2022, 10:44:25 AM »
There is another post ( a few months back, don't remember exactly ) about this custom upload interval stability of gw1000.
It was noted that it may be related to uploading to different online weather services.

I think you're talking about my topic: https://www.wxforum.net/index.php?topic=42587.0

I already asked Ecowitt if they can do something about it, but they're not really responding to my emails. I have to chase them time by time to get an answer. If they respond with a 'no that's not possible' then this is fine, but then at least we know it.

Offline Gyvate

  • Forecaster
  • *****
  • Posts: 2060
Re: FOSHKplugin - brief introduction
« Reply #173 on: January 29, 2022, 06:55:31 AM »
from what they (Ecowitt) wrote it was clear that it is hardware related ... (see my earlier post)
the processing power and/or modem bandwidth is simply too small, especially when you have many sensors.
The later on upcoming sensor "inflation" might not yet have been considered in the design of the HP2551. 
(the workaround, for the so far rather few users - compared to HP2551 consoles sold - who [think they] need exact timing for the custom server postings, is a GWxy00).

And I don't think they will make a big withdrawal and exchange program as it's done with cars and car parts.
In a new display console design they may consider this.
I assume that the WN19x0 console has a similar hardware setup as the GWxxxx devices.
Maybe some owners of this console can perform some tests with it
WS2350 1.6.4, GW1000(3) 1.7.5, WH2650 WiFi (2) 1.7.5 (test/backup), GW1100 2.2.0, GW2000(3) 2.2.0, HP2551 1.6.4/1.8.6;
Ecowitt WS90(2), WS80, WH40, WH65, WH31(5), WH31-EP, WN30, WN34L, WN35, WH32, WH32-EP, WH32B, WH57 [Lightning], WH41 [PM2.5] (2), WH51 (4), WH45, WH55
MeteobridgePro(2)[test,prod] 5.5 Oct 27 2022, 14854 - Blake-Larsen Sun Recorder - RPi4/weewx 4.8.0/CumulusMX 3214/MB RPi4(2886)
Barani Meteoshield Pro, MetSpec Rad02 - Ecowitt 5763,34418;WU ISAARB3(WH4000SE), ISAARB22(HP2553), http://meshka.eu

Offline Patt21

  • Member
  • *
  • Posts: 15
Re: FOSHKplugin - brief introduction
« Reply #174 on: February 07, 2022, 03:22:12 PM »
Hello everyone, I read this Post, but I am not very good at computers, just the basics. If I want to install FOSHKplugin what does it need as hardware in addition to my ASUS windows. Thank you.