I just re-signed up for CWOP as a Ham operator here in Texas.
I had been on the program ~12 years ago or so in California (Stockton) but the new station I got didn't support it. I had gremlins too with my older station, though that was siting in a way, I had a small backyard and did the best I could with location (having to keep in mind exposures, and putting it on the fenceline would mean it being swiped in days). Barometer was easy to figure out and recalibrate, but in the summer months I had temp issues, and it took some fine tuning to get them adjusted to where they wouldn't go nuts between 1-3pm. The heavyweather application helped out with that, as well as a few "neighbor" stations who helped me configure it to where I could deduct a few degrees in those particular hours, with a "rolling ramp" on it where it would slowly apply, peak at the value in the middle, and then roll off as it got to the end of the time span.
NWS locally (I believe my contact was in Sacramento) was cool with it. They just let me know by email that they seemed a bit off, and I worked on it. They had no issues with me getting stuff fixed and calibrated. Once I got it corrected it was fine, and I had no further issues. But some of the "outside" analysis never liked me.
My thinking was simply that if NWS was okay with it and it was within their "acceptable paramaters" I wasn't worried about it. I'll be doing the same this time and making sure I'm giving good data (my site is much better where I am now!) but I'm not going to nitpick if I'm off by a few percent of the airport across town or whoever is my neighbor on CWOP. If its way off, sure I'll be after it, and I do have other stations and gear to "cross check" the one transmitting, but after being paranoid at first, I found it was better to monitor it, correct to stay within the mean, but realize also that my weather situation was a little different than the guy two blocks over (yard 4X as big, trees, able to put a pole right in the middle of it at 30 feet plus...).
It will be interesting to see what results I get. But I guess the way I look at it is this: I emailed the NWS to sign up, they will be the ones I will listen to if something is off. Will I keep an eye on my stuff? Sure. Will I run other analysis on it? Sure. But I'll take it with a grain of salt and if something is off, I'll see why before I start messing with it. Part of the reason they want the data from a wide area is because of fluctuations, but some of those are correct and some are not.
See what 12+ years of work on it will do to it when I start checking again. I missed being on the program, but at the time I didn't have the money to outlay to get a station where I could possibly upload to it again. I don't have a problem sharing the data and such and doing so with some level of QC, but I'm not going to freak out if some website "analyzes" my stuff and says I'm way off when I know I'm not either.
Going to be interesting though...that's for sure.