Author Topic: CWOP MADIS Rating?  (Read 25039 times)

0 Members and 1 Guest are viewing this topic.

Offline Ravenstar

  • Senior Contributor
  • ****
  • Posts: 180
    • http://veronaweather.com
CWOP MADIS Rating?
« on: October 30, 2006, 04:33:49 PM »
Just noticed this today, have no idea what it is. It's on the CWOP Site Information page for my station. Read the MADIS page still don't know, anyone?



Two thumbs up is better than two thumbs down I'm sure, but two thumbs up out of a possible five is not so great, just not sure how this works.


Vantage pro 2 (wireless)

Offline FishDude

  • Member
  • *
  • Posts: 46
    • OFA Weather Web!
Re: CWOP MADIS Rating?
« Reply #1 on: October 30, 2006, 05:33:29 PM »
Quote from: "Ravenstar"

Two thumbs up is better than two thumbs down I'm sure, but two thumbs up out of a possible five is not so great, just not sure how this works.


With all the thumbs, I think Fonzi from Happy Dyas is doing QA?

Offline kray1000

  • Purveyor of wry
  • Forecaster
  • *****
  • Posts: 1336
    • http://www.roanokevalleyweather.com
Re: CWOP MADIS Rating?
« Reply #2 on: October 30, 2006, 05:52:03 PM »
Quote from: "Ravenstar"
two thumbs up out of a possible five is not so great, just not sure how this works.


Where did you see that 5 thumbs is the maximum rating?  I saw one site this morning (not mine) that had 99% ratings for all 3 categories... two green thumbs for each one.

Just a guess, but I'm thinking they do two different types of quality checks, one for each thumb.  Either green or red, or maybe yellow?

Offline Ravenstar

  • Senior Contributor
  • ****
  • Posts: 180
    • http://veronaweather.com
CWOP MADIS Rating?
« Reply #3 on: October 30, 2006, 05:56:10 PM »
Kevin I didn't see anywhere it says five thumbs up, just used that to get across that I have no idea what two thumbs up means. Where did you see a percentage rating? Maybe I need to contact Russ.


Vantage pro 2 (wireless)

Offline kray1000

  • Purveyor of wry
  • Forecaster
  • *****
  • Posts: 1336
    • http://www.roanokevalleyweather.com
CWOP MADIS Rating?
« Reply #4 on: October 30, 2006, 05:58:10 PM »
Quote from: "Ravenstar"
Kevin I didn't see anywhere it says five thumbs up, just used that to get across that I have no idea what two thumbs up means. Where did you see a percentage rating? Maybe I need to contact Russ.


If you're using IE, you can mouseover that graphic and see the percentages.  Doesn't work for FF...

Offline tinplate

  • Forecaster
  • *****
  • Posts: 368
    • http://www.softwx.com/products.html
Re: CWOP MADIS Rating?
« Reply #5 on: November 02, 2006, 03:32:40 PM »
The mouseover works for FireFox now also.

Offline mikejeep

  • Member
  • *
  • Posts: 29
Re: CWOP MADIS Rating?
« Reply #6 on: November 02, 2006, 03:45:08 PM »
From the CWOP QC summary page, down in the "Quality Notes" section:

Quote from: "http://weather.gladstonefamily.net/site/C3224"
The 'MADIS rating' reports on the percentage of observations that pass the MADIS checks. You should aim for two thumbs up!


So two thumbs is equivalent to five stars. :)

-Mike

Offline ocala

  • Forecaster
  • *****
  • Posts: 4396
  • The blues had a baby and named it rock n roll
Re: CWOP MADIS Rating?
« Reply #7 on: November 02, 2006, 06:53:46 PM »
Just curious, I had 2 thumbs for temp and dewpoint but none for pressure. Did anyone have thumbs for pressure?

Offline kray1000

  • Purveyor of wry
  • Forecaster
  • *****
  • Posts: 1336
    • http://www.roanokevalleyweather.com
Re: CWOP MADIS Rating?
« Reply #8 on: November 02, 2006, 06:56:56 PM »
Quote from: "ocala"
Just curious, I had 2 thumbs for temp and dewpoint but none for pressure. Did anyone have thumbs for pressure?


No thumbs?  Yeah, I had two for all three...
http://weather.gladstonefamily.net/site/C2195

What's your CWOP ID?

Offline ocala

  • Forecaster
  • *****
  • Posts: 4396
  • The blues had a baby and named it rock n roll
Re: CWOP MADIS Rating?
« Reply #9 on: November 03, 2006, 01:41:55 PM »

Offline Ravenstar

  • Senior Contributor
  • ****
  • Posts: 180
    • http://veronaweather.com
Re: CWOP MADIS Rating?
« Reply #10 on: November 03, 2006, 02:15:04 PM »
Thanks Mike for finding that.

Today for yesterday's data I only had two thumbs up for temperature the others had no thumbs up. I don't see how my pressure could get much closer without overlaping exactly their target readings.



I'm not being anal about it but they do say you should shot for two thumbs up. If I lowered my sea level a tad to match the left side that would only put it lower on the right side that does match up. No win situation.


Vantage pro 2 (wireless)

Offline ocala

  • Forecaster
  • *****
  • Posts: 4396
  • The blues had a baby and named it rock n roll
Re: CWOP MADIS Rating?
« Reply #11 on: November 03, 2006, 04:40:35 PM »
David I wouldn't sweat it. As long as YOU know your data is accurate that's all that's important.
In my case I know my pressure reading is accurate because I am right in the middle of 2 NWS reporting stations and for the most part my data mirrors those two.
 It only takes a few reporting stations to throw the whole thing out of wack. There is a PWS that just came online by me and his pressure data is way off.

Offline W3DRM

  • Forecaster
  • *****
  • Posts: 3360
    • Emmett Weather
Re: CWOP MADIS Rating?
« Reply #12 on: November 04, 2006, 02:39:14 PM »
One thing to remember about the CWOP quality info is that the graph you see is only showing the last 24 hours of data while the default quality rating is based on the previous 28 days.

You can select other ranges "All the means and standard deviations shown below are from the last 28 days. Change analysis period to Last 3 days  Last 7 days  Last 14 days  Last 8 weeks  Last 13 weeks  Last 26 weeks  Last 39 weeks".

If you've had a report showing bad data it will continue to show bad until that data rolls off the chart. By selecting a shorter period such as, "Last 3 days", will show the results for the past 72 hours only and thus, let you how you are doing for that shorter period of time.

Hope I'm making sense here. If not, let me know and I'll try to explain it differently.
Don - W3DRM - Emmett, Idaho --- Blitzortung ID: 808 --- FlightRadar24 ID: F-KBOI7
Davis Wireless VP2, WD 10.37s150,
StartWatch, VirtualVP, VPLive, Win10 Pro
--- Logitech HD Pro C920 webcam (off-line)
--- RIPE Atlas Probe - 32849

Offline mikejeep

  • Member
  • *
  • Posts: 29
Re: CWOP MADIS Rating?
« Reply #13 on: November 05, 2006, 05:42:35 AM »
Quote from: "ocala"
It only takes a few reporting stations to throw the whole thing out of wack. There is a PWS that just came online by me and his pressure data is way off.


Yeah, I have one station in particular that is within a mile of me that is way off on most values, especially barometric pressure.  Makes it tough to nail down how accurate my graphs really are...  :?

-Mike

Offline Anthony

  • Forecaster
  • *****
  • Posts: 1707
    • Anthony's Weather
Re: CWOP MADIS Rating?
« Reply #14 on: November 05, 2006, 08:52:21 AM »
How I don't get off topic here but here goes. I've always had a problem with my dew point temperature which means my humidity is also wrong. My pressure is always right on. And for along time my temperature was right on. Now all of a sudden my temperature is not. I wonder what could have happened to effect my temperature readings? If you want to viwe my data is listed under my ham radio call WB8YUE.


Thanks,
Anthony
WB8YUE

Offline Ravenstar

  • Senior Contributor
  • ****
  • Posts: 180
    • http://veronaweather.com
Re: CWOP MADIS Rating?
« Reply #15 on: November 05, 2006, 11:56:00 PM »
Hi Anthony, your CWOP temp chart for 11/05 yesterday passed QC checks and actually got a two thumbs up MADIS rating. I looked at other days and see where it failed (dreaded red X).

It sounds to me as though your sensors need calibrating. I'd recommend a hygrometer. I don't have one but plan on getting one one of these days, hopefully before my readings start to go fluy. This way you could calibrate and get everything back on track.

I also know you are contemplating a new station, Davis Vantage Pro. So guess it's a matter of priorities.

BTW Don you made perfect sense. Sometimes I can't see the forest I'm so focused in on a single tree. :)


Vantage pro 2 (wireless)

Offline W3DRM

  • Forecaster
  • *****
  • Posts: 3360
    • Emmett Weather
Re: CWOP MADIS Rating?
« Reply #16 on: November 06, 2006, 12:44:27 AM »
Anthony,

Your amateur callsign is WB8YUE  but your CWOP id is "AR263" which is what is used to display your analysis data "http://weather.gladstonefamily.net/site/AR263".

In looking over your data, it appears that your temperature sensor is reading lower (colder) than the analysis data is expecting it should read. That is why you are getting the error indicator. Not sure why it would suddenly change. Have you made any changes to your wx station? If not, check all connections to be sure none of them have become corroded. Sometimes, just unplugging and plugging in the connectors will clean the contacts just enough to eliminate the problem.

Also, I see something that is really strange. You show a RED "X" for temperature but have two GREEN THUMBS-UP indicators. Can't imagine how that could be!
Don - W3DRM - Emmett, Idaho --- Blitzortung ID: 808 --- FlightRadar24 ID: F-KBOI7
Davis Wireless VP2, WD 10.37s150,
StartWatch, VirtualVP, VPLive, Win10 Pro
--- Logitech HD Pro C920 webcam (off-line)
--- RIPE Atlas Probe - 32849

Offline Ravenstar

  • Senior Contributor
  • ****
  • Posts: 180
    • http://veronaweather.com
Re: CWOP MADIS Rating?
« Reply #17 on: November 06, 2006, 02:23:09 AM »
Don, if you put this url in it changes to AR263 automatically:
http://weather.gladstonefamily.net/site/WB8YUE


Vantage pro 2 (wireless)

Offline Anthony

  • Forecaster
  • *****
  • Posts: 1707
    • Anthony's Weather
Re: CWOP MADIS Rating?
« Reply #18 on: November 06, 2006, 06:35:36 AM »
Something else I noticed that was strange concerns dew point. The two green thumbs and if you place your pointer over them it gives you are percentage. Which I guess it the percentage of time that the data is incorrect?

On a second note. Where do you request to have the quailty control reports e-mailed to you on a daily basis? I've looked around on the cwop web site but have not been able to find it.


Thanks,
Anthony
WB8YUE

Offline kray1000

  • Purveyor of wry
  • Forecaster
  • *****
  • Posts: 1336
    • http://www.roanokevalleyweather.com
Re: CWOP MADIS Rating?
« Reply #19 on: November 06, 2006, 07:48:07 AM »
Quote from: "ocala"
CW1118

http://weather.gladstonefamily.net/site/C1118


If I change the time from 4 weeks to 26 weeks (or more), the green thumbs appear.  Don't know why they won't appear for time periods less than that.  :?:   Your data appears to track pretty closely to the analysis.

Liked your station pictures, by the way...

Offline W3DRM

  • Forecaster
  • *****
  • Posts: 3360
    • Emmett Weather
Re: CWOP MADIS Rating?
« Reply #20 on: November 06, 2006, 11:26:53 AM »
Quote from: "Anthony"
...On a second note. Where do you request to have the quailty control reports e-mailed to you on a daily basis? I've looked around on the cwop web site but have not been able to find it.


Anthony,

Go to the following link to sign up for daily quality emails that show you what portion(s), if any, of your data is not within expected values.
    http://weather.gladstonefamily.net/weather-qc[/list]Just enter your email address and amateur radio  callsign (or CWOP id for non-amateur radio operators).
    Don - W3DRM - Emmett, Idaho --- Blitzortung ID: 808 --- FlightRadar24 ID: F-KBOI7
    Davis Wireless VP2, WD 10.37s150,
    StartWatch, VirtualVP, VPLive, Win10 Pro
    --- Logitech HD Pro C920 webcam (off-line)
    --- RIPE Atlas Probe - 32849

    Offline ocala

    • Forecaster
    • *****
    • Posts: 4396
    • The blues had a baby and named it rock n roll
    Re: CWOP MADIS Rating?
    « Reply #21 on: November 06, 2006, 02:19:22 PM »
    Anthony you may want to check the actual sensor itself. If its inside a radiation shield there could be a bee's nest or a huge colony of spiders on the sensor blocking the ports.

    Offline Anthony

    • Forecaster
    • *****
    • Posts: 1707
      • Anthony's Weather
    Re: CWOP MADIS Rating?
    « Reply #22 on: November 06, 2006, 03:56:58 PM »
    Don, Thanks for the link. I'm all signed up.

    Ocala, thanks for the suggestion. Right now I am currently using my Ch 1 sensor. It is in a shield and the sensor and the shield are clean as I just replaced the batteries in the sensor. I started using this sensor in hopes it would make a difference with my dewpoint readings. But alias it has not.

    This sensor does provide better temperature readings that my main sensor does even thou it is also inside a shield.

    As far as me getting a Davis anytime soon. Things aren't looking good. There needs to be a financial assistance program for us weather observers.


    Thanks,
    Anthony
    WB8YUE

    Offline Ravenstar

    • Senior Contributor
    • ****
    • Posts: 180
      • http://veronaweather.com
    Re: CWOP MADIS Rating?
    « Reply #23 on: November 06, 2006, 06:37:16 PM »
    I started looking thru the wxqc (CWOP) mailing list archive for some answers to this MADIS issue. Here's one I found from a Philip Gladstone answering a question as to what the MADIS QC checks mean:

    Quote

    Philip Gladstone philip at gladstonefamily.net
    Sun Oct 29 21:44:36 CST 2006

        * Previous message: [wxqc] MADIS rating
        * Next message: [wxqc] MADIS rating
        * Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

    The answer is that there is no explanation (as of yet). However, the
    idea is that the MADIS rating indicates how many of your readings pass
    the QC checks.

    I got a bumch of grief from some people who got a red cross, and yet
    they were passing the MADIS checks. This way, you get to see both bits
    of information.

    Suggestions for improvement welcome, so expect the fine details to
    change over the coming weeks.

    Philip

    ============= Original Question ==================
    [Name edited out] wrote:
    > Hi,
    >  
    > Looks like there is a new feature on the Quality Checking page, called a
    > Madis Rating.   Is there a explanation for this new rating system
    > somewhere?  I guess I did OK, I got two thumbs up and a 96% QC OK (hover
    > over the rating) for temperature and two TU and 98% QC OK.


    I'll keep monitoring the mailing list.


    Vantage pro 2 (wireless)

    Offline Anthony

    • Forecaster
    • *****
    • Posts: 1707
      • Anthony's Weather
    Re: CWOP MADIS Rating?
    « Reply #24 on: November 07, 2006, 08:02:04 AM »
    Well that explanes the red "X" yet the green thumbs on my dew point. But it still doesn't make and sense. How can it pass one and not the other?


    Thanks,
    Anthony
    WB8YUE

     

    anything