Author Topic: Analysing weather data  (Read 2154 times)

0 Members and 1 Guest are viewing this topic.

Offline sleepy67

  • Member
  • *
  • Posts: 3
Analysing weather data
« on: February 15, 2025, 04:37:10 PM »
Hi,
I'm wondering how people analyse their weather data.  My station uploads to ecowitt and wunderground and scrape this data on Ubuntu into a csv.

So I have just under half million rows of data, which is nice, but information overload.

I've tried Power BI, but it's a bit restrictive using it from a home account, so I'm now trying Tableau.

Has anyone else used any data analysis tools?  I'm keen to share and learn.

Thanks
Tony

Offline R.Sidetrack

  • Senior Contributor
  • ****
  • Posts: 298
Re: Analysing weather data
« Reply #1 on: February 15, 2025, 08:33:25 PM »
Its not clear to me exactly what kind of data analysis you want to do, but perhaps CumulusMX might be useful?
https://cumuluswiki.org/a/Software

CumulusMX can pull data directly from your local Ecowitt gateway, so data collection is not dependent on your internet connection.

As you mentioned Ubuntu, I'll point out that there is a Raspberry Pi image with CumulusMX which may be of interest.
« Last Edit: February 15, 2025, 10:07:46 PM by R.Sidetrack »
Graham

--- Variety of 'discrete' Ecowitt devices; CumulusMX on Raspberry Pi4 ---

Offline weatherdoc

  • Senior Contributor
  • ****
  • Posts: 280
    • Weather Doc's Weather
Re: Analysing weather data
« Reply #2 on: February 16, 2025, 08:04:18 AM »
As @R.Sidetrack said, it depends what kind of analysis you want to do. I use Weather Display and have multiple ways of displaying the data:

https://wxdoc.info/tabular.php
https://wxdoc.info/wxhistory.php
https://wxdoc.info/wxwuhistory.php
https://wxdoc.info/202502-daily-charts.php
https://wxdoc.info/climaterecordfeb2025.php
https://wxdoc.info/wxrecords.php

For any specific weather events in which I wanted to dig deeper or customize the data I just use Excel. Tableau graphs look nicer than Excel, IMHO.

Offline DesertRatR

  • Member
  • *
  • Posts: 2
Re: Analysing weather data
« Reply #3 on: March 07, 2025, 03:44:42 PM »
Brand new to this forum, here goes. My Ambient Weather station downloads csv data in 5 min increments. It provides pretty much anything the backyard hobbyist cares about. Plenty for me to work with in a spreadsheet. I prefer xy plots, rather than color contours, so it works.

Offline sleepy67

  • Member
  • *
  • Posts: 3
Re: Analysing weather data
« Reply #4 on: March 09, 2025, 09:35:32 AM »
I have been getting used to Tableau, the lite public version which is free to use and have found it gives me easy access to year on year graphs.  Now I am only a beginner here but the graphs are quite easy to generate for any of the fields imported in the excel.
 [ You are not allowed to view attachments ]
 [ You are not allowed to view attachments ]

Offline sleepy67

  • Member
  • *
  • Posts: 3
Re: Analysing weather data
« Reply #5 on: May 13, 2025, 04:54:11 PM »
Hi.  Bit of an update on using Tableau to graphically represent weather data.  Fig1 focuses on temperatures with the upper graph grouped by year and month and the lower graph performing a count when day temp > 20 degrees.  Fig2 is quite basic and shows, for each day, pressure vs rain accumulation.  Fig3 is a weekly bar graph for rain accumulation.  There is a filter top right to select date ranges and each bar is a weeks worth of rain with the blocks showing when it rained continuously.
Hope this is helpful and I'd be interested if anyone else uses Tableau.
Thanks
Tony

 

anything