WXforum.net

Weather Station Hardware => AcuRite Weather Stations => Topic started by: gnuloco on March 20, 2018, 11:31:15 AM

Title: Retrieve Data from Atlas
Post by: gnuloco on March 20, 2018, 11:31:15 AM
Hello!

Noob here, looking to somehow get the data from my Atlas setup? Looking to use the data (realtime as possible) for a local intranet website.  I do realize that there is a CSV file on the SD card, but is there any other method for collecting this data?

Thank you in advance,
Title: Re: Retrieve Data from Atlas
Post by: alanb on March 20, 2018, 01:21:31 PM
You must be a beta tester as the Atlas doesn't seem to be for sale yet. Don't you get some kind of preferential tech support from Acurite as a beta tester?
Title: Re: Retrieve Data from Atlas
Post by: gnuloco on March 20, 2018, 01:24:08 PM
I signed an NDA and installed to specifications. Working well.

I will have to call them I suppose. Will report back if I figure anything out.
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 20, 2018, 02:47:15 PM
Hello!

Noob here, looking to somehow get the data from my Atlas setup? Looking to use the data (realtime as possible) for a local intranet website.  I do realize that there is a CSV file on the SD card, but is there any other method for collecting this data?

Thank you in advance,

At the moment the best you can do is sniff the data enroute to wunderground.  The wunderground data from the Atlas is unencrypted and sent rapid fire.

Another option would be to use RTL_433 to retrieve data off-the-air, but I'm not aware of anyone who has decoded the data yet.
Title: Re: Retrieve Data from Atlas
Post by: waiukuweather on March 20, 2018, 02:52:05 PM
this is your data
it is not good that its such a closed system like it is
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 20, 2018, 03:02:18 PM
this is your data
it is not good that its such a closed system like it is

There are two "official" ways to get to your data... from the myAcurite website and from the SD card.

There's nothing to preclude another method of access being added in the future.
Title: Re: Retrieve Data from Atlas
Post by: Bushman on March 20, 2018, 04:39:54 PM
SD card?  Hmmm.... could you use one of those Wifi SD cards that they have form cameras??
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 20, 2018, 04:52:18 PM
SD card?  Hmmm.... could you use one of those Wifi SD cards that they have form cameras??

Maybe.  I used to have an Eye-Fi SD card, but unfortunately I haven't been able to find it.

One "gotcha", though, is that the 10-second logged data is first held in an internal buffer, then the buffer is dumped to the SD card every 20 minutes, so it wouldn't be exactly "real-time".
Title: Re: Retrieve Data from Atlas
Post by: waiukuweather on March 20, 2018, 09:21:06 PM
but does the myacurite web site allow you to actually get YOUR data for your own use/logging/analysis ,etc?
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 20, 2018, 09:50:33 PM
but does the myacurite web site allow you to actually get YOUR data for your own use/logging/analysis ,etc?

What other data would they send you?  It's provided as a CSV file.
Title: Re: Retrieve Data from Atlas
Post by: waiukuweather on March 20, 2018, 10:46:42 PM
so you can download the data as a CSV file?
can that be auto?

waiting for the next drip feed of info
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 20, 2018, 10:50:58 PM
so you can download the data as a CSV file?
can that be auto?

waiting for the next drip feed of info

Yes, it's a CSV file.

Currently there is no way to automate it on myAcurite's end.  You have to hit the download button and specify the time period you are interested in.  Then a few minutes later they send you an email with a link that downloads the file.
Title: Re: Retrieve Data from Atlas
Post by: BeaverMeadow on March 20, 2018, 10:51:19 PM
but does the myacurite web site allow you to actually get YOUR data for your own use/logging/analysis ,etc?

You can download 30 days max so you must do this every month if you want the data for personal use.
Title: Re: Retrieve Data from Atlas
Post by: waiukuweather on March 20, 2018, 11:09:31 PM
personally I think its terrible how Acuite locks up YOUR data like this
I would be looking at other stations
not sure how anyone can defend how this works
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 20, 2018, 11:18:35 PM
personally I think its terrible how Acuite locks up YOUR data like this
I would be looking at other stations
not sure how anyone can defend how this works

What exactly are you talking about?

You can get your data in two different ways.  How is it "locked up"?
Title: Re: Retrieve Data from Atlas
Post by: waiukuweather on March 20, 2018, 11:28:54 PM
so you are defending this?
that the only way you can get YOUR data is by manually clicking to get a CSV file?
that is very restrictive

not sure how you can defend that
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 20, 2018, 11:36:10 PM
so you are defending this?
that the only way you can get YOUR data is by manually clicking to get a CSV file?
that is very restrictive

not sure how you can defend that

Who said that is the "only way" to get your data?  Remember the SD card mentioned earlier?

And I also said the current methods don't preclude other methods being added in the future.

Your data isn't "locked up".
Title: Re: Retrieve Data from Atlas
Post by: BeaverMeadow on March 21, 2018, 12:31:53 AM
Hello!

Noob here, looking to somehow get the data from my Atlas setup? Looking to use the data (realtime as possible) for a local intranet website.  I do realize that there is a CSV file on the SD card, but is there any other method for collecting this data?

Thank you in advance,

At the moment the best you can do is sniff the data enroute to wunderground.  The wunderground data from the Atlas is unencrypted and sent rapid fire.

Another option would be to use RTL_433 to retrieve data off-the-air, but I'm not aware of anyone who has decoded the data yet.

Would it be a good idea for Acurite to give their customers the key to decode this data or are there valid reasons for them to keep it proprietary, and how do other companies like Davis and Ambient handle the data being transmitted from their weather stations?

Title: Re: Retrieve Data from Atlas
Post by: waiukuweather on March 21, 2018, 12:59:08 AM
since they have a powered hub, why do they not make the real time data available from that (e.g UDP broadcasts)
its YOUR data
it should be made easily available for you to use (i.e having that flexibility/option)

Title: Re: Retrieve Data from Atlas
Post by: Bushman on March 21, 2018, 05:13:23 PM
Unless Chaney decides to use some stupid strong encryption that will likely mess their system up, it is only a matter of time before the data stream is decoded.  Information yearns to be free!
Title: Re: Retrieve Data from Atlas
Post by: KC5JIM on March 21, 2018, 05:43:56 PM
so you are defending this?
that the only way you can get YOUR data is by manually clicking to get a CSV file?
that is very restrictive

not sure how you can defend that

Who said that is the "only way" to get your data?  Remember the SD card mentioned earlier?

And I also said the current methods don't preclude other methods being added in the future.

Your data isn't "locked up".

If you want the real time data stream it IS locked up. Refusing to let you access YOUR weather data stream in real time for use in any way that YOU see fit is draconian.
Title: Re: Retrieve Data from Atlas
Post by: KC5JIM on March 21, 2018, 06:07:15 PM
so you are defending this?
that the only way you can get YOUR data is by manually clicking to get a CSV file?
that is very restrictive

not sure how you can defend that

Who said that is the "only way" to get your data?  Remember the SD card mentioned earlier?

And I also said the current methods don't preclude other methods being added in the future.

Your data isn't "locked up".

"There have been some technical changes that will make network interception of the data more difficult, if not impossible.  Data is encrypted going to myAcurite.  Data to wunderground is currently not.  That could always change, though."

Proves to me that the end game for AcuRite is to FORCE people to PAY for access to My AcuRite to get real time access to YOUR data unless you are sitting at home in front of the screen. There is simply no excuse for this behavior by AcuRite, and stating that "It might change in the future" is simply AcuRite fanaticism. It DID change, to the ENCRYPTION that you mentioned. Since they went to the expense to encrypt the data, there is no chance that they will simply decide to throw that away - that is their golden ticket to fleece the consumer.
Title: Re: Retrieve Data from Atlas
Post by: vreihen on March 21, 2018, 06:50:55 PM
If you want the real time data stream it IS locked up. Refusing to let you access YOUR weather data stream in real time for use in any way that YOU see fit is draconian.

They are definitely one-upping Netatmo, the poster child for un-tappable data streams with consumer-grade sampling intervals.....
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 21, 2018, 07:13:33 PM
Proves to me that the end game for AcuRite is to FORCE people to PAY for access to My AcuRite to get real time access to YOUR data unless you are sitting at home in front of the screen. There is simply no excuse for this behavior by AcuRite, and spouting off that "It might change in the future" is simply AcuRite fanboisism. It DID change, to the ENCRYPTION that you mentioned. Since they went to the expense to encrypt the data, there is no chance that they will simply decide to throw that away - that is their golden ticket to fleece the consumer.

I mentioned that wunderground data is currently unencrypted but that could eventually change.  How you can interpret that as "AcuRite fanboisism" (sic) is beyond me.

In any case, I'm just describing how things were during the Atlas beta test.  It was not the final product, and it will likely continue to evolve after the initial release.

No one is going to be holding your data "hostage". 
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 21, 2018, 07:17:46 PM
If you want the real time data stream it IS locked up. Refusing to let you access YOUR weather data stream in real time for use in any way that YOU see fit is draconian.

They are definitely one-upping Netatmo, the poster child for un-tappable data streams with consumer-grade sampling intervals.....

But isn't encryption the road that everyone seems to be taking nowadays?  Continued gleaning of data from the network just doesn't seem like it's going to be practical in the future as everyone is demanding "privacy".
Title: Re: Retrieve Data from Atlas
Post by: KC5JIM on March 21, 2018, 07:24:02 PM
If you want the real time data stream it IS locked up. Refusing to let you access YOUR weather data stream in real time for use in any way that YOU see fit is draconian.

They are definitely one-upping Netatmo, the poster child for un-tappable data streams with consumer-grade sampling intervals.....

But isn't encryption the road that everyone seems to be taking nowadays?  Continued gleaning of data from the network just doesn't seem like it's going to be practical in the future as everyone is demanding "privacy".

I have not met one single person that is concerned with the "privacy" of their weather data. That is a nonsensical argument. There is NOTHING related to PII (personally identifiable information) contained in weather data - it's not like the sun embeds the GPS coordinates of your toothbrush in it's rays, or the wind embeds your SSN in each breeze, or the rain carries your bank account information within each drop, or the barometric pressure knows your date of birth...
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 21, 2018, 07:38:55 PM
If you want the real time data stream it IS locked up. Refusing to let you access YOUR weather data stream in real time for use in any way that YOU see fit is draconian.

They are definitely one-upping Netatmo, the poster child for un-tappable data streams with consumer-grade sampling intervals.....

But isn't encryption the road that everyone seems to be taking nowadays?  Continued gleaning of data from the network just doesn't seem like it's going to be practical in the future as everyone is demanding "privacy".

I have not met one single person that is concerned with the "privacy" of their weather data. That is a nonsensical argument. There is NOTHING related to PII (personally identifiable information) contained in weather data - it's not like the sun embeds the GPS coordinates of your toothbrush in it's rays, or the wind embeds your SSN in each breeze, or the rain carries your bank account information within each drop, or the barometric pressure knows your date of birth...

I've met many.  I agree that privacy isn't a terribly good argument for weather data, but the "encrypt everywhere" folks are quite insistent.

Given the half-hearted way Acurite implemented the encryption, it seems more of a marketing bullet point ("Yes!  We Encrypt!") to give people a warm-fuzzy that their data is safe from the evil hackers.
Title: Re: Retrieve Data from Atlas
Post by: vreihen on March 22, 2018, 07:09:01 AM
But isn't encryption the road that everyone seems to be taking nowadays?  Continued gleaning of data from the network just doesn't seem like it's going to be practical in the future as everyone is demanding "privacy".

Kudos to WeatherFlow for putting the live observations out via UDP broadcasts to the local subnet for any device to pick off without resorting to MitM packet interceptor hacks.  Proof that a vendor *can* make the data freely available locally...if they want to.  I'd be buying whatever Acu-Rite's hub of the week is in a heartbeat if it did this.....
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 22, 2018, 08:13:34 AM
But isn't encryption the road that everyone seems to be taking nowadays?  Continued gleaning of data from the network just doesn't seem like it's going to be practical in the future as everyone is demanding "privacy".

Kudos to WeatherFlow for putting the live observations out via UDP broadcasts to the local subnet for any device to pick off without resorting to MitM packet interceptor hacks.  Proof that a vendor *can* make the data freely available locally...if they want to.  I'd be buying whatever Acu-Rite's hub of the week is in a heartbeat if it did this.....

Or you could just stream the data directly from the device, removing the restriction of having to be on the local subnet to get the data.

There are a number of ways you can connect devices on the network level, but I'll bet most consumers are looking more for some type of SmartHome integration so they don't have to do any low-level programming.

Acurite isn't blind to that.  Why do you think they were in the SmartHome section of CES18?  They obviously know they can't be an island.
Title: Re: Retrieve Data from Atlas
Post by: gnuloco on March 22, 2018, 06:21:32 PM
I guess I need to clarify, I do not have an uplink to Acurite. My access light is blue but when I try to add my device to the website or App it tells me that I need to have it connected to the internet.

I'm thinking my device ID isn't in the database yet or something.  I have an email into their support, will report back with how I got it fixed as well as what options I have for data from the device or website.

Thanks for your comments!
Title: Re: Retrieve Data from Atlas
Post by: nincehelser on March 22, 2018, 09:03:54 PM
I guess I need to clarify, I do not have an uplink to Acurite. My access light is blue but when I try to add my device to the website or App it tells me that I need to have it connected to the internet.

I'm thinking my device ID isn't in the database yet or something.  I have an email into their support, will report back with how I got it fixed as well as what options I have for data from the device or website.

Thanks for your comments!

Probably one of the more common problems is mis-reading the MAC label on the bottom of the Access.  Personally, I always take a clear picture of the MAC label with my smartphone for future reference.

Folks often confuse the "eight" and "bee", and also the "dee", "zero", and "oh".  ("Oh" is never used)