After doing a little snooping it seems the more ground clutter you have in the image, trees, grass, buildings etc the less blue the sky there is. Images that were mostly just sky had much more blue sky. Direction didn't seem to make a difference. Generally speaking.
If you guys could chime in about the above in regards to your images it would be appreciated.