On 15 May 2014 13:59, Ewan Slater ewan.slater@googlemail.com wrote:
Dropbox or a NoSQL database in the cloud?
We currently use some pretty cheap cloud storage which is fine, but we now have a requirement to run some scripts on the data so we need to move away from pure storage.
In truth though, no matter where the data is stored I have an instinctive dislike for storing large text files in an uncompressed format. Maybe this goes back to using Stacker under DOS all those many years ago, but the fact is that CPUs are faster than disks and generally it's quicker to retrieve a compressed file and uncompress it than it is to retrieve an uncompressed file, so as long as it can be done transparently that would be my preference. One of the few features I miss from Windows is the NTFS compression option, which I regularly use in areas where it makes sense (eg log directories). In contrast Linux makes it incredibly easy to work with compressed files (eg .gz/.bz2), but not so much when the compression needs to be "invisible".
Mark