Excursions by Amit Gawande

Files are fraught with peril

A really great article summarizing the perils of files and writes and file systems. And also on why exactly consumers should care. Especially, the below excerpt on cost of data corruption is bang on.

(…) if we look at how consumer software works, it’s usually quite unsafe with respect to handling data. IMO, the key difference here is that when a huge tech company loses data, whether that’s data on who’s likely to click on which ads or user emails, the company pays the cost, directly or indirectly and the cost is large enough that it’s obviously correct to spend a lot of effort to avoid data loss. But when consumers have data corruption on their own machines, they’re mostly not sophisticated enough to know who’s at fault, so the company can avoid taking the brunt of the blame. If we have a global optimization function, the math is the same — of course we should put more effort into protecting data on consumer machines. But if we’re a company that’s locally optimizing for our own benefit, the math works out differently and maybe it’s not worth it to spend a lot of effort on avoiding data corruption.

links
Have you posted a response to this? Provide the URL.