Personal Update: I’m taking some time off from daily posting until January 2nd, 2007, much to Ms. Mojo’s relief. There may be some things I just can’t resist. Just don’t expect daily posts. Cheers,
Robin
I did a post on the /. Apple forum and got back an interesting response from someone who, IMHO, is test driving some FUD for their employer. Smart, articulate and close enough to the truth to know better. This is the opening of another front in the war to marginalize ZFS, Apple and Sun.
Here is the their original response. They responded to my bullet points, which are included in the quote, and then my response to each point is inserted between the quote sections.
I flamed more than I usually do. There must be something about those /. forums that bring out the beast in me.
Re:Good Reasons To Support ZFS on Mac
(Score:2)
by Junta (36770) on Tuesday December 19, @12:53PM (#17304700)
-No RAID controllers needed: ZFS gives you fast RAID for free. Just add drives.Not particularly new, systems have been fast enough for general software raid for a long time. ZFS has the opportunity to leverage FS-level knowledge to milk some efficiency out of things that block-level approaches cannot, but ultimately ZFS isn’t obsoleting the need for RAID controllers any more than software RAID already has. I admit that there are a lot of proprietary RAID controllers employed where they shouldn’t be, but that’s not a technical problem, it’s a perception problem, ZFS won’t fix that.
Hard to know where to start. Do you work for Microsoft? You aren’t stupid, and are well-written, so I won’t sugar coat this.
ZFS RAID: ZFS does full stripe writes, all the time, which are the fastest software RAID writes, thanks to variable stripe writes. This does, in fact, obsolete mid-range HW RAID.
-No more Disk Warrior. The entire data store is self-validating. No bit rot.
ZFS doesn’t mandate the storage pool be implemented in any particularly redundant way. If you have just one drive, it’s fairly obviously non-redundant. If you add a second drive, it may or may not be a mirror of the first one, depending on how each was added to the pool. Every indication I have seen shows that ZFS checksumming helps detect data integrity errors, and does not implement ECC. It detects block-level silent data corruption, and if the pool is configured just so, the subsystem can reroute things and alert user to service need. If Apples always ship with two drives, it could get clever, but it isn’t magical.
Self-validating the data store is independent of RAID. If you don’t understand this, it is back to school time. File systems are supposed to be independent of the underlying infrastructure.
-No more volumes and, therefore, no more volume management. ZFS eliminates the whole volume concept. Add a disk to your system and it joins your storage pool. More capacity. Not more management.
For the most part ZFS simplifies it, but not all storage will be wanted in the pool. One shining long term example is removable media (optical and flash). Another is so far, even Sun hasn’t figured out how to boot from it, so you will have some volume management still, just adding an external hard disk can be made much much easier than under Linux or Windows.(New uninitialized device detected, add to (cute volume name) or…
Apple engineers can figure out how to boot from it. Not a priority for Sun, whose E10K’s required an internal SCSI disk for years to boot.
-Continuous Data Protection out of the box. Time Machine could give you a view of your data every time you update a file.
ZFS as far as I can see is not a versioned filesystem where every single modification is tracked. It has built-in snapshotting functionality, and therefore makes an easy way to implement time machine backend (or at least offloaded to Sun to sweat the details instead of Apple), perhaps even lower impact at snapshotting time than Time Machine’s current implementation, but it won’t continuously track changes.
Versioning isn’t the same as CDP, as you well know. Since snapshots in ZFS are cheaper than overwrites, it would be simple – and I have no idea what APPL engineers are implementing – to snapshot before every ~Documents write. And your point is???
-ITV, or whatever it is going to be called. Multi-GB files that each cost $10-20, that can’t be backed up – thanks DRM! – and therefore need a cheap and highly reliable RAID. ITV, two firewire drives, ZFS and you are in business.
Not enough details are available to ascertain how it will work, but while the savvy get the point (my Myth setup separates backend and frontend to have more robust, but noiser measures to protect stuff), by and large mass-market set top boxes get away without redundancy.
Today’s set-top boxes aren’t hoping you will spend thousands of dollars purchasing copies of content that they won’t let you back up. ITV is. So Apple is suddenly going to offer a generic set-top box? WTF?
-Not to mention the existential pleasure of having great technology that Vista doesn’t have. In fact, since consumer technology is driving the enterprise, expect ZFS on Mac to raise the bar for every OS and file system.
ZFS on Mac will likely do little to nothing to raise the bar in the enterprise beyond Solaris doing it. I admit ZFS is the one nugget Sun has brought out for Solaris that has me curious, but OSX’s embracing it didn’t extend it more. ZFS is among their biggest assets, and they clearly want either revenue or Solaris acceptance from it (hence licensing that precludes it from linux, their primary competitive solution). I think someone was on to something when they discussed the Sun/Apple relationship long term. Solaris, *particularly* thanks to ZFS can perform server-side tasks competently and still has some mindshare. Solaris workstations, however, are largely considered unneeded and counter-productive in ease of use nowadays. Apple has not captured server mindshare (and in fact makes crappy server products hardware wise relative to the competition including Sun), but no one argues that OSX is too hard to be a desktop/workstation system (though maybe lacking critical application support)…. To date Apple has been fairly hands-off about ‘solutions’ involving other platforms (i.e. windows and linux). They’ve tried to do servers but ultimately their marketing image doesn’t align with that part of the market even if they did put together a competent hardware platform. If they did ally with Sun to try to push into the professional space, it *could* be interesting, if not too late for Sun at least.
You don’t know a frikkin’ thing about technology diffusion, do you? A hint: when you get hundreds of thousands of people going to work and telling the CIO that my home system does this and this and your expensive proprietary system doesn’t, that raises the bar. Remember when PC’s and VisiCalc were new, and smart guys would rip IT a new one because their batch IBM 4300s couldn’t respond as quickly as a $3k PC? No bells ringing?
Apple doesn’t care about the enterprise. The enterprise is the elephant’s graveyard of IT companies. The enterprise is coming to Apple, and companies like Apple, not vice-versa.
Comments welcome, as always. Flame bait won’t be published. Serious comments only, please. Moderation on to deflect comment spam.
Overall, very much agree with the article. We’ve been using ZFS for awhile now for our OLTP databases and love it. Just don’t agree that the enterprise is the elephant’s graveyard of IT. ๐ Too many interesting difficult scaling problems that the average consumer doesn’t see…ZFS solving a lot of them in storage. ๐
Jason, thanks for the comment. I’d like to hear more about your experience with ZFS for OLTP. If you are using Oracle, Kevin Closson might want to hear also.
As for the “elephant’s graveyard” comment – that is a topic for a future post that I think you will enjoy.
Robin
Couple of very interesting ZFS posts. This blog doesn’t seem to know about the “world-class” ZFS posts on StorageMojo. I did a search and they have several StorageMojo references but none on ZFS?
“Why ZFS?”
Montag, 18. Dezember 2006
http://www.c0t0d0s0.org/archives/2410-Why-ZFS.html
[Article excerpt]
“Itรยดs really really cool that ZFS will be integrated into Leopard.
When you read forums like digg or slashdot there seems to be an utter
absence of creativity or knowledge, about the advantages someone gets
by using ZFS in client operating systems.
To get a view of the benefits, i will describe my workflows on
hahdafang, my primary mac@home:”
“Economics of ZFS” from the same blog:
http://www.c0t0d0s0.org/archives/2413-Economics-of-ZFS.html
[article referenced in the above post]
“Paul Murphy posted a good article about ZFS economics in his blog.”
[Source article]
“ZFS, HW RAID, and expensive mis-apprehensions”
Posted by Paul Murphy @ 12:15 am
http://blogs.zdnet.com/Murphy/?p=759
[article excerpt]
“Solaris 10 now ships with ZFS – and ZFS obsoletes both PC style RAID controllers and the external RAID controllers used with bigger systems.”
okay, lots of flaming indeed. But the guy really has a point.
ZFS is great technologie and i agree with you it will give Apple something Vista lacks after they lost WinFS. So it’s a advantage but it’s not ht ehloy grail of IT and there are lots of nice solutions for normal workstations to get the same amount of datasecurity.
It’s a pity everyone with another bias gets a MS tag. Do not kill the discussion just because the other partner has unwanted points. Flaming sometimes is nice, but do not become a Fanboy. please!
Robert,
Thanks for the links, I’ll check them out.
Se,
I am a ZFS fan. I think it is great technology and I don’t agree that there are similar solutions available. Pools, verifiable data integrity, “free” snapshots, file systems as a practical management tool, fast software RAID – I think it is technology well worth getting excited about.
While I asked the question if the respondent might work for Microsoft, it could be any company who has the imagination to look at the potential of ZFS and the design moxie of Apple and think that the sleepy, ingrown world of storage is about to get a thorough shaking.
The larger issue is this: digital media and, if you will, a digital life, requires reliable digital storage. ZFS is a massive step forward from the timeworn paradigms of the past. It will take time, but I expect that Apple, as they already have with Time Machine, will demonstrate that the lasting problems of storage can be turned into competitive advantage with intuitively obvious solutions based on ZFS.
Commoditized RAID. CDP and recovery, all demonstrated on millions of Macs, will shake up the industry. It will make the pain Microsoft has suffered around Internet Explorer look like small beer, because, after all, we are talking about the user’s data, not their browsing experience.
I’ll probably expand on these thoughts later. Rest assured, I welcome honest dialogue on these issues, and I’m noodling away on them myself. In the meantime if you can point me to products that are equivalent to ZFS I’d be happy to look at them. Cheers!
Robin
about the problesm around booting form ZFS
http://blogs.sun.com/tabriz/entry/zfs_boot
nice story
i guess you know the wiki:
http://en.wikipedia.org/wiki/Zfs
Interestingly enough, ZFS is better suited to a company like apple than Sun. Sun has too many filesystems (QFS, SAMFS and now ZFS to name a few). They each have their advantages and disadvantages… but a server centric filesystem is probably a better fit with the consumer, low end IT space than the high end enterprise.
Things that ZFS was not designed to handle are things like being a SAN filesystem (like CXFS, Exagrid, Polyserve, and QFS). Perhaps I’m getting too technical, but the differences are big. From a storage perspective, ZFS is a step back from Sun’s QFS, because it is server centric, and doesn’t provide multi system use of the same storage (like a SAN / Cluster FS). Sure, it provides a lot of nice benefits, but the benefits it does provide aren’t needed by high-end storage most of the time anyway (except perhaps integrated volume management).
Again, in the consumer / low end IT space, that isn’t a problem. However in the high end, data center and HPC segments, that is a HUGE problem.
Thus, ZFS is a great fit for Apple, and only an OK fit for Sun. Sun’s biggest problem right now as I see it is their desire to force fit ZFS into everything, including places it doesn’t belong like high end data-centers with multi system access requirements, which is EXACTLY where something like QFS (or Polyserve, Clustre, etc. etc.) do belong.