The vendors all need to come up with a solution that
1) now has to handle max 320 MB/s and max 75K I/O’s per sec, but can (easily) scale to more than that
2) now has to have 15TB of nett fast storage (eg SAS 15k rpm drives) and around 45TB of nett slow storage (eg 7.2k rpm SATA-II 750GB drives), but also can scale to much higher levels
3) has to be presented to the clients (people and processing nodes) as one simple and single cluster (or namespace or some other fancy word for that).

Anyway, HP’s proposal will probably look like this:
- 2 DL380 G5 clustered servers serving as gateways
- an EVA6000 system with the SAS storage and an MSA1500 for the SATA-II storage
- PolyServe software (now inhouse HP called EFS) to enable the clustering now and for later
HP will be able to scale performance and capacity with EFS
The offer will probably be between 200-250K EUR

Dell’s offer will be something like this:
- 2 NX1950 servers in a cluster
- a Dell-EMC CX3-40 with both SAS and SATA capacity
- for the clustering and namespace stuff they need to bring in outside software co IBrix from the US as they cannot scale above the config above without breaking the single namespace/cluster req.
My guess is they know what HP can do and have to win on pricing as ther config is less appealing because of multi vendor. I think they’ll come in between 150 and 220K EUR

Then ONStor:
- 2 bobcat 2260 gateways
- in their pantera clustered system with SAS and SATA
- the bobcats come with their smart software to enable clustering now and later
- they do not provide FC switches, UPS-es or racks
My guess is they’ll come in at 250-350K

Now the big question is whether I should seriously think about Isilon here. My gut feeling is yes, although they apparent;y are a really new player in the market.
But they offer a very appealing solution and I have an idea of the price. The only thing I cannot find on their site is the throughput and IOPS so I can figure out what;s needed.

Given the pricing on this site (thank you mr s-mojo!) this is what I think the Isilon config would look like:
- 3 x IQ6000 + 3 x software > 64K + 50K = 114K USD
- 2 x switch > 19K USD
- 10 x EX6000 > 130K USD
and then some support, cables, installation/training and other stuf for 20K USD
Adding accelerator nodes is uncertain as I don’t know the capablities within above config.

This would total about 270K USD of just over 200K EUR at today’s rate.
Now two questions for you pros our there:
- is this quick&dirty calc correct or not?
- should we seriously consider this as opposd to the other 3?

I would be much obliged if anyone can shed some more light on this new development for me!

Cheers,
Ezra

http://www.exanet.com.

Just an idea, because you can get 500GB SATA-II for under $200 now. Since they’re not using RAID, the system could easily have hardware for $5000 which would be the addition of OneFS for that price.

Anyone have any more details?

-SMFX

That being said, or asked… I think avoiding a completely proprietary solution is important to budget minded companies. Sure Kodak can spend $6800 a TB without even thinking about it, but what about budget conscience companies that need to stretch every dollar.

Having a software solution across Dell or HP servers or other NAS appliances allows a company to change direction. If the selected solutions is not working then the total investment is not lost, because you still have the servers available that can be used however you like. It is very hard to throw out a $120,000 investment in 3 devices that provide 12Tb of storage, for a budget constrained company. And once you are in, you are in. There is no changing the software or hardware when a single company is providing both, and the hardware is function specific.

The fact is that clustered storage technologies are going to replace servers eventually as other companies develop appliance products to compete using clustered technology. It seems to me that Isilon has chosen to tap into the “get the most cash I can as quick as I can from the biggest companies” type of marketing mentality, as apposed to a “provide an affordable solution to as many companies as I can, while I am the leader” marketing philosophy. Is there anyone out there who provides the high availability, extremely fault tolerant solutions for the non-Kodaks?

These industrious and innovative companies should make money on their storage solutions, but I would prefer to buy three $10k servers (inflated) that have 6Tb of storage of cheap SAS, and then add the needed functionality. If I did, then I would have $90,000 left over to pay for the software and management overhead. I just can’t see that type of margin being acceptable for the average company that has storage and performance issues.

As a budget company needing to high throughput for millions of very small files, is there any recommendations that leverage fault-tolerance, performance, and ease of maintenance. I think if it takes a little bit of work to manage the system, we ca deal with that for $90k.

much obliged,

Wim

Performance is crazy, though - you can basically scale linearly according to the number of nodes in the cluster. They can all read/write in parallel.

Some of the other questions…
- Node price does include 12 X 500GB SATA drives
- Typically you can use one or two Infiniband connections. Only the first one will be used, though - the second is only there for failover. They cannot be used in a load-balancing or double-the-throughput way.
- In a full-up redundant configuration, both the front end (GigE) and back-end (Infiniband) would be dual-homed. The two GigEs in front, while going to separate switches, would probably still be on the same broadcast network.

Node “configuration” is ridiculously easy. It literally takes more time to rack the damn nodes than to add them to the cluster. Adding nodes is a matter of pressing the front panel button once - basically an acknowledgment of which cluster to add to - and takes 1-2 minutes, after which the other nodes auto-balance the data across all nodes.

Gavin can you help me calculate performance on this system? Basically if I have a few edit seats(FCP) in addition to just doing data storage what should be the sustained bandwidth I would expect from the system. To give you a little more idea the requirement is:
35 FCP seats doing DV25 (4audio) editing
40TB usable capacity

Thanks for your help.

Isilon just announced their IQ 200 on Monday. Check that out for lower pricing. I do not think it can be mix and matched with EX nodes but it runs OneFS and should function like a peer in most cases.

I was told by an Isilon worker that they aren’t trying to replace SANs but rather augment them with faster storage for files that would normally be on a NAS I presume.

Esteban and Gavin,

Thanks for shedding some light on Isilon’s target markets. I went through their website looking for some guidance on that very point and found almost nothing. They seem to be positioning themselves as general purpose storage. All in all, I’m surprised at how little information they provide about what they do and where the biggest benefits are. It just seems weird.

Also. that 52% number feels bogus. What is digital media? Powerpoint? PDF? Flash? Do we assume that these files are mostly over 1MB? Most JPEGs aren’t. Is this home data or business data?

Anyway, I’m doing some more research on Isilon - expect to see more later today.

Robin

The Isilon IQ solution has a distributed file system and parallel Gig-E connectivity, so for every node you have host connectivity, IOPs processing power and 4GBs of pre-emtive cache.

This is complimented by load balancing and out of band intra-cluster ops being shared amongst the nodes, so this is a truly linear solution with no master node or NAS head as in the more traditional NetApp world.

The key USPs for Isilon are,

Scalability, up to a PB in a single global namespace
Ease of deployment, takes longer to rack than it does to configure
It is as easy to manage a PB as it is 6TBs
There is no RAID management / configuration
Just select your protection level and go

Lets be clear, this technology is specifically targeted at digital media or large files of over 1MB. It offers performance of up to 10GBytes (thats bytes not bits) from a cluster, and with the IQ accelerator node or EX (expansion node) Isilon are able to exactly match the customers throughput requirements in addition to the useable storage capacity.

So these are the market verticals.

Media and Broadcast (BSKYB, HIT Entertainment, Channel 4 are all Isilon users)
Oil and Gas
Online Content Delivery (My Space is powered by Isilon, so is the Kodak easyshare gallery)
Bio Medical
High Performance Computing (grid)
+ a few others

There will be a growth in the market opportunity as more companies offer rich media for download on the internet, then there is the emergence of VOD and IPTV…

Isilon is a round peg, and it needs a round hole for a good fit.
Isilon has competition, but you haven’t named any of them so far.

I have capacity and performance calculators, I cannot share this with you but if you would like an example please mail me.

I will leave you with this.

From an industry analyst source, 52% of new data is digital media.

http://www.sun.com/software/solaris/cluster/
http://www.sun.com/download/products.xml?id=4581ab9e

And possible to use with multiple storage solutions:

http://www.sun.com/software/cluster/osp/

What’s even more interesting is that Sun is planning to incorporate the StorageTech Availability Suite into OpenSolaris some type this month:

http://www.opensolaris.org/jive/thread.jspa?messageID=78537#78686

So even if you don’t have a SAN, you can add AVS replication and do HA fail over.

Seems that a lot of what used to be only available through hardware is slowly becoming commodity via software (though you’ll have to pay for support of course).

Thanks for the IB correction, I’ve updated the post and the pricing.

Isilon does offer an IQAccelerator-i that has no storage and enables the cluster to handle more IOPS. As near as I can tell Isilon offers no metrics for what this does, so while I’d *like* to look at this as an IOPS solution - good point, Blake - they don’t make it easy. Anyone have some numbers?

I suspect that Isilon is not mentioning performance because it isn’t a strong point, even with the accelerator product. At $12k (hw+sw), you can buy a lot of SATA drives and get added performance, more redundancy and capacity.

I’m still trying to get my head around the Isilon value prop, so bear with me as I do some more research. They may be the guys who come out of left field and kneecap the array vendors and/or NetApp. Or not. Anyone with experience with Isilon, please write. If you just want to give me feedback with having it published , just say so in your comment or send me email from my contact page.

Robin