Shock, vibe and awe

by Robin Harris on Wednesday, 19 May, 2010

Shouting at a disk drive will cause it to stop. But what about the constant nagging they get in busy data centers? That’s a bigger problem.

Bad, bad, bad vibrations
The use of consumer-grade SATA drives in the enterprise raises the concern. A 2005 study, Performance Impact of External Vibration on Consumer-grade and Enterprise-class Disk Drives, by Thomas Ruwart and Yingping Lu found that consumer

. . . disk drives are more sensitive to the vibration from physically coupled adjacent disk drives. . . . [G]reater care needs to be taken in enclosure design, particularly for the 3.5-inch form factor disk drives due to their higher-energy seek operations when compared to seek operations on a 2.5-inch form factor disk drive.

Yet another reason to end-of-life 3.5″ drives.

Mechanical engineers know that drive vibration is a serious problem. How serious is the question. We do know that steel does a good job of transmitting vibrations as this graph shows:
Courtesy Rockwell Automation
An internal study of a vibration-damping rack by a major storage and server vendor obtained by StorageMojo – and not available on the web – found a

20% decrease in IO throughput performance (read) and 25% increase in total time to perform a task of typical 2U servers resulting in 25% increase in energy consumption . . . when vibration level went up from 0.1 GRMS to 1 GRMS. This is a conservative result, as newer HDDs are more sensitive to vibration, “write operation” is 20% more sensitive than “read operation” to vibration and effect of vibration on rotating components , HDDs & fans, are not accounted for.

[GRMS – properly Grms – is the root mean square of acceleration measured in g’s. Check out The Calculation of GRMS (pdf) for a technical discussion.]

Drives use accelerometers to compensate for shock and linear and rotational vibration but the info isn’t available externally so it’s difficult to directly quantify vibration impact. But data centers are noisy places quivering with the vibration of fans, air conditioners, disk drives and 60 cycle hum, all supported by steel racks.

A limited study
In a USENIX paper presented at the SustainIT ’10 conference Julian Turner reported on limited tests of a prototype anti-vibration rack. The AVR-1000 is an engineered carbon fiber composite rack designed to dissipate vibration across a wide frequency range.

His observations include:

Performance improvements for random reads ranged from 56% to 246% while improvements for random writes ranged from 34% to 88% for a defined set of industry benchmarks. Streaming sequential reads and writes had a much smaller performance improvement. . . .

The internal study found similar results:

IO throughput performance (write) increased by 285% and total time and energy to perform a task of a 4U storage server with 48 HDDs decreased by 64% when vibration level went down from 1 GRMS to 0.1 GRMS.

Evidently the combination of random head movements and vibration has a substantial effect on disk read performance.

For the enterprise and Internet-scale data centers the implications are substantial:

  • Energy savings. Anti-vibration racks can save power by improving disk performance and reducing run times.
  • SSD value. Flash SSDs have fast random read access. But disks can improve their performance by 50% through vibration damping, changing the SSD value proposition.
  • Array sizing. Enterprise arrays are over-configured to improve performance. If disks were suddenly 50% faster that could be reduced or, alternatively, the utilization could be increased.

The StorageMojo take
The research is limited, but everything we know about disks and vibration today suggests this is real. Assuming further research finds similar results we could see an explosion of products using engineered materials to improve disk performance.

This is already the norm in chip fabs, where nanometer precision requires extensive vibration damping. Disk feature sizes are even smaller, so why not?

Drive vendors should make accelerometer data available to researchers. Vibration-damping racks could make disks much more competitive with SSDs – and mean billions to drive vendors – but only if we have the data.

For home users of multi-drive towers it may be that damping carbon fiber towers or disk mounts could improve performance. It may not be economic, but it sure would look awesome.

The impact for Internet-scale infrastructures is more nuanced. Google, for one, doesn’t use high-density storage – maybe 120 drives per rack – so the performance gains may not be economic for them. But users of many drive servers with, say, 300+ drives in a rack would find it easier to justify.

Courteous comments welcome, of course.

{ 8 comments… read them below or add one }

Tony May 19, 2010 at 4:42 pm

How effective are the basic rubber vibration mounts many new cases come with? I’m pretty sure the original intent was to make the computer quieter (a good thing), but if the rubber reduces vibrations to the HDD’s (not just from the HDDs), it should help performance…

mrb May 19, 2010 at 9:56 pm

You mentioned vibrations on Storage Bits some days ago – I do not think they change the value proposition of SSDs:
http://blog.zorinaq.com/?e=3
Also vibrations are definitely real, as per the story in that same blog post…

adam May 20, 2010 at 7:23 am

I am not sure this is “new” news. Take a look at the Xiotech ISE system. The drives are oriented so that their vibrations cancel each other out.

Robin Harris May 20, 2010 at 8:27 am

Adam,

Good catch. Xiotech and Atrato both use unusual disk orientations to minimize the effect of rotational vibration. Xiotech has claimed some very high IOPS rates, although they’ve never to my knowledge broken out the impact of vibration. And AFAIK neither has used a vibration damping material in their enclosures.

Robin

Anoni-mouse May 20, 2010 at 4:20 pm

Rumor has it that HP is dropping the use of “consumer grade SATA” drives altogether and will provide ‘midline SAS’ drives as a lower end standard for the enterprise for these performance reasons as well as longevity. This doesn’t mean your $500 Pavillion won’t have a “consumer grade SATA” drive, but if you are buying enterprise grade arrays etc. you’ll get longer lasting and better performing drives.

Rex May 24, 2010 at 12:15 pm

I’d like to see more research on the dominant sources of harmful vibration in data centers, and how to counteract them.

Right now we have only two choices for mitigating this problem:

– Try to eliminate “obvious” sources of vibration through guesswork.

– Replace all our racks with carbon-fiber anti-vibration racks from a startup company associated with the research. Hmmm. I’ll get back to you on that one.

LeRoy Dennison May 25, 2010 at 10:09 am

The chassis for Active Storage’s ActiveRAID was specifically engineered to minimize transient vibration by using aluminum vs. steel as well as the drive carriers being engineered for maximum airflow and vibration elimination.

lto 5 tape June 23, 2010 at 4:19 am

I really like to use the lto 5 tapes. they provide extra storage and security. Now lto5 with lot of characteristic is available in market.

Leave a Comment

{ 1 trackback }

Previous post:

Next post: