Archive for the ‘Storage Economics’ Category

After all, FAST makes a debut

December 8th, 2009 4 comments

So EMC has proved critics like me wrong and have introduced EMC FAST (Fully Automated Storage Tiering) as an offering in Dec 2009. There were many skeptics like me that saw this product release being stalled because of various reasons, here.

FAST (Fully Automated Storage Tiering)

FAST (Fully Automated Storage Tiering)

Truly this was one of the most awaited products of 2009 from EMC after the initial announcement by EMC back in April 2009 along with the release of Symmetrix V-Max.

I have dedicated a separate deep-dive section for EMC FAST on the StorageNerve Blog, here

Along with FAST, EMC has also introduced some new enhancements to the EMC Symmetrix V-Max, Clariion CX4 and Celerra NS platforms. Currently FAST will be available on the above 3 platforms at debut and will provide automated storage tiering “in-the-box” for Symmetrix V-Max, “in-the-box” for Clariion CX4 and “out-of-box” for Celerra NS platforms.

As expected EMC has not made this feature free but rather offers a pricing model based on bundled software. FAST will be an available feature within ATSM: Advanced Tiering Storage Management bundle and will be charged based on RAW Capacity of the Array (Symmetrix, Clariion and Celerra)

FAST will not be supported on EMC DMX-4 and Clariion CX3. In essence FAST is only compatible with EMC Symmetrix V-Max Enginuity Microcode and Clariion CX4 Flarecode Release 29.

FAST is a software only feature and integrates with existing hardware / software on the associated platforms.

The following are some of the features FAST will support at GA on the EMC Symmetrix V-Max, Clariion CX4 and Celerra NS platforms.

EMC Symmetrix V-Max

Symmetrix V-Max Data Movement

Symmetrix V-Max Data Movement

  • Volume / LUN based data movement (Automated Storage Tiering) for open systems and CKD – mainframe volumes.
  • Management of FAST through Symmetrix Management Console or SymCLI
  • Data Movement can be accomplished between FLASH, fibre channel and SATA drives within the V-Max platform. Data can move in any direction and on any type of the drives based on policy.
  • Data movement within a single frame or serial number only.
  • FAST suite can be purchased as a standalone software suite but will be available at a discounted price based on a bundled option with Symmetrix Optimizer, DCP: Dynamic Cache Partitioning and SPC: Symmetrix Priority Controls.
  • Symmetrix Performance Analyzer will be required for FAST to operate on Symmetrix V-Max platform. (Based on the comment from Barry Burke below, Symmetrix Performance Analyzer is not required for FAST to operate on the Symmetrix V-Max platform.

EMC Clariion CX4

Clariion CX4 Data Movement

Clariion CX4 Data Movement

  • LUN based data movement (Automated Storage Tiering)
  • Management of FAST will be enabled through CLI only. Not supported as an integrated part of Navisphere today.
  • Will work with Flarecode Release 29 (Clariion CX4) only.
  • Unlike the Symmetrix, the automated data movement will only be supported between fibre channel drives to FLASH or fibre channel drives to SATA. There is no automation related to data movement from FLASH to fibre channel or FLASH to SATA or SATA to FLASH or SATA to fibre Channel drives.
  • Data movement within a single frame or serial number only.
  • FAST suite can be purchased as a standalone software suite but will be available at a discounted price based on bundled option with Navisphere Analyzer and NQSM: Navisphere Quality Service Manager.
  • Navisphere Analyzer is required for FAST to operate.

EMC Celerra platform

Celerra in the box data movement

Celerra in the box data movement

Celerra in the box and out of box data movement

Celerra out of box data movement

  • File based data movement (Automated Storage Tiering)
  • Management of FAST can be accomplished through Rainfinity file management appliance GUI or CLI. Customers also have an option to purchase Rainfinity File management/VE (Virtual Appliance), which has some limitations.
  • Data movement can be enabled to another tier “in-the-box” or to another Celerra or Centera or Atmos.
  • Celerra FAST is most interesting as it enables out the system data movement, like to another Celerra or Centera or Atmos.
  • FAST suite can be purchased as a standalone software suite but will be available at a discounted price based on a bundled option with Rainfinity File Management Appliance or Rainfinity File Management /VE.

Based on EMC heat index charts, a before and after picture of a FAST implementation would look like this.

FAST Implementation

FAST Implementation

A FAST implementation video

Here is a post, back from August 2009 on Gestalt IT describing how EMC’s Unified Storage vision and federation may work. It is good to see, some of those things come to fruition now, and at least FAST with Celerra proves it.

Stay tuned for a series of FAST posts over the next few days talking about various other topics and how FAST plays within those areas.

Drobo Performance Stats

December 1st, 2009 10 comments

Some discussions on twitter last week triggered the topic of performance relating to the Drobo’s. This is the 5th consecutive post on Drobo Series of products.

To read other Drobo related posts:

Drobo S and DroboElite – Introduced 11/23/2009

Some very interesting articles on Drobo S and DroboElite

The Drobo Math

I totally love my Drobo but


Here are some performance stats collected with running Drobo as a direct attached storage and using some benchmarking tools to compile these results.  All the performance stats are collected using different criteria’s that can affect the performance of the Drobo. Also used various connection methods including USB and Firewire to obtain these stats.

The entire series of tests have been performed using Mac OSX 10.6.2 host with either USB attached or Firewire attached to the Drobo.

These results are limited to the Drobo and cannot be compared to the Drobo Pro or Drobo Elite or Drobo S.

The test were carried out with using various combination of drives, rebuilt data protection, best-case scenario, worst-case scenario, 1 drive, 2 drives, 4 drives, different drive cache & capacity.

Drobo Stats


The Storage Economics Practice – (Post on ITKE)

November 25th, 2009 No comments

A Featured Guest post by StorageNerve on ITKE (IT Knowledge Exchange) – TechTarget about the importance of Storage Economics and some important aspects to consider with establishing a Storage Economics practice for your organization.
Screen shot 2009-11-22 at 1.39.23 PM

The Drobo Math

November 24th, 2009 6 comments

In the previous blog post, I covered the newly introduced Drobo S and Drobo Elite storage systems, they are new product offerings from Data Robotics, you can read about them here.

Today we will jump into installing and configuring a new Drobo.

So after writing this post in its entirety, I decided to change the title of it. Though we will walk through an install of the Drobo during this post, it uncovers the details on writable / usable storage based on what you insert and the amount of overhead it creates with using the BeyondRaid technology.

Here is a video, created while unpacking, installing and configuring the Drobo, you may probably like the sound track of the video.

Song: Jai Ho (Movie: Slumdog Millionaire)

As for the installation and setup, here are some important things to look forward to..

I have to honestly say, this configuration exercise was a piece of cake, but we have uncovered some details around usable space with the Drobo. With the installation of Drobo you do not need to be a storage expert neither a person with a technical background and that makes it a big selling point in the home / SMB space.

For this blog post,  I have used the MAC OSX 10.6.2 installation along with HFS+ file system. But a windows installation with FAT32 file system will be on similar lines.

  • Insert the CD in the CD Rom Drive….let the magic begin…
  • Welcome Screen.
    Screen shot 2009-11-23 at 1.35.49 PM.
  • Accept the licensing agreement and click on Continue, to install the Drobo dashboard.Screen shot 2009-11-23 at 1.39.13 PM.
  • During the installation you will be prompted to register your Drobo with Data Robotics. You can skip this step and register later. If you decide to register now, you will need your name, address, phone, Drobo serial number (found at the bottom of the unit) and some other additional information.Screen shot 2009-11-23 at 1.43.10 PM.
  • If you have any Drobo’s connected to the computer where you are installing the Dashboard, please disconnect them at this point.Screen shot 2009-11-23 at 1.44.20 PM.
  • It will take about couple of minutes to install the necessary files on Mac OSX or Windows.Screen shot 2009-11-23 at 1.48.32 PM.
  • Reconnect the Drobo to the computer. Drives can be installed or uninstalled within the Drobo at this point. Screen shot 2009-11-23 at 2.01.38 PM.
  • As seen in the picture, we have connected the Drobo with no drives in it.  Drobo Volume shows 0 TB usable.Screen shot 2009-11-23 at 2.02.19 PM.
  • Drobo showing no drives present in any slots.  Screen shot 2009-11-23 at 2.03.34 PM.
  • Insert 1 x 1TB drive in the Drobo, alerts showing the Drobo will not be able to protect the drive until another drive is inserted. You can only obtain data protection through atleast 2 drives in the Drobo. Screen shot 2009-11-23 at 2.04.36 PM.
  • Insert 1TB drive with 32MB cache drive in Slot 0, Insert 500 GB with 16MB cache drive in slot 1. Two drives have same speed but different onboard cache and drive sizes.Screen shot 2009-11-23 at 2.05.58 PM

Note: The beauty of the Drobo is it can accept drives with multiple speeds, sizes and cache on board to create a Drobo thin provisioned volume.

  • Going through Data Protection process now.  It may take about 24 mins for a 1TB drive and a 500GB drive to creat the necessary data protection. During this data protection build, the drives and data on the Drobo is not protected from failures (in short your data will stay intact if no additional drives fail during the data protection build).Screen shot 2009-11-23 at 2.06.12 PM.
  • After about 21 mins of wait, the data is finally protected. Screen shot 2009-11-23 at 2.13.12 PM.
  • As you can see we have 449GB of available space to create volumes, there are no volumes created so far. Creating volumes in a Drobo world means installing a file system on the volume and making it available to the attached host. Volumes can be bigger than the actual drive sizes installed in the system. Standard Volume sizes offered within the Drobo are 2TB, 4TB, 8TB and 16TB. With 16TB, is possibly only supported with Drobo Pro and not with a Drobo. Screen shot 2009-11-23 at 2.37.48 PM.
  • On the Tools tab, lets setup some values.Screen shot 2009-11-23 at 2.41.04 PM.
  • Blink Lights” will start flashing lights on the front of the Drobo, “Standby” will put the Drobo in Standby mode for maintenance or possibly to turn it off if not needed. “Format” allows you for format the Drobo in HFS+ or FAT32 formats. “Reset” will reset your Drobo to factory setting. “Rename the Drobo and Volumes” will rename your Drobo and the volume names.
  • Drobo will send alerts based on your selection. I like to leave the option on for “when a situation is important” send me an email. This option will only work when an actual computer is connected to the Drobo. If you plan to leave your Drobo unconnected for longer duration of times, you may not get an notifications for failed drives or components.
  • Register your Drobo if you haven’t so far, Check for updates for the Drobo dashboard and Drobo firmware.
  • Format Volume, Here we are creating a 4TB volume, even though the drives we are inserting in the Drobo do not add up to total 4 TB’s right now. We are creating a max volume size at this point based on what we think we may use within this Drobo (Again remember the concept of the Drobo is to expand your storage on the fly). That means if the Drobo was running at full capacity, we would be able to use 4TB of storage with 4 x 1TB drives. Create a volume name, hit continue and wait for about 5 mins for volume format.
  • Screen shot 2009-11-23 at 2.42.48 PM.
    Screen shot 2009-11-23 at 2.43.13 PM
  • A confirmation screen pops up and an icon of your Drobo named volume shows up. Screen shot 2009-11-23 at 3.17.57 PM
    Screen shot 2009-11-23 at 3.18.14 PM
    Screen shot 2009-11-23 at 3.20.35 PM
    Screen shot 2009-11-23 at 3.20.42 PM
  • Volume created now is a 4TB volume, though the usable space on this volume will only be 455GB. Remember our total volume is 4TB (Max). Screen shot 2009-11-23 at 3.23.41 PM.
  • To setup email alerts, go to the Drobo Dashboard email settings.  Include your TO email address, FROM email address, mail server address, port address (generally 25 or 587)Screen shot 2009-11-23 at 3.24.20 PM.
  • To Create Drobo CopyScreen shot 2009-11-23 at 4.53.44 PM.
  • Advanced settings within Drobo CopyScreen shot 2009-11-23 at 4.54.13 PM.
  • Email settings within  Drobo Copy
  • Screen shot 2009-11-23 at 4.54.45 PM.

One obvious disadvantage of the Drobo I see is, the drive writable size with two drives is still limited to the smallest drive in place. With a 1TB drive and a 500GB drive, we have a usable space of 455 GBs. With additional two drives we install, the limitation of the smallest drive will be ignored. Again remember our total max volume size is 4TB, so your host see 4TB of storage but can only save uptoo 455 GB of storage on the disk unless you are able to add other disk in the Drobo.

Lets see by adding other drives if things change.

Lets add a 640GB drive into the mix now. I suspect the total usable storage will now be close to 1.0 TB and not 1.1TB. Lets see….


  • Another drive inserted alert Screen shot 2009-11-23 at 4.59.56 PM.
  • It now seems we have 1.02 TB of usable data. Screen shot 2009-11-23 at 5.01.03 PM
    Screen shot 2009-11-23 at 5.02.15 PM.
  • Added a new 1TB drive in the system, lets see what results we get with this new drive. Screen shot 2009-11-23 at 5.06.20 PM.
  • 1.93GB of data is now usable.Screen shot 2009-11-23 at 5.07.28 PM
    Screen shot 2009-11-23 at 5.08.35 PM.

Total inserted storage in our case is 3.14 TB, total usable storage is 1.93TB, Total volume size is 4TB, giving us 61% usable storage ration to our inserted storage. About 941 GB of data is used for protection, or call it parity or call is some bit that is used to recover the data.

With traditional RAID 5 (3+1), you will have around 25% overhead.

With traditional RAID 6 (6+2), you will have around 25% overhead.

With Drobo (4) drives, we have around 39% overhead, the cost of BeyondRAID technology.

  • By Rearranging and reformatting the drives, Slot 0: 1TB, Slot 1: 1TB, Slot 2: 640GB, Slot 3: 500GB, the usable space now is 1.94TB, with 2TB of maximum volume size
  • By Rearranging and reformatting the drives, Slot 0: 1TB, Slot 1: 1TB, Slot 2: 640GB, Slot 3: 500GB, the usable space now is 1.93TB with 4TB maximum volume size.
  • Screen shot 2009-11-23 at 6.16.14 PM
    Screen shot 2009-11-23 at 6.16.38 PM
  • Quick Notes:.
  • Volume size of 4TB that we created in this case cannot be changed without a reformat of the drives. So select the write volume size from the get go.
  • End result is at least 39% overhead, If you look at it, its kinda high….
  • Need to test Drobo with 4 x 1 TB drives to see what is the usable storage…i suspect even though you have created a 4TB volume, it is not 4TB usable space.
  • The DROBO offers easy installation, easy setup, easy configuration, easy use and data in place upgrades if well planned.
  • Stay tuned for a deep dive session on how the Drobo works internally….Note: Will update the post around 11:00 Am tomorrow with my finding on overhead with 2 x 1TB drives in the system. So 4TB volume configured, 2 x 1 TB inserted, how much is the usable / writable storage based on those stats. Please comment if you figure out before I update. I suspect it to be around 610GB – 650GB’s total?
  • Oh….the 2 x 1 TB drives produced a completely different result….920GB usable, so here we only have about 8% overhead. This does mean, that even though the Drobo is marketed as a device that accepts drives of multiple sizes, there is an additional overhead with putting drives of multiple sizes in there.Here is the test result…Screen shot 2009-11-24 at 11.47.10 AM
  • Another test revealed with 4 x 2TB drives in the system, the end user was able to obtain about 5.5TB of usable storage, that is about 68% usable space or 32% overhead.
  • One rule of thumb I get out of this exercise, what ever you do, try to keep the drive sizes common between all the drives you use within the Drobo for maximum usable storage or less overhead.
  • Edited 11/24.2009 at 6:00 PM.
  • Some additional test results with the Drobo
  • If you plug in 4 x 1TB drive you get 2.7TB of usable space that is 32.5% Overhead (protection and reserved space).
  • If you plug in 2 x 1TB drive you get 920 GB, that is 54% overhead (protection and reserved space). And again, I am not recommending you use this scenario, using less than 4 drives or different drive sizes causes added penalties.
  • If you were replacing one drive out of the set of 4 x 1TB drive with a 2TB drive, so 1 x 2TB and 3 x 1 TB, no additional storage space is available.
  • If you had 4 x 2TB drives and just replaced two of those 2TB drives with 2 x 500GB drives, your usable storage falls from 5.5TB to 2.7TB 46% overhead.

May be I am looking at this the completely wrong way, but the marketing buzz word around use the drives you have, mix and match drive types and sizes, may not give you an optimal solution. Though if you plan to really keep the drive sizes similar across the Drobo, it may be for you….

  • Comments always welcome, please feel free to correct if you see this differently….