Google+

Archive

Archive for the ‘Storage’ Category

The Drobo Math

November 24th, 2009 6 comments

In the previous blog post, I covered the newly introduced Drobo S and Drobo Elite storage systems, they are new product offerings from Data Robotics, you can read about them here.

Today we will jump into installing and configuring a new Drobo.

So after writing this post in its entirety, I decided to change the title of it. Though we will walk through an install of the Drobo during this post, it uncovers the details on writable / usable storage based on what you insert and the amount of overhead it creates with using the BeyondRaid technology.

Here is a video, created while unpacking, installing and configuring the Drobo, you may probably like the sound track of the video.

Song: Jai Ho (Movie: Slumdog Millionaire)

As for the installation and setup, here are some important things to look forward to..

I have to honestly say, this configuration exercise was a piece of cake, but we have uncovered some details around usable space with the Drobo. With the installation of Drobo you do not need to be a storage expert neither a person with a technical background and that makes it a big selling point in the home / SMB space.

For this blog post,  I have used the MAC OSX 10.6.2 installation along with HFS+ file system. But a windows installation with FAT32 file system will be on similar lines.

  • Insert the CD in the CD Rom Drive….let the magic begin…
  • Welcome Screen.
    Screen shot 2009-11-23 at 1.35.49 PM.
  • Accept the licensing agreement and click on Continue, to install the Drobo dashboard.Screen shot 2009-11-23 at 1.39.13 PM.
  • During the installation you will be prompted to register your Drobo with Data Robotics. You can skip this step and register later. If you decide to register now, you will need your name, address, phone, Drobo serial number (found at the bottom of the unit) and some other additional information.Screen shot 2009-11-23 at 1.43.10 PM.
  • If you have any Drobo’s connected to the computer where you are installing the Dashboard, please disconnect them at this point.Screen shot 2009-11-23 at 1.44.20 PM.
  • It will take about couple of minutes to install the necessary files on Mac OSX or Windows.Screen shot 2009-11-23 at 1.48.32 PM.
  • Reconnect the Drobo to the computer. Drives can be installed or uninstalled within the Drobo at this point. Screen shot 2009-11-23 at 2.01.38 PM.
  • As seen in the picture, we have connected the Drobo with no drives in it.  Drobo Volume shows 0 TB usable.Screen shot 2009-11-23 at 2.02.19 PM.
  • Drobo showing no drives present in any slots.  Screen shot 2009-11-23 at 2.03.34 PM.
  • Insert 1 x 1TB drive in the Drobo, alerts showing the Drobo will not be able to protect the drive until another drive is inserted. You can only obtain data protection through atleast 2 drives in the Drobo. Screen shot 2009-11-23 at 2.04.36 PM.
  • Insert 1TB drive with 32MB cache drive in Slot 0, Insert 500 GB with 16MB cache drive in slot 1. Two drives have same speed but different onboard cache and drive sizes.Screen shot 2009-11-23 at 2.05.58 PM
    ..

Note: The beauty of the Drobo is it can accept drives with multiple speeds, sizes and cache on board to create a Drobo thin provisioned volume.

  • Going through Data Protection process now.  It may take about 24 mins for a 1TB drive and a 500GB drive to creat the necessary data protection. During this data protection build, the drives and data on the Drobo is not protected from failures (in short your data will stay intact if no additional drives fail during the data protection build).Screen shot 2009-11-23 at 2.06.12 PM.
  • After about 21 mins of wait, the data is finally protected. Screen shot 2009-11-23 at 2.13.12 PM.
  • As you can see we have 449GB of available space to create volumes, there are no volumes created so far. Creating volumes in a Drobo world means installing a file system on the volume and making it available to the attached host. Volumes can be bigger than the actual drive sizes installed in the system. Standard Volume sizes offered within the Drobo are 2TB, 4TB, 8TB and 16TB. With 16TB, is possibly only supported with Drobo Pro and not with a Drobo. Screen shot 2009-11-23 at 2.37.48 PM.
  • On the Tools tab, lets setup some values.Screen shot 2009-11-23 at 2.41.04 PM.
  • Blink Lights” will start flashing lights on the front of the Drobo, “Standby” will put the Drobo in Standby mode for maintenance or possibly to turn it off if not needed. “Format” allows you for format the Drobo in HFS+ or FAT32 formats. “Reset” will reset your Drobo to factory setting. “Rename the Drobo and Volumes” will rename your Drobo and the volume names.
  • Drobo will send alerts based on your selection. I like to leave the option on for “when a situation is important” send me an email. This option will only work when an actual computer is connected to the Drobo. If you plan to leave your Drobo unconnected for longer duration of times, you may not get an notifications for failed drives or components.
  • Register your Drobo if you haven’t so far, Check for updates for the Drobo dashboard and Drobo firmware.
  • Format Volume, Here we are creating a 4TB volume, even though the drives we are inserting in the Drobo do not add up to total 4 TB’s right now. We are creating a max volume size at this point based on what we think we may use within this Drobo (Again remember the concept of the Drobo is to expand your storage on the fly). That means if the Drobo was running at full capacity, we would be able to use 4TB of storage with 4 x 1TB drives. Create a volume name, hit continue and wait for about 5 mins for volume format.
  • Screen shot 2009-11-23 at 2.42.48 PM.
    Screen shot 2009-11-23 at 2.43.13 PM
    .
  • A confirmation screen pops up and an icon of your Drobo named volume shows up. Screen shot 2009-11-23 at 3.17.57 PM
    Screen shot 2009-11-23 at 3.18.14 PM
    Screen shot 2009-11-23 at 3.20.35 PM
    Screen shot 2009-11-23 at 3.20.42 PM
    .
  • Volume created now is a 4TB volume, though the usable space on this volume will only be 455GB. Remember our total volume is 4TB (Max). Screen shot 2009-11-23 at 3.23.41 PM.
  • To setup email alerts, go to the Drobo Dashboard email settings.  Include your TO email address, FROM email address, mail server address, port address (generally 25 or 587)Screen shot 2009-11-23 at 3.24.20 PM.
  • To Create Drobo CopyScreen shot 2009-11-23 at 4.53.44 PM.
  • Advanced settings within Drobo CopyScreen shot 2009-11-23 at 4.54.13 PM.
  • Email settings within  Drobo Copy
  • Screen shot 2009-11-23 at 4.54.45 PM.

One obvious disadvantage of the Drobo I see is, the drive writable size with two drives is still limited to the smallest drive in place. With a 1TB drive and a 500GB drive, we have a usable space of 455 GBs. With additional two drives we install, the limitation of the smallest drive will be ignored. Again remember our total max volume size is 4TB, so your host see 4TB of storage but can only save uptoo 455 GB of storage on the disk unless you are able to add other disk in the Drobo.

Lets see by adding other drives if things change.

Lets add a 640GB drive into the mix now. I suspect the total usable storage will now be close to 1.0 TB and not 1.1TB. Lets see….

.

  • Another drive inserted alert Screen shot 2009-11-23 at 4.59.56 PM.
  • It now seems we have 1.02 TB of usable data. Screen shot 2009-11-23 at 5.01.03 PM
    Screen shot 2009-11-23 at 5.02.15 PM.
  • Added a new 1TB drive in the system, lets see what results we get with this new drive. Screen shot 2009-11-23 at 5.06.20 PM.
  • 1.93GB of data is now usable.Screen shot 2009-11-23 at 5.07.28 PM
    Screen shot 2009-11-23 at 5.08.35 PM.

Total inserted storage in our case is 3.14 TB, total usable storage is 1.93TB, Total volume size is 4TB, giving us 61% usable storage ration to our inserted storage. About 941 GB of data is used for protection, or call it parity or call is some bit that is used to recover the data.

With traditional RAID 5 (3+1), you will have around 25% overhead.

With traditional RAID 6 (6+2), you will have around 25% overhead.

With Drobo (4) drives, we have around 39% overhead, the cost of BeyondRAID technology.

  • By Rearranging and reformatting the drives, Slot 0: 1TB, Slot 1: 1TB, Slot 2: 640GB, Slot 3: 500GB, the usable space now is 1.94TB, with 2TB of maximum volume size
    .
  • By Rearranging and reformatting the drives, Slot 0: 1TB, Slot 1: 1TB, Slot 2: 640GB, Slot 3: 500GB, the usable space now is 1.93TB with 4TB maximum volume size.
  • Screen shot 2009-11-23 at 6.16.14 PM
    Screen shot 2009-11-23 at 6.16.38 PM
  • Quick Notes:.
  • Volume size of 4TB that we created in this case cannot be changed without a reformat of the drives. So select the write volume size from the get go.
  • End result is at least 39% overhead, If you look at it, its kinda high….
  • Need to test Drobo with 4 x 1 TB drives to see what is the usable storage…i suspect even though you have created a 4TB volume, it is not 4TB usable space.
  • The DROBO offers easy installation, easy setup, easy configuration, easy use and data in place upgrades if well planned.
    .
  • Stay tuned for a deep dive session on how the Drobo works internally….Note: Will update the post around 11:00 Am tomorrow with my finding on overhead with 2 x 1TB drives in the system. So 4TB volume configured, 2 x 1 TB inserted, how much is the usable / writable storage based on those stats. Please comment if you figure out before I update. I suspect it to be around 610GB – 650GB’s total?
  • Oh….the 2 x 1 TB drives produced a completely different result….920GB usable, so here we only have about 8% overhead. This does mean, that even though the Drobo is marketed as a device that accepts drives of multiple sizes, there is an additional overhead with putting drives of multiple sizes in there.Here is the test result…Screen shot 2009-11-24 at 11.47.10 AM
    .
  • Another test revealed with 4 x 2TB drives in the system, the end user was able to obtain about 5.5TB of usable storage, that is about 68% usable space or 32% overhead.
  • One rule of thumb I get out of this exercise, what ever you do, try to keep the drive sizes common between all the drives you use within the Drobo for maximum usable storage or less overhead.
  • Edited 11/24.2009 at 6:00 PM.
  • Some additional test results with the Drobo
  • If you plug in 4 x 1TB drive you get 2.7TB of usable space that is 32.5% Overhead (protection and reserved space).
  • If you plug in 2 x 1TB drive you get 920 GB, that is 54% overhead (protection and reserved space). And again, I am not recommending you use this scenario, using less than 4 drives or different drive sizes causes added penalties.
  • If you were replacing one drive out of the set of 4 x 1TB drive with a 2TB drive, so 1 x 2TB and 3 x 1 TB, no additional storage space is available.
  • If you had 4 x 2TB drives and just replaced two of those 2TB drives with 2 x 500GB drives, your usable storage falls from 5.5TB to 2.7TB 46% overhead.

May be I am looking at this the completely wrong way, but the marketing buzz word around use the drives you have, mix and match drive types and sizes, may not give you an optimal solution. Though if you plan to really keep the drive sizes similar across the Drobo, it may be for you….

  • Comments always welcome, please feel free to correct if you see this differently….

Some very interesting articles on DROBO S and DROBO Elite

November 24th, 2009 No comments

If you haven’t already read about the DROBO S and DROBO Elite, released yesterday (11/23/2009), here are a few interesting links, nice comparisons,  details and info in these post….

Contemplating IT

Pack Rat – Stephen Foskett

Louis Gray

Sunshine Mugrabi

Cheers

@storagenerve

……And incase you missed the DROBO S and DROBO ELITE video on (YOUTUBE) from yesterday…….

DROBO S and DROBO Elite – Introduced 11/23/2009

November 23rd, 2009 No comments

As most of you know, DROBO has been in the market for the past couple of years. There are three primary units that Data Robotics has in the industry today. The DROBO – 4 Drive Unit, DROBO Pro – 8 Drive Unit and DROBO Share that enables you to connect two DROBO’s and run community designed applications.

As of 11/23/2009, there are two new DROBO devices being introduced, the DROBO S and DROBO ElIte.

Both these DROBO’s will compete in the similar market space of its predecessors, but has additional features compared to the DROBO and DROBO Pro devices.

The big marketing buzz Data Robotics uses with it products today is “Set it, Forget it”. Data Robotics has designed a technology called BeyondRAID that in essence is a self-healing storage solution. The market space that DROBO and DROBO Pro’s compete today is the home and SMB space.

Introducing DROBO S and DROBO ELITE: Movie by StorageNerve

Song: Blue Theme (Movie: Blue)

DROBO S FEATURES:

Connectivity to Host

USB 2.0 Connectivity

Firewire 800 / 400 Connectivity – 25% faster than USB 2.0

e-SATA Connectivity – 50% faster than Firewire

Drives

DROBO supported 4 drives, the DROBO S now supports 5 drives, expanding total storage to 10 TB’s.

Supports different drive sizes.

Supports failure of 2 drives in the unit with no Data loss.

Self-healing technology supported as a core feature within DROBO S.

Different drive speeds and different cache on drive supported within the unit.

SATA – I and SATA – II drives supported.

OS

Windows – Win XP and Win 2003 onwards

MAC  – MAC OS X 10.5.6 onwards

Linux

Filesystems

HFS+

NTFS

FAT32

EXT3

Markets

Home User

Desktop Use in SMB space.

Power Save Mode

Seems like when you disconnect the DROBO S from a connected host, it enters in power save mode.

Upgrades

No Downtime with drive upgrades.

No Downtime with drive failure – upto 2.

No Downtime with new drive installations.

Take drives out of DROBO and plug them into DROBO S for data in-place upgrade.

For Home and SMB use it lacks the following

Entertainment – Photo Library, iTunes Library, FTP Support, NAS Support, Ethernet Support, iSCSI, AD integration, Turn off / on at a certain time of the day.

Technology

Technology Drobo S

Technology Drobo S

DROBO ELITE FEATURES

DROBO ELITE offers 50% faster throughput compared to DROBO Pro.

Connectivity to Host

USB 2.0 Connectivity (For Management only)

2 x Gigabit Ethernet

iSCSI Support

Upto 255 Host Volumes – (From Common Pool of storage – like Thin Provisioning)

Upto 16 host systems supported

Drives

DROBO ELITE supports 8 drives, expanding total storage to 16 TB’s.

Supports different drive sizes

Supports failure of 2 drives in the unit with no Data loss

Self-healing technology supported as a core feature within DROBO Elite

Different drive speeds and different cache on drive supported within the unit

SATA – I and SATA – II drives supported

OS

Windows – Win XP and Win 2003 onwards

MAC  – MAC OS X 10.5.6 onwards

Linux

Vmware ESX 3.5 and V-Sphere support

Filesystems

HFS+

NTFS

FAT32

EXT3

VMFS

Markets

SMB Market

Server Consolidation

Multiple Server Support

Vmware Support

Upgrades

No Downtime with drive upgrades

No Downtime with drive failure – upto 2

No Downtime with new drive installations.

Take drives out of DROBO PRO and plug them into DROBO ELITE for data in-place upgrade

Technology

DROBO ELITE

DROBO ELITE

I particularly like the self-healing no maintenance, no setup configuration. It has a great feature of plug it in, forget it…

I will start using the DROBO this week and hopefully be able to write more about the underlying technology, stay tuned!!!

Is Storage Tiering ILM or a subset of ILM, but where is ILM

November 20th, 2009 3 comments

I was writing a blog post on Storage Economics last night for ITKE (IT Knowledge Exchange). During some thought  process and writing, I got confused on a sentence I was trying to format. The confusion was between ILM (Information Lifecycle Management) and Storage Tiering. Though I think both the concepts are overlapping, most of the responses I got from twitter were Storage Tiering is a revamped ILM or ILM with lipstick. Twitter search: “ILM, Tiering”.

After thinking about this for the past 24 hours, I am still not sure if I am at the right conclusion.

What is ILM (Information Lifecycle Management):

A process to manage information through out its lifecycle from creation to deletion. Lets look at ILM from a storage perspective.

1) A user or an application creates data and possibly over time that data is modified.
2) The data needs to be stored and possibly be protected through RAID, snaps, clones, replication and backups.
3) The data now needs to be archived as it gets old, and retention policies & laws kick in.
4) The data needs to be search-able and retrievable NOW.
5) Finally the data needs to be deleted.

Though some argue protection (RAID, snaps, clones, replication, backups) are part of ILP: Information Lifecycle Protection and not ILM: Information Lifecycle Management.

Here is a definition of ILM as I found on google: “define: ILM”.

What is Storage Tiering:

A defined pool of Storage within a storage environment that is classified based on either speed, availability, protection levels, access times, SLA’s, frequency of use and possibly cost.

The higher the Storage Tier 0, 1, 2, the higher the cost of management, purchase, availability, speed, protection levels, frequency of use and least access times and outages. The lower the Storage Tier 3, 4, 5, the lower the cost of management, purchase, availability, speed, protection levels, frequency of use and higher access times.

As data gets old or unused, based on workflow, the data moves from higher tiers to lower tiers, could be an automated move, a manual move, a business rules defined move or a policies based move.

Data Protection, Tiering, Archiving, Backup, Retention, Search are all components of Storage Tiering these days. So does this mean, Storage Tiering is merely a subset of ILM.

The Overlap:

I have not heard the word ILM from large vendors in any tech-talk, on any blogs, nor any podcasts these days. So where is ILM or have the vendors given up on the concept of ILM. Is Storage Tiering the new ILM, if that is the case what is the difference.

ILM does include two major components which are data creation and data deletion, but storage tiering does not encompass those, it only preaches moving the data to a lower or higher tier based on availability, backup, archive, retention, search and retrieve features.

So is ILM still alive and if it is, where is it. If it is dead, does it mean we do not have workflows and automation around the other aspects of ILM not included in Storage Tiering. Is Storage Tiering just a marketing buzz and is still uses the underlying concept of ILM.

I am all confused!!!

.