Future of storage: Is disk dead?

See ya, SCSI?

A big move on the horizon is away from expensive SCSI disks towards less expensive alternatives. "I think the big move over the next few years will be from people using SANs based on SCSI or Fibre Channel attached disks to ATA, serial ATA, and serial SCSI," says McIsaac. This is good news for the bean counters, since Serial ATA can give around 75 percent of the performance of SCSI disks at around half the price, McIsaac says. "There will be a more rapid decline in the cost of storage driven by the move towards ATA and serial ATA over the next 12 to 18 months," he predicts.

One company that is very pleased with this trend is 3ware, which makes RAID controllers for ATA and serial ATA drives, and was recently acquired by semiconductor company AMCC. "We created a switched architecture for storage and each ATA drive gets its own dedicated port on our switched fabric," says Peter Herz, 3ware's CEO. "It solves the reliability problem because any drive can die, including in a way that destroys the interface, but it will only take the one port down, not the entire array. From a performance perspective it dedicates full bandwidth to each drive."

3ware initially aimed its products at the server market, expecting the industry would jump at the chance to ditch the overpriced SCSI disks. "We were dead wrong. The profits made on SCSI are so obscene that vendors are not really interested in fixing that problem," says Herz.

Conspiracy theories aside, SCSI disks fulfill one very important function in the datacentre environment: fast data access speeds. "The most important thing in the transaction processing environment is you want to do lots and lots of small transactions, so you want the fastest possible rotation rate disk drives [to get to the data as quickly as possible]," says Herz.

3ware's ATA-based systems have been a lot more successful in the emerging area of streaming data, such a video surveillance systems, video-on-demand systems for hotels, and scientific research applications with extremely large datasets. "In streaming applications, the rotational rate of the drive actually doesn't matter, you want a very high data rate, and you want to be able to aggregate that into as much bandwidth as possible," explains Herz. Because of the scale of storage required by streaming applications, "the systems -- if they were based on SCSI or fibre channel -- would be unaffordable."

More plumbing
Just as important as the drives themselves are the ways the drives are connected to each other. In the previous feature, we discussed a concept from IBM's research called Ice Cube, where storage "bricks" containing disk drives, controllers, and associated software can be stacked in three dimensions like Lego blocks. This is an extreme example of a trend towards greater redundancy and modularity in storage systems, aiming for a "scale out" approach of combining many small units, as opposed to a "scale up" approach of buying bigger and bigger boxes.

"We've been working on a variety of technologies trying to address the idea of scale out for storage: how you do build large storage systems as a collection of smaller components, focusing on having a level of manageability and reliability that meets or exceeds that of larger storage systems," says Kandlur. "This gives you the option of growing your systems more gracefully and matching the requirements of different applications in a much more scalable manner." But as with the difference between SCSI and ATA disks, Kandlur thinks this approach may not be best suited to high-performance transactional systems. "We see this is being appropriate for several classes of applications; perhaps not for transaction processing which will probably still go with the scale-up systems," he explains.

Currently storage can be connected to the systems it serves either directly using SCSI or ATA, over the network using Ethernet (network attached storage or NAS), or in a storage area network (SAN) using fibre channel. However, these distinctions are beginning to blur, with direct attached being the first to go. "Over the next few years you will effectively see the complete migration to storage networks away from the direct attached model in most datacentres," says Kandlur. The difference between NAS and SAN will also become less of an issue. "The argument over NAS vs SAN is moving away from a major decision to a provisioning issue," says McIsaac.

The emerging of the IP-based storage protocol iSCSI -- which allows storage data to be transported over IP networks, even across the Internet -- is considered by analysts unlikely to become a serious competitor to Fibre Channel, but will find niche applications such as transporting data between campuses linked in a WAN. "Meanwhile Fibre Channel becomes the dominant backbone," says McIsaac.

To cope with increasing data volumes, connectivity will have to expand greatly over the next few years. "You will also see the introduction of 10Gbps links, probably going to 40Gbps within 10 years. This will match the requirements coming from the applications," says Kandlur.

  • See ya, SCSI?
  • Advertisement

    Talkback 2 comments

      Sony already have a 500GB nati ...Anonymous -- 13/07/04

      Sony already have a 500GB native capacity tape, the Super-AIT. But where is quantum storage...?

      Dear Editor(s): I have a kind ...Anonymous -- 14/12/04

      Dear Editor(s):

      I have a kind comment on your article about data storage demand in general.

      During the last three years (2001 - 2004), there is a slow-down in consumers demand concerning the Hard Disk Drives For Desktop Applications.

      Let us compare the previous time-period: 1998 - 2001, WHEN the hard drives were at 2.1 GB and they reached 20 GB in late 2000. This is 10 TIMES UP in two years. Well, do the today's (late 2004) desktop PCs have 200 GB drives?

      The answer is NO (at least in Europe). The majority of consumers does not seem to seek more than 80 GB for their PCs. Of course, the HDD makers sell 250 or 400 GB drives BUT ONLY to a few seekers (mainly for movies storage).

      The above mean that we may need TeraBytes much longer than we think. On the other hand, other applications e.g, NEW cell phones, game machines, PDAs etc REQUIRE Hard Disks for their operation. But whether or not these devices will START TO DRIVE the consumers demand for TeraBytes is something that we have to see it.

      Kind Regards,

      Basil Dimitropoulos
      http://www.energynews.gr/jobs.htm

    Add your opinion

    Latest Videos

    Sponsored content

    Power Centre - Content from our premier sponsors

    Blogs

    • Phil Dobbie A guide to the future of the internet
      Last week we looked at the history of the internet in Australia. It's been around for 20 years and changed our lives in so many ways. Imagine what it could do given another 20 years.
    • Array Carelessness busts Linux security
      No operating system can ever properly protect a computer from trojans as long as users continue to do silly things. Just because Linux is immune to your standard drive-by viruses it does not mean that it can escape trojan horses.
    • Array Sun shining on Ajnaware
      Graham Dawson talks about the future of iPhone app development and augmented reality.
    • More blogs »

    Tags

    Back to top

    Featured