IT Jobs

Did you know? Techworld now offers an IT Jobs section with hundreds of jobs! Current job listings are now available for Software Developers, Web Developers, Application Engineers, Project Managers, Graduate opportunities and more. Apply for your new IT job today!

MIT baby-talk project births massive IP SAN

Project will use a 1.4 petabyte array to store digital audio, video data

Imagine a storage array with capacity that's equivalent to a stack of iPods three times the height of the Empire State Building but that can be managed with common Ethernet networking tools, and you'll get what a group of MIT scientists and four storage vendors are in the process of building.

The storage array will support an MIT Media Lab project called the Human Speechome Project that is studying how babies develop the ability to talk. The project began three months ago when MIT associate professor Deb Roy began recording his baby boy's everyday life through the use of 14 microphones and 11 fish-eye lens cameras set up throughout his house, giving researchers a bird's-eye view of every room. The baby is now nine months old.

A 5TB disk cache in the basement stores data temporarily until it is physically carted back to the Media Lab for analysis.

New chip design could help the blind to see

In order to store and then process the video and audio data, a massive storage area network (SAN) was needed to archive and search what is expected to be 1.4 petabytes of data, or 1,400TB of data, over the span of the three-year project.

The SAN is being built from commodity hardware and uses a 10GbE IP network for data transfer between the backend SAN and hundreds of servers.

"I think here what we're seeing is what the future of storage is going to be like. This is a great marriage between industry and the academic world," said Frank Moss, director of the Media Lab and a former CEO of Tivoli Systems, a maker of storage management software now owned by IBM.

Moss spoke at a press conference held yesterday at MIT's Media Lab in Cambridge, Mass.

The Human Speechome Project computing infrastructure is expected to be composed of more than 300 Hammer Z-Rack storage enclosures from Bell Microproducts, about 3,000 SATA (Serial Advanced Technology Attachment) hard disk drives from Seagate Technology LLC. and more than 100 10GbE switches and 400 blade processors from Marvell Technology Group Ltd.

The high-throughput switches are needed for the storage I/O anticipated by researchers who believe they'll be processing 700TB of data during every 12-hour analytical run. To achieve the desired performance requirements, 150-drive stripes (aggregated virtual volumes) will be created using the native virtualisation capabilities of Bell's (actually Zetera's) Z-SAN. Protection against data loss will be delivered through RAID 10 mirrors (duplicate copies) of the raw video data, transform data, and metadata files.

"Our approach allows us to eliminate a lot of cost by using high volume, commonly available systems," said Jeff Greenberg, senior director of product marketing at Zetera, the vendor designing the SAN.

The project has been amassing several terabytes of audio and video data per week of early childhood learning and socialization data in order to model human language acquisition.

"If you take all parallel tracks of data over three years you'll have 400,000 hours of video and audio data," Roy said.

Roy said an application the university built allows researchers to quickly hone in on video and audio streams that involve his child's development while avoiding video playback of empty rooms or footage of mundane tasks, such as getting a drink of water or making coffee.



What are your views on this subject? Use the form below to post a comment on this article up to 500 characters.


Characters remaining: 500

Related Storage news

HP tool offers continous laptop backup

Set it and forget.

Intel fixes drive bricking firmware update for flash drives

Company to re-release SSD software

IBM offers Lotus Symphony on Keepod USB devices

Thin USB device uses VMware to provide secure access to the Lotus suite

Sun claims record-breaking storage array

Says Storage 7000 is fastest on the planet

Related Storage reviews



Email this article to a friend or colleague:


PLEASE NOTE: Your name is used only to let the recipient know who sent the story, and in case of transmission error. Both your name and the recipient's name and address will not be used for any other purpose.

Techworld White Papers

Database security: Preventing enterprise data leaks at the source

IDC discusses the growing internal threats to business information, the impact of government regulations on the protection of data, and how enterprises must adopt database security best practices...

Download Whitepaper

Service-oriented security

SOA has become an integral part of enterprise software by providing a framework to efficiently develop software as services that is easily sharable, reusable, and integrated. No where is the need more apparent than in the Identity Management space. Welcome to the age of Service-Oriented Security (SOS).

Download Whitepaper

Data protection prospective vendor checklist

Organisations need a way to map business needs against all these challenges in procuring a technical solution. To help, SANS has developed the following Prospective Vendor Checklist.

Download Whitepaper

Unlock the power of the mainframe

This whitepaper presents the notion of CICS as an integration hub based on a component-based, service-oriented architecture supporting Web services. Highlights will review the challenges and contrasted support for Web services natively in CICS.

Download Whitepaper

Techworld UK - Technology - Business

COLT White Paper

Are all VoIP services the same?

Questions to ask your service provider to ensure you get the VoIP service you need
With careful choice of partner, your business can have all the advantages of VoIP access - reduced costs, flexibility and simplicity - without the drawbacks.
This white paper is your guide to ensure you get right the VoIP service and details the pitfalls which businesses would do well to avoid.

Download white paper
BMC

Ride the express lane in the journey to speed ITIL adoption

Explore the challenges in making the journey to ITIL and the criteria for selecting consulting services
By following ITIL practices, your IT organisation will become more closely integrated with the business. We recommend making the journey to ITIL in a sequence of six incremental steps, the phases of which are driven through execution of a strategic transformational roadmap.

Download white paper

Webcast: IT Financial Management: Cost Optimisation for Efficiency and Agility.
On Demand Webcast
Join this webcast to learn about the techniques and technologies that can help you prove the value of IT to the business by understanding the true cost of today's IT services and those that will be necessary to deliver future success.

Register Today

Site Map

IDG Network

* *