IU partners with Whamcloud to advance Lustre over WAN for data intensive scientific research
FOR IMMEDIATE RELEASE
September 15, 2010
Editors: Watch a video of Stephen Simms discussing how Whamcloud will help advance the Lustre file system and wide area network: http://pti.iu.edu/video/whamcloud
BLOOMINGTON, Ind. -- Leaders of the Data Capacitor project team at Indiana University's Pervasive Technology Institute (PTI) have launched a partnership with technology startup Whamcloud to improve upon IU's pioneering work in the use of Lustre over Wide Area Networks (WANs).
In spring 2008, the IU Data Capacitor team started using Lustre in production across WANs as part of a service providing 350TB of storage for collaborative research projects mounting file systems across the TeraGrid network and other national high speed networks. This service has proven valuable to many types of scientific research including life sciences, environmental science, and astronomy—all of which require teams of scientists to move, share, and access very large data sets among distant and remote locations.
With help from Whamcloud's team of expert Lustre networking technicians, the IU team hopes to increase the performance and reliability of their Lustre WAN service while exploring new ideas and methods for large-scale data management.
"Working with Whamcloud is a natural fit for us," said Stephen Simms, Data Capacitor project lead from PTI. "Eric Barton and Whamcloud's pool of talent have an enormous amount of Lustre networking experience. Their collaboration could help take the Data Capacitor project to an exciting new level."
The IU Data Capacitor is a high speed, high bandwidth storage system for research computing. It serves all IU campuses and is available to the national scientific research community via Internet2, National LambdaRail, and the TeraGrid—the National Science Foundation's national network of supercomputing resources for which IU serves as a Resource Provider.
The Data Capacitor allows users to access very large, remote data files as if the file system were mounted locally. It also bridges multiple geographically distributed resources to allow new workflow opportunities, doing away with cumbersome data transfer techniques.
"Working with Indiana University is a privilege. It's an opportunity to extend WAN file system performance with an incredibly knowledgeable and talented partner," said Brent Gorda, CEO of Whamcloud. "We very excited about the opportunity to do cutting-edge work with the IU team to improve Lustre's performance and reliability on WANs."
The Data Capacitor's wide area functionality currently supports several nationally funded research projects, helping to move and manage massive data sets related to polar ice sheet exploration, Alzheimer's Disease research, and research on planetary formation.
"The Whamcloud partnership could help to open up the Data Capacitor for a wide range of new scientific projects and users," said Simms. "The ability to quickly and easily move and manipulate large data sets has become essential to scientific discovery, and the Lustre-powered Data Capacitor has proven to be a very powerful tool for this purpose. If we can hone our ability to offer it over a wide area network, the value to scientific research could be exceptional."
About Pervasive Technology Institute
Pervasive Technology Institute (PTI) at Indiana University is a world-class organization dedicated to the development and delivery of innovative information technology to advance research, education, industry, and society. Supported in part by a $15-million grant from the Lilly Endowment, Inc., PTI is built upon a spirit of collaboration and brings together researchers and technologists from a range of disciplines and organizations, including the IU School of Informatics and Computing at Bloomington, the IU Maurer School of Law, and University Information Technology Services at Indiana University. For more information, see http://pti.iu.edu.
About Whamcloud
Whamcloud is a venture-backed company formed from worldwide high-performance computing (HPC) storage industry veterans focused on enabling unprecedented application scaling and information insight through the evolution of HPC storage technologies in collaboration with the world's most scalable computing centers. For more information, see http://www.whamcloud.com.
