Saturday, November 11, 2006

Cleversafe, your OSS data Grid Solution

Next step in your grid project or grid research project is Storage. At least mine is;). I have been looking for a better solution for my storage grid requirements and the first ear mark! (learned this during the elections) is that it had to be open source. So it is not easy t find a mature well functioning solution.
Then I came across Cleversafe Project. I have busy with it ever since.
Currently Cleversafe has quite a few projects under it's arms. Most notables are;

Cleversafe Dispersed Storage™
DSGrid File System™
Cleversafe Desktop™

Cleversafe Dispersed Storage™
The Dispersed Storage Project is the central point of development and idea exchange for developers around the world to contribute to innovative storage solutions leveraging dispersed storage methodology.

The project uses information dispersal algorithms IDAs to separate data into 11 unrecognizable DataSlices™ and distribute them, via secure Internet connections, to 11 storage locations throughout the world, creating a storage grid. With dispersed storage, transmission and storage of data is inherently private and secure. No single entire copy of the data is in one location, and only 6 out of the 11 nodes need to be available in order to perfectly retrieve the data.

Data on the grid remains private and secure in the face of natural catastrophes, or failures of hardware, connection, facility, or IT management. Moreover, the individual data slices do not carry enough information for an unauthorized viewer to determine the original content.

DSGrid File System™

The dsgfs project will enable a dispersed storage grid, such as the Cleversafe Research Storage Grid, a freely available, multi-terabyte globally dispersed storage grid, to appear as an ultra-reliable, durable hard drive to a Linux application. Using the dsgfs, users will be able to seamlessly store data on the Cleversafe Research Storage Grid, on a commercial grid or on a grid they build themselves. dsgfs initially will support various versions of Linux, including Debian, Fedora and CentOS.

The file system is facilitated by Cleversafe Dispersed Storage technology uses Information Dispersal Algorithms (IDAs™) to separate data into 11 unrecognizable DataSlices™ and distribute them, via secure Internet connections, to 11 storage locations throughout the world.

Cleversafe Desktop™

The Desktop Client, unlike the CLI, supports the concept of Storage Sets. Storage Sets allow files located in different locations on a computer to be grouped together as a single set. By using Storage Sets combined with the backup scheduling features of Cleversafe Desktop, ordinary users can backup individual machines at scheduled intervals, or on-demand--without the use of complex command line operations.

Cleversafe Desktop is written from the ground-up for multi-platform support. Initial releases will support Windows XP client and server flavors with various versions of Linux, including Debian, Fedora, RedHat, FreeBSD, Ubuntu and CentOS and Mac OS X ports to follow. This makes storage grids more accessible and attractive to a wider group of non-technical users and developers, including fans of Windows, Linux and embedded Linux solutions.

I really like the last one, the desktop project. Because I need the services provided by it as my clients are multi platform.
“This new project makes it much easier for a wider range of developers to use dispersed storage and explain the power of it to business managers,” said Manish Motwani, Cleversafe Desktop project lead. “It puts a presentable face on the grid, which is quite complex and technical behind-the-scenes, and adds point-and-click simplicity to better organize files for easier data retrieval. It’s also cross-platform savvy to ensure there are as few barriers as possible to using open source dispersed storage grids.”
Go explore your grid storage needs.
Links;
Cleversafe.org
Cleversafe wiki

No comments: