A Study of the Zettabyte File System (ZFS)
Kurchi Subhra Hazra - lead student researcher Goutam Sanyal - faculty advisor Tania Hamid - student researcher
National Institute of Technology, Durgapur, West Bengal, India
Second Progress Report [PDF]
First Progress Report [PDF]
Statement of Purpose:
The research work is aimed at carrying out a thorough study of Zettabyte File System, a new kind of file system developed by Sun Microsystems for Solaris OS, which claims to provide simple administration, transactional semantics, end-to-end data integrity, and immense scalability. We propose verifying its performance and explain the working behind it. As an ambitious proposal, we also intend to suggest some possible improvements in it.
Abstract
ZFS is a new kind of file system that provides simple administration, transactional semantics, end-to-end data integrity, and immense scalability. ZFS is not an incremental improvement to existing technology; it is a fundamentally new approach to data management. Although ZFS has is available on all Solaris 10 OS-supported platforms now, there has not been much of work to explain and verify every detail of it.
Some work has already been done in this connection though. There exists white papers like “Solaris ZFS vs. Red Hat Enterprise Linux EXT3 White Paper”, “Solaris ZFS and Microsoft Windows Server 2003 NTFS File System Performance” and “SOLARIS™ ZFS AND VERITAS STORAGE FOUNDATION FILE SYSTEM PERFORMANCE White Paper June 2007 to compare the performance of ZFS to other file systems.
Key technology goals of the project
- Carry out a thorough study of ZFS
- Compare and contrast it with other file systems
- Write a thorough one stop document as a ZFS reference material
Research Methodology
Module 1: A thorough conceptual study
Time: 12 weeks
Initially, a thorough study of ZFS is to be carried out. We intend to install Solaris 10 or use a Sun Workstation, as grants permit, and study the working of ZFS. We plan to verify the following claimed characteristics of ZFS :
Pooled storage
- Completely eliminates the antique notion of volumes
- Does for storage what VM did for memory
Transactional object system
- Always consistent on disk – no fsck, ever
- Universal – file, block, iSCSI, swap ...
Provable end-to-end data integrity
- Detects and corrects silent data corruption
- Historically considered “too expensive” – no longer true
Simple administration
- Concisely express your intent
We also take a thorough look into the compression standards used in ZFS as well as the encryption techniques used.
Module 2: A thorough comparative study of ZFS verses other File Systems
Time: 6 weeks
In this phase, a comparative study of ZFS with other file systems ( Linux Ext 3 and NTFS) will be carried out, to bring to light the advantages of ZFS over other file systems. All concepts behind ZFS will be compared and contrasted with that of the other file systems mentioned.
Module 3: Comprehensive All encompassing Document on ZFS and possible suggestion for improvements in ZFS
Time: 4 weeks
In this phase, we plan to put together all our study under one document(in pdf format) that will serve as a detailed reference for ZFS. The document will be comprehensive, as well as, well illustrated easy to read.
Besides, as time permits, based on our research work, we would also like to point out possible suggestions to improve the file system.
The grant from OpenSolaris community will help us in purchasing any required systems(Sun work station) or softwares (Solaris 10/Linux/Other softwares required for performance evaluation) that will be required to carry out the work in the given 3 phases.
Expected outcome of this research
The proposed research work will be beneficial to the entire Open Solaris community. A simple search shows the lack of knowledge resources on ZFS. We thus intend to come up with a detailed and comprehensive document on ZFS, the concepts behind it and its advantages.
Significant Deliverables:
- A complete reference document on ZFS in pdf format.
- We also plan to hold talks and seminars on campus to make them aware of the file system and its advantages.
References
- http://www.opensolaris.org/os/community/zfs/
- http://www.sun.com/2004-0914/feature/
- http://www.opensolaris.org/os/community/zfs/whatis/
- White Paper: Solaris ZFS and Red Hat Enterprise Linux ext3 File System Performance
- http://blogs.sun.com/roch/entry/the_dynamics_of_zfs
- Introduction to Operating Systems: A Hands-On ApproachUsing the OpenSolaris Project Student Guide