OpenSolaris
Collectives
Discussions
Documentation
Download
Source Browser
Free CD
Log-in
|
en
User Group qosug
:
How-to's
>
ZFS iSCSI pool integration
Top Menu
Show
:
Comments
Attachments
History
Information
Print
:
Print
Print preview
Export as PDF
Export as RTF
Export as HTML
Export as XAR
Wiki code for
ZFS iSCSI pool integration
Hide Line numbers
1: One of the biggest problems we face today, as consolidation specialists, in storage, is attempting to actually push everything to a unified //"one size fits all"// standfast. In thinking about the concept of one-size-fits-all storage consolidation, I realised that ZFS is somewhat adept at this, given the intrinsic variable sector allocation that takes place seamlessly. 2: 3: In this tangent, I began trying to come up with a way to make better backup mechanisms from Mac OS X, Vista and "other" desktop operating systems, floating around my network. One of the biggest problems thus far with Time Machine and WHS (Windows Home Server) amongst other non-enterprise desktop OS’s is that, they don’t really play well with ZFS pools when shared across CIFS or Samba (or NFS), and oftentimes, it is quite hackish, just to get them to work at all. Those familiar with Time Machine architecture will know this string off by heart: 4: 5: {{{ 6: defaults write com.apple.systempreferences TMShowUnsupportedNetworkVolumes 1 7: }}} 8: 9: You are left, on the zpool, with what is known as a "sparse bundle", whereby you force Apple’s Time Machine to recognise that an smb/NFS share is "legal" as a backup store, then it writes, what looks like an ever-expanding ISO file to the zpool. Unfortunately, no matter how you construe it, this won’t work correctly with the TimeMachine interface, and you’ll eventually get TM errors thrown as a result of the inability of the TM interface to read hard links from the ZFS pool, which is full of CoW soft links. 10: 11: So, I had a few thoughts about the use of //iscsitadm// and using proper iscsi exported LUN’s back to the clients to achieve this task a little more succinctly. 12: 13: 1. Installed OpenSolaris snv_103 on Intel Core2Duo Q6600 system 14: 15: 2. Created a raidz1 array 16: 17: {{{ 18: 19: bash 3.2# zpool create raidz1 backups c1t1d0 c1t1d1 c1t1d2 20: 21: }}} 22: 23: 3. Add some on the fly compression 24: 25: {{{ 26: 27: zfs set compression=on backups 28: 29: }}} 30: 31: 4. Created iSCSI backing stores for separated backup volumes for each environment I wanted to cater for: 32: 33: {{{ 34: 35: bash-3.2# zfs create -s -V 100GB backups/zebra_osx_backup 36: bash-3.2# zfs create -s -V 100GB backups/zebra_linux_backup 37: bash-3.2# zfs create -s -V 250GB backups/zebra_windows_backup 38: 39: }}} 40: 41: Next, they needed to be shared out: 42: 43: {{{ 44: 45: bash-3.2# zfs set shareiscsi=on backups/zebra_osx_backup 46: bash-3.2# zfs set shareiscsi=on backups/zebra_linux_backup 47: bash-3.2# zfs set shareiscsi=on backups/zebra_windows_backup 48: 49: }}} 50: 51: 5. At this point, it would be wise to check the LUN mapping information: 52: 53: {{{ 54: 55: bash-3.2# iscsitadm list target 56: Target: backups/zebra_osx_backup 57: iSCSI Name: iqn.1986-03.com.sun:02:b32135fe-29fe-ce68-a3de-83bd0ec088b1 58: Connections: 0 59: 60: Target: backups/zebra_linux_backup 61: iSCSI Name: iqn.1986-03.com.sun:02:42859bd6-2b40-6b7c-beeb-a3d0a2be647e 62: Connections: 0 63: 64: Target: backups/zebra_windows_backup 65: iSCSI Name: iqn.1986-03.com.sun:02:f6fcb58a-b3ac-4d09-f473-b62b6126adcc 66: Connections: 0 67: 68: }}} 69: 70: 6. Mac OS X has some problems talking iSCSI without a few modifications. A non-product documented plist needs to be added, to make any initiator of any use to us. As follows, from /Library/Preferences/iSCSIconfig.plst: 71: 72: {{{ 73: 74: Manually Added Targets 75: 76: Portals 77: 78: IPSec ESP Mode 79: Normal 80: IPSec IKE Mode 81: Normal 82: IPSec PFS Mode 83: 0 84: Portal Name 85: 192.168.0.8 86: Portal Port 87: 3260 88: Use Data Digest 89: 0 90: Use Header Digest 91: 0 92: Use IPSec 93: 0 94: 95: }}} 96: 97: So, Mac OS X now understands iSCSI, but we’ll need an initiator daemon! 98: 99: 7. I found a wonderful FREE iscsi-initiator from globalSAN Inc, for Mac OS X. Once installed, I directed it to look for iSCSI targets at the IP address of the Solaris host: 100: 101: [[image:User Group qosug.files@zfsinteg1.png||alt="zfsinteg1.png"]] 102: 103: 8. Once this is dealt with, you can then take a look in disk utility, to make the LUN act as real HFS+, just as Apple would prefer it: 104: 105: [[image:User Group qosug.files@zfsinteg2.png||alt="zfsinteg2.png"]] 106: 107: At this point, one should check if Time Machine actually works: 108: 109: [[image:User Group qosug.files@zfsinteg3.png||alt="zfsinteg3.png"]] 110: 111: Indeed, it appears to. Let’s check the navigation GUI Apple provide: 112: 113: [[image:User Group qosug.files@zfsinteg4.png||alt="zfsinteg4.png"]] 114: 115: The same can be said for Windows Vista. We can make it behave just like any other disk internally to the system, with all the same behavioural patterns of NTFS, albeit, atop a ZFS zvol. We need to simply point the inbuilt Vista iSCSI initiator at the OpenSolaris host and discover targets. 116: 117: Finally, import it using the disk management utility that Windows offers, and format as a normal NTFS volume. Enjoy.
Search
Collectives
Community Group
Academic and Research
Accessibility
Advocacy
Appliances
Approachability
Architecture Process and Tools
BrandZ
Chinese Users
Community Advisory Board
Databases
Desktop
Device Drivers
Distribution
Documentation
DTrace
Emerging Platforms
Fault Management
Games on OpenSolaris
HA Clusters
HPC Developer
Installation and Packaging
Internationalization and Localization
Laptop
Logical Domains
Modular Debugger (MDB)
Networking
NFS
Observability
OpenSolaris Governing Board (OGB)
OpenSolaris Printing
OS/Net (ON)
Performance
Power Management
PowerPC
Security
Service Management Facility (smf(5))
Software Porters
Solaris Volume Manager
Storage
Systems Administration Community Group
Testing
Tools Home
Unix File Systems (UFS)
Website Community
X Window System
Xen
ZFS
Zones
Project
ADSL Modem Enhancement
ARC Process Definition
ARM Platform Port
Automatic Data Migration
BIND Update
Bluetooth Stack & Drivers
Brocade FC HBA - Initiator
Brocade FC HBA - Target
Brussels - unified network link configuration
Caiman, Solaris Install Revisited
Celeste
Český portál
Chime Visualization Tool for DTrace
CIFS client for Solaris
CIFS Server
Clearview: Network Interface Coherence
Cluster Agent: Informix Dynamic Server
Cluster Agent: OpenSolaris Container
Cluster Agent: OpenSolaris xVM
Cluster Agent: Oracle E-Business Suite
Cluster agent: PostgreSQL
Cluster Agent: Samba
Cluster Agent: Tomcat
CMT
Coarse Data Flow Parallelism
Colorado: Open HA Cluster on OpenSolaris
Command Assistant
Common Array Manager
Companion - /opt/sfw: Free and Open Source software
COMSTAR: Common Multiprotocol SCSI Target
Content
Contest
CPU Observability
Credentials Process Groups
Crossbow: Network Virtualization and Resource Control
Crypto KMS Agent Toolkit
Cryptographic Framework
Data Migration Manager
Data Tethers
Deutsches Portal
Device Detection Tool
Device Driver Utility
Device Manager
Device Mapper
Direct Rendering Infrastructure & 3D drivers
DTrace Guide
Duckwater: Simplified name services management
Easy Tools
Emancipation
Emulex Fibre Channel Device Driver
Emulex Advanced Ethernet Device Driver
Enable/Enhance Solaris support for Intel Platform
Enhance the support of USB webcams
Enhanced SMF Profiles
Enhancements for AMD-based Platforms
Erlang DTrace Integration
Ethernet bridge module for Solaris
Evaluate Conary
Events Registry
Ext3 file system support
F/OSS Package Base
Facilitation
Fibre Channel over Ethernet
Fine Grained Access Policy (FGAP)
Fingerprint Authentication
Flexible Mandatory Access Control
Forensic Tools
Fully Open X Project
Fuse on Solaris
gcore
Generic Machine Check Architecture Improvements
Google SOC
HA-JBoss
HA-MySQL
Hadoop Live CD
Hitachi
HoneyComb Fixed Content Storage
HPC Stack
Image Packaging System
Improved Performance MIB
Indiana
Innovation Awards
Input Method
Intel Graphics
Interrupt Resource Management
IP Datapath Refactoring
IP over Infiniband
IPsec Tunnel Reform
iSCSI Extensions for Remote DMA (iSER)
iSNS Server
JeOS - Just enough Operating System
JKstat - a java binding for libkstat
Journaled File System (JFS)
K Desktop Environment
Kerberos
Kernel Sockets
Kernel SSL Enhancements
Key Management Framework
Korn Shell 93 integration/migration project
Labeled IPsec
LatencyTOP
Layer 2 Filtering
LDoms Manager
Lending
libMicro - portable microbenchmarks
Link Layer Discovery
Live Media: Technologies for distributions running from CD and other media
Locale Data
lofi compression and cryptography support
lx64 brand
Media Management System
Mega_sas
Mexico
MilaX minimal Live Distribution
MIPS Platform Port
Mozilla DTrace
MRSL.NONsharedDevice
Multi-lingual Glossary
Multi-pathing software (MPxIO)
Multiple disk sector size support
Multiple DOI
Muskoka: An open repository for OpenSolaris technical content
Navigator
Nemo: A Framework for High-Performance Networking
Network Auto-Magic
Network Data Management Protocol
Network MIBs
Network Storage
Network Time Protocol (NTP)
Nevada Globalization
New Design of 4over6 Mechanism Based on OpenSolaris
NFS RDMA transport update and performance analysis
NFS Server in non-Global Zones
NFS version 4.1 pNFS
NFSv4 namespace extensions
Nightingale: Port Songbird to OpenSolaris
NPort ID Virtualization (NPIV)
NUMA
Object Storage Device (OSD) support for Solaris
OHACGE Script Based Plug-in
ON/Nevada (ONNV) Project
Open Development Infrastructure
Open HA Cluster Utilities
Open Sound System
OpenGrok
OpenPegasus CIM Server
OpenRTI
OpenSolaris Busybox
OpenSolaris Desktop
OpenSolaris Hispano
OpenSolaris Security Audit
OpenSolaris support for the QEMU processor emulator: host and guest
PEF: Packet Event Framework
Performance Wrappers
Pkgfactory
Polski Portal
Portail Francophone
Portal Brasil
Portals
Power Management Usability Interfaces
Presto: Automatic Printing Configuration
Printable Many Page Solaris Manuals
Promise SuperTrak RAID HBA Driver
QLogic Converged Network Adapter GLDv3 NIC Driver
Quagga Routing Protocol Suite Integration
RAID Configuration Utility
RBridge (IETF TRILL) support
RDMA Offload Framework
Reno: Login Process Enhancements for Interop
Resource Management
s10brand
SAM/QFS
SCM Migration Project
SCSI RDMA Protocol
SDcard Drivers
Sensor Abstraction Layer
Session Initiation Protocol
SFW
Shell: bourne shell, korn shell, C shell, etc.
Sierra: Intel WiFi Chipsets Support
Simple Panels
SM-HBA Based SAS HBA Management
SMF Documentation
Solaris iSCSI Target
Solaris PowerPC Port
SourceJuicer
Sparks: name service switch/nscd enhancements
Squashfs
Star integration/migration project
Starfish
Starter Kit
Storage Power Management
Sun Security Toolkit
Sun StorageTek Availability Suite
Support for OpenFabrics User Verbs / API on OpenSolaris OS
Support gcc4/GCCfss in Solaris
Suspend/Resume
SVR4 Packaging
Systemz
Tamarack: Removable Media Enhancements in Solaris
Tesla: OpenSolaris Enhanced Power Management
Test Development
Tickless Kernel Architecture
TIPC
Trademarks
Trusted networking interface policy database for Trusted Extensions
Trusted Platform Module support
Use Case
Validated Execution Project
Virtual Console
Virtual Network Machines
Visual Panels
Visualization for HPC
Volo
VRRP: Virtual Router Redundancy Protocol Implementation
VSCAN service
Web Stack
Website
Winchester: Schema mapping and ID mapping for AD Interoperability
Wireless USB Support
Wireless Wide Area Network
X Consolidation
x86 Generic FMA Topology Enumerator
Xen Gate
Xfce: A lightweight desktop environment
ZFS Boot and Install
ZFS on disk encryption support
Zone Manager
Zone Statistics
Русский портал
البوابة العربية
भारतीय पोर्टल
中国门户
日本ポータル
한국 포탈
User Group
Adelaide
Argentina
Arizona
Atlanta
Baltimore-Washington
Bangalore
Bangkok
Bangladesh
Beijing
Bélem
Berlin
Bhimavaram
Bloomington
Campus Ambassadors
Capital Region
Cardiff
Charlotte
Chengdu
Chennai
Chihuahua
Chile
Cleveland
Colombia
Columbus
Connecticut
Cracow
Czech
Dallas/Ft. Worth
Danish
Delaware
Edinburgh
Egypt
Finland
Florida
Front Range
FuZhou
Great Lakes
Greece
Hangzhou
Hawaii
HeFei
Houston
Hyderabad
Indonesia
Irish
Israel
Italian
Jinan
Kabul
Kansas City
Latvia
London
Madurai
Manchester
Mato Grosso
Melbourne
Minas Gerais
Minnesota
Montreal
Moscow
Mumbai
Munich
NEA
Netherlands
New England
New York City
New Zealand
NIT Hamirpur
Noroeste
Oklahoma City
Osnabrück
Peru
Philadelphia
Piaski
Pittsburgh
Porto Alegre
Puget Sound
Pune
Queensland
Research Triangle Park
Romania
Russia
San Antonio
San Diego
San Francisco
São Paulo
Scottish
Serbia
Shanghai
Shenzhen
Silicon Valley
Singapore
Slovak
South African
Southern Connecticut
St. Louis
Sweden
Switzerland
Sydney
Szczecin
Taiwan
Tecum
Thames Valley
Tokyo
Toronto
Trondheim
Tulsa
Turkey
Ukraine
University of Melbourne
Vale do Paraíba
Vancouver
Venezuela
Welsh - Cymru
Wisconsin
Xi'an
Subsites
Code Reviews
Code Repositories
Package Search
Bugster
Bugzilla
Test Machines
Planet
Mailing Lists
Elections & Polls
ARC Case Logs
Source Juicer
Package Factory
User Authentication
User Group qosug Pages
Files
How-to's
Fast root ZFS boot SXCE Upgrade using lu tools
SAM-FS atop ZFS.
ZFS iSCSI pool integration
ZFS vdev on the fly expansion - sort of