Upgrading from FhGFS Version 2009.08 to 2011.04

Do NOT upgrade your packages immediately! Follow this guide.

This guide describes all steps for upgrading an existing installation based on the 2009.08 format to the new 2011.04 release.

The FhGFS 2011.04 release series is based on a new storage format, which is not compatible with the former 2009.08 on disk layout. Thus, in addition to the normal package upgrade, a format conversion tool must be run on all servers.

The local conversion process on the storage and metadata servers, described in steps 2 and 3, should generally complete within a few hours. The full metadata refresh, described in step 6, involves network communication and may take more than 10 hours for large file systems.

Before you begin, stop the FhGFS services on all clients and servers!

Note: Depending on your environment, consider a metadata backup before starting the conversion.
The upgrade tools were designed to allow resuming after an interruption or error. However, the existing metadata is converted in-place (and not copied), so problems like a power outage during the conversion process might lead to data loss. (Storage server conversion only moves files to different directories without modifying them, which is save on a journaling file system even in case of a power outage.)

Step 1: Download and Install Upgrade Tools Package

1) Download the appropriate fhgfs-upgrade package for your Linux distribution from the table below.

2) Use the rpm or dpkg command (depending on your distribution) to install the package.
Linux Base DistributionVersionArchitecturePackage Path
Suse Linux
Red Hat Linux
(including derivatives,
such as CentOS,
Scientific, Fedora, ...)
Debian GNU Linux
(including derivatives,
such as Ubuntu)
Table 1: Available fhgfs-upgrade packages

$ ssh root@storage01
$ wget http://www.fhgfs.com/release/fhgfs_2011.04/upgrade/fhgfs-upgrade-2011.04-r4.el5.x86_64.rpm
$ rpm -ihv fhgfs-upgrade-2011.04-r4.el5.x86_64.rpm

$ ssh root@storage02
$ wget ...
Example: Upgrade Tools Installation (RHEL 5)

Step 2: Storage Server Conversion

$ ssh root@storage01
$ /opt/fhgfs/sbin/fhgfs-upgrade-storage-to-2011.04 /data/fhgfs_storage

$ ssh root@storage02
$ /opt/fhgfs/sbin/fhgfs-upgrade-storage-to-2011.04 ...
Example: Storage Server Conversion

Note: You do not need to wait for the storage server conversion to complete before you start the metadata server conversion process.

Step 3: Metadata Server Conversion

$ ssh root@meta01
$ /opt/fhgfs/sbin/fhgfs-upgrade-meta-to-2011.04 /data/fhgfs_meta xattr

$ ssh root@meta02
$ /opt/fhgfs/sbin/fhgfs-upgrade-meta-to-2011.04 ...
Example: Metadata Server Conversion

Step 4: Management Server Cleanup

$ ssh root@mgmt01
$ rm -rf /data/fhgfs_mgmtd
Example: Management Server Cleanup

Step 5: Package Upgrade

Step 6: Refresh All Metadata

$ ssh root@client01
$ fhgfs-ctl mode=listnodes nodetype=meta print_details
$ fhgfs-ctl mode=listnodes nodetype=storage print_details
Example: Check Server Registration

$ ssh root@client01
$ fhgfs-ctl mode=refreshallentries nodeID=meta01 start
$ fhgfs-ctl mode=refreshallentries nodeID=meta02 start
$ ...
Example: Metadata Information Update

$ ssh root@client01
$ fhgfs-ctl mode=refreshallentries nodeID=meta01
Example: Metadata Information Update - Status Query

Step 7: Done

Valid XHTML :: Valid CSS: :: Powered by WikkaWiki