Upgrading from FhGFS Version 2011.04 to 2012.10

Do NOT upgrade your packages immediately! Follow this guide.

The upgrade requires a running version 2011.04 file system.

This guide describes all steps for upgrading an existing installation based on the 2011.04 format to the new 2012.10 release. Users of the 2009.08 version first need to upgrade to the 2011.04 format and only then may upgrade to the 2012.10 format.

The FhGFS 2012.10 release series is based on a new storage format, which is not compatible with the former 2011.04 on disk layout. Thus, in addition to the normal package upgrade, a format conversion tool must be run on all servers.

The local conversion process on the storage and metadata servers, described in steps 3 and 4, should generally complete within a few hours. The overall upgrade time depends on the number of files and IOPs your disks can provide. The size of user files is not relevant for the upgrade time.

Note: Depending on your environment, consider a metadata backup before starting the conversion.
The upgrade tools were designed to allow resuming after an interruption or error. However, the existing metadata is converted in-place (and not copied), so problems like a power outage during the conversion process might lead to data loss. (Storage server conversion only moves files to different directories without modifying them, which is save on a journaling file system even in case of a power outage.)

Step 1: Download and Install Upgrade Tools Package

1) Download the appropriate fhgfs-upgrade package for your Linux distribution from the table below.

2) Use the rpm or dpkg command (depending on your distribution) to install the package.
Linux Base DistributionVersionArchitecturePackage Path
Suse Linux
Red Hat Linux
(including derivatives,
such as CentOS,
Scientific, Fedora, ...)
Debian GNU Linux
(including derivatives,
such as Ubuntu)
Table 1: Available fhgfs-upgrade packages

$ ssh root@storage01
$ wget http://www.fhgfs.com/release/fhgfs_2012.10/upgrade/fhgfs-upgrade-to-2012.10-2012.10.r8-el6.x86_64.rpm
$ rpm -ihv fhgfs-upgrade-to-2012.10-2012.10.r8-el6.x86_64.rpm

$ ssh root@storage02
$ wget ...
Example: Upgrade Tools Installation (RHEL 6)

Step 2: Creation of string to numeric ID mapping files

Step 2.1: The metadata server ID mapping file

Step 2.2: The target ID mapping file

Step 2.3: The storage server ID mapping file

Step 2.4: Distribute the mapping files to all of your servers

Step 2.5: Stop FhGFS

Step 3: Storage Server Conversion

$ ssh root@storage01

# convert first target on this server...
$ /opt/fhgfs/sbin/fhgfs-upgrade-storage-to-2012.10 		\
	storeStorageDirectory=/data/fhgfs/storage/target1 	\
	metaIdMapFile=/root/metaIDMap.txt 			\
	targetIdMapFile=/root/targetIDMap.txt 			\

# convert next target (if any) on this server...
$ /opt/fhgfs/sbin/fhgfs-upgrade-storage-to-2012.10 		\
	storeStorageDirectory=/data/fhgfs/storage/target2 	\
	metaIdMapFile=/root/metaIDMap.txt 			\
	targetIdMapFile=/root/targetIDMap.txt	 		\

# continue with next server...
$ ssh root@storage02
$ /opt/fhgfs/sbin/fhgfs-upgrade-storage-to-2012.10 ...
Example: Storage Server Conversion

Note: You do not need to wait for the storage server conversion to complete before you start the metadata server conversion process.

Step 4: Metadata Server Conversion

$ ssh root@meta01
$ /opt/fhgfs/sbin/fhgfs-upgrade-meta-to-2012.10 	\
	storeMetaDirectory=/data/fhgfs/meta 		\
	metaIdMapFile=/root/metaIDMap.txt 		\

$ ssh root@meta02
$ /opt/fhgfs/sbin/fhgfs-upgrade-meta-to-2012.10 ...
Example: Metadata Server Conversion

Step 5: Management Server Cleanup

$ ssh root@mgmt01
$ rm -rf /data/fhgfs_mgmtd
Example: Management Server Cleanup

Step 6: Upgrade Errors

Step 7: Package Upgrade

Step 8: Start new FhGFS version

Step 9: Delete Backup files

Valid XHTML :: Valid CSS: :: Powered by WikkaWiki