This is a draft document that was built and uploaded automatically. It may document beta software and be incomplete or even incorrect. Use this document at your own risk.

Jump to content Jump to page navigation: previous page [access key p]/next page [access key n]

Deployment Guide / Documentation Updates

Applies to SUSE Enterprise Storage 5.5 (SES 5 & SES 5.5)

A Documentation Updates #

This chapter lists content changes for this document since the initial release of SUSE Enterprise Storage 4. You can find changes related to the cluster deployment that apply to previous versions in https://documentation.suse.com/ses/5.5/single-html/ses-deployment/#ap-deploy-docupdate.

The document was updated on the following dates:

A.1 The Latest Documentation Update #

Bugfixes #

Added an important box stating that encrypted OSDs boot longer than unencrypted in Section 4.5.1.6, “Deploying Encrypted OSDs” (https://bugzilla.suse.com/show_bug.cgi?id=1124813).
Added a step to disable AppArmor profiles in Important: Software Requirements (https://bugzilla.suse.com/show_bug.cgi?id=1127297).
Added Section 10.4.4, “Authentication and Access Control” and extended Section 10.4.6, “Advanced Settings” (https://bugzilla.suse.com/show_bug.cgi?id=1114705).
Added DeepSea stage 2 to the deployment process in Procedure 12.0, “” (https://bugzilla.suse.com/show_bug.cgi?id=1119167).
Added Section 1.3, “User Privileges and Command Prompts” (https://bugzilla.suse.com/show_bug.cgi?id=1116537).
Added Section 5.4.2, “Details on the salt target ceph.maintenance.upgrade Command” (https://bugzilla.suse.com/show_bug.cgi?id=1104794).

A.2 October, 2018 (Documentation Maintenance Update) #

General Updates #

Added Chapter 3, Ceph Admin Node HA Setup (Fate#325622).
Encrypted OSDs during deployment and upgrade in Section 4.5.1.6, “Deploying Encrypted OSDs” and Section 5.3, “Encrypting OSDs during Upgrade” (Fate#321665).

Bugfixes #

Cleaned the update repository sections in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1109377).
Added Section 4.5.1.5, “Overriding Default Search for Disk Devices” (https://bugzilla.suse.com/show_bug.cgi?id=1105967).
Prepended DeepSea Stage 0 execution in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1110440).
Fixed creation of demo users in Section 12.2, “Example Installation” (https://bugzilla.suse.com/show_bug.cgi?id=1105739).
Removed the default stage_prep_master and stage_prep_minion values in Section 7.1.5, “Updates and Reboots during Stage 0” (https://bugzilla.suse.com/show_bug.cgi?id=1103242).
Updated various parts of Chapter 13, Exporting Ceph Data via Samba (https://bugzilla.suse.com/show_bug.cgi?id=1101478).
Added information on preconfiguring network settings by a custom cluster.yml in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1099448).
Removed spare role-igw definitions (https://bugzilla.suse.com/show_bug.cgi?id=1099687).
Added a tip on running a second terminal session for the monitor mode in Section 4.4.1, “DeepSea CLI: Monitor Mode” (https://bugzilla.suse.com/show_bug.cgi?id=1099453).
Non-data Object Gateway pools need to be replicated in Section 9.1.1.2, “Create Pools (Optional)” (https://bugzilla.suse.com/show_bug.cgi?id=1095743).
FQDN of all nodes must be resolvable to the public network IP. See Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1067113).
Added a tip on sharing multiple roles in Chapter 4, Deploying with DeepSea/Salt (https://bugzilla.suse.com/show_bug.cgi?id=1093824).
Added Section 2.4, “Metadata Server Nodes” (https://bugzilla.suse.com/show_bug.cgi?id=1047230).
Manually edit policy.cfg for openATTIC (https://bugzilla.suse.com/show_bug.cgi?id=1073331).
Recommended /var/lib/ceph on SSD in Section 2.2, “Monitor Nodes” (https://bugzilla.suse.com/show_bug.cgi?id=1056322).
Added Section 1.5, “BlueStore” and Section 2.1.3, “Recommended Size for the BlueStore's WAL and DB Device” (https://bugzilla.suse.com/show_bug.cgi?id=1072502).
Extended the deployment of encrypted OSDs in Section 4.5.1.6, “Deploying Encrypted OSDs” (https://bugzilla.suse.com/show_bug.cgi?id=1093003).
Increased the number of bytes to erase to 4M in Step 12 (https://bugzilla.suse.com/show_bug.cgi?id=1093331).
Firewall breaks DeepSea stages, in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1090683).
Added the list of repositories in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1088170).
Added instructions to manually add repositories using zypper Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5”, Section 5.5, “Upgrade from SUSE Enterprise Storage 4 (ceph-deploy Deployment) to 5”, and Section 5.6, “Upgrade from SUSE Enterprise Storage 4 (Crowbar Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1073308).
Added a list of upgrade repositories + brief explanation of the DeepSea's upgrade_init option in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1073372).
Added Section 7.1.5, “Updates and Reboots during Stage 0” (https://bugzilla.suse.com/show_bug.cgi?id=1081524).
Fixed prompts in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1084307).
Added Section 2.12, “SUSE Enterprise Storage 5.5 and Other SUSE Products” (https://bugzilla.suse.com/show_bug.cgi?id=1089717).
Added a note on the Object Gateway configuration sections in Book “Administration Guide”, Chapter 1 “Salt Cluster Administration”, Section 1.12 “Adjusting ceph.conf with Custom Settings” (https://bugzilla.suse.com/show_bug.cgi?id=1089300).
Added WAL/DB snippets to Section 2.1.2, “Minimum Disk Size” (https://bugzilla.suse.com/show_bug.cgi?id=1057797).
MONs' public addresses are calculated dynamically (https://bugzilla.suse.com/show_bug.cgi?id=1089151).
Fixed keyrings location in Section 5.5, “Upgrade from SUSE Enterprise Storage 4 (ceph-deploy Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1073368).
Provided several helper snippets in Section 4.5.1.2, “Role Assignment” (https://bugzilla.suse.com/show_bug.cgi?id=1061629).
Engulfing custom ceph.conf in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1085443).
Updated RAM value recommended for BlueStore deployment in Section 2.1.1, “Minimum Requirements” (https://bugzilla.suse.com/show_bug.cgi?id=1076385)).
Added manual steps to upgrade the iSCSI Gateways after the engulf command in Section 5.5, “Upgrade from SUSE Enterprise Storage 4 (ceph-deploy Deployment) to 5” and Section 5.6, “Upgrade from SUSE Enterprise Storage 4 (Crowbar Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1073327)).
The iSCSI Gateway deployment updated to the DeepSea way in Section 10.4, “Installation and Configuration” (https://bugzilla.suse.com/show_bug.cgi?id=1073327).
CephFS quotas are not supported. See Section 11.1, “Supported CephFS Scenarios and Guidance” (https://bugzilla.suse.com/show_bug.cgi?id=1077269). CephFS quotas are not supported. See Section 11.1, “Supported CephFS Scenarios and Guidance”. (https://bugzilla.suse.com/show_bug.cgi?id=1077269))
Include partitions with higher numbers than 9 in zeroing step, see Step 12. (https://bugzilla.suse.com/show_bug.cgi?id=1050230).

A.3 November, 2017 (Maintenance Update) #

General Updates #

Added Section 11.3.2, “MDS Cluster Size” and Section 11.3.3, “MDS Cluster and Updates”.

Bugfixes #

Enhanced the disk wiping strategy in Step 12 of Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1073897).
Added tip on disengaging safety measures in Section 5.4.1, “OSD Migration to BlueStore” (https://bugzilla.suse.com/show_bug.cgi?id=1073720).
Referred to Section 4.2.2.1, “Matching the Minion Name” in Procedure 4.1, “Running Deployment Stages” and Book “Administration Guide”, Chapter 1 “Salt Cluster Administration”, Section 1.1 “Adding New Cluster Nodes” to unify the information source (https://bugzilla.suse.com/show_bug.cgi?id=1073374).
In Section 5.2, “General Upgrade Procedure” only update Salt master and minion and not all packages. Therefore replace salt target state.apply ceph.updates with salt target state.apply ceph.updates.salt (https://bugzilla.suse.com/show_bug.cgi?id=1073373).
Added Section 5.6, “Upgrade from SUSE Enterprise Storage 4 (Crowbar Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1073317 and https://bugzilla.suse.com/show_bug.cgi?id=1073701).
Replaced '*' with target and extended the targeting introduction in Section 4.2.2, “Targeting the Minions” (https://bugzilla.suse.com/show_bug.cgi?id=1068956).
Added verification of Salt minions' fingerprints in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1064045).
Removed advice to copy the example refactor.conf file in Book “Administration Guide”, Chapter 1 “Salt Cluster Administration”, Section 1.9 “Automated Installation via Salt” (https://bugzilla.suse.com/show_bug.cgi?id=1065926).
Fixed path to network configuration YAML file in Procedure 4.1, “Running Deployment Stages” (https://bugzilla.suse.com/show_bug.cgi?id=1067730).
Verify the cluster layout in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1067189).
Added ceph osd set sortbitwise to Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” and Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1067146).
osd crush location is gone, ceph.conf is customized differently in Important: Software Requirements (https://bugzilla.suse.com/show_bug.cgi?id=1067381).
Fixed 'role-admin' from 'role-master' in Section 4.5.1.2, “Role Assignment” (https://bugzilla.suse.com/show_bug.cgi?id=1064056).
Fixed path to cluster.yml in Procedure 4.1, “Running Deployment Stages” (https://bugzilla.suse.com/show_bug.cgi?id=1066711).
Added Section 12.3.5, “NFS Ganesha HA and DeepSea” (https://bugzilla.suse.com/show_bug.cgi?id=1058313).
Re-added Section 2.7.2, “Monitor Nodes on Different Subnets” (https://bugzilla.suse.com/show_bug.cgi?id=1050115).
The file deepsea_minions.sls must contain only one deepsea_minions entry. See Procedure 4.1, “Running Deployment Stages”. (https://bugzilla.suse.com/show_bug.cgi?id=1065403)
Changed order of steps in first procedure of Section 4.3, “Cluster Deployment”. (https://bugzilla.suse.com/show_bug.cgi?id=1064770)
Clarified Section 5.4.1, “OSD Migration to BlueStore”. (https://bugzilla.suse.com/show_bug.cgi?id=1063250)

A.4 October, 2017 (Release of SUSE Enterprise Storage 5) #

General Updates #

Added Section 5.7, “Upgrade from SUSE Enterprise Storage 3 to 5” (Fate #323072).
Removed the obsolete Crowbar installation tool in favor of DeepSea.
Removed the obsolete ceph-deploy tool in favor of DeepSea.
Updated Chapter 2, Hardware Requirements and Recommendations (https://bugzilla.suse.com/show_bug.cgi?id=1029544 and https://bugzilla.suse.com/show_bug.cgi?id=1042283).
Updated Chapter 12, Installation of NFS Ganesha (https://bugzilla.suse.com/show_bug.cgi?id=1036495, https://bugzilla.suse.com/show_bug.cgi?id=1031444, FATE#322464).
DeepSea naming schema of profiles changed. See Section 4.5.1.4, “Profile Assignment” (https://bugzilla.suse.com/show_bug.cgi?id=1046108).
CephFS can be used on EC pools, see Section 11.3.1, “Creating CephFS” (FATE#321617).

Bugfixes #

Added Section 10.5, “Exporting RADOS Block Device Images using tcmu-runner” (https://bugzilla.suse.com/show_bug.cgi?id=1064467).
Improved the upgrade procedure to include the openATTIC role in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1064621).
Added a reference to Procedure 4.1, “Running Deployment Stages” in Step 4 (https://bugzilla.suse.com/show_bug.cgi?id=1064276).
Modified the upgrade procedure in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1061608 and https://bugzilla.suse.com/show_bug.cgi?id=1048959).
Added rgw.conf in Book “Administration Guide”, Chapter 1 “Salt Cluster Administration”, Section 1.12 “Adjusting ceph.conf with Custom Settings” (https://bugzilla.suse.com/show_bug.cgi?id=1062109).
Moved DeepSea installation to the very end in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1056292).
Added Section 4.5.1.6, “Deploying Encrypted OSDs” (https://bugzilla.suse.com/show_bug.cgi?id=1061751).
Updated and simplified the upgrade procedure in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1059362).
Check for DeepSea version before upgrade in Important: Software Requirements (https://bugzilla.suse.com/show_bug.cgi?id=1059331).
Prefixing custom .sls files with custom- in Section 7.1, “Using Customized Configuration Files” (https://bugzilla.suse.com/show_bug.cgi?id=1048568).
Added a note about key caps mismatch in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1054186).
Merged redundant list items in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1055140).
Added a note about the long time the cluster upgrade may take in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1054079).
Salt minions targeting with deepsea_minions: is mandatory (https://bugzilla.suse.com/show_bug.cgi?id=1054229).
Inserted Stage 1 after engulfing in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1054155).
Added Book “Administration Guide”, Chapter 1 “Salt Cluster Administration”, Section 1.12 “Adjusting ceph.conf with Custom Settings” (https://bugzilla.suse.com/show_bug.cgi?id=1052806).
Added missing steps in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1052597).
Fixed radosgw-admin command syntax in Section 12.2, “Example Installation” (https://bugzilla.suse.com/show_bug.cgi?id=1052698).
'salt' is not the required host name of the Salt master during the upgrade in Procedure 5.1, “Steps to Apply to All Cluster Nodes (including the Calamari Node)” (https://bugzilla.suse.com/show_bug.cgi?id=1052907).
Better wording and text flow in the 'important' section of Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1052147).
Added a note about manual role assignment during engulfment in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1050554).
Added Section 5.4.1, “OSD Migration to BlueStore” (https://bugzilla.suse.com/show_bug.cgi?id=1052210).
Explained salt-run populate.engulf_existing_cluster in detail in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1051258).
Added openATTIC role in Section 4.5.1.8, “Example policy.cfg File” (https://bugzilla.suse.com/show_bug.cgi?id=1052076).
Fixed profile-default paths in Section 4.5.1.8, “Example policy.cfg File” (https://bugzilla.suse.com/show_bug.cgi?id=1051760).
Detached previous section into a new chapter Chapter 7, Customizing the Default Configuration (https://bugzilla.suse.com/show_bug.cgi?id=1050238).
Referencing to Section 1.2.3, “Ceph Nodes and Daemons” from DeepSea Stages Description to keep the list of Ceph services up-to-date (https://bugzilla.suse.com/show_bug.cgi?id=1050221).
Improved Salt master description and wording in Chapter 4, Deploying with DeepSea/Salt (https://bugzilla.suse.com/show_bug.cgi?id=1050214).
Added optional node roles description in Section 1.2.3, “Ceph Nodes and Daemons” (https://bugzilla.suse.com/show_bug.cgi?id=1050085).
Updated the upgrade procedure in general (https://bugzilla.suse.com/show_bug.cgi?id=1048436, https://bugzilla.suse.com/show_bug.cgi?id=1048959, and https://bugzilla.suse.com/show_bug.cgi?id=104i7085).
Added a new DeepSea role Ceph Manager (https://bugzilla.suse.com/show_bug.cgi?id=1047472).
Added Section 5.5, “Upgrade from SUSE Enterprise Storage 4 (ceph-deploy Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1048436).
Made Stage 0 fully optional in DeepSea Stages Description (https://bugzilla.suse.com/show_bug.cgi?id=1045845).
Updated the list of default pools in Section 9.1.1, “Object Gateway Configuration” (https://bugzilla.suse.com/show_bug.cgi?id=1034039).
Added an 'important' snippet about Object Gateway being deployed by DeepSea now in Chapter 9, Ceph Object Gateway (https://bugzilla.suse.com/show_bug.cgi?id=1044928).
Fixed shell script in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1044684).
Added "Set require-osd-release luminous Flag" to Section 5.2, “General Upgrade Procedure” (https://bugzilla.suse.com/show_bug.cgi?id=1040750).
Added annotation to the example policy.cfg in Section 4.5.1.8, “Example policy.cfg File” (https://bugzilla.suse.com/show_bug.cgi?id=1042691).
Improved commands for OSD disk zapping in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1042074).
Removed advice to install salt-minion on Salt master in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1041590).
Added firewall recommendation to Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1039344).
Removed XML-RPC references from openATTIC systemd command lines in Section 7.1, “Using Customized Configuration Files” (https://bugzilla.suse.com/show_bug.cgi?id=1037371).
Fixed YAML syntax in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1035498).
Added the 'ganesha' role explanation in Section 4.5.1.2, “Role Assignment” (https://bugzilla.suse.com/show_bug.cgi?id=1037365).
Clarified and improved text flow in Section 4.5.1, “The policy.cfg File” (https://bugzilla.suse.com/show_bug.cgi?id=1037360).
Added the SUSE Enterprise Storage 4 to 5 upgrade procedure in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1036266).
Replaced the term 'provisioning' with 'preparation' in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1036400 and https://bugzilla.suse.com/show_bug.cgi?id=1036492).
Added warning about advanced techniques in Section 4.5.1.7, “Item Filtering” (https://bugzilla.suse.com/show_bug.cgi?id=1036278).
Replaced redundant role-admin assignment in Section 4.5.1.8, “Example policy.cfg File” (https://bugzilla.suse.com/show_bug.cgi?id=1036506).
Improved DeepSea Stages Description and Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1036278).
Added deployment steps modifications in Section 7.1, “Using Customized Configuration Files” (https://bugzilla.suse.com/show_bug.cgi?id=1026782).
Clarified and enhanced Chapter 4, Deploying with DeepSea/Salt as suggested by (https://bugzilla.suse.com/show_bug.cgi?id=1020920).
Recommended enabling custom openATTIC services in Section 7.1, “Using Customized Configuration Files” (https://bugzilla.suse.com/show_bug.cgi?id=989349).
Moved network recommendations to Chapter 2, Hardware Requirements and Recommendations and included Section 2.7.1, “Adding a Private Network to a Running Cluster” (https://bugzilla.suse.com/show_bug.cgi?id=1026569).