A Documentation Updates #
This chapter lists content changes for this document since the initial release of SUSE Enterprise Storage 4. You can find changes related to the cluster deployment that apply to previous versions in https://documentation.suse.com/ses/5.5/single-html/ses-deployment/#ap-deploy-docupdate.
The document was updated on the following dates:
A.1 The Latest Documentation Update #
Bugfixes #
Added an important box stating that encrypted OSDs boot longer than unencrypted in Section 4.5.1.6, “Deploying Encrypted OSDs” (https://bugzilla.suse.com/show_bug.cgi?id=1124813).
Added a step to disable AppArmor profiles in Important: Software Requirements (https://bugzilla.suse.com/show_bug.cgi?id=1127297).
Added Section 10.4.4, “Authentication and Access Control” and extended Section 10.4.6, “Advanced Settings” (https://bugzilla.suse.com/show_bug.cgi?id=1114705).
Added DeepSea stage 2 to the deployment process in Procedure 12.0, “” (https://bugzilla.suse.com/show_bug.cgi?id=1119167).
Added Section 1.3, “User Privileges and Command Prompts” (https://bugzilla.suse.com/show_bug.cgi?id=1116537).
Added Section 5.4.2, “Details on the
salt target ceph.maintenance.upgradeCommand” (https://bugzilla.suse.com/show_bug.cgi?id=1104794).
A.2 October, 2018 (Documentation Maintenance Update) #
General Updates #
Added Chapter 3, Ceph Admin Node HA Setup (Fate#325622).
Encrypted OSDs during deployment and upgrade in Section 4.5.1.6, “Deploying Encrypted OSDs” and Section 5.3, “Encrypting OSDs during Upgrade” (Fate#321665).
Bugfixes #
Cleaned the update repository sections in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1109377).
Added Section 4.5.1.5, “Overriding Default Search for Disk Devices” (https://bugzilla.suse.com/show_bug.cgi?id=1105967).
Prepended DeepSea Stage 0 execution in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1110440).
Fixed creation of demo users in Section 12.2, “Example Installation” (https://bugzilla.suse.com/show_bug.cgi?id=1105739).
Removed the default
stage_prep_masterandstage_prep_minionvalues in Section 7.1.5, “Updates and Reboots during Stage 0” (https://bugzilla.suse.com/show_bug.cgi?id=1103242).Updated various parts of Chapter 13, Exporting Ceph Data via Samba (https://bugzilla.suse.com/show_bug.cgi?id=1101478).
Added information on preconfiguring network settings by a custom
cluster.ymlin Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1099448).Removed spare
role-igwdefinitions (https://bugzilla.suse.com/show_bug.cgi?id=1099687).Added a tip on running a second terminal session for the monitor mode in Section 4.4.1, “DeepSea CLI: Monitor Mode” (https://bugzilla.suse.com/show_bug.cgi?id=1099453).
Non-data Object Gateway pools need to be replicated in Section 9.1.1.2, “Create Pools (Optional)” (https://bugzilla.suse.com/show_bug.cgi?id=1095743).
FQDN of all nodes must be resolvable to the public network IP. See Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1067113).
Added a tip on sharing multiple roles in Chapter 4, Deploying with DeepSea/Salt (https://bugzilla.suse.com/show_bug.cgi?id=1093824).
Added Section 2.4, “Metadata Server Nodes” (https://bugzilla.suse.com/show_bug.cgi?id=1047230).
Manually edit
policy.cfgfor openATTIC (https://bugzilla.suse.com/show_bug.cgi?id=1073331).Recommended on SSD in Section 2.2, “Monitor Nodes” (https://bugzilla.suse.com/show_bug.cgi?id=1056322).
Added Section 1.5, “BlueStore” and Section 2.1.3, “Recommended Size for the BlueStore's WAL and DB Device” (https://bugzilla.suse.com/show_bug.cgi?id=1072502).
Extended the deployment of encrypted OSDs in Section 4.5.1.6, “Deploying Encrypted OSDs” (https://bugzilla.suse.com/show_bug.cgi?id=1093003).
Increased the number of bytes to erase to 4M in Step 12 (https://bugzilla.suse.com/show_bug.cgi?id=1093331).
Firewall breaks DeepSea stages, in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1090683).
Added the list of repositories in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1088170).
Added instructions to manually add repositories using
zypperSection 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5”, Section 5.5, “Upgrade from SUSE Enterprise Storage 4 (ceph-deployDeployment) to 5”, and Section 5.6, “Upgrade from SUSE Enterprise Storage 4 (Crowbar Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1073308).Added a list of upgrade repositories + brief explanation of the DeepSea's
upgrade_initoption in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1073372).Added Section 7.1.5, “Updates and Reboots during Stage 0” (https://bugzilla.suse.com/show_bug.cgi?id=1081524).
Fixed prompts in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1084307).
Added Section 2.12, “SUSE Enterprise Storage 5.5 and Other SUSE Products” (https://bugzilla.suse.com/show_bug.cgi?id=1089717).
Added a note on the Object Gateway configuration sections in Book “Administration Guide”, Chapter 1 “Salt Cluster Administration”, Section 1.12 “Adjusting
ceph.confwith Custom Settings” (https://bugzilla.suse.com/show_bug.cgi?id=1089300).Added WAL/DB snippets to Section 2.1.2, “Minimum Disk Size” (https://bugzilla.suse.com/show_bug.cgi?id=1057797).
MONs' public addresses are calculated dynamically (https://bugzilla.suse.com/show_bug.cgi?id=1089151).
Fixed keyrings location in Section 5.5, “Upgrade from SUSE Enterprise Storage 4 (
ceph-deployDeployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1073368).Provided several helper snippets in Section 4.5.1.2, “Role Assignment” (https://bugzilla.suse.com/show_bug.cgi?id=1061629).
Engulfing custom
ceph.confin Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1085443).Updated RAM value recommended for BlueStore deployment in Section 2.1.1, “Minimum Requirements” (https://bugzilla.suse.com/show_bug.cgi?id=1076385)).
Added manual steps to upgrade the iSCSI Gateways after the engulf command in Section 5.5, “Upgrade from SUSE Enterprise Storage 4 (
ceph-deployDeployment) to 5” and Section 5.6, “Upgrade from SUSE Enterprise Storage 4 (Crowbar Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1073327)).The iSCSI Gateway deployment updated to the DeepSea way in Section 10.4, “Installation and Configuration” (https://bugzilla.suse.com/show_bug.cgi?id=1073327).
CephFS quotas are not supported. See Section 11.1, “Supported CephFS Scenarios and Guidance” (https://bugzilla.suse.com/show_bug.cgi?id=1077269). CephFS quotas are not supported. See Section 11.1, “Supported CephFS Scenarios and Guidance”. (https://bugzilla.suse.com/show_bug.cgi?id=1077269))
Include partitions with higher numbers than 9 in zeroing step, see Step 12. (https://bugzilla.suse.com/show_bug.cgi?id=1050230).
A.3 November, 2017 (Maintenance Update) #
General Updates #
Bugfixes #
Enhanced the disk wiping strategy in Step 12 of Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1073897).
Added tip on disengaging safety measures in Section 5.4.1, “OSD Migration to BlueStore” (https://bugzilla.suse.com/show_bug.cgi?id=1073720).
Referred to Section 4.2.2.1, “Matching the Minion Name” in Procedure 4.1, “Running Deployment Stages” and Book “Administration Guide”, Chapter 1 “Salt Cluster Administration”, Section 1.1 “Adding New Cluster Nodes” to unify the information source (https://bugzilla.suse.com/show_bug.cgi?id=1073374).
In Section 5.2, “General Upgrade Procedure” only update Salt master and minion and not all packages. Therefore replace
salt target state.apply ceph.updateswithsalt target state.apply ceph.updates.salt(https://bugzilla.suse.com/show_bug.cgi?id=1073373).Added Section 5.6, “Upgrade from SUSE Enterprise Storage 4 (Crowbar Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1073317 and https://bugzilla.suse.com/show_bug.cgi?id=1073701).
Replaced '*' with target and extended the targeting introduction in Section 4.2.2, “Targeting the Minions” (https://bugzilla.suse.com/show_bug.cgi?id=1068956).
Added verification of Salt minions' fingerprints in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1064045).
Removed advice to copy the example refactor.conf file in Book “Administration Guide”, Chapter 1 “Salt Cluster Administration”, Section 1.9 “Automated Installation via Salt” (https://bugzilla.suse.com/show_bug.cgi?id=1065926).
Fixed path to network configuration YAML file in Procedure 4.1, “Running Deployment Stages” (https://bugzilla.suse.com/show_bug.cgi?id=1067730).
Verify the cluster layout in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1067189).
Added
ceph osd set sortbitwiseto Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” and Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1067146).osd crush locationis gone,ceph.confis customized differently in Important: Software Requirements (https://bugzilla.suse.com/show_bug.cgi?id=1067381).Fixed 'role-admin' from 'role-master' in Section 4.5.1.2, “Role Assignment” (https://bugzilla.suse.com/show_bug.cgi?id=1064056).
Fixed path to
cluster.ymlin Procedure 4.1, “Running Deployment Stages” (https://bugzilla.suse.com/show_bug.cgi?id=1066711).Added Section 12.3.5, “NFS Ganesha HA and DeepSea” (https://bugzilla.suse.com/show_bug.cgi?id=1058313).
Re-added Section 2.7.2, “Monitor Nodes on Different Subnets” (https://bugzilla.suse.com/show_bug.cgi?id=1050115).
The file
deepsea_minions.slsmust contain only onedeepsea_minionsentry. See Procedure 4.1, “Running Deployment Stages”. (https://bugzilla.suse.com/show_bug.cgi?id=1065403)Changed order of steps in first procedure of Section 4.3, “Cluster Deployment”. (https://bugzilla.suse.com/show_bug.cgi?id=1064770)
Clarified Section 5.4.1, “OSD Migration to BlueStore”. (https://bugzilla.suse.com/show_bug.cgi?id=1063250)
A.4 October, 2017 (Release of SUSE Enterprise Storage 5) #
General Updates #
Added Section 5.7, “Upgrade from SUSE Enterprise Storage 3 to 5” (Fate #323072).
Removed the obsolete
Crowbarinstallation tool in favor of DeepSea.Removed the obsolete
ceph-deploytool in favor of DeepSea.Updated Chapter 2, Hardware Requirements and Recommendations (https://bugzilla.suse.com/show_bug.cgi?id=1029544 and https://bugzilla.suse.com/show_bug.cgi?id=1042283).
Updated Chapter 12, Installation of NFS Ganesha (https://bugzilla.suse.com/show_bug.cgi?id=1036495, https://bugzilla.suse.com/show_bug.cgi?id=1031444, FATE#322464).
DeepSea naming schema of profiles changed. See Section 4.5.1.4, “Profile Assignment” (https://bugzilla.suse.com/show_bug.cgi?id=1046108).
CephFS can be used on EC pools, see Section 11.3.1, “Creating CephFS” (FATE#321617).
Bugfixes #
Added Section 10.5, “Exporting RADOS Block Device Images using
tcmu-runner” (https://bugzilla.suse.com/show_bug.cgi?id=1064467).Improved the upgrade procedure to include the openATTIC role in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1064621).
Added a reference to Procedure 4.1, “Running Deployment Stages” in Step 4 (https://bugzilla.suse.com/show_bug.cgi?id=1064276).
Modified the upgrade procedure in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1061608 and https://bugzilla.suse.com/show_bug.cgi?id=1048959).
Added
rgw.confin Book “Administration Guide”, Chapter 1 “Salt Cluster Administration”, Section 1.12 “Adjustingceph.confwith Custom Settings” (https://bugzilla.suse.com/show_bug.cgi?id=1062109).Moved DeepSea installation to the very end in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1056292).
Added Section 4.5.1.6, “Deploying Encrypted OSDs” (https://bugzilla.suse.com/show_bug.cgi?id=1061751).
Updated and simplified the upgrade procedure in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1059362).
Check for DeepSea version before upgrade in Important: Software Requirements (https://bugzilla.suse.com/show_bug.cgi?id=1059331).
Prefixing custom .sls files with
custom-in Section 7.1, “Using Customized Configuration Files” (https://bugzilla.suse.com/show_bug.cgi?id=1048568).Added a note about key caps mismatch in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1054186).
Merged redundant list items in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1055140).
Added a note about the long time the cluster upgrade may take in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1054079).
Salt minions targeting with
deepsea_minions:is mandatory (https://bugzilla.suse.com/show_bug.cgi?id=1054229).Inserted Stage 1 after engulfing in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1054155).
Added Book “Administration Guide”, Chapter 1 “Salt Cluster Administration”, Section 1.12 “Adjusting
ceph.confwith Custom Settings” (https://bugzilla.suse.com/show_bug.cgi?id=1052806).Added missing steps in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1052597).
Fixed
radosgw-admincommand syntax in Section 12.2, “Example Installation” (https://bugzilla.suse.com/show_bug.cgi?id=1052698).'salt' is not the required host name of the Salt master during the upgrade in Procedure 5.1, “Steps to Apply to All Cluster Nodes (including the Calamari Node)” (https://bugzilla.suse.com/show_bug.cgi?id=1052907).
Better wording and text flow in the 'important' section of Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1052147).
Added a note about manual role assignment during engulfment in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1050554).
Added Section 5.4.1, “OSD Migration to BlueStore” (https://bugzilla.suse.com/show_bug.cgi?id=1052210).
Explained
salt-run populate.engulf_existing_clusterin detail in Procedure 5.2, “Steps to Apply to the Salt master Node” (https://bugzilla.suse.com/show_bug.cgi?id=1051258).Added openATTIC role in Section 4.5.1.8, “Example
policy.cfgFile” (https://bugzilla.suse.com/show_bug.cgi?id=1052076).Fixed
profile-defaultpaths in Section 4.5.1.8, “Examplepolicy.cfgFile” (https://bugzilla.suse.com/show_bug.cgi?id=1051760).Detached previous section into a new chapter Chapter 7, Customizing the Default Configuration (https://bugzilla.suse.com/show_bug.cgi?id=1050238).
Referencing to Section 1.2.3, “Ceph Nodes and Daemons” from DeepSea Stages Description to keep the list of Ceph services up-to-date (https://bugzilla.suse.com/show_bug.cgi?id=1050221).
Improved Salt master description and wording in Chapter 4, Deploying with DeepSea/Salt (https://bugzilla.suse.com/show_bug.cgi?id=1050214).
Added optional node roles description in Section 1.2.3, “Ceph Nodes and Daemons” (https://bugzilla.suse.com/show_bug.cgi?id=1050085).
Updated the upgrade procedure in general (https://bugzilla.suse.com/show_bug.cgi?id=1048436, https://bugzilla.suse.com/show_bug.cgi?id=1048959, and https://bugzilla.suse.com/show_bug.cgi?id=104i7085).
Added a new DeepSea role Ceph Manager (https://bugzilla.suse.com/show_bug.cgi?id=1047472).
Added Section 5.5, “Upgrade from SUSE Enterprise Storage 4 (
ceph-deployDeployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1048436).Made Stage 0 fully optional in DeepSea Stages Description (https://bugzilla.suse.com/show_bug.cgi?id=1045845).
Updated the list of default pools in Section 9.1.1, “Object Gateway Configuration” (https://bugzilla.suse.com/show_bug.cgi?id=1034039).
Added an 'important' snippet about Object Gateway being deployed by DeepSea now in Chapter 9, Ceph Object Gateway (https://bugzilla.suse.com/show_bug.cgi?id=1044928).
Fixed shell script in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1044684).
Added "Set
require-osd-release luminousFlag" to Section 5.2, “General Upgrade Procedure” (https://bugzilla.suse.com/show_bug.cgi?id=1040750).Added annotation to the example
policy.cfgin Section 4.5.1.8, “Examplepolicy.cfgFile” (https://bugzilla.suse.com/show_bug.cgi?id=1042691).Improved commands for OSD disk zapping in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1042074).
Removed advice to install
salt-minionon Salt master in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1041590).Added firewall recommendation to Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1039344).
Removed XML-RPC references from openATTIC
systemdcommand lines in Section 7.1, “Using Customized Configuration Files” (https://bugzilla.suse.com/show_bug.cgi?id=1037371).Fixed YAML syntax in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1035498).
Added the 'ganesha' role explanation in Section 4.5.1.2, “Role Assignment” (https://bugzilla.suse.com/show_bug.cgi?id=1037365).
Clarified and improved text flow in Section 4.5.1, “The
policy.cfgFile” (https://bugzilla.suse.com/show_bug.cgi?id=1037360).Added the SUSE Enterprise Storage 4 to 5 upgrade procedure in Section 5.4, “Upgrade from SUSE Enterprise Storage 4 (DeepSea Deployment) to 5” (https://bugzilla.suse.com/show_bug.cgi?id=1036266).
Replaced the term 'provisioning' with 'preparation' in Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1036400 and https://bugzilla.suse.com/show_bug.cgi?id=1036492).
Added warning about advanced techniques in Section 4.5.1.7, “Item Filtering” (https://bugzilla.suse.com/show_bug.cgi?id=1036278).
Replaced redundant
role-adminassignment in Section 4.5.1.8, “Examplepolicy.cfgFile” (https://bugzilla.suse.com/show_bug.cgi?id=1036506).Improved DeepSea Stages Description and Section 4.3, “Cluster Deployment” (https://bugzilla.suse.com/show_bug.cgi?id=1036278).
Added deployment steps modifications in Section 7.1, “Using Customized Configuration Files” (https://bugzilla.suse.com/show_bug.cgi?id=1026782).
Clarified and enhanced Chapter 4, Deploying with DeepSea/Salt as suggested by (https://bugzilla.suse.com/show_bug.cgi?id=1020920).
Recommended enabling custom openATTIC services in Section 7.1, “Using Customized Configuration Files” (https://bugzilla.suse.com/show_bug.cgi?id=989349).
Moved network recommendations to Chapter 2, Hardware Requirements and Recommendations and included Section 2.7.1, “Adding a Private Network to a Running Cluster” (https://bugzilla.suse.com/show_bug.cgi?id=1026569).