Administration Guide
- About This Guide
- I Cluster Management
- 1 User Privileges and Command Prompts
- 2 Salt Cluster Administration
- 2.1 Adding New Cluster Nodes
- 2.2 Adding New Roles to Nodes
- 2.3 Removing and Reinstalling Cluster Nodes
- 2.4 Redeploying Monitor Nodes
- 2.5 Verify an Encrypted OSD
- 2.6 Adding an OSD Disk to a Node
- 2.7 Removing an OSD
- 2.8 Replacing an OSD Disk
- 2.9 Recovering a Reinstalled OSD Node
- 2.10 Moving the Admin Node to a New Server
- 2.11 Automated Installation via Salt
- 2.12 Updating the Cluster Nodes
- 2.13 Halting or Rebooting Cluster
- 2.14 Adjusting
ceph.confwith Custom Settings - 2.15 Enabling AppArmor Profiles
- 2.16 Deactivating Tuned Profiles
- 2.17 Removing an Entire Ceph Cluster
- 3 Backing Up Cluster Configuration and Data
- II Ceph Dashboard
- 4 About Ceph Dashboard
- 5 Dashboard's Web User Interface
- 6 Managing Dashboard Users and Roles
- 7 Viewing Cluster Internals
- 8 Managing Pools
- 9 Managing RADOS Block Devices
- 10 Managing NFS Ganesha
- 11 Managing Ceph File Systems
- 12 Managing Object Gateways
- 13 Manual Configuration
- 14 Managing Users and Roles on the Command Line
- III Operating a Cluster
- 15 Introduction
- 16 Operating Ceph Services
- 17 Determining Cluster State
- 17.1 Checking a Cluster's Status
- 17.2 Checking Cluster Health
- 17.3 Watching a Cluster
- 17.4 Checking a Cluster's Usage Stats
- 17.5 Checking OSD Status
- 17.6 Checking for Full OSDs
- 17.7 Checking Monitor Status
- 17.8 Checking Placement Group States
- 17.9 Using the Admin Socket
- 17.10 Storage Capacity
- 17.11 Monitoring OSDs and Placement Groups
- 17.12 OSD Is Not Running
- 18 Monitoring and Alerting
- 19 Authentication with
cephx - 20 Stored Data Management
- 21 Ceph Manager Modules
- 22 Managing Storage Pools
- 23 RADOS Block Device
- 24 Erasure Coded Pools
- 25 Ceph Cluster Configuration
- IV Accessing Cluster Data
- 26 Ceph Object Gateway
- 26.1 Object Gateway Restrictions and Naming Limitations
- 26.2 Deploying the Object Gateway
- 26.3 Operating the Object Gateway Service
- 26.4 Configuration Options
- 26.5 Managing Object Gateway Access
- 26.6 HTTP Front-ends
- 26.7 Enabling HTTPS/SSL for Object Gateways
- 26.8 Synchronization Modules
- 26.9 LDAP Authentication
- 26.10 Bucket Index Sharding
- 26.11 Integrating OpenStack Keystone
- 26.12 Pool Placement and Storage Classes
- 26.13 Multisite Object Gateways
- 26.14 Load Balancing the Object Gateway Servers with HAProxy
- 27 Ceph iSCSI Gateway
- 28 Clustered File System
- 29 Exporting Ceph Data via Samba
- 30 NFS Ganesha: Export Ceph Data via NFS
- 26 Ceph Object Gateway
- V Integration with Virtualization Tools
- VI FAQs, Tips and Troubleshooting
- 33 Hints and Tips
- 33.1 Identifying Orphaned Partitions
- 33.2 Adjusting Scrubbing
- 33.3 Stopping OSDs without Rebalancing
- 33.4 Time Synchronization of Nodes
- 33.5 Checking for Unbalanced Data Writing
- 33.6 Btrfs Subvolume for
/var/lib/cephon Ceph Monitor Nodes - 33.7 Increasing File Descriptors
- 33.8 Integration with Virtualization Software
- 33.9 Firewall Settings for Ceph
- 33.10 Testing Network Performance
- 33.11 How to Locate Physical Disks Using LED Lights
- 34 Frequently Asked Questions
- 35 Troubleshooting
- 35.1 Reporting Software Problems
- 35.2 Sending Large Objects with
radosFails with Full OSD - 35.3 Corrupted XFS File system
- 35.4 'Too Many PGs per OSD' Status Message
- 35.5 'nn pg stuck inactive' Status Message
- 35.6 OSD Weight is 0
- 35.7 OSD is Down
- 35.8 Finding Slow OSDs
- 35.9 Fixing Clock Skew Warnings
- 35.10 Poor Cluster Performance Caused by Network Problems
- 35.11
/varRunning Out of Space - 35.12 OSD Panic Occurs when Media Error Happens during FileStore Directory Split
- 33 Hints and Tips
- A DeepSea Stage 1 Custom Example
- B Ceph Maintenance Updates Based on Upstream 'Nautilus' Point Releases
- Glossary
- C Documentation Updates
- 5.1 Ceph Dashboard Login Screen
- 5.2 Ceph Dashboard Home Page
- 5.3 Status Widgets
- 5.4 performance Widgets
- 5.5 Capacity Widgets
- 6.1 User Management
- 6.2 Adding a User
- 6.3 User Roles
- 6.4 Adding a Role
- 7.1 Hosts
- 7.2 Ceph Monitors
- 7.3 Ceph OSDs
- 7.4 OSD Flags
- 7.5 OSD Recovery Priority
- 7.6 OSD Details
- 7.7 Cluster Configuration
- 7.8 CRUSH Map
- 7.9 Manager Modules
- 7.10 Logs
- 8.1 List of Pools
- 8.2 Adding a New Pool
- 9.1 List of RBD Images
- 9.2 RBD Details
- 9.3 RBD Configuration
- 9.4 Adding a New RBD
- 9.5 RBD Snapshots
- 9.6 List of iSCSI Targets
- 9.7 iSCSI Target Details
- 9.8 Adding a New Target
- 9.9 Running
rbd-mirrorDaemons - 9.10 Creating a Pool with RBD Application
- 9.11 Configuring the Replication Mode
- 9.12 Adding Peer Credentials
- 9.13 List of Replicated Pools
- 9.14 New RBD Image
- 9.15 New RBD Image Synchronized
- 9.16 RBD Images' Replication Status
- 10.1 List of NFS Exports
- 10.2 NFS Export Details
- 10.3 Adding a New NFS Export
- 10.4 Editing an NFS Export
- 11.1 CephFS Details
- 12.1 Gateway's Details
- 12.2 Gateway Users
- 12.3 Adding a New Gateway User
- 12.4 Gateway Bucket Details
- 17.1 Ceph Cluster
- 17.2 Peering Schema
- 17.3 Placement Groups Status
- 19.1 Basic
cephxAuthentication - 19.2
cephxAuthentication - 19.3
cephxAuthentication - MDS and OSD - 20.1 OSDs with Mixed Device Classes
- 20.2 Example Tree
- 20.3 Node Replacement Methods
- 20.4 Placement Groups in a Pool
- 20.5 Placement Groups and OSDs
- 22.1 Pools before Migration
- 22.2 Cache Tier Setup
- 22.3 Data Flushing
- 22.4 Setting Overlay
- 22.5 Migration Complete
- 23.1 RADOS Protocol
- 27.1 iSCSI Initiator Properties
- 27.2 Discover Target Portal
- 27.3 Target Portals
- 27.4 Targets
- 27.5 iSCSI Target Properties
- 27.6 Device Details
- 27.7 New Volume Wizard
- 27.8 Offline Disk Prompt
- 27.9 Confirm Volume Selections
- 27.10 iSCSI Initiator Properties
- 27.11 Add Target Server
- 27.12 Manage Multipath Devices
- 27.13 Paths Listing for Multipath
- 27.14 Add Storage Dialog
- 27.15 Custom Space Setting
- 27.16 iSCSI Datastore Overview
- 2.1 Removing a Salt minion from the Cluster
- 2.2 Migrating Nodes
- 2.3 Removal of a Failed Node
- 2.4 Removal of a Failed Storage Node
- 17.1 Locating an Object
- 18.1 Global Configuration
- 18.2 ROUTE
- 18.3 INHIBIT_RULE
- 18.4 HTTP_CONFIG
- 18.5 RECEIVER
- 18.6 EMAIL_CONFIG
- 18.7 HIPCHAT_CONFIG
- 18.8 PAGERDUTY_CONFIG
- 18.9 PUSHOVER_CONFIG
- 18.10 SLACK_CONFIG
- 18.11 ACTION_CONFIG for SLACK_CONFIG
- 18.12 FIELD_CONFIG for SLACK_CONFIG
- 18.13 OPSGENIE_CONFIG
- 18.14 VICTOROPS_CONFIG
- 18.15 WEBHOOK_CONFIG
- 18.16 WECHAT_CONFIG
- 18.17 Adding Custom Alerts to SUSE Enterprise Storage
- 18.18 SNMP Trap Configuration
- 20.1
crushtool --reclassify-root - 20.2
crushtool --reclassify-bucket - 25.1 Example Beast Configuration in
/etc/ceph/ceph.conf - 25.2 Example Civetweb Configuration in
/etc/ceph/ceph.conf - 26.1 Trivial Configuration
- 26.2 Non-trivial Configuration
Copyright © 2022 SUSE LLC
Copyright © 2016, RedHat, Inc, and contributors.
The text of and illustrations in this document are licensed under a Creative Commons Attribution-Share Alike 4.0 International ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/4.0/legalcode. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version.
Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, MetaMatrix, Fedora, the Infinity Logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. Linux® is the registered trademark of Linus Torvalds in the United States and other countries. Java® is a registered trademark of Oracle and/or its affiliates. XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. All other trademarks are the property of their respective owners.
For SUSE trademarks, see http://www.suse.com/company/legal/. All other third-party trademarks are the property of their respective owners. Trademark symbols (®, ™ etc.) denote trademarks of SUSE and its affiliates. Asterisks (*) denote third-party trademarks.
All information found in this book has been compiled with utmost attention to detail. However, this does not guarantee complete accuracy. Neither SUSE LLC, its affiliates, the authors nor the translators shall be held liable for possible errors or the consequences thereof.