overcloud ceph deploy not following roles_data
Issue
-
OSP 17.1.1 new DCN HCI site. The site has 3 nodes with ceph mon, mgr and osd roles and 4th node with only ceph osd role but overcloud ceph deploy command installs ceph mon mgr and osd on 4th node. It is not following the ScaleOut custom composible role created for 4th node.
-
You can see mgr and mon service have overcloud-edge1-hci-scaleout-4
cephadm shell ceph status
:
[root@overcloud-edge1-hci-1 tripleo-admin]# cephadm shell ceph status
Inferring fsid b71c1646-2d73-5297-8aa1-994b80036f22
Inferring config /var/lib/ceph/b71c1646-2d73-5297-8aa1-994b80036f22/mon.overcloud-edge1-hci-1/config
Using ceph image with id 'e0a07e0bc118' and tag 'latest' created on 2023-10-09 19:12:33 +0000 UTC
satellite.spoc.localdomain/nfv_localdomain-qa-osp17_cv-osp17_containers-rhceph-6-rhel9@sha256:3ee8169c13d824d96c0494d5e58d6376f3fa8b947d81cf3e98f722e5d33028e5
cluster:
id: b71c1646-2d73-5297-8aa1-994b80036f22
health: HEALTH_OK
services:
mon: 4 daemons, quorum overcloud-edge1-hci-1,overcloud-edge1-hci-3,overcloud-edge1-hci-2,overcloud-edge1-hci-scaleout-4 (age 21m)
mgr: overcloud-edge1-hci-1.vsnwim(active, since 19h), standbys: overcloud-edge1-hci-3.pskkma, overcloud-edge1-hci-2.eoyvcg, overcloud-edge1-hci-scaleout-4.zcrlcc
osd: 80 osds: 80 up (since 21m), 80 in (since 21m)
data:
pools: 4 pools, 97 pgs
objects: 2 objects, 769 KiB
usage: 1.9 GiB used, 233 TiB / 233 TiB avail
pgs: 97 active+clean
- Only CephOsd is configured for this role:
- name: HciEdge1ScaleOut
description: |
Basic Compute Node role with OVN
CountDefault: 0
networks:
InternalApi:
subnet: internal_api_edge1
Tenant:
subnet: tenant_edge1
Storage:
subnet: storage_edge1
StorageMgmt:
subnet: storage_mgmt_edge1
HostnameFormatDefault: '%stackname%-hci-scaleout-%index%'
uses_deprecated_params: False
disable_upgrade_deployment: True
RoleParametersDefault:
TunedProfileName: "cpu-partitioning"
VhostuserSocketGroup: "hugetlbfs"
NovaLibvirtRxQueueSize: 1024
NovaLibvirtTxQueueSize: 1024
ServicesDefault:
- OS::TripleO::Services::Aide
- OS::TripleO::Services::AuditD
- OS::TripleO::Services::BarbicanClient
- OS::TripleO::Services::BootParams
- OS::TripleO::Services::CACerts
- OS::TripleO::Services::CephClient
- OS::TripleO::Services::CephExternal
- OS::TripleO::Services::CephOSD
- OS::TripleO::Services::Collectd
- OS::TripleO::Services::ComputeCeilometerAgent
- OS::TripleO::Services::CeilometerAgentIpmi
- OS::TripleO::Services::ComputeNeutronCorePlugin
- OS::TripleO::Services::ComputeNeutronL3Agent
- OS::TripleO::Services::ComputeNeutronMetadataAgent
- OS::TripleO::Services::ComputeNeutronOvsAgent
- OS::TripleO::Services::ComputeNeutronOvsDpdk
- OS::TripleO::Services::OvsDpdkNetcontrold
- OS::TripleO::Services::ContainersLogrotateCrond
- OS::TripleO::Services::HAproxyEdge
- OS::TripleO::Services::IpaClient
- OS::TripleO::Services::Ipsec
- OS::TripleO::Services::Iscsid
- OS::TripleO::Services::Kernel
- OS::TripleO::Services::LoginDefs
- OS::TripleO::Services::MetricsQdr
- OS::TripleO::Services::Multipathd
Environment
- Red Hat OpenStack Platform 17.1 (RHOSP)
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.