overcloud ceph deploy not following roles_data

Solution In Progress - Updated -

Issue

  • OSP 17.1.1 new DCN HCI site. The site has 3 nodes with ceph mon, mgr and osd roles and 4th node with only ceph osd role but overcloud ceph deploy command installs ceph mon mgr and osd on 4th node. It is not following the ScaleOut custom composible role created for 4th node.

  • You can see mgr and mon service have overcloud-edge1-hci-scaleout-4 cephadm shell ceph status:

[root@overcloud-edge1-hci-1 tripleo-admin]# cephadm shell ceph status
Inferring fsid b71c1646-2d73-5297-8aa1-994b80036f22
Inferring config /var/lib/ceph/b71c1646-2d73-5297-8aa1-994b80036f22/mon.overcloud-edge1-hci-1/config
Using ceph image with id 'e0a07e0bc118' and tag 'latest' created on 2023-10-09 19:12:33 +0000 UTC
satellite.spoc.localdomain/nfv_localdomain-qa-osp17_cv-osp17_containers-rhceph-6-rhel9@sha256:3ee8169c13d824d96c0494d5e58d6376f3fa8b947d81cf3e98f722e5d33028e5
  cluster:
    id:     b71c1646-2d73-5297-8aa1-994b80036f22
    health: HEALTH_OK

  services:
    mon: 4 daemons, quorum overcloud-edge1-hci-1,overcloud-edge1-hci-3,overcloud-edge1-hci-2,overcloud-edge1-hci-scaleout-4 (age 21m)
    mgr: overcloud-edge1-hci-1.vsnwim(active, since 19h), standbys: overcloud-edge1-hci-3.pskkma, overcloud-edge1-hci-2.eoyvcg, overcloud-edge1-hci-scaleout-4.zcrlcc
    osd: 80 osds: 80 up (since 21m), 80 in (since 21m)

  data:
    pools:   4 pools, 97 pgs
    objects: 2 objects, 769 KiB
    usage:   1.9 GiB used, 233 TiB / 233 TiB avail
    pgs:     97 active+clean
  • Only CephOsd is configured for this role:
- name: HciEdge1ScaleOut
  description: |
    Basic Compute Node role with OVN
  CountDefault: 0
  networks:
    InternalApi:
      subnet: internal_api_edge1
    Tenant:
      subnet: tenant_edge1
    Storage:
      subnet: storage_edge1
    StorageMgmt:
      subnet: storage_mgmt_edge1
  HostnameFormatDefault: '%stackname%-hci-scaleout-%index%'
  uses_deprecated_params: False
  disable_upgrade_deployment: True
  RoleParametersDefault:
    TunedProfileName: "cpu-partitioning"
    VhostuserSocketGroup: "hugetlbfs"
    NovaLibvirtRxQueueSize: 1024
    NovaLibvirtTxQueueSize: 1024
  ServicesDefault:
    - OS::TripleO::Services::Aide
    - OS::TripleO::Services::AuditD
    - OS::TripleO::Services::BarbicanClient
    - OS::TripleO::Services::BootParams
    - OS::TripleO::Services::CACerts
    - OS::TripleO::Services::CephClient
    - OS::TripleO::Services::CephExternal
    - OS::TripleO::Services::CephOSD
    - OS::TripleO::Services::Collectd
    - OS::TripleO::Services::ComputeCeilometerAgent
    - OS::TripleO::Services::CeilometerAgentIpmi
    - OS::TripleO::Services::ComputeNeutronCorePlugin
    - OS::TripleO::Services::ComputeNeutronL3Agent
    - OS::TripleO::Services::ComputeNeutronMetadataAgent
    - OS::TripleO::Services::ComputeNeutronOvsAgent
    - OS::TripleO::Services::ComputeNeutronOvsDpdk
    - OS::TripleO::Services::OvsDpdkNetcontrold
    - OS::TripleO::Services::ContainersLogrotateCrond
    - OS::TripleO::Services::HAproxyEdge
    - OS::TripleO::Services::IpaClient
    - OS::TripleO::Services::Ipsec
    - OS::TripleO::Services::Iscsid
    - OS::TripleO::Services::Kernel
    - OS::TripleO::Services::LoginDefs
    - OS::TripleO::Services::MetricsQdr
    - OS::TripleO::Services::Multipathd

Environment

  • Red Hat OpenStack Platform 17.1 (RHOSP)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content