Unable to start osd with error "failed to find osd.x in keyring retval"

Issue

• Unable to start osd with error "failed to find osd.x in keyring retval"：

Feb 22 12:30:22 cephnode1 conmon[62705]: audit 2022-03-01T05:44:51.392735+0000 mon.cephnode1 (mon.0) 60787 : audit [INF] from='mgr.17976 10.115.34.101:0/273626262' entity='mgr.cephnode1.wfedgr' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch
Feb 22 12:30:23 cephnode1 conmon[62705]: cephadm 2022-03-01T05:44:51.394147+0000 mgr.cephnode1.wfedgr (mgr.17976) 135070 : cephadm [ERR] executing create_from_spec_one(([('cephnode1', <ceph.deployment.drive_selection.selector.DriveSelection object at 0x7ffa0fe7e160>), ('cephnode2', <ceph.deployment.drive_selection.selector.DriveSelection object at 0x7ffa0fe7e278>), ('cephnode1', <ceph.deployment.drive_selection.selector.DriveSelection object at 0x7ffa0fe7e7b8>)],)) failed.
Feb 22 12:30:23 cephnode1 conmon[62705]: Traceback (most recent call last):
Feb 22 12:30:23 cephnode1 conmon[62705]:   File "/usr/share/ceph/mgr/cephadm/utils.py", line 73, in do_work
Feb 22 12:30:23 cephnode1 conmon[62705]:     return f(*arg)
Feb 22 12:30:23 cephnode1 conmon[62705]:   File "/usr/share/ceph/mgr/cephadm/services/osd.py", line 62, in create_from_spec_one
Feb 22 12:30:23 cephnode1 conmon[62705]:     replace_osd_ids=osd_id_claims_for_host, env_vars=env_vars
Feb 22 12:30:23 cephnode1 conmon[62705]:   File "/usr/share/ceph/mgr/cephadm/services/osd.py", line 90, in create_single_host
Feb 22 12:30:23 cephnode1 conmon[62705]:     replace_osd_ids)
Feb 22 12:30:23 cephnode1 conmon[62705]:   File "/usr/share/ceph/mgr/cephadm/services/osd.py", line 135, in deploy_osd_daemons_for_existing_osds
Feb 22 12:30:23 cephnode1 conmon[62705]:     daemon_spec.final_config, daemon_spec.deps = self.generate_config(daemon_spec)
Feb 22 12:30:23 cephnode1 conmon[62705]:   File "/usr/share/ceph/mgr/cephadm/services/cephadmservice.py", line 380, in generate_config
Feb 22 12:30:23 cephnode1 conmon[62705]:     extra_ceph_config=daemon_spec.ceph_conf)
Feb 22 12:30:23 cephnode1 conmon[62705]:   File "/usr/share/ceph/mgr/cephadm/services/cephadmservice.py", line 422, in get_config_and_keyring
Feb 22 12:30:23 cephnode1 conmon[62705]:     'entity': entity,
Feb 22 12:30:23 cephnode1 conmon[62705]:   File "/usr/share/ceph/mgr/mgr_module.py", line 1259, in check_mon_command
Feb 22 12:30:23 cephnode1 conmon[62705]:     raise MonCommandFailed(f'{cmd_dict["prefix"]} failed: {r.stderr} retval: {r.retval}')
Feb 22 12:30:23 cephnode1 conmon[62705]: mgr_module.MonCommandFailed: auth get failed: failed to find osd.4 in keyring retval: -2