systemd 停止读和处理 runc cgroup 调用的 dbus 事件
Issue
- 在节点上启动的 Pod 处于
ContainerCreating状态,直到它们被手动删除或主机重启。 - Pod 处于
Terminating状态,直到 OpenShift 节点被手动重启。 - 部署存在许多问题,因为大多数 deploy pod 已处于
ContainerCreating状态超过一天。 - 使用
docker启动容器失败,并显示/usr/bin/docker-current:Error response from daemon: containerd: container did not start before the specified timeout - 我们在
journal中看到大量以下消息,并且无法在此特定节点上使用docker启动任何新容器。
Jun 24 10:10:26 node123 crond[111309]: pam_systemd(crond:session): Failed to create session: Connection timed out
Jun 24 10:10:26 node123 systemd-logind[10714]: Failed to start user slice user-0.slice, ignoring: Connection timed out ((null))
Jun 24 10:10:51 node123 systemd-logind[10714]: Failed to start session scope session-13692.scope: Connection timed out
systemd报告一个奇怪的错误消息,之后与DBus相关的各种操作都失败:
Jun 04 14:03:35 node123 systemd[1]: Failed to propagate agent release message: Operation not supported
- 容器卡在 ContainerCreating 状态,以下信息可在journal 日志中看到。
Jan 01 01:01:01 hostname atomic-openshift-node: I0530 01:01:01.145075 91428 server.go:470] type: 'Warning' reason: 'FailedCreatePodSandBox' Failed create pod sandbox: rpc error: code = Unknown desc = failed to start sandbox container for pod "pod-name": Error response from daemon: oci runtime error: The maximum number of active connections for UID 0 has been reached
Environment
- Red Hat Enterprise Linux 7
- OpenShift Container Platform 3.x
- systemd
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.