Satellite failing to start "Traceback: /etc/cobbler/settings is not a valid YAML file"

Solution Verified - Updated -

Environment

  • Red Hat Satellite 5.6

Issue

  • Satellite failing to start "Traceback: Satellite failing to start "/etc/cobbler/settings is not a valid YAML file"
Starting osa-dispatcher: Spacewalk 28837 2014/01/06 15:14:00 +01:00: ('Not able to reconnect',)
Spacewalk 28837 2014/01/06 15:14:00 +01:00: ('Traceback (most recent call last):\n  File "/usr/share/rhn/osad/jabber_lib.py", line 252, in setup_connection\n    c = self._get_jabber_client(js)\n  File "/usr/share/rhn/osad/jabber_lib.py", line 309, in _get_jabber_client\n    c.connect()\n  File "/usr/share/rhn/osad/jabber_lib.py", line 589, in connect\n    raise SSLDisabledError\nSSLDisabledError\n',)
                                                           [  OK  ]
Starting Monitoring ...
[ OK ]
Starting MonitoringScout ...
[ OK ]
Starting rhn-search...
Starting cobbler daemon: Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/cobbler/serializer.py", line 52, in __grab_lock
    fd = open("/var/lib/cobbler/lock","w+")
IOError: [Errno 13] Permission denied: '/var/lib/cobbler/lock'
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/cobbler/config.py", line 202, in deserialize
    serializer.deserialize(self._settings)
  File "/usr/lib/python2.6/site-packages/cobbler/serializer.py", line 120, in deserialize
    __grab_lock()
  File "/usr/lib/python2.6/site-packages/cobbler/serializer.py", line 60, in __grab_lock
    sys.exit(7)
SystemExit: 7
Traceback (most recent call last):
  File "/usr/bin/cobblerd", line 76, in main
    api = cobbler_api.BootAPI(is_cobblerd=True)
  File "/usr/lib/python2.6/site-packages/cobbler/api.py", line 128, in __init__
    self.deserialize()
  File "/usr/lib/python2.6/site-packages/cobbler/api.py", line 689, in deserialize
    return self._config.deserialize()
  File "/usr/lib/python2.6/site-packages/cobbler/config.py", line 205, in deserialize
    raise CX("/etc/cobbler/settings is not a valid YAML file")
CX: '/etc/cobbler/settings is not a valid YAML file'

Resolution

  • Review the FQDN under /etc/hosts file

  • Set SELINUX as 'permissive' mode and restart the Satellite services again:

setenforce 0

Root Cause

  • FQDN was pointing to a different address under /etc/hosts
  • Review the SElinux policies.

Diagnostic Steps

  • For more information check /var/log/rhn/tasko/sat/cobbler-sync-bunch/cobbler-sync_2410132_err.
.err file
2014-01-22 08:48:00,023 [DefaultQuartzScheduler_Worker-6] ERROR com.redhat.rhn.taskomatic.task.CobblerSyncTask  - RuntimeExceptioneError trying to sync to cobbler: XmlRpcException calling cobbler.
java.lang.RuntimeException: XmlRpcException calling cobbler.
        at com.redhat.rhn.manager.kickstart.cobbler.CobblerXMLRPCHelper.invokeMethod(CobblerXMLRPCHelper.java:72)
        at com.redhat.rhn.taskomatic.task.CobblerSyncTask.execute(CobblerSyncTask.java:71)
        at com.redhat.rhn.taskomatic.task.RhnJavaJob.execute(RhnJavaJob.java:82)
        at com.redhat.rhn.taskomatic.TaskoJob.execute(TaskoJob.java:169)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:216)
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)
Caused by:
redstone.xmlrpc.XmlRpcException: The response could not be parsed.
        at redstone.xmlrpc.XmlRpcClient.handleResponse(XmlRpcClient.java:434)
        at redstone.xmlrpc.XmlRpcClient.endCall(XmlRpcClient.java:376)
        at redstone.xmlrpc.XmlRpcClient.invoke(XmlRpcClient.java:165)
        at com.redhat.rhn.manager.kickstart.cobbler.CobblerXMLRPCHelper.invokeMethod(CobblerXMLRPCHelper.java:69)
        ... 5 more
Caused by:
java.io.IOException: Server returned HTTP response code: 503 for URL: http://fqdn.example.hostname:80/cobbler_api
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1479)
        at redstone.xmlrpc.XmlRpcClient.handleResponse(XmlRpcClient.java:420)
        ... 8 more
2014-01-22 08:48:00,024 [DefaultQuartzScheduler_Worker-6] ERROR com.redhat.rhn.taskomatic.task.CobblerSyncTask  - re-throwing exception since we havent yet.
2014-01-22 08:48:00,024 [DefaultQuartzScheduler_Worker-6] ERROR com.redhat.rhn.taskomatic.task.CobblerSyncTask  - XmlRpcException calling cobbler.
2014-01-22 08:48:00,024 [DefaultQuartzScheduler_Worker-6] ERROR com.redhat.rhn.taskomatic.task.CobblerSyncTask  - redstone.xmlrpc.XmlRpcException: The response could not be parsed.

and the .out file 

2014-01-22 08:48:00,023 [DefaultQuartzScheduler_Worker-6] ERROR com.redhat.rhn.taskomatic.task.CobblerSyncTask  - RuntimeExceptioneError trying to sync to cobbler: XmlRpcException calling cobbler.
java.lang.RuntimeException: XmlRpcException calling cobbler.
        at com.redhat.rhn.manager.kickstart.cobbler.CobblerXMLRPCHelper.invokeMethod(CobblerXMLRPCHelper.java:72)
        at com.redhat.rhn.taskomatic.task.CobblerSyncTask.execute(CobblerSyncTask.java:71)
        at com.redhat.rhn.taskomatic.task.RhnJavaJob.execute(RhnJavaJob.java:82)
        at com.redhat.rhn.taskomatic.TaskoJob.execute(TaskoJob.java:169)
        at org.quartz.core.JobRunShell.run(JobRunShell.java:216)
        at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)
Caused by:
redstone.xmlrpc.XmlRpcException: The response could not be parsed.
        at redstone.xmlrpc.XmlRpcClient.handleResponse(XmlRpcClient.java:434)
        at redstone.xmlrpc.XmlRpcClient.endCall(XmlRpcClient.java:376)
        at redstone.xmlrpc.XmlRpcClient.invoke(XmlRpcClient.java:165)
        at com.redhat.rhn.manager.kickstart.cobbler.CobblerXMLRPCHelper.invokeMethod(CobblerXMLRPCHelper.java:69)
        ... 5 more
Caused by:
java.io.IOException: Server returned HTTP response code: 503 for URL: http://fqdn.example.hostname:80/cobbler_api
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1479)
        at redstone.xmlrpc.XmlRpcClient.handleResponse(XmlRpcClient.java:420)
        ... 8 more
2014-01-22 08:48:00,024 [DefaultQuartzScheduler_Worker-6] ERROR com.redhat.rhn.taskomatic.task.CobblerSyncTask  - re-throwing exception since we havent yet.
2014-01-22 08:48:00,024 [DefaultQuartzScheduler_Worker-6] ERROR com.redhat.rhn.taskomatic.task.CobblerSyncTask  - XmlRpcException calling cobbler.
2014-01-22 08:48:00,024 [DefaultQuartzScheduler_Worker-6] ERROR com.redhat.rhn.taskomatic.task.CobblerSyncTask  - redstone.xmlrpc.XmlRpcException: The response could not be parsed.

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.

Comments