Problem after upgrading RHEV 3.1 All In One install
Hi guys,
(started this question at: https://access.redhat.com/discussion/all-one-aio-rhev-plans)
I run an All In One install of RHEV 3.1 (used the all-in-one plugin). I did a 'yum upgrade' and a 'rhevm-upgrade', now the web interface is gone. I'm looking into this, but maybe I should not have ran the upgrade on an All In One install?
I did not turn to GSS because of: "Red Hat's Global Support Services will not accept issues reported on this tool" https://access.redhat.com/knowledge/solutions/265803
After a 'service ovirt-engine start' is done, below can be found in /var/log/ovirt-engine/server.log:
... 2013-01-16 15:11:25,963 ERROR [org.jboss.as.server.deployment] (MSC service thread 1-5) JBAS015892: Deployment unit processor org.jboss.as.web.deployment.ELExpressionFactoryProcessor@3504c501 unexpectedly threw an exception during undeploy phase POST_MODULE of deployment "engine.ear": java.lang.NoClassDefFoundError: org/jboss/el/cache/FactoryFinderCache at org.jboss.as.web.deployment.ELExpressionFactoryProcessor.undeploy(ELExpressionFactoryProcessor.java:113) at org.jboss.as.server.deployment.DeploymentUnitPhaseService.safeUndeploy(DeploymentUnitPhaseService.java:172) [jboss-as-server.jar:7.1.3.Final-redhat-4] at org.jboss.as.server.deployment.DeploymentUnitPhaseService.start(DeploymentUnitPhaseService.java:121) [jboss-as-server.jar:7.1.3.Final-redhat-4] at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1811) [jboss-msc.jar:1.0.2.GA-redhat-2] at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1746) [jboss-msc.jar:1.0.2.GA-redhat-2] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_09-icedtea] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_09-icedtea] at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_09-icedtea] 2013-01-16 15:11:25,973 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-5) MSC000001: Failed to start service jboss.deployment.unit."engine.ear".POST_MODULE: org.jboss.msc.service.StartException in service jboss.deployment.unit."engine.ear".POST_MODULE: JBAS018733: Failed to process phase POST_MODULE of deployment "engine.ear" at org.jboss.as.server.deployment.DeploymentUnitPhaseService.start(DeploymentUnitPhaseService.java:123) [jboss-as-server.jar:7.1.3.Final-redhat-4] at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1811) [jboss-msc.jar:1.0.2.GA-redhat-2] at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1746) [jboss-msc.jar:1.0.2.GA-redhat-2] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_09-icedtea] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_09-icedtea] at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_09-icedtea] Caused by: java.lang.NoClassDefFoundError: org/jboss/el/cache/FactoryFinderCache at org.jboss.as.web.deployment.ELExpressionFactoryProcessor.deploy(ELExpressionFactoryProcessor.java:106) at org.jboss.as.server.deployment.DeploymentUnitPhaseService.start(DeploymentUnitPhaseService.java:116) [jboss-as-server.jar:7.1.3.Final-redhat-4] ... 5 more Caused by: java.lang.ClassNotFoundException: org.jboss.el.cache.FactoryFinderCache from [Module "org.jboss.as.web:main" from local module loader @25b94dbc (roots: /usr/share/ovirt-engine/modules,/usr/share/jbossas/modules)] at org.jboss.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:190) at org.jboss.modules.ConcurrentClassLoader.performLoadClassUnchecked(ConcurrentClassLoader.java:468) at org.jboss.modules.ConcurrentClassLoader.performLoadClassChecked(ConcurrentClassLoader.java:456) at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:398) at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:120) ... 7 more 2013-01-16 15:11:26,184 INFO [org.jboss.as.server] (ServerService Thread Pool -- 17) JBAS018559: Deployed "engine.ear" 2013-01-16 15:11:26,304 INFO [org.jboss.as.controller] (Controller Boot Thread) JBAS014774: Service status report JBAS014777: Services which failed to start: service jboss.deployment.unit."engine.ear".POST_MODULE: org.jboss.msc.service.StartException in service jboss.deployment.unit."engine.ear".POST_MODULE: JBAS018733: Failed to process phase POST_MODULE of deployment "engine.ear"
(update: s/engine.log/server.log/)
Responses
I'm having this same problem after a reboot this morning but I don't have the all-in-one plugin on RHEV 3.1.
engine.log is not being updated.
server.log now shows:
2013-01-16 13:30:04,769 ERROR [org.jboss.msc.service.fail] (MSC service thread 1-4) MSC000001: Failed to start service jboss.deployment.unit."engine.ear".POST_MODULE: org.jboss.msc.service.StartException in service jboss.deployment.unit."engine.ear".POST_MODULE: JBAS018733: Failed to process phase POST_MODULE of deployment "engine.ear"
at org.jboss.as.server.deployment.DeploymentUnitPhaseService.start(DeploymentUnitPhaseService.java:123) [jboss-as-server.jar:7.1.3.Final-redhat-4]
at org.jboss.msc.service.ServiceControllerImpl$StartTask.startService(ServiceControllerImpl.java:1811) [jboss-msc.jar:1.0.2.GA-redhat-2]
at org.jboss.msc.service.ServiceControllerImpl$StartTask.run(ServiceControllerImpl.java:1746) [jboss-msc.jar:1.0.2.GA-redhat-2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) [rt.jar:1.7.0_09-icedtea]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) [rt.jar:1.7.0_09-icedtea]
at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_09-icedtea]
Caused by: java.lang.NoClassDefFoundError: org/jboss/el/cache/FactoryFinderCache
at org.jboss.as.web.deployment.ELExpressionFactoryProcessor.deploy(ELExpressionFactoryProcessor.java:106)
at org.jboss.as.server.deployment.DeploymentUnitPhaseService.start(DeploymentUnitPhaseService.java:116) [jboss-as-server.jar:7.1.3.Final-redhat-4]
... 5 more
Caused by: java.lang.ClassNotFoundException: org.jboss.el.cache.FactoryFinderCache from [Module "org.jboss.as.web:main" from local module loader @5cbf5bb7 (roots: /usr/share/ovirt-engine/modules,/usr/share/jbossas/modules)]
at org.jboss.modules.ModuleClassLoader.findClass(ModuleClassLoader.java:190)
at org.jboss.modules.ConcurrentClassLoader.performLoadClassUnchecked(ConcurrentClassLoader.java:468)
at org.jboss.modules.ConcurrentClassLoader.performLoadClassChecked(ConcurrentClassLoader.java:456)
at org.jboss.modules.ConcurrentClassLoader.performLoadClass(ConcurrentClassLoader.java:398)
at org.jboss.modules.ConcurrentClassLoader.loadClass(ConcurrentClassLoader.java:120)
... 7 more
2013-01-16 13:30:04,784 WARN [org.jboss.as.dependency.private] (MSC service thread 1-2) JBAS018567: Deployment "deployment.engine.ear.restapi.war" is using a private module ("org.codehaus.jackson.jackson-mapper-asl:main") which may be changed or removed in future versions without notice.
2013-01-16 13:30:04,784 WARN [org.jboss.as.dependency.private] (MSC service thread 1-2) JBAS018567: Deployment "deployment.engine.ear.restapi.war" is using a private module ("org.codehaus.jackson.jackson-core-asl:main") which may be changed or removed in future versions without notice.
2013-01-16 13:30:04,784 WARN [org.jboss.as.dependency.private] (MSC service thread 1-2) JBAS018567: Deployment "deployment.engine.ear.restapi.war" is using a private module ("org.codehaus.jackson.jackson-mapper-asl:main") which may be changed or removed in future versions without notice.
2013-01-16 13:30:04,990 INFO [org.jboss.as.server] (ServerService Thread Pool -- 17) JBAS018559: Deployed "engine.ear"
2013-01-16 13:30:04,991 INFO [org.jboss.as.controller] (Controller Boot Thread) JBAS014774: Service status report
JBAS014777: Services which failed to start: service jboss.deployment.unit."engine.ear".POST_MODULE: org.jboss.msc.service.StartException in service jboss.deployment.unit."engine.ear".POST_MODULE: JBAS018733: Failed to process phase POST_MODULE of deployment "engine.ear"
Just upgraded an internal setup from 3.1.0 to 3.1.1 and everything works.
Was this setup initially 3.0 or even 2.x, before it was upgraded to 3.1?
So far nobody managed to reproduce this issue, which probably means you have something customized that we are not aware of. Were there any issues in the upgrade logs?
> Cannot set value VerySecret to key AdminPassword.
rhevm-config --help
engine-config: get/set/list configuration
USAGE:
engine-config ACTION [--cver=version] [-p | --properties=/path/to/alternate/property/file] [-c | --config=/path/to/alternate/config/file]
Where:
ACTION action to perform, see details below
version relevant configuration version to use.
-p, --properties= (optional) use the given alternate properties file.
-c, --config= (optional) use the given alternate configuration file.
Available actions:
-l, --list
list available configuration keys.
-a, --all
get all available configuration values.
-g key, --get=key [--cver=version]
get the value of the given key for the given version. If a version is not given, the values of all existing versions are returned.
-s key=val --cver=version, --set key=val --cver=version
set the value of the given key for the given version. The cver version is mandatory for this action.
-h, --help
display this help and exit.
### Notes:
### 1. Passwords: password can be set in interacetive mode ie:
### engine-config -s PasswordEntry=interactive
### or via file with one of the following options:
### engine-config -s PasswordEntry --admin-pass-file=/tmp/mypass
### engine-config -s PasswordEntry=/tmp/mypass
### 2. In order for your change(s) to take effect,
### restart the oVirt engine service (using: 'service ovirt-engine restart').
################################################################################
I marked the important part in bold. Inserting passwords openly is not a good idea, and should never be done, so even in rhevm-config, we force it to be hidden