java:jboss/exported is not available in @PreDestroy methods during shutdown

Issue

With the following code in a class named e.g. JNDIBinderBean.java

private static final String name = "java:jboss/exported/JNDIBinderBean";
private static final String value = "JNDIBinderBean instantiated at " + new Date();

@PostConstruct
public void start() {
  new InitialContext().rebind(name, value);
}

@PreDestroy
public void stop() {
    new InitialContext().unbind(name);
}

When JBoss shuts down, I get an error saying that the MSC service isn't available:

javax.naming.NamingException: JBAS011836: Could not resolve service
  service jboss.naming.context.java.jboss.exported.JNDIBinderBean