Issues with Kie Scanner picking up deployment changes

Issue

We have developed an application that uses KieScanner to fetch the latest kbase. This works in general, but we are seeing unexpected behavior when we add/remove packages from the kbase:

• If I declare two packages p1 and p2 and start the scanner for the first app run it will work;
• If I removed p1, it will still fire rules from p1 and p2 <<< This is already a problem;
• If I start the app running scanner and add only p1 to kmodule.xml, the scanner will fire the rules from p1;
• Keeping the app running and then adding a new package to the kbase causes the new package rules to be ignored;
• If restart the app, rule from p1 and p2 will fire normally.

It looks like runtime modification of the declared kbase packages are not being picked by KieScanner.