Unable to scale out because of os-collect-config gets 403 Access Denied

Issue

When we are doing an update to scale out, one of the nodes doesn't install because os-collect-config cannot access it's metadata. In the journalctl -u os-collect-config or /var/log/messages we are seeing following errors with 403 AccessDenied.

Dec 14 15:04:18 node1 os-collect-config: 2016-12-14 15:04:18.735 4749 WARNING os_collect_config.cfn [-] 403 Client Error: AccessDenied
Dec 14 15:04:18 node1 os-collect-config: 2016-12-14 15:04:18.735 4749 WARNING os-collect-config [-] Source [cfn] Unavailable.
Dec 14 15:04:18 node1 os-collect-config: 2016-12-14 15:04:18.736 4749 WARNING os-collect-config [-] Source [request] Unavailable.
Dec 14 15:04:18 node1 os-collect-config: 2016-12-14 15:04:18.736 4749 WARNING os_collect_config.local [-] /var/lib/os-collect-config/local-data not found. Skipping
Dec 14 15:04:18 node1 os-collect-config: 2016-12-14 15:04:18.736 4749 WARNING os_collect_config.local [-] No local metadata found (['/var/lib/os-collect-config/local-data'])
Dec 14 15:04:18 node1 os-collect-config: 2016-12-14 15:04:18.736 4749 WARNING os_collect_config.zaqar [-] No auth_url configured.