insights-client daily upload failing with IOError 28 No space left on device

Issue

• insights-client not able to upload the data and failing with below error:

  2023-05-02 03:48:13,510    DEBUG insights.util.subproc Executing: [['timeout', '-s', '9', '120', '/usr/sbin/dmidecode']]
  2023-05-02 03:48:13,530    ERROR insights.core.serde Could not serialize insights.specs.Specs.dmidecode to json: IOError(28, 'No space left on device')
  2023-05-02 03:48:13,531    DEBUG insights.util.subproc Executing: [['rm', '-rf', '/var/tmp/insights-client/insights-archive-20Jlct/insights-example.com-20230502004808/meta_data/insights.specs.Specs.dmidecode.json']]
  2023-05-02 03:48:13,613    DEBUG insights.util.subproc Executing: [['timeout', '-s', '9', '120', '/bin/hostname', '-s']]
  2023-05-02 03:48:13,620    ERROR insights.core.serde Could not serialize insights.specs.Specs.hostname_short to json: IOError(28, 'No space left on device')
  2023-05-02 03:48:13,621    DEBUG insights.util.subproc Executing: [['rm', '-rf', '/var/tmp/insights-client/insights-archive-20Jlct/insights-example.com-20230502004808/meta_data/insights.specs.Specs.host2023-05-02 03:48:34,435    DEBUG insights.core.plugins /var/log/foreman/production.log does not exist.
  2023-05-02 03:48:34,435    ERROR insights.core.serde Could not serialize insights.specs.Specs.foreman_production_log to json: IOError(28, 'No space left on device')
  

• Systems are not able to check-in to insights via insights-client.service.