rhel8: /var/log/pcp/pmcd/openmetrics.log errors when grafana is installed

Solution Verified - Updated -

Issue

Noticed the /var/log/pcp/pmcd/openmetrics.log log file growing rapidly. Most lines contain some type of parse error. Need help determining issue. Other 8.6 system built from same image not having issues. Here are some sample lines in log:

[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Initializing ... currently in notready state.
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Config change detected, traversed 1 config entries in 0.0001s, rescanning ...
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Found source grafana cluster 1
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric <!DOCTYPE pmid=144.1.0 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric <html pmid=144.1.1 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store <head>:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric <script pmid=144.1.2 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric !(function pmid=144.1.3 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric if pmid=144.1.4 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric var pmid=144.1.5 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric g.o pmid=144.1.6 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric g.e pmid=144.1.7 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store });:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store g.o.observe({ entryTypes: ['longtask'] });: Expected =
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store }:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store })();:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store </script>:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric <meta pmid=144.1.8 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store <title>Grafana</title>:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric <base pmid=144.1.9 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store <link:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store rel="preload":
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store href="public/fonts/roboto/RxZJdnzeo3R5zSexge8UUVtXRa8TVwTICgirnJhmVJw.woff2":
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store as="font":
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store crossorigin:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store />:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric <link pmid=144.1.10 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store performance.mark('frontend_boot_css_time_seconds');:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store </script>:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store </head>:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric <body pmid=144.1.11 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store <style>:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store .preloader {:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric height: pmid=144.1.12 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric flex-direction: pmid=144.1.13 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric display: pmid=144.1.14 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric justify-content: pmid=144.1.15 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric align-items: pmid=144.1.16 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store }:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store .preloader__enter {:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric opacity: pmid=144.1.17 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric animation-name: pmid=144.1.18 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric animation-iteration-count: pmid=144.1.19 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric animation-duration: pmid=144.1.20 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric animation-delay: pmid=144.1.21 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Info: Metric: adding new metric animation-fill-mode: pmid=144.1.22 type=5 sem=3 singular=True mindom=0xffffffff labels={}
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store }:
[Thu Aug 18 09:33:14] pmdaopenmetrics(1490555) Error: cannot parse/store .preloader__bounce {:

Environment

  • Red Hat Enterprise Linux (RHEL) 8
  • Performance Co-Pilot (PCP)
  • Grafana
  • pmda-openmetrics

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content