High CPU utilization cause by JON storage node

Solution Verified - Updated -

Issue

  • JON storage node java process is consuming very high cpu, the rhq-storage.log shows following messages during this time.
WARN [ScheduledTasks:1] 2015-03-18 12:03:43,130 GCInspector.java (line 142) Heap is 0.775731168696205 full.  You may need to reduce memtable and/or cache sizes.  Cassandra will now flush up to the two largest memtables to free up memory.  Adjust flush_largest_memtables_at threshold in cassandra.yaml if you don't want Cassandra to do this automatically

INFO [FlushWriter:40] 2015-03-18 13:08:16,546 Memtable.java (line 436) Completed flushing ../../../rhq-data/data/rhq/aggregate_metrics/rhq-aggregate_metrics-ic-4495-Data.db (1377091 bytes) for commitlog position ReplayPosition(segmentId=1426662370440, position=17473570)
  • High CPU Spike after JON Upgrade 3.2.x to 3.3.0.

Environment

  • Red Hat JBoss Operations Network (ON)
    • 3.3
    • JBoss ON 3.3 storage node is installed and running

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content