High CPU utilization cause by JON storage node

Solution Verified - Updated -

Issue

  • JON storage node java process is consuming very high cpu, the rhq-storage.log shows following messages during this time.
WARN [ScheduledTasks:1] 2015-03-18 12:03:43,130 GCInspector.java (line 142) Heap is 0.775731168696205 full.  You may need to reduce memtable and/or cache sizes.  Cassandra will now flush up to the two largest memtables to free up memory.  Adjust flush_largest_memtables_at threshold in cassandra.yaml if you don't want Cassandra to do this automatically

INFO [FlushWriter:40] 2015-03-18 13:08:16,546 Memtable.java (line 436) Completed flushing ../../../rhq-data/data/rhq/aggregate_metrics/rhq-aggregate_metrics-ic-4495-Data.db (1377091 bytes) for commitlog position ReplayPosition(segmentId=1426662370440, position=17473570)
  • High CPU Spike after JON Upgrade 3.2.x to 3.3.0.

Environment

  • Red Hat JBoss Operations Network (ON)
    • 3.3
    • JBoss ON 3.3 storage node is installed and running

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.