Slower disk access time when going through cache

Solution Verified - Updated -

Issue

  • We noticed an odd behavior on one node of an Oracle RAC cluster. If we run 'dd' to read 1mb of data from a SAN disk we get 75-80mb/sec, run after run. But if we add the "iflag=direct" parameter (bypass cache) our performance goes UP to ~250mb/sec.
  • Why is bypassing cache giving us much better performance?
  • We don't see this same behavior on the other two nodes in this cluster.

Environment

  • RHEL 6.5.z, kernel version 2.6.32-573.1.1.el6.x86_64
  • HP ProLiant DL380p Gen8, BIOS P70
  • EMC SYMMETRIX SAN Storage
  • Emulex lpfc HBAs
  • 3 node Oracle RAC cluster with several EMC SAN LUNs shared between them.

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content