File system went into read-only mode with several EXT3-fs error messages in message log

Solution Verified - Updated -

Issue

  • File system goes into read-only mode with several EXT3-fs error messages in message log.
  • From the logs, we see:
Sep 14 02:15:08 server kernel: EXT3-fs error (device dm-31): ext3_lookup: unlinked inode 372930 in dir #79249
Sep 14 02:15:08 server kernel: Aborting journal on device dm-31.
Sep 14 02:15:08 server kernel: ext3_abort called.
Sep 14 02:15:08 server kernel: EXT3-fs error (device dm-31): ext3_journal_start_sb: Detected aborted journal
Sep 14 02:15:08 server kernel: Remounting filesystem read-only
Sep 14 02:15:09 server kernel: EXT3-fs error (device dm-31): ext3_lookup: unlinked inode 372928 in dir #79249
Sep 14 02:15:10 server kernel: EXT3-fs error (device dm-31): ext3_lookup: unlinked inode 372925 in dir #79249
Sep 14 02:15:12 server kernel: EXT3-fs error (device dm-31): ext3_lookup: unlinked inode 372929 in dir #79249
Sep 14 02:16:04 server clurgmgrd: [10981]: <err> fs:FS_admin: isAlive failed write test on [/oracle/admin/FSADMIN]. Return code: 1 
Sep 14 02:16:04 server clurgmgrd: [10981]: <err> fs:FS_admin: Mount point is not accessible! 
Sep 14 02:16:04 server clurgmgrd[10981]: <notice> status on fs "FS_admin" returned 1 (generic error) 
Sep 14 02:16:04 server clurgmgrd[10981]: <notice> Stopping service service:DB
Sep 14 02:16:04 server openais[6452]: [TOTEM] Retransmit List: 3ce  
[...]

Environment

  • Red Hat Enterprise Linux 5
  • kernel-2.6.18-193.el5 and older

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content