File system went into read-only mode with several EXT3-fs error messages in message log
Issue
- File system goes into read-only mode with several EXT3-fs error messages in message log.
- From the logs, we see:
Sep 14 02:15:08 server kernel: EXT3-fs error (device dm-31): ext3_lookup: unlinked inode 372930 in dir #79249
Sep 14 02:15:08 server kernel: Aborting journal on device dm-31.
Sep 14 02:15:08 server kernel: ext3_abort called.
Sep 14 02:15:08 server kernel: EXT3-fs error (device dm-31): ext3_journal_start_sb: Detected aborted journal
Sep 14 02:15:08 server kernel: Remounting filesystem read-only
Sep 14 02:15:09 server kernel: EXT3-fs error (device dm-31): ext3_lookup: unlinked inode 372928 in dir #79249
Sep 14 02:15:10 server kernel: EXT3-fs error (device dm-31): ext3_lookup: unlinked inode 372925 in dir #79249
Sep 14 02:15:12 server kernel: EXT3-fs error (device dm-31): ext3_lookup: unlinked inode 372929 in dir #79249
Sep 14 02:16:04 server clurgmgrd: [10981]: <err> fs:FS_admin: isAlive failed write test on [/oracle/admin/FSADMIN]. Return code: 1
Sep 14 02:16:04 server clurgmgrd: [10981]: <err> fs:FS_admin: Mount point is not accessible!
Sep 14 02:16:04 server clurgmgrd[10981]: <notice> status on fs "FS_admin" returned 1 (generic error)
Sep 14 02:16:04 server clurgmgrd[10981]: <notice> Stopping service service:DB
Sep 14 02:16:04 server openais[6452]: [TOTEM] Retransmit List: 3ce
[...]
Environment
- Red Hat Enterprise Linux 5
- kernel-2.6.18-193.el5 and older
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.