Issue

Millions of entries in brick logs, exceeding disk space limits.

[2015-08-25 13:23:24.252011] E [rpcsvc.c:530:rpcsvc_check_and_reply_error] 0-rpcsvc: rpc actor failed to complete successfully
[2015-08-25 13:23:24.252547] E [rpcsvc.c:261:rpcsvc_program_actor] 0-rpc-service: RPC Program procedure not available for procedure 2 in GF-DUMP

We are also seeing:

Aug 25 10:30:46 node4 kernel: glusterfsd: page allocation failure. order:4, mode:0x20
Aug 25 10:30:46 node4 kernel: Pid: 27672, comm: glusterfsd Not tainted 2.6.32-358.56.1.el6.x86_64 #1
Aug 25 10:30:46 node4 kernel: Call Trace:
Aug 25 10:30:46 node4 kernel: [<ffffffff8112c3ba>] ? __alloc_pages_nodemask+0x74a/0x8d0
Aug 25 10:30:46 node4 kernel: [<ffffffff81166f62>] ? kmem_getpages+0x62/0x170
Aug 25 10:30:46 node4 kernel: [<ffffffff81167b7a>] ? fallback_alloc+0x1ba/0x270
Aug 25 10:30:46 node4 kernel: [<ffffffff811678f9>] ? ____cache_alloc_node+0x99/0x160
Aug 25 10:30:46 node4 kernel: [<ffffffff81168ac0>] ? kmem_cache_alloc_node_trace+0x90/0x200
Aug 25 10:30:46 node4 kernel: [<ffffffff81168cdd>] ? __kmalloc_node+0x4d/0x60
Aug 25 10:30:46 node4 kernel: [<ffffffff8143ec5d>] ? __alloc_skb+0x6d/0x190
Aug 25 10:30:46 node4 kernel: [<ffffffff8143fd80>] ? skb_copy+0x40/0xb0
...