Ceph: RGW crashes with Segmentation fault on s3:copy_obj
Issue
RGW crashes with Segmentation Fault on s3:copy_obj
From the RGW logs (crash signature):
-16> 2023-03-09T21:42:10.189+0000 7effd0fe4700 1 ====== starting new request req=0x7f004b5f5630 =====
-15> 2023-03-09T21:42:10.189+0000 7effd0fe4700 2 req 5307773063622220559 0.000000000s initializing for trans_id = tx0000049a8ff7ac596db0f-00640a52b2-711548-wdc-prod
-14> 2023-03-09T21:42:10.190+0000 7effd0fe4700 2 req 5307773063622220559 0.001000014s getting op 1
-13> 2023-03-09T21:42:10.190+0000 7effd0fe4700 2 req 5307773063622220559 0.001000014s s3:copy_obj verifying requester
-12> 2023-03-09T21:42:10.190+0000 7effd0fe4700 2 req 5307773063622220559 0.001000014s s3:copy_obj normalizing buckets and tenants
-11> 2023-03-09T21:42:10.190+0000 7effd0fe4700 2 req 5307773063622220559 0.001000014s s3:copy_obj init permissions
-10> 2023-03-09T21:42:10.190+0000 7effd0fe4700 2 req 5307773063622220559 0.001000014s s3:copy_obj recalculating target
-9> 2023-03-09T21:42:10.190+0000 7effd0fe4700 2 req 5307773063622220559 0.001000014s s3:copy_obj reading permissions
-8> 2023-03-09T21:42:10.190+0000 7effd0fe4700 2 req 5307773063622220559 0.001000014s s3:copy_obj init op
-7> 2023-03-09T21:42:10.190+0000 7effd0fe4700 2 req 5307773063622220559 0.001000014s s3:copy_obj verifying op mask
-6> 2023-03-09T21:42:10.190+0000 7effd0fe4700 2 req 5307773063622220559 0.001000014s s3:copy_obj verifying op permissions
-5> 2023-03-09T21:42:10.191+0000 7effcbfda700 2 overriding permissions due to admin operation
-4> 2023-03-09T21:42:10.191+0000 7effcbfda700 2 req 16620898467553786795 0.009000135s s3:copy_obj verifying op params
-3> 2023-03-09T21:42:10.191+0000 7effcbfda700 2 req 16620898467553786795 0.009000135s s3:copy_obj pre-executing
-2> 2023-03-09T21:42:10.191+0000 7effcbfda700 2 req 16620898467553786795 0.009000135s s3:copy_obj executing
-1> 2023-03-09T21:42:10.195+0000 7f002e2a5700 10 monclient: tick
0> 2023-03-09T21:42:10.197+0000 7effcbfda700 -1 *** Caught signal (Segmentation fault) ***
in thread 7effcbfda700 thread_name:radosgw
ceph version 16.2.10-138.el8cp (a63ae467c8e1f7503ea3855893f1e5ca189a71b9) pacific (stable)
1: /lib64/libpthread.so.0(+0x12cf0) [0x7f003fcc1cf0]
2: (RGWCopyObj::execute(optional_yield)+0xf4) [0x7f004ac33c04]
3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, bool)+0xb36) [0x7f004a861466]
4: (process_request(rgw::sal::RGWRadosStore*, RGWREST*, RGWRequest*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, rgw::auth::StrategyRegistry const&, RGWRestfulIO*, OpsLogSink*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >*, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*, int*)+0x28b1) [0x7f004a865321]
5: /lib64/libradosgw.so.2(+0x45993d) [0x7f004a7e393d]
6: /lib64/libradosgw.so.2(+0x45b26b) [0x7f004a7e526b]
7: make_fcontext()
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
Environment
Red Hat Ceph Storage (RHCS) 5.0.x
Red Hat Ceph Storage (RHCS) 5.1.x
Red Hat Ceph Storage (RHCS) 5.2.x
Red Hat Ceph Storage (RHCS) 5.3.0
Red Hat Ceph Storage (RHCS) 5.3.1
Ceph Rados Gateway (RGW)
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.