Example of stacktrace with untracked_memory for ThreadStatus

clickhouse.untracked_memory.stacktrace

2024.12.10 14:13:33.100758 [ 3466 ] {b0c2bae7-e930-484d-9a98-26d972c8a985} <Trace> PushingToViews: Pushing (sequentially) from default.t_null (97ff26c2-3608-4b4b-b9a9-41696dd3f1a1) to default.t_mv (6ce3ce80-e1b0-4986-a79f-6c318399a8a6) took 21719 ms.
2024.12.10 14:13:33.100823 [ 3466 ] {} <Error> ThreadStatus: Untracked memory left: -96.00 B
2024.12.10 14:13:33.100969 [ 3135 ] {} <Trace> BaseDaemon: Received signal 6
2024.12.10 14:13:33.101277 [ 13793 ] {} <Fatal> BaseDaemon: ########## Short fault info ############
2024.12.10 14:13:33.101325 [ 13793 ] {} <Fatal> BaseDaemon: (version 24.12.1.1, build id: FBBF1E9C30254289BBFDF63093B967C2508ACB4C, git hash: 423da86c3064580c77679684d61b2b9d73da756f, architecture: x86_64) (from thread 3466) Received signal 6
2024.12.10 14:13:33.101344 [ 13793 ] {} <Fatal> BaseDaemon: Signal description: Aborted
2024.12.10 14:13:33.101351 [ 13793 ] {} <Fatal> BaseDaemon:
2024.12.10 14:13:33.101370 [ 13793 ] {} <Fatal> BaseDaemon: Stack trace: 0x000000000c16f4ed 0x000000000c42cafc 0x00007ffff7dd01d0 0x00007ffff7e293f5 0x00007ffff7dd0120 0x00007ffff7db74c3 0x000000000c185b91 0x0000000013a72db4 0x0000000013a7319f 0x0000000013a733fe 0x0000000010ca2980 0x0000000010ca5b40 0x0000000010cab3b2 0x0000000010c97999 0x0000000012d78970 0x0000000012d75e9a 0x0000000012d7de0d 0x0000000012d7d811 0x0000000013a9b294 0x00000000139c8f64 0x00000000139c8db9 0x00000000139c883e 0x000000001375b8b5 0x0000000013750afd 0x000000001375051a 0x0000000012f29148 0x0000000012f21d00 0x0000000012f2234f 0x0000000012f208e8 0x0000000013a9b294 0x00000000139c8f64 0x00000000139c8db9 0x00000000139c883e 0x000000001375b8b5 0x0000000013750afd 0x00000000137501ec 0x000000001374ff18 0x000000001374f1c8 0x000000000c215d1b 0x000000000c21b4ef 0x00007ffff7e2739d 0x00007ffff7eac49c
2024.12.10 14:13:33.101386 [ 13793 ] {} <Fatal> BaseDaemon: ########################################
2024.12.10 14:13:33.101396 [ 13793 ] {} <Fatal> BaseDaemon: (version 24.12.1.1, build id: FBBF1E9C30254289BBFDF63093B967C2508ACB4C, git hash: 423da86c3064580c77679684d61b2b9d73da756f) (from thread 3466) (no query) Received signal Aborted (6)
2024.12.10 14:13:33.101403 [ 13793 ] {} <Fatal> BaseDaemon:
2024.12.10 14:13:33.101410 [ 13793 ] {} <Fatal> BaseDaemon: Stack trace: 0x000000000c16f4ed 0x000000000c42cafc 0x00007ffff7dd01d0 0x00007ffff7e293f5 0x00007ffff7dd0120 0x00007ffff7db74c3 0x000000000c185b91 0x0000000013a72db4 0x0000000013a7319f 0x0000000013a733fe 0x0000000010ca2980 0x0000000010ca5b40 0x0000000010cab3b2 0x0000000010c97999 0x0000000012d78970 0x0000000012d75e9a 0x0000000012d7de0d 0x0000000012d7d811 0x0000000013a9b294 0x00000000139c8f64 0x00000000139c8db9 0x00000000139c883e 0x000000001375b8b5 0x0000000013750afd 0x000000001375051a 0x0000000012f29148 0x0000000012f21d00 0x0000000012f2234f 0x0000000012f208e8 0x0000000013a9b294 0x00000000139c8f64 0x00000000139c8db9 0x00000000139c883e 0x000000001375b8b5 0x0000000013750afd 0x00000000137501ec 0x000000001374ff18 0x000000001374f1c8 0x000000000c215d1b 0x000000000c21b4ef 0x00007ffff7e2739d 0x00007ffff7eac49c
2024.12.10 14:13:33.110440 [ 13793 ] {} <Fatal> BaseDaemon: 0.0. inlined from /src/ch/clickhouse/src/Common/StackTrace.cpp:380: StackTrace::tryCapture()
2024.12.10 14:13:33.110449 [ 13793 ] {} <Fatal> BaseDaemon: 0. /src/ch/clickhouse/src/Common/StackTrace.cpp:349: StackTrace::StackTrace(ucontext_t const&) @ 0x000000000c16f4ed
2024.12.10 14:13:33.120292 [ 13793 ] {} <Fatal> BaseDaemon: 1. /src/ch/clickhouse/src/Common/SignalHandlers.cpp:100: signalHandler(int, siginfo_t*, void*) @ 0x000000000c42cafc
2024.12.10 14:13:33.120299 [ 13793 ] {} <Fatal> BaseDaemon: 2. ? @ 0x00007ffff7dd01d0
2024.12.10 14:13:33.120302 [ 13793 ] {} <Fatal> BaseDaemon: 3. ? @ 0x00007ffff7e293f5
2024.12.10 14:13:33.120304 [ 13793 ] {} <Fatal> BaseDaemon: 4. ? @ 0x00007ffff7dd0120
2024.12.10 14:13:33.120306 [ 13793 ] {} <Fatal> BaseDaemon: 5. ? @ 0x00007ffff7db74c3
2024.12.10 14:13:33.130953 [ 13793 ] {} <Fatal> BaseDaemon: 6. /src/ch/clickhouse/src/Common/ThreadStatus.cpp:244: DB::ThreadStatus::~ThreadStatus() @ 0x000000000c185b91
2024.12.10 14:13:33.174474 [ 13793 ] {} <Fatal> BaseDaemon: 7.0. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: std::default_delete<DB::ThreadStatus>::operator()[abi:v15007](DB::ThreadStatus*) const
2024.12.10 14:13:33.174484 [ 13793 ] {} <Fatal> BaseDaemon: 7.1. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305: std::unique_ptr<DB::ThreadStatus, std::default_delete<DB::ThreadStatus>>::reset[abi:v15007](DB::ThreadStatus*)
2024.12.10 14:13:33.174487 [ 13793 ] {} <Fatal> BaseDaemon: 7.2. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259: ~unique_ptr
2024.12.10 14:13:33.174491 [ 13793 ] {} <Fatal> BaseDaemon: 7.3. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: _ZNSt3__112__destroy_atB6v15007INS_10unique_ptrIN2DB12ThreadStatusENS_14default_deleteIS3_EEEETnNS_9enable_ifIXntsr8is_arrayIT_EE5valueEiE4typeELi0EEEvPS8_
2024.12.10 14:13:33.174495 [ 13793 ] {} <Fatal> BaseDaemon: 7.4. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/construct_at.h:88: _ZNSt3__110destroy_atB6v15007INS_10unique_ptrIN2DB12ThreadStatusENS_14default_deleteIS3_EEEETnNS_9enable_ifIXnt10is_array_vIT_EEiE4typeELi0EEEvPS8_
2024.12.10 14:13:33.174505 [ 13793 ] {} <Fatal> BaseDaemon: 7.5. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317: void std::allocator_traits<std::allocator<std::__list_node<std::unique_ptr<DB::ThreadStatus, std::default_delete<DB::ThreadStatus>>, void*>>>::destroy[abi:v15007]<std::unique_ptr<DB::ThreadStatus, std::default_delete<DB::ThreadStatus>>, void, void>(std::allocator<std::__list_node<std::unique_ptr<DB::ThreadStatus, std::default_delete<DB::ThreadStatus>>, void*>>&, std::unique_ptr<DB::ThreadStatus, std::default_delete<DB::ThreadStatus>>*)
2024.12.10 14:13:33.174511 [ 13793 ] {} <Fatal> BaseDaemon: 7.6. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/list:1667: std::list<std::unique_ptr<DB::ThreadStatus, std::default_delete<DB::ThreadStatus>>, std::allocator<std::unique_ptr<DB::ThreadStatus, std::default_delete<DB::ThreadStatus>>>>::pop_front()
2024.12.10 14:13:33.174514 [ 13793 ] {} <Fatal> BaseDaemon: 7.7. inlined from /src/ch/clickhouse/src/Processors/Transforms/buildPushingToViewsChain.cpp:85: ~ThreadStatusesHolder
2024.12.10 14:13:33.174517 [ 13793 ] {} <Fatal> BaseDaemon: 7.8. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: _ZNSt3__112__destroy_atB6v15007IN2DB20ThreadStatusesHolderETnNS_9enable_ifIXntsr8is_arrayIT_EE5valueEiE4typeELi0EEEvPS4_
2024.12.10 14:13:33.174521 [ 13793 ] {} <Fatal> BaseDaemon: 7.9. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/construct_at.h:88: _ZNSt3__110destroy_atB6v15007IN2DB20ThreadStatusesHolderETnNS_9enable_ifIXnt10is_array_vIT_EEiE4typeELi0EEEvPS4_
2024.12.10 14:13:33.174525 [ 13793 ] {} <Fatal> BaseDaemon: 7.10. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317: void std::allocator_traits<std::allocator<DB::ThreadStatusesHolder>>::destroy[abi:v15007]<DB::ThreadStatusesHolder, void, void>(std::allocator<DB::ThreadStatusesHolder>&, DB::ThreadStatusesHolder*)
2024.12.10 14:13:33.174529 [ 13793 ] {} <Fatal> BaseDaemon: 7. /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:309: std::__shared_ptr_emplace<DB::ThreadStatusesHolder, std::allocator<DB::ThreadStatusesHolder>>::__on_zero_shared() @ 0x0000000013a72db4
2024.12.10 14:13:33.215649 [ 13793 ] {} <Fatal> BaseDaemon: 8.0. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:174: std::__shared_count::__release_shared[abi:v15007]()
2024.12.10 14:13:33.215656 [ 13793 ] {} <Fatal> BaseDaemon: 8.1. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:215: std::__shared_weak_count::__release_shared[abi:v15007]()
2024.12.10 14:13:33.215659 [ 13793 ] {} <Fatal> BaseDaemon: 8.2. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:702: ~shared_ptr
2024.12.10 14:13:33.215663 [ 13793 ] {} <Fatal> BaseDaemon: 8. /src/ch/clickhouse/src/Processors/Transforms/buildPushingToViewsChain.cpp:89: DB::ViewsData::~ViewsData() @ 0x0000000013a7319f
2024.12.10 14:13:33.256751 [ 13793 ] {} <Fatal> BaseDaemon: 9.0. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:174: std::__shared_count::__release_shared[abi:v15007]()
2024.12.10 14:13:33.256758 [ 13793 ] {} <Fatal> BaseDaemon: 9.1. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:215: std::__shared_weak_count::__release_shared[abi:v15007]()
2024.12.10 14:13:33.256762 [ 13793 ] {} <Fatal> BaseDaemon: 9.2. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:702: ~shared_ptr
2024.12.10 14:13:33.256765 [ 13793 ] {} <Fatal> BaseDaemon: 9.3. inlined from /src/ch/clickhouse/src/Processors/Transforms/buildPushingToViewsChain.cpp:120: ~CopyingDataToViewsTransform
2024.12.10 14:13:33.256768 [ 13793 ] {} <Fatal> BaseDaemon: 9.4. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: _ZNSt3__112__destroy_atB6v15007IN2DB27CopyingDataToViewsTransformETnNS_9enable_ifIXntsr8is_arrayIT_EE5valueEiE4typeELi0EEEvPS4_
2024.12.10 14:13:33.256772 [ 13793 ] {} <Fatal> BaseDaemon: 9.5. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/construct_at.h:88: _ZNSt3__110destroy_atB6v15007IN2DB27CopyingDataToViewsTransformETnNS_9enable_ifIXnt10is_array_vIT_EEiE4typeELi0EEEvPS4_
2024.12.10 14:13:33.256778 [ 13793 ] {} <Fatal> BaseDaemon: 9.6. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317: void std::allocator_traits<std::allocator<DB::CopyingDataToViewsTransform>>::destroy[abi:v15007]<DB::CopyingDataToViewsTransform, void, void>(std::allocator<DB::CopyingDataToViewsTransform>&, DB::CopyingDataToViewsTransform*)
2024.12.10 14:13:33.256782 [ 13793 ] {} <Fatal> BaseDaemon: 9. /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:309: std::__shared_ptr_emplace<DB::CopyingDataToViewsTransform, std::allocator<DB::CopyingDataToViewsTransform>>::__on_zero_shared() @ 0x0000000013a733fe
2024.12.10 14:13:33.275812 [ 13793 ] {} <Fatal> BaseDaemon: 10.0. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:174: ~shared_ptr
2024.12.10 14:13:33.275821 [ 13793 ] {} <Fatal> BaseDaemon: 10.1. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: _ZNSt3__112__destroy_atB6v15007INS_10shared_ptrIN2DB10IProcessorEEETnNS_9enable_ifIXntsr8is_arrayIT_EE5valueEiE4typeELi0EEEvPS6_
2024.12.10 14:13:33.275825 [ 13793 ] {} <Fatal> BaseDaemon: 10.2. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/construct_at.h:88: _ZNSt3__110destroy_atB6v15007INS_10shared_ptrIN2DB10IProcessorEEETnNS_9enable_ifIXnt10is_array_vIT_EEiE4typeELi0EEEvPS6_
2024.12.10 14:13:33.275830 [ 13793 ] {} <Fatal> BaseDaemon: 10.3. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317: void std::allocator_traits<std::allocator<std::shared_ptr<DB::IProcessor>>>::destroy[abi:v15007]<std::shared_ptr<DB::IProcessor>, void, void>(std::allocator<std::shared_ptr<DB::IProcessor>>&, std::shared_ptr<DB::IProcessor>*)
2024.12.10 14:13:33.275835 [ 13793 ] {} <Fatal> BaseDaemon: 10.4. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/vector:843: std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>::__base_destruct_at_end[abi:v15007](std::shared_ptr<DB::IProcessor>*)
2024.12.10 14:13:33.275838 [ 13793 ] {} <Fatal> BaseDaemon: 10.5. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/vector:837: std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>::__clear[abi:v15007]()
2024.12.10 14:13:33.275843 [ 13793 ] {} <Fatal> BaseDaemon: 10.6. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/vector:439: std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>::__destroy_vector::operator()[abi:v15007]()
2024.12.10 14:13:33.275846 [ 13793 ] {} <Fatal> BaseDaemon: 10.7. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/vector:449: ~vector
2024.12.10 14:13:33.275850 [ 13793 ] {} <Fatal> BaseDaemon: 10.8. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/construct_at.h:63: _ZNSt3__112__destroy_atB6v15007INS_6vectorINS_10shared_ptrIN2DB10IProcessorEEENS_9allocatorIS5_EEEETnNS_9enable_ifIXntsr8is_arrayIT_EE5valueEiE4typeELi0EEEvPSA_
2024.12.10 14:13:33.275854 [ 13793 ] {} <Fatal> BaseDaemon: 10.9. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/construct_at.h:88: _ZNSt3__110destroy_atB6v15007INS_6vectorINS_10shared_ptrIN2DB10IProcessorEEENS_9allocatorIS5_EEEETnNS_9enable_ifIXnt10is_array_vIT_EEiE4typeELi0EEEvPSA_
2024.12.10 14:13:33.275860 [ 13793 ] {} <Fatal> BaseDaemon: 10.10. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/allocator_traits.h:317: void std::allocator_traits<std::allocator<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>>::destroy[abi:v15007]<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>, void, void>(std::allocator<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>&, std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>*)
2024.12.10 14:13:33.275865 [ 13793 ] {} <Fatal> BaseDaemon: 10. /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:309: std::__shared_ptr_emplace<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>, std::allocator<std::vector<std::shared_ptr<DB::IProcessor>, std::allocator<std::shared_ptr<DB::IProcessor>>>>>::__on_zero_shared() @ 0x0000000010ca2980
2024.12.10 14:13:33.290033 [ 13793 ] {} <Fatal> BaseDaemon: 11.0. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:174: std::__shared_count::__release_shared[abi:v15007]()
2024.12.10 14:13:33.290039 [ 13793 ] {} <Fatal> BaseDaemon: 11.1. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:215: std::__shared_weak_count::__release_shared[abi:v15007]()
2024.12.10 14:13:33.290042 [ 13793 ] {} <Fatal> BaseDaemon: 11.2. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:702: ~shared_ptr
2024.12.10 14:13:33.290046 [ 13793 ] {} <Fatal> BaseDaemon: 11. /src/ch/clickhouse/src/QueryPipeline/QueryPipeline.cpp:53: DB::QueryPipeline::~QueryPipeline() @ 0x0000000010ca5b40
2024.12.10 14:13:33.307583 [ 13793 ] {} <Fatal> BaseDaemon: 12. /src/ch/clickhouse/src/QueryPipeline/QueryPipeline.cpp:699: DB::QueryPipeline::reset() @ 0x0000000010cab3b2
2024.12.10 14:13:33.308906 [ 13793 ] {} <Fatal> BaseDaemon: 13.0. inlined from /src/ch/clickhouse/src/QueryPipeline/BlockIO.cpp:19: DB::BlockIO::reset()
2024.12.10 14:13:33.308911 [ 13793 ] {} <Fatal> BaseDaemon: 13. /src/ch/clickhouse/src/QueryPipeline/BlockIO.cpp:46: DB::BlockIO::~BlockIO() @ 0x0000000010c97999
2024.12.10 14:13:33.349810 [ 13793 ] {} <Fatal> BaseDaemon: 14. /src/ch/clickhouse/src/Storages/StorageBuffer.cpp:1082: DB::StorageBuffer::writeBlockToDestination(DB::Block const&, std::shared_ptr<DB::IStorage>) @ 0x0000000012d78970
2024.12.10 14:13:33.387985 [ 13793 ] {} <Fatal> BaseDaemon: 15. /src/ch/clickhouse/src/Storages/StorageBuffer.cpp:982: DB::StorageBuffer::flushBuffer(DB::StorageBuffer::Buffer&, bool, bool) @ 0x0000000012d75e9a
2024.12.10 14:13:33.432999 [ 13793 ] {} <Fatal> BaseDaemon: 16. /src/ch/clickhouse/src/Storages/StorageBuffer.cpp:746: DB::BufferSink::insertIntoBuffer(DB::Block const&, DB::StorageBuffer::Buffer&, int) @ 0x0000000012d7de0d
2024.12.10 14:13:33.477257 [ 13793 ] {} <Fatal> BaseDaemon: 17. /src/ch/clickhouse/src/Storages/StorageBuffer.cpp:722: DB::BufferSink::consume(DB::Chunk&) @ 0x0000000012d7d811
2024.12.10 14:13:33.481494 [ 13793 ] {} <Fatal> BaseDaemon: 18. /src/ch/clickhouse/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000013a9b294
2024.12.10 14:13:33.489746 [ 13793 ] {} <Fatal> BaseDaemon: 19.0. inlined from /src/ch/clickhouse/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: operator()
2024.12.10 14:13:33.489752 [ 13793 ] {} <Fatal> BaseDaemon: 19.1. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ?
2024.12.10 14:13:33.489754 [ 13793 ] {} <Fatal> BaseDaemon: 19.2. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/invoke.h:479: ?
2024.12.10 14:13:33.489757 [ 13793 ] {} <Fatal> BaseDaemon: 19.3. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:235: ?
2024.12.10 14:13:33.489759 [ 13793 ] {} <Fatal> BaseDaemon: 19. /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000139c8f64
2024.12.10 14:13:33.498257 [ 13793 ] {} <Fatal> BaseDaemon: 20.0. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:848: ?
2024.12.10 14:13:33.498262 [ 13793 ] {} <Fatal> BaseDaemon: 20.1. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:1197: ?
2024.12.10 14:13:33.498266 [ 13793 ] {} <Fatal> BaseDaemon: 20. /src/ch/clickhouse/src/Processors/Transforms/ExceptionKeepingTransform.cpp:114: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x00000000139c8db9
2024.12.10 14:13:33.503211 [ 13793 ] {} <Fatal> BaseDaemon: 21. /src/ch/clickhouse/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work() @ 0x00000000139c883e
2024.12.10 14:13:33.506511 [ 13793 ] {} <Fatal> BaseDaemon: 22.0. inlined from /src/ch/clickhouse/src/Processors/Executors/ExecutionThreadContext.cpp:49: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*)
2024.12.10 14:13:33.506516 [ 13793 ] {} <Fatal> BaseDaemon: 22. /src/ch/clickhouse/src/Processors/Executors/ExecutionThreadContext.cpp:98: DB::ExecutionThreadContext::executeTask() @ 0x000000001375b8b5
2024.12.10 14:13:33.515341 [ 13793 ] {} <Fatal> BaseDaemon: 23. /src/ch/clickhouse/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x0000000013750afd
2024.12.10 14:13:33.524565 [ 13793 ] {} <Fatal> BaseDaemon: 24. /src/ch/clickhouse/src/Processors/Executors/PipelineExecutor.cpp:164: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000001375051a
2024.12.10 14:13:33.540985 [ 13793 ] {} <Fatal> BaseDaemon: 25. /src/ch/clickhouse/src/Storages/Distributed/DistributedSink.cpp:778: DB::DistributedSink::writeToLocal(DB::Cluster::ShardInfo const&, DB::Block const&, unsigned long) @ 0x0000000012f29148
2024.12.10 14:13:33.559394 [ 13793 ] {} <Fatal> BaseDaemon: 26. /src/ch/clickhouse/src/Storages/Distributed/DistributedSink.cpp:740: DB::DistributedSink::writeAsyncImpl(DB::Block const&, unsigned long) @ 0x0000000012f21d00
2024.12.10 14:13:33.576968 [ 13793 ] {} <Fatal> BaseDaemon: 27. /src/ch/clickhouse/src/Storages/Distributed/DistributedSink.cpp:711: DB::DistributedSink::writeSplitAsync(DB::Block const&) @ 0x0000000012f2234f
2024.12.10 14:13:33.594242 [ 13793 ] {} <Fatal> BaseDaemon: 28.0. inlined from /src/ch/clickhouse/src/Storages/Distributed/DistributedSink.cpp:206: DB::DistributedSink::writeAsync(DB::Block const&)
2024.12.10 14:13:33.594249 [ 13793 ] {} <Fatal> BaseDaemon: 28. /src/ch/clickhouse/src/Storages/Distributed/DistributedSink.cpp:179: DB::DistributedSink::consume(DB::Chunk&) @ 0x0000000012f208e8
2024.12.10 14:13:33.598525 [ 13793 ] {} <Fatal> BaseDaemon: 29. /src/ch/clickhouse/src/Processors/Sinks/SinkToStorage.cpp:18: DB::SinkToStorage::onConsume(DB::Chunk) @ 0x0000000013a9b294
2024.12.10 14:13:33.606795 [ 13793 ] {} <Fatal> BaseDaemon: 30.0. inlined from /src/ch/clickhouse/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: operator()
2024.12.10 14:13:33.606801 [ 13793 ] {} <Fatal> BaseDaemon: 30.1. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ?
2024.12.10 14:13:33.606803 [ 13793 ] {} <Fatal> BaseDaemon: 30.2. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/invoke.h:479: ?
2024.12.10 14:13:33.606806 [ 13793 ] {} <Fatal> BaseDaemon: 30.3. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:235: ?
2024.12.10 14:13:33.606808 [ 13793 ] {} <Fatal> BaseDaemon: 30. /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x00000000139c8f64
2024.12.10 14:13:33.615291 [ 13793 ] {} <Fatal> BaseDaemon: 31.0. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:848: ?
2024.12.10 14:13:33.615297 [ 13793 ] {} <Fatal> BaseDaemon: 31.1. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:1197: ?
2024.12.10 14:13:33.615300 [ 13793 ] {} <Fatal> BaseDaemon: 31. /src/ch/clickhouse/src/Processors/Transforms/ExceptionKeepingTransform.cpp:114: DB::runStep(std::function<void ()>, DB::ThreadStatus*, std::atomic<unsigned long>*) @ 0x00000000139c8db9
2024.12.10 14:13:33.620318 [ 13793 ] {} <Fatal> BaseDaemon: 32. /src/ch/clickhouse/src/Processors/Transforms/ExceptionKeepingTransform.cpp:150: DB::ExceptionKeepingTransform::work() @ 0x00000000139c883e
2024.12.10 14:13:33.623491 [ 13793 ] {} <Fatal> BaseDaemon: 33.0. inlined from /src/ch/clickhouse/src/Processors/Executors/ExecutionThreadContext.cpp:49: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*)
2024.12.10 14:13:33.623496 [ 13793 ] {} <Fatal> BaseDaemon: 33. /src/ch/clickhouse/src/Processors/Executors/ExecutionThreadContext.cpp:98: DB::ExecutionThreadContext::executeTask() @ 0x000000001375b8b5
2024.12.10 14:13:33.632182 [ 13793 ] {} <Fatal> BaseDaemon: 34. /src/ch/clickhouse/src/Processors/Executors/PipelineExecutor.cpp:290: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x0000000013750afd
2024.12.10 14:13:33.640407 [ 13793 ] {} <Fatal> BaseDaemon: 35.0. inlined from /src/ch/clickhouse/src/Processors/Executors/PipelineExecutor.cpp:256: DB::PipelineExecutor::executeSingleThread(unsigned long)
2024.12.10 14:13:33.640413 [ 13793 ] {} <Fatal> BaseDaemon: 35. /src/ch/clickhouse/src/Processors/Executors/PipelineExecutor.cpp:442: DB::PipelineExecutor::executeImpl(unsigned long, bool) @ 0x00000000137501ec
2024.12.10 14:13:33.649335 [ 13793 ] {} <Fatal> BaseDaemon: 36. /src/ch/clickhouse/src/Processors/Executors/PipelineExecutor.cpp:127: DB::PipelineExecutor::execute(unsigned long, bool) @ 0x000000001374ff18
2024.12.10 14:13:33.653507 [ 13793 ] {} <Fatal> BaseDaemon: 37.0. inlined from /src/ch/clickhouse/src/Processors/Executors/CompletedPipelineExecutor.cpp:49: DB::threadFunction(DB::CompletedPipelineExecutor::Data&, std::shared_ptr<DB::ThreadGroup>, unsigned long, bool)
2024.12.10 14:13:33.653513 [ 13793 ] {} <Fatal> BaseDaemon: 37.1. inlined from /src/ch/clickhouse/src/Processors/Executors/CompletedPipelineExecutor.cpp:89: operator()
2024.12.10 14:13:33.653516 [ 13793 ] {} <Fatal> BaseDaemon: 37.2. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ?
2024.12.10 14:13:33.653520 [ 13793 ] {} <Fatal> BaseDaemon: 37.3. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/tuple:1789: _ZNSt3__118__apply_tuple_implB6v15007IRZN2DB25CompletedPipelineExecutor7executeEvE3$_0RNS_5tupleIJEEETpTnmJEEEDcOT_OT0_NS_15__tuple_indicesIJXspT1_EEEE
2024.12.10 14:13:33.653524 [ 13793 ] {} <Fatal> BaseDaemon: 37.4. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/tuple:1798: decltype(auto) std::apply[abi:v15007]<DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&>(DB::CompletedPipelineExecutor::execute()::$_0&, std::tuple<>&)
2024.12.10 14:13:33.653529 [ 13793 ] {} <Fatal> BaseDaemon: 37.5. inlined from /src/ch/clickhouse/src/Common/ThreadPool.h:311: operator()
2024.12.10 14:13:33.653533 [ 13793 ] {} <Fatal> BaseDaemon: 37.6. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/invoke.h:394: ?
2024.12.10 14:13:33.653536 [ 13793 ] {} <Fatal> BaseDaemon: 37.7. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/invoke.h:479: ?
2024.12.10 14:13:33.653538 [ 13793 ] {} <Fatal> BaseDaemon: 37.8. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:235: ?
2024.12.10 14:13:33.653541 [ 13793 ] {} <Fatal> BaseDaemon: 37. /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:716: ? @ 0x000000001374f1c8
2024.12.10 14:13:33.660757 [ 13793 ] {} <Fatal> BaseDaemon: 38.0. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:848: ?
2024.12.10 14:13:33.660762 [ 13793 ] {} <Fatal> BaseDaemon: 38.1. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/function.h:1197: ?
2024.12.10 14:13:33.660766 [ 13793 ] {} <Fatal> BaseDaemon: 38. /src/ch/clickhouse/src/Common/ThreadPool.cpp:785: ThreadPoolImpl<std::thread>::ThreadFromThreadPool::worker() @ 0x000000000c215d1b
2024.12.10 14:13:33.673777 [ 13793 ] {} <Fatal> BaseDaemon: 39.0. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/__functional/invoke.h:359: ?
2024.12.10 14:13:33.673790 [ 13793 ] {} <Fatal> BaseDaemon: 39.1. inlined from /src/ch/clickhouse/contrib/llvm-project/libcxx/include/thread:284: void std::__thread_execute[abi:v15007]<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*, 2ul>(std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>&, std::__tuple_indices<2ul>)
2024.12.10 14:13:33.673794 [ 13793 ] {} <Fatal> BaseDaemon: 39. /src/ch/clickhouse/contrib/llvm-project/libcxx/include/thread:295: void* std::__thread_proxy[abi:v15007]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>>(void*) @ 0x000000000c21b4ef
2024.12.10 14:13:33.673799 [ 13793 ] {} <Fatal> BaseDaemon: 40. ? @ 0x00007ffff7e2739d
2024.12.10 14:13:33.673802 [ 13793 ] {} <Fatal> BaseDaemon: 41. ? @ 0x00007ffff7eac49c
2024.12.10 14:13:33.673807 [ 13793 ] {} <Fatal> BaseDaemon: Integrity check of the executable skipped because the reference checksum could not be read.
2024.12.10 14:13:33.673816 [ 13793 ] {} <Information> SentryWriter: Not sending crash report
2024.12.10 14:13:33.673819 [ 13793 ] {} <Fatal> BaseDaemon: This ClickHouse version is not official and should be upgraded to the official build.
2024.12.10 14:13:35.718185 [ 3468 ] {} <Trace> SystemLog (system.metric_log): Flushing system log, 7 entries to flush up to offset 689
2024.12.10 14:13:35.734538 [ 3468 ] {} <Trace> system.metric_log (f06f3c02-6b50-4c6e-99de-760e24c42198): Trying to reserve 1.00 MiB using storage policy from min volume index 0
2024.12.10 14:13:35.734568 [ 3468 ] {} <Trace> DiskLocal: Reserved 1.00 MiB on local disk `default`, having unreserved 312.61 GiB.
2024.12.10 14:13:35.742981 [ 3468 ] {} <Trace> MergedBlockOutputStream: filled checksums 202412_94_94_0 (state Temporary)
2024.12.10 14:13:35.751609 [ 3468 ] {} <Trace> system.metric_log (f06f3c02-6b50-4c6e-99de-760e24c42198): Renaming temporary part tmp_insert_202412_94_94_0 to 202412_94_94_0 with tid (1, 1, 00000000-0000-0000-0000-000000000000).
2024.12.10 14:13:35.754452 [ 3468 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 689
Aborted (core dumped)