Skip to content

Eval bug: Assertion `status == LLAMA_MEMORY_STATUS_SUCCESS' failed #14506

Closed
@ExposedCat

Description

@ExposedCat

Name and Version

ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 2 ROCm devices:
  Device 0: AMD Radeon RX 6800 XT, gfx1030 (0x1030), VMM: no, Wave Size: 32
  Device 1: AMD Radeon Graphics, gfx1036 (0x1036), VMM: no, Wave Size: 32
register_backend: registered backend ROCm (2 devices)
register_device: registered device ROCm0 (AMD Radeon RX 6800 XT)
register_device: registered device ROCm1 (AMD Radeon Graphics)
register_backend: registered backend CPU (1 devices)
register_device: registered device CPU (AMD Ryzen 5 7600X 6-Core Processor)
load_backend: failed to find ggml_backend_init in /home/exposedcat/Pets/AI/llama.cpp/build/bin/libggml-hip.so
load_backend: failed to find ggml_backend_init in /home/exposedcat/Pets/AI/llama.cpp/build/bin/libggml-cpu.so
version: 5774 (27208bf6)
built with HIP version: 6.3.42133-0 for x86_64-redhat-linux-gnu

Operating systems

Linux

GGML backends

BLAS

Hardware

RX 6800 XT

Models

Applies to any, at the moment of the report it was Gemma3 Q4

Problem description & steps to reproduce

Starting server with

llama-server --model gemma3.gguf -ngl 49 --no-webui --port 8181 -mg 0 -c 10000 --mlock

Works but randomly crashes during inference with error

llama-server: /src/llama-kv-cache-unified.cpp:1779: virtual bool llama_kv_cache_unified_context::apply(): Assertion `status == LLAMA_MEMORY_STATUS_SUCCESS' failed.

First Bad Commit

It was happening on older versions, too

Relevant log output

Process 340301 (llama-server) of user 1000 dumped core.
                                                                         
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module [dso] without build-id.
                                                                         Module libpcre2-8.so.0 from rpm pcre2-10.45-1.fc42.x86_64
                                                                         Module libselinux.so.1 from rpm libselinux-3.8-2.fc42.x86_64
                                                                         Module libdrm.so.2 from rpm libdrm-2.4.125-1.fc42.x86_64
                                                                         Module libelf.so.1 from rpm elfutils-0.193-2.fc42.x86_64
                                                                         Module libdrm_amdgpu.so.1 from rpm libdrm-2.4.125-1.fc42.x86_64
                                                                         Module libzstd.so.1 from rpm zstd-1.5.7-1.fc42.x86_64
                                                                         Module libkeyutils.so.1 from rpm keyutils-1.6.3-5.fc42.x86_64
                                                                         Module libkrb5support.so.0 from rpm krb5-1.21.3-6.fc42.x86_64
                                                                         Module libcom_err.so.2 from rpm e2fsprogs-1.47.2-3.fc42.x86_64
                                                                         Module libk5crypto.so.3 from rpm krb5-1.21.3-6.fc42.x86_64
                                                                         Module libkrb5.so.3 from rpm krb5-1.21.3-6.fc42.x86_64
                                                                         Module libunistring.so.5 from rpm libunistring-1.1-9.fc42.x86_64
                                                                         Module libnuma.so.1 from rpm numactl-2.0.19-2.fc42.x86_64
                                                                         Module libz.so.1 from rpm zlib-ng-2.2.4-3.fc42.x86_64
                                                                         Module libgssapi_krb5.so.2 from rpm krb5-1.21.3-6.fc42.x86_64
                                                                         Module libcrypto.so.3 from rpm openssl-3.2.4-3.fc42.x86_64
                                                                         Module libssl.so.3 from rpm openssl-3.2.4-3.fc42.x86_64
                                                                         Module libidn2.so.0 from rpm libidn2-2.3.8-1.fc42.x86_64
                                                                         Module libnghttp2.so.14 from rpm nghttp2-1.64.0-3.fc42.x86_64
                                                                         Module libcurl.so.4 from rpm curl-8.11.1-5.fc42.x86_64
                                                                         Stack trace of thread 340301:
                                                                         #0  0x00007f8cdb28111c __pthread_kill_implementation (libc.so.6 + 0x7311c)
                                                                         #1  0x00007f8cdb227afe raise (libc.so.6 + 0x19afe)
                                                                         #2  0x00007f8cdb20f6d0 abort (libc.so.6 + 0x16d0)
                                                                         #3  0x00007f8cdb20f639 __assert_fail_base.cold (libc.so.6 + 0x1639)
                                                                         #4  0x00007f8cdf6dbfd0 _ZN30llama_kv_cache_unified_context5applyEv (libllama.so + 0x106fd0)
                                                                         #5  0x00007f8cdf6df6a6 _ZN35llama_kv_cache_unified_iswa_context5applyEv (libllama.so + 0x10a6a6)
                                                                         #6  0x00007f8cdf6a6241 _ZN13llama_context14kv_self_updateEb (libllama.so + 0xd1241)
                                                                         #7  0x00007f8cdf6a7f74 _ZN13llama_context6decodeERK11llama_batch (libllama.so + 0xd2f74)
                                                                         #8  0x00007f8cdf6ac4cb llama_decode (libllama.so + 0xd74cb)
                                                                         #9  0x0000562c7e7cad24 _ZN14server_context12update_slotsEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0x148d24)
                                                                         #10 0x0000562c7e752806 _ZN12server_queue10start_loopEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd0806)
                                                                         #11 0x0000562c7e7140e7 main (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0x920e7)
                                                                         #12 0x00007f8cdb2115f5 __libc_start_call_main (libc.so.6 + 0x35f5)
                                                                         #13 0x00007f8cdb2116a8 __libc_start_main@@GLIBC_2.34 (libc.so.6 + 0x36a8)
                                                                         #14 0x0000562c7e710055 _start (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0x8e055)
                                                                         
                                                                         Stack trace of thread 340499:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27e71e pthread_cond_wait@@GLIBC_2.3.2 (libc.so.6 + 0x7071e)
                                                                         #4  0x00007f8cdb444b20 _ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE (libstdc++.so.6 + 0x44b20)
                                                                         #5  0x0000562c7e8eb3db _ZZN10common_log6resumeEvENKUlvE_clEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0x2693db)
                                                                         #6  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #7  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #8  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340302:
                                                                         #0  0x00007f8cdb2fdaad ioctl (libc.so.6 + 0xefaad)
                                                                         #1  0x00007f8ccb6f6280 hsakmt_ioctl (libhsa-runtime64.so.1 + 0xf6280)
                                                                         #2  0x00007f8ccb6f6ab9 hsaKmtWaitOnMultipleEvents_Ext.part.0 (libhsa-runtime64.so.1 + 0xf6ab9)
                                                                         #3  0x00007f8ccb679de0 _ZN4rocr4core7Runtime15AsyncEventsLoopEPv (libhsa-runtime64.so.1 + 0x79de0)
                                                                         #4  0x00007f8ccb61bb8c _ZN4rocr2os16ThreadTrampolineEPv (libhsa-runtime64.so.1 + 0x1bb8c)
                                                                         #5  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #6  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340501:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27e71e pthread_cond_wait@@GLIBC_2.3.2 (libc.so.6 + 0x7071e)
                                                                         #4  0x00007f8cdb444b20 _ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE (libstdc++.so.6 + 0x44b20)
                                                                         #5  0x0000562c7e757e51 _ZN7httplib10ThreadPool6workerclEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd5e51)
                                                                         #6  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #7  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #8  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340502:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27e71e pthread_cond_wait@@GLIBC_2.3.2 (libc.so.6 + 0x7071e)
                                                                         #4  0x00007f8cdb444b20 _ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE (libstdc++.so.6 + 0x44b20)
                                                                         #5  0x0000562c7e757e51 _ZN7httplib10ThreadPool6workerclEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd5e51)
                                                                         #6  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #7  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #8  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340504:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27e71e pthread_cond_wait@@GLIBC_2.3.2 (libc.so.6 + 0x7071e)
                                                                         #4  0x00007f8cdb444b20 _ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE (libstdc++.so.6 + 0x44b20)
                                                                         #5  0x0000562c7e757e51 _ZN7httplib10ThreadPool6workerclEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd5e51)
                                                                         #6  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #7  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #8  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340503:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27e71e pthread_cond_wait@@GLIBC_2.3.2 (libc.so.6 + 0x7071e)
                                                                         #4  0x00007f8cdb444b20 _ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE (libstdc++.so.6 + 0x44b20)
                                                                         #5  0x0000562c7e757e51 _ZN7httplib10ThreadPool6workerclEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd5e51)
                                                                         #6  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #7  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #8  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340505:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27eb52 pthread_cond_clockwait@GLIBC_2.30 (libc.so.6 + 0x70b52)
                                                                         #4  0x0000562c7e7bd066 _ZN15server_response17recv_with_timeoutERKSt13unordered_setIiSt4hashIiESt8equal_toIiESaIiEEi (/home/exposedcat/Pets/AI/llama.cpp/build>
                                                                         #5  0x0000562c7e7bd7bb _ZN14server_context27receive_cmpl_results_streamERKSt13unordered_setIiSt4hashIiESt8equal_toIiESaIiEERKSt8functionIFbRSt10unique_ptrI18>
                                                                         #6  0x0000562c7e732d3a _ZNSt17_Function_handlerIFbmRN7httplib8DataSinkEEZZ4mainENKUl16server_task_typeRN8nlohmann16json_abi_v3_12_010basic_jsonINS6_11ordered>
                                                                         #7  0x0000562c7e7bd65b _ZNSt17_Function_handlerIFbmmRN7httplib8DataSinkEENS0_6detail22ContentProviderAdapterEE9_M_invokeERKSt9_Any_dataOmSA_S2_ (/home/expose>
                                                                         #8  0x0000562c7e790aed _ZN7httplib6detail21write_content_chunkedIZNS_6Server27write_content_with_providerERNS_6StreamERKNS_7RequestERNS_8ResponseERKNSt7__cxx>
                                                                         #9  0x0000562c7e78d7e3 _ZN7httplib6Server27write_content_with_providerERNS_6StreamERKNS_7RequestERNS_8ResponseERKNSt7__cxx1112basic_stringIcSt11char_traitsIc>
                                                                         #10 0x0000562c7e78bc76 _ZN7httplib6Server19write_response_coreERNS_6StreamEbRKNS_7RequestERNS_8ResponseEb (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama>
                                                                         #11 0x0000562c7e783f3b _ZN7httplib6Server15process_requestERNS_6StreamERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEiSA_ibRbRKSt8functionIFvRNS_7Req>
                                                                         #12 0x0000562c7e782766 _ZZN7httplib6detail21process_server_socketIZNS_6Server24process_and_close_socketEiEUlRNS_6StreamEbRbE_EEbRKSt6atomicIiEimlllllT_ENKUlb>
                                                                         #13 0x0000562c7e754171 _ZN7httplib6Server24process_and_close_socketEi (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd2171)
                                                                         #14 0x0000562c7e757f52 _ZN7httplib10ThreadPool6workerclEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd5f52)
                                                                         #15 0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #16 0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #17 0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340506:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27e71e pthread_cond_wait@@GLIBC_2.3.2 (libc.so.6 + 0x7071e)
                                                                         #4  0x00007f8cdb444b20 _ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE (libstdc++.so.6 + 0x44b20)
                                                                         #5  0x0000562c7e757e51 _ZN7httplib10ThreadPool6workerclEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd5e51)
                                                                         #6  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #7  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #8  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340500:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27ba24 __syscall_cancel (libc.so.6 + 0x6da24)
                                                                         #3  0x00007f8cdb303582 accept4 (libc.so.6 + 0xf5582)
                                                                         #4  0x0000562c7e7c1c92 _ZN7httplib6Server15listen_internalEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0x13fc92)
                                                                         #5  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #6  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #7  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340507:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27e71e pthread_cond_wait@@GLIBC_2.3.2 (libc.so.6 + 0x7071e)
                                                                         #4  0x00007f8cdb444b20 _ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE (libstdc++.so.6 + 0x44b20)
                                                                         #5  0x0000562c7e757e51 _ZN7httplib10ThreadPool6workerclEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd5e51)
                                                                         #6  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #7  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #8  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340514:
                                                                         #0  0x00007f8cdb2fdaad ioctl (libc.so.6 + 0xefaad)
                                                                         #1  0x00007f8ccb6f6280 hsakmt_ioctl (libhsa-runtime64.so.1 + 0xf6280)
                                                                         #2  0x00007f8ccb6f6ab9 hsaKmtWaitOnMultipleEvents_Ext.part.0 (libhsa-runtime64.so.1 + 0xf6ab9)
                                                                         #3  0x00007f8ccb680c10 _ZN4rocr4core6Signal7WaitAnyEjPK12hsa_signal_sPK22hsa_signal_condition_tPKlm16hsa_wait_state_tPl (libhsa-runtime64.so.1 + 0x80c10)
                                                                         #4  0x00007f8ccb6794e6 _ZN4rocr4core7Runtime15AsyncEventsLoopEPv (libhsa-runtime64.so.1 + 0x794e6)
                                                                         #5  0x00007f8ccb61bb8c _ZN4rocr2os16ThreadTrampolineEPv (libhsa-runtime64.so.1 + 0x1bb8c)
                                                                         #6  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #7  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340508:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27e71e pthread_cond_wait@@GLIBC_2.3.2 (libc.so.6 + 0x7071e)
                                                                         #4  0x00007f8cdb444b20 _ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE (libstdc++.so.6 + 0x44b20)
                                                                         #5  0x0000562c7e757e51 _ZN7httplib10ThreadPool6workerclEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd5e51)
                                                                         #6  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #7  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #8  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340509:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27e71e pthread_cond_wait@@GLIBC_2.3.2 (libc.so.6 + 0x7071e)
                                                                         #4  0x00007f8cdb444b20 _ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE (libstdc++.so.6 + 0x44b20)
                                                                         #5  0x0000562c7e757e51 _ZN7httplib10ThreadPool6workerclEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd5e51)
                                                                         #6  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #7  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #8  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340510:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27e71e pthread_cond_wait@@GLIBC_2.3.2 (libc.so.6 + 0x7071e)
                                                                         #4  0x00007f8cdb444b20 _ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE (libstdc++.so.6 + 0x44b20)
                                                                         #5  0x0000562c7e757e51 _ZN7httplib10ThreadPool6workerclEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd5e51)
                                                                         #6  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #7  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #8  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         
                                                                         Stack trace of thread 340511:
                                                                         #0  0x00007f8cdb2876c2 __syscall_cancel_arch (libc.so.6 + 0x796c2)
                                                                         #1  0x00007f8cdb27b9da __internal_syscall_cancel (libc.so.6 + 0x6d9da)
                                                                         #2  0x00007f8cdb27c04c __futex_abstimed_wait_common (libc.so.6 + 0x6e04c)
                                                                         #3  0x00007f8cdb27e71e pthread_cond_wait@@GLIBC_2.3.2 (libc.so.6 + 0x7071e)
                                                                         #4  0x00007f8cdb444b20 _ZNSt18condition_variable4waitERSt11unique_lockISt5mutexE (libstdc++.so.6 + 0x44b20)
                                                                         #5  0x0000562c7e757e51 _ZN7httplib10ThreadPool6workerclEv (/home/exposedcat/Pets/AI/llama.cpp/build/bin/llama-server + 0xd5e51)
                                                                         #6  0x00007f8cdb44e164 execute_native_thread_routine (libstdc++.so.6 + 0x4e164)
                                                                         #7  0x00007f8cdb27f1d4 start_thread (libc.so.6 + 0x711d4)
                                                                         #8  0x00007f8cdb301cec __clone3 (libc.so.6 + 0xf3cec)
                                                                         ELF object binary architecture: AMD x86-64

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions