Skip to content

Instantly share code, notes, and snippets.

@gounthar
Created March 28, 2026 11:08
Show Gist options
  • Select an option

  • Save gounthar/3d836c6114ce8e9064d59872985787f2 to your computer and use it in GitHub Desktop.

Select an option

Save gounthar/3d836c6114ce8e9064d59872985787f2 to your computer and use it in GitHub Desktop.
llama.cpp native riscv64 build on BananaPi F3 (GCC 14.2.0, GGML_NATIVE=ON, 56min)
=== System info ===
Linux bananapif3-1 6.6.99-current-spacemit #1 SMP PREEMPT_DYNAMIC Thu Apr 10 14:00:52 UTC 2025 riscv64 GNU/Linux
gcc (Debian 14.2.0-19) 14.2.0
=== Configure ===
-- The C compiler identification is GNU 14.2.0
-- The CXX compiler identification is GNU 14.2.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: /usr/bin/cc - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: /usr/bin/c++ - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
CMAKE_BUILD_TYPE=Release
-- Found Git: /usr/bin/git (found version "2.47.3")
-- The ASM compiler identification is GNU
-- Found assembler: /usr/bin/cc
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- ccache found, compilation results will be cached. Disable with GGML_CCACHE=OFF.
-- CMAKE_SYSTEM_PROCESSOR: riscv64
-- GGML_SYSTEM_ARCH: riscv64
-- Including CPU backend
-- Found OpenMP_C: -fopenmp (found version "4.5")
-- Found OpenMP_CXX: -fopenmp (found version "4.5")
-- Found OpenMP: TRUE (found version "4.5")
-- riscv64 detected
-- Adding CPU backend variant ggml-cpu: -march=rv64gcv_zfh_zvfh_zicbop_zihintpause;-mabi=lp64d
-- ggml version: 0.9.8
-- ggml commit: b0f0dd3
-- Found OpenSSL: /usr/lib/riscv64-linux-gnu/libcrypto.so (found version "3.5.5")
-- Performing Test OPENSSL_VERSION_SUPPORTED
-- Performing Test OPENSSL_VERSION_SUPPORTED - Success
-- OpenSSL found: 3.5.5
-- Generating embedded license file for target: common
-- Configuring done (9.4s)
-- Generating done (1.6s)
-- Build files have been written to: /tmp/llama.cpp/build
=== Build ===
[ 1%] Building C object ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o
[ 1%] Building CXX object vendor/cpp-httplib/CMakeFiles/cpp-httplib.dir/httplib.cpp.o
[ 1%] Building CXX object common/CMakeFiles/build_info.dir/build-info.cpp.o
[ 2%] Building C object examples/gguf-hash/CMakeFiles/xxhash.dir/deps/xxhash/xxhash.c.o
[ 2%] Building C object examples/gguf-hash/CMakeFiles/sha256.dir/deps/sha256/sha256.c.o
[ 2%] Building C object examples/gguf-hash/CMakeFiles/sha1.dir/deps/sha1/sha1.c.o
[ 4%] Building CXX object tools/mtmd/CMakeFiles/llama-llava-cli.dir/deprecation-warning.cpp.o
[ 4%] Building CXX object tools/mtmd/CMakeFiles/llama-gemma3-cli.dir/deprecation-warning.cpp.o
[ 4%] Built target build_info
[ 4%] Building CXX object tools/mtmd/CMakeFiles/llama-minicpmv-cli.dir/deprecation-warning.cpp.o
[ 4%] Built target sha1
[ 4%] Building CXX object tools/mtmd/CMakeFiles/llama-qwen2vl-cli.dir/deprecation-warning.cpp.o
[ 4%] Linking CXX executable ../../bin/llama-gemma3-cli
[ 4%] Linking CXX executable ../../bin/llama-llava-cli
[ 4%] Linking CXX executable ../../bin/llama-qwen2vl-cli
[ 4%] Linking CXX executable ../../bin/llama-minicpmv-cli
[ 4%] Built target llama-gemma3-cli
[ 4%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/ggml.cpp.o
[ 4%] Built target llama-llava-cli
[ 4%] Built target llama-qwen2vl-cli
[ 4%] Built target llama-minicpmv-cli
[ 4%] Building C object ggml/src/CMakeFiles/ggml-base.dir/ggml-alloc.c.o
[ 4%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/ggml-backend.cpp.o
[ 5%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/ggml-opt.cpp.o
[ 5%] Built target sha256
[ 5%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/ggml-threading.cpp.o
[ 5%] Building C object ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o
[ 5%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/gguf.cpp.o
[ 5%] Built target xxhash
[ 5%] Linking CXX shared library ../../bin/libggml-base.so
[ 5%] Built target ggml-base
[ 6%] Building C object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu.c.o
[ 6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/repack.cpp.o
[ 6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/hbm.cpp.o
[ 6%] Building C object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/quants.c.o
[ 7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/traits.cpp.o
[ 7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ggml-cpu.cpp.o
[ 7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/amx.cpp.o
[ 7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/amx/mmq.cpp.o
[ 7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/binary-ops.cpp.o
[ 8%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/unary-ops.cpp.o
[ 8%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/vec.cpp.o
In file included from /tmp/llama.cpp/ggml/src/ggml-cpu/common.h:7,
from /tmp/llama.cpp/ggml/src/ggml-cpu/unary-ops.h:3,
from /tmp/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c:11:
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: In function ‘riscv_compute_fp16_to_fp32’:
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h:97:9: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
97 | _Float16 hf;
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: In function ‘riscv_compute_fp32_to_fp16’:
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h:104:9: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
104 | _Float16 hf = (_Float16)f;
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h:104:24: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
104 | _Float16 hf = (_Float16)f;
| ^~~~~~~~
In file included from /tmp/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c:13:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h: In function ‘ggml_vec_dot_f16_unroll’:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:244:61: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
244 | vfloat16m2_t ay0 = __riscv_vle16_v_f16m2((const _Float16 *)(y + i), epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:245:63: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
245 | vfloat16m2_t ax0_0 = __riscv_vle16_v_f16m2((const _Float16 *)(x[0] + i), epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:246:63: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
246 | vfloat16m2_t ax1_0 = __riscv_vle16_v_f16m2((const _Float16 *)(x[1] + i), epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:250:61: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
250 | vfloat16m2_t ay1 = __riscv_vle16_v_f16m2((const _Float16 *)(y + i + epr), epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:251:63: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
251 | vfloat16m2_t ax0_1 = __riscv_vle16_v_f16m2((const _Float16 *)(x[0] + i + epr), epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:252:63: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
252 | vfloat16m2_t ax1_1 = __riscv_vle16_v_f16m2((const _Float16 *)(x[1] + i + epr), epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:263:60: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
263 | vfloat16m2_t ay = __riscv_vle16_v_f16m2((const _Float16 *)(y + i), vl);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:264:61: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
264 | vfloat16m2_t ax0 = __riscv_vle16_v_f16m2((const _Float16 *)(x[0] + i), vl);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:265:61: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
265 | vfloat16m2_t ax1 = __riscv_vle16_v_f16m2((const _Float16 *)(x[1] + i), vl);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h: In function ‘ggml_vec_mad_f16’:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:537:11: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
537 | const _Float16 scale = *(const _Float16*)(&s);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:537:36: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
537 | const _Float16 scale = *(const _Float16*)(&s);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:537:29: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
537 | const _Float16 scale = *(const _Float16*)(&s);
| ^~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:546:57: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
546 | vfloat16m4_t ax0 = __riscv_vle16_v_f16m4((const _Float16*)x + i, epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:547:57: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
547 | vfloat16m4_t ay0 = __riscv_vle16_v_f16m4((const _Float16*)y + i, epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:549:32: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
549 | __riscv_vse16_v_f16m4((_Float16*)y + i, ay0, epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:552:57: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
552 | vfloat16m4_t ax1 = __riscv_vle16_v_f16m4((const _Float16*)x + i + epr, epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:553:57: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
553 | vfloat16m4_t ay1 = __riscv_vle16_v_f16m4((const _Float16*)y + i + epr, epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:555:32: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
555 | __riscv_vse16_v_f16m4((_Float16*)y + i + epr, ay1, epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:563:57: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
563 | vfloat16m4_t ax0 = __riscv_vle16_v_f16m4((const _Float16*)x + i, vl);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:564:57: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
564 | vfloat16m4_t ay0 = __riscv_vle16_v_f16m4((const _Float16*)y + i, vl);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:566:32: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
566 | __riscv_vse16_v_f16m4((_Float16*)y + i, ay0, vl);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h: In function ‘ggml_vec_scale_f16’:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:810:11: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
810 | const _Float16 scale = *(const _Float16*)(&s);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:810:36: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
810 | const _Float16 scale = *(const _Float16*)(&s);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:810:29: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
810 | const _Float16 scale = *(const _Float16*)(&s);
| ^~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:819:57: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
819 | vfloat16m4_t ay0 = __riscv_vle16_v_f16m4((const _Float16*)y + i, epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:821:32: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
821 | __riscv_vse16_v_f16m4((_Float16*)y + i, ay0, epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:824:57: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
824 | vfloat16m4_t ay1 = __riscv_vle16_v_f16m4((const _Float16*)y + i + epr, epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:826:32: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
826 | __riscv_vse16_v_f16m4((_Float16*)y + i + epr, ay1, epr);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:834:57: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
834 | vfloat16m4_t ay0 = __riscv_vle16_v_f16m4((const _Float16*)y + i, vl);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:836:32: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
836 | __riscv_vse16_v_f16m4((_Float16*)y + i, ay0, vl);
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c: In function ‘ggml_cpu_fp32_to_fp16’:
/tmp/llama.cpp/ggml/src/ggml-cpu/ggml-cpu.c:3341:32: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
3341 | __riscv_vse16_v_f16m1((_Float16 *)&y[i], vy, vl);
| ^~~~~~~~
[ 8%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/ops.cpp.o
[ 8%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/llamafile/sgemm.cpp.o
In file included from /tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp:1:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h: In function ‘void ggml_vec_mad_f16(int, ggml_fp16_t*, const ggml_fp16_t*, float)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:537:29: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
537 | const _Float16 scale = *(const _Float16*)(&s);
| ^~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h: In function ‘void ggml_vec_scale_f16(int, ggml_fp16_t*, float)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:810:29: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
810 | const _Float16 scale = *(const _Float16*)(&s);
| ^~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp: In function ‘void ggml_vec_dot_f32(int, float*, size_t, const float*, size_t, const float*, size_t, int)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp:93:41: warning: ‘vsum’ is used uninitialized [-Wuninitialized]
93 | vsum = __riscv_vfmv_v_f_f32m8_tu(vsum, 0.0f, vl);
| ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp:90:22: note: ‘vsum’ was declared here
90 | vfloat32m8_t vsum;
| ^~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp:96:42: warning: ‘ax’ may be used uninitialized [-Wmaybe-uninitialized]
96 | ax = __riscv_vle32_v_f32m8_tu(ax, &x[i], vl);
| ~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp:91:22: note: ‘ax’ was declared here
91 | vfloat32m8_t ax;
| ^~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp:97:42: warning: ‘ay’ may be used uninitialized [-Wmaybe-uninitialized]
97 | ay = __riscv_vle32_v_f32m8_tu(ay, &y[i], vl);
| ~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp:92:22: note: ‘ay’ was declared here
92 | vfloat32m8_t ay;
| ^~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp: In function ‘void ggml_vec_dot_f16(int, float*, size_t, ggml_fp16_t*, size_t, ggml_fp16_t*, size_t, int)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp:347:46: warning: ‘ax’ may be used uninitialized [-Wmaybe-uninitialized]
347 | ax = __riscv_vle16_v_f16m1_tu(ax, (const _Float16 *)&x[i], vl);
| ~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp:342:26: note: ‘ax’ was declared here
342 | vfloat16m1_t ax;
| ^~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp:348:46: warning: ‘ay’ may be used uninitialized [-Wmaybe-uninitialized]
348 | ay = __riscv_vle16_v_f16m1_tu(ay, (const _Float16 *)&y[i], vl);
| ~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.cpp:343:26: note: ‘ay’ was declared here
343 | vfloat16m1_t ay;
| ^~
[ 8%] Building C object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/arch/riscv/quants.c.o
In file included from /tmp/llama.cpp/ggml/src/ggml-cpu/quants.c:5:
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: In function ‘riscv_compute_fp16_to_fp32’:
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h:97:9: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
97 | _Float16 hf;
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: In function ‘riscv_compute_fp32_to_fp16’:
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h:104:9: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
104 | _Float16 hf = (_Float16)f;
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h:104:24: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
104 | _Float16 hf = (_Float16)f;
| ^~~~~~~~
[ 9%] Building CXX object ggml/src/CMakeFiles/ggml-cpu.dir/ggml-cpu/arch/riscv/repack.cpp.o
In file included from /tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:6:
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: In function ‘riscv_compute_fp16_to_fp32’:
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h:97:9: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
97 | _Float16 hf;
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h: In function ‘riscv_compute_fp32_to_fp16’:
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h:104:9: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
104 | _Float16 hf = (_Float16)f;
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/simd-mappings.h:104:24: warning: ISO C does not support the ‘_Float16’ type before C23 [-Wpedantic]
104 | _Float16 hf = (_Float16)f;
| ^~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c: In function ‘quantize_row_q8_K’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:193:25: warning: declaration of ‘k’ shadows a parameter [-Wshadow]
193 | for (size_t k = 16; k < vl; k += 16) {
| ^
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:116:87: note: shadowed declaration is here
116 | void quantize_row_q8_K(const float * GGML_RESTRICT x, void * GGML_RESTRICT y, int64_t k) {
| ~~~~~~~~^
In function ‘ggml_vec_dot_iq4_nl_q8_0_vl128’,
inlined from ‘ggml_vec_dot_iq4_nl_q8_0’ at /tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3183:13:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3099:20: warning: ‘iq4bits1’ may be used uninitialized [-Wmaybe-uninitialized]
3099 | iq4bits1 = __riscv_vset_v_u8m1_u8m2(iq4bits1, 0, __riscv_vand_vx_u8m1(iq4_packed1, 0xf, 16));
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c: In function ‘ggml_vec_dot_iq4_nl_q8_0’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3098:20: note: ‘iq4bits1’ was declared here
3098 | vuint8m2_t iq4bits1;
| ^~~~~~~~
In function ‘ggml_vec_dot_iq4_nl_q8_0_vl128’,
inlined from ‘ggml_vec_dot_iq4_nl_q8_0’ at /tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3183:13:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3102:20: warning: ‘iq4bits2’ may be used uninitialized [-Wmaybe-uninitialized]
3102 | iq4bits2 = __riscv_vset_v_u8m1_u8m2(iq4bits2, 0, __riscv_vand_vx_u8m1(iq4_packed2, 0xf, 16));
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c: In function ‘ggml_vec_dot_iq4_nl_q8_0’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3101:20: note: ‘iq4bits2’ was declared here
3101 | vuint8m2_t iq4bits2;
| ^~~~~~~~
In function ‘ggml_vec_dot_iq4_xs_q8_K_vl256’,
inlined from ‘ggml_vec_dot_iq4_xs_q8_K’ at /tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3276:13:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3239:23: warning: ‘iq4bits’ may be used uninitialized [-Wmaybe-uninitialized]
3239 | iq4bits = __riscv_vset_v_u8m2_u8m4(iq4bits, 0, iq4bits_lo);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c: In function ‘ggml_vec_dot_iq4_xs_q8_K’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3238:24: note: ‘iq4bits’ was declared here
3238 | vuint8m4_t iq4bits;
| ^~~~~~~
In function ‘ggml_vec_dot_mxfp4_q8_0_vl128’,
inlined from ‘ggml_vec_dot_mxfp4_q8_0’ at /tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3614:13:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3530:19: warning: ‘mxbits1’ may be used uninitialized [-Wmaybe-uninitialized]
3530 | mxbits1 = __riscv_vset_v_u8m1_u8m2(mxbits1, 0, __riscv_vand_vx_u8m1(mx_packed1, 0xf, 16));
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c: In function ‘ggml_vec_dot_mxfp4_q8_0’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3529:20: note: ‘mxbits1’ was declared here
3529 | vuint8m2_t mxbits1;
| ^~~~~~~
In function ‘ggml_vec_dot_mxfp4_q8_0_vl128’,
inlined from ‘ggml_vec_dot_mxfp4_q8_0’ at /tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3614:13:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3533:19: warning: ‘mxbits2’ may be used uninitialized [-Wmaybe-uninitialized]
3533 | mxbits2 = __riscv_vset_v_u8m1_u8m2(mxbits2, 0, __riscv_vand_vx_u8m1(mx_packed2, 0xf, 16));
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c: In function ‘ggml_vec_dot_mxfp4_q8_0’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/quants.c:3532:20: note: ‘mxbits2’ was declared here
3532 | vuint8m2_t mxbits2;
| ^~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp: In function ‘void ggml_gemv_q4_0_16x1_q8_0(int, float*, size_t, const void*, const void*, int, int)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:251:68: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
251 | const vfloat32m2_t d_0 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d, 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp: In function ‘void ggml_gemv_iq4_nl_16x1_q8_0(int, float*, size_t, const void*, const void*, int, int)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:438:68: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
438 | const vfloat32m2_t d_0 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d, 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp: In function ‘void ggml_gemv_q8_0_16x1_q8_0(int, float*, size_t, const void*, const void*, int, int)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:488:68: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
488 | const vfloat32m2_t d_0 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d, 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp: In function ‘void ggml_gemv_q2_K_16x1_q8_K(int, float*, size_t, const void*, const void*, int, int)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:497:140: warning: unused parameter ‘nr’ [-Wunused-parameter]
497 | void ggml_gemv_q2_K_16x1_q8_K(int n, float * GGML_RESTRICT s, size_t bs, const void * GGML_RESTRICT vx, const void * GGML_RESTRICT vy, int nr, int nc) {
| ~~~~^~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp: In function ‘void ggml_gemm_q4_0_16x1_q8_0(int, float*, size_t, const void*, const void*, int, int)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:964:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
964 | const vfloat32m2_t d_0 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[0], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:965:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
965 | const vfloat32m2_t d_1 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[1], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:966:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
966 | const vfloat32m2_t d_2 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[2], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:967:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
967 | const vfloat32m2_t d_3 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[3], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp: In function ‘void ggml_gemm_iq4_nl_16x1_q8_0(int, float*, size_t, const void*, const void*, int, int)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:1317:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
1317 | const vfloat32m2_t d_0 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[0], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:1318:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
1318 | const vfloat32m2_t d_1 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[1], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:1319:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
1319 | const vfloat32m2_t d_2 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[2], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:1320:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
1320 | const vfloat32m2_t d_3 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[3], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp: In function ‘void ggml_gemm_q8_0_16x1_q8_0(int, float*, size_t, const void*, const void*, int, int)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:1387:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
1387 | const vfloat32m2_t d_0 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[0], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:1388:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
1388 | const vfloat32m2_t d_1 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[1], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:1389:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
1389 | const vfloat32m2_t d_2 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[2], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/arch/riscv/repack.cpp:1390:72: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
1390 | const vfloat32m2_t d_3 = __riscv_vfwmul_vf_f32m2(b_d, *(const _Float16 *)&a_ptr[l].d[3], 16);
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
In file included from /tmp/llama.cpp/ggml/src/ggml-cpu/ops.cpp:9:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h: In function ‘void ggml_vec_mad_f16(int, ggml_fp16_t*, const ggml_fp16_t*, float)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:537:29: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
537 | const _Float16 scale = *(const _Float16*)(&s);
| ^~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h: In function ‘void ggml_vec_scale_f16(int, ggml_fp16_t*, float)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/vec.h:810:29: warning: dereferencing type-punned pointer will break strict-aliasing rules [-Wstrict-aliasing]
810 | const _Float16 scale = *(const _Float16*)(&s);
| ^~~~~~~~~~~~~~~~~~~~~
/tmp/llama.cpp/ggml/src/ggml-cpu/repack.cpp: In function ‘void ggml_quantize_mat_q8_K_4x1(const float*, void*, int64_t)’:
/tmp/llama.cpp/ggml/src/ggml-cpu/repack.cpp:97:15: warning: unused variable ‘blck_size_interleave’ [-Wunused-variable]
97 | const int blck_size_interleave = 1;
| ^~~~~~~~~~~~~~~~~~~~
[ 9%] Linking CXX shared library ../../bin/libggml-cpu.so
[ 9%] Built target ggml-cpu
[ 9%] Building CXX object ggml/src/CMakeFiles/ggml.dir/ggml-backend-dl.cpp.o
[ 9%] Building CXX object ggml/src/CMakeFiles/ggml.dir/ggml-backend-reg.cpp.o
[ 9%] Linking CXX shared library ../../bin/libggml.so
[ 9%] Built target ggml
[ 9%] Building CXX object examples/gguf-hash/CMakeFiles/llama-gguf-hash.dir/gguf-hash.cpp.o
[ 9%] Building CXX object examples/gguf/CMakeFiles/llama-gguf.dir/gguf.cpp.o
[ 9%] Building CXX object src/CMakeFiles/llama.dir/llama-arch.cpp.o
[ 9%] Building CXX object src/CMakeFiles/llama.dir/llama-batch.cpp.o
[ 10%] Building CXX object src/CMakeFiles/llama.dir/llama.cpp.o
[ 10%] Building CXX object src/CMakeFiles/llama.dir/llama-adapter.cpp.o
[ 10%] Building CXX object src/CMakeFiles/llama.dir/llama-chat.cpp.o
[ 10%] Linking CXX static library libcpp-httplib.a
[ 10%] Built target cpp-httplib
[ 11%] Building CXX object src/CMakeFiles/llama.dir/llama-context.cpp.o
[ 12%] Linking CXX executable ../../bin/llama-gguf
[ 12%] Built target llama-gguf
[ 12%] Building CXX object src/CMakeFiles/llama.dir/llama-cparams.cpp.o
[ 12%] Building CXX object src/CMakeFiles/llama.dir/llama-grammar.cpp.o
[ 12%] Linking CXX executable ../../bin/llama-gguf-hash
[ 12%] Built target llama-gguf-hash
[ 12%] Building CXX object src/CMakeFiles/llama.dir/llama-graph.cpp.o
[ 12%] Building CXX object src/CMakeFiles/llama.dir/llama-hparams.cpp.o
[ 13%] Building CXX object src/CMakeFiles/llama.dir/llama-impl.cpp.o
[ 13%] Building CXX object src/CMakeFiles/llama.dir/llama-io.cpp.o
[ 13%] Building CXX object src/CMakeFiles/llama.dir/llama-kv-cache.cpp.o
[ 13%] Building CXX object src/CMakeFiles/llama.dir/llama-kv-cache-iswa.cpp.o
[ 14%] Building CXX object src/CMakeFiles/llama.dir/llama-memory.cpp.o
[ 14%] Building CXX object src/CMakeFiles/llama.dir/llama-memory-hybrid.cpp.o
[ 14%] Building CXX object src/CMakeFiles/llama.dir/llama-memory-hybrid-iswa.cpp.o
[ 14%] Building CXX object src/CMakeFiles/llama.dir/llama-memory-recurrent.cpp.o
[ 14%] Building CXX object src/CMakeFiles/llama.dir/llama-mmap.cpp.o
[ 15%] Building CXX object src/CMakeFiles/llama.dir/llama-model-loader.cpp.o
[ 15%] Building CXX object src/CMakeFiles/llama.dir/llama-model-saver.cpp.o
[ 15%] Building CXX object src/CMakeFiles/llama.dir/llama-model.cpp.o
[ 15%] Building CXX object src/CMakeFiles/llama.dir/llama-quant.cpp.o
[ 16%] Building CXX object src/CMakeFiles/llama.dir/llama-sampler.cpp.o
[ 16%] Building CXX object src/CMakeFiles/llama.dir/llama-vocab.cpp.o
[ 16%] Building CXX object src/CMakeFiles/llama.dir/unicode-data.cpp.o
[ 16%] Building CXX object src/CMakeFiles/llama.dir/unicode.cpp.o
[ 16%] Building CXX object src/CMakeFiles/llama.dir/models/afmoe.cpp.o
[ 17%] Building CXX object src/CMakeFiles/llama.dir/models/apertus.cpp.o
[ 17%] Building CXX object src/CMakeFiles/llama.dir/models/arcee.cpp.o
[ 17%] Building CXX object src/CMakeFiles/llama.dir/models/arctic.cpp.o
[ 17%] Building CXX object src/CMakeFiles/llama.dir/models/arwkv7.cpp.o
[ 18%] Building CXX object src/CMakeFiles/llama.dir/models/baichuan.cpp.o
[ 18%] Building CXX object src/CMakeFiles/llama.dir/models/bailingmoe.cpp.o
[ 18%] Building CXX object src/CMakeFiles/llama.dir/models/bailingmoe2.cpp.o
[ 18%] Building CXX object src/CMakeFiles/llama.dir/models/bert.cpp.o
[ 18%] Building CXX object src/CMakeFiles/llama.dir/models/bitnet.cpp.o
[ 19%] Building CXX object src/CMakeFiles/llama.dir/models/bloom.cpp.o
[ 19%] Building CXX object src/CMakeFiles/llama.dir/models/chameleon.cpp.o
[ 19%] Building CXX object src/CMakeFiles/llama.dir/models/chatglm.cpp.o
[ 19%] Building CXX object src/CMakeFiles/llama.dir/models/codeshell.cpp.o
[ 19%] Building CXX object src/CMakeFiles/llama.dir/models/cogvlm.cpp.o
[ 20%] Building CXX object src/CMakeFiles/llama.dir/models/cohere2-iswa.cpp.o
[ 20%] Building CXX object src/CMakeFiles/llama.dir/models/command-r.cpp.o
[ 20%] Building CXX object src/CMakeFiles/llama.dir/models/dbrx.cpp.o
[ 20%] Building CXX object src/CMakeFiles/llama.dir/models/deci.cpp.o
[ 21%] Building CXX object src/CMakeFiles/llama.dir/models/deepseek.cpp.o
[ 21%] Building CXX object src/CMakeFiles/llama.dir/models/deepseek2.cpp.o
[ 21%] Building CXX object src/CMakeFiles/llama.dir/models/delta-net-base.cpp.o
[ 21%] Building CXX object src/CMakeFiles/llama.dir/models/dots1.cpp.o
[ 21%] Building CXX object src/CMakeFiles/llama.dir/models/dream.cpp.o
[ 22%] Building CXX object src/CMakeFiles/llama.dir/models/ernie4-5-moe.cpp.o
[ 22%] Building CXX object src/CMakeFiles/llama.dir/models/ernie4-5.cpp.o
[ 22%] Building CXX object src/CMakeFiles/llama.dir/models/eurobert.cpp.o
[ 22%] Building CXX object src/CMakeFiles/llama.dir/models/exaone-moe.cpp.o
[ 23%] Building CXX object src/CMakeFiles/llama.dir/models/exaone.cpp.o
[ 23%] Building CXX object src/CMakeFiles/llama.dir/models/exaone4.cpp.o
[ 23%] Building CXX object src/CMakeFiles/llama.dir/models/falcon-h1.cpp.o
[ 23%] Building CXX object src/CMakeFiles/llama.dir/models/falcon.cpp.o
[ 23%] Building CXX object src/CMakeFiles/llama.dir/models/gemma-embedding.cpp.o
[ 24%] Building CXX object src/CMakeFiles/llama.dir/models/gemma.cpp.o
[ 24%] Building CXX object src/CMakeFiles/llama.dir/models/gemma2-iswa.cpp.o
[ 24%] Building CXX object src/CMakeFiles/llama.dir/models/gemma3.cpp.o
[ 24%] Building CXX object src/CMakeFiles/llama.dir/models/gemma3n-iswa.cpp.o
[ 24%] Building CXX object src/CMakeFiles/llama.dir/models/glm4-moe.cpp.o
[ 25%] Building CXX object src/CMakeFiles/llama.dir/models/glm4.cpp.o
[ 25%] Building CXX object src/CMakeFiles/llama.dir/models/gpt2.cpp.o
[ 25%] Building CXX object src/CMakeFiles/llama.dir/models/gptneox.cpp.o
[ 25%] Building CXX object src/CMakeFiles/llama.dir/models/granite-hybrid.cpp.o
[ 26%] Building CXX object src/CMakeFiles/llama.dir/models/granite.cpp.o
[ 26%] Building CXX object src/CMakeFiles/llama.dir/models/grok.cpp.o
[ 26%] Building CXX object src/CMakeFiles/llama.dir/models/grovemoe.cpp.o
[ 26%] Building CXX object src/CMakeFiles/llama.dir/models/hunyuan-dense.cpp.o
[ 26%] Building CXX object src/CMakeFiles/llama.dir/models/hunyuan-moe.cpp.o
[ 27%] Building CXX object src/CMakeFiles/llama.dir/models/internlm2.cpp.o
[ 27%] Building CXX object src/CMakeFiles/llama.dir/models/jais.cpp.o
[ 27%] Building CXX object src/CMakeFiles/llama.dir/models/jais2.cpp.o
[ 27%] Building CXX object src/CMakeFiles/llama.dir/models/jamba.cpp.o
[ 28%] Building CXX object src/CMakeFiles/llama.dir/models/kimi-linear.cpp.o
[ 28%] Building CXX object src/CMakeFiles/llama.dir/models/lfm2.cpp.o
[ 28%] Building CXX object src/CMakeFiles/llama.dir/models/llada-moe.cpp.o
[ 28%] Building CXX object src/CMakeFiles/llama.dir/models/llada.cpp.o
[ 28%] Building CXX object src/CMakeFiles/llama.dir/models/llama-iswa.cpp.o
[ 29%] Building CXX object src/CMakeFiles/llama.dir/models/llama.cpp.o
[ 29%] Building CXX object src/CMakeFiles/llama.dir/models/maincoder.cpp.o
[ 29%] Building CXX object src/CMakeFiles/llama.dir/models/mamba-base.cpp.o
[ 29%] Building CXX object src/CMakeFiles/llama.dir/models/mamba.cpp.o
[ 29%] Building CXX object src/CMakeFiles/llama.dir/models/mimo2-iswa.cpp.o
[ 30%] Building CXX object src/CMakeFiles/llama.dir/models/minicpm3.cpp.o
[ 30%] Building CXX object src/CMakeFiles/llama.dir/models/minimax-m2.cpp.o
[ 30%] Building CXX object src/CMakeFiles/llama.dir/models/mistral3.cpp.o
[ 30%] Building CXX object src/CMakeFiles/llama.dir/models/modern-bert.cpp.o
[ 31%] Building CXX object src/CMakeFiles/llama.dir/models/mpt.cpp.o
[ 31%] Building CXX object src/CMakeFiles/llama.dir/models/nemotron-h.cpp.o
[ 31%] Building CXX object src/CMakeFiles/llama.dir/models/nemotron.cpp.o
[ 31%] Building CXX object src/CMakeFiles/llama.dir/models/neo-bert.cpp.o
[ 31%] Building CXX object src/CMakeFiles/llama.dir/models/olmo.cpp.o
[ 32%] Building CXX object src/CMakeFiles/llama.dir/models/olmo2.cpp.o
[ 32%] Building CXX object src/CMakeFiles/llama.dir/models/olmoe.cpp.o
[ 32%] Building CXX object src/CMakeFiles/llama.dir/models/openai-moe-iswa.cpp.o
[ 32%] Building CXX object src/CMakeFiles/llama.dir/models/openelm.cpp.o
[ 33%] Building CXX object src/CMakeFiles/llama.dir/models/orion.cpp.o
[ 33%] Building CXX object src/CMakeFiles/llama.dir/models/paddleocr.cpp.o
[ 33%] Building CXX object src/CMakeFiles/llama.dir/models/pangu-embedded.cpp.o
[ 33%] Building CXX object src/CMakeFiles/llama.dir/models/phi2.cpp.o
[ 33%] Building CXX object src/CMakeFiles/llama.dir/models/phi3.cpp.o
[ 34%] Building CXX object src/CMakeFiles/llama.dir/models/plamo.cpp.o
[ 34%] Building CXX object src/CMakeFiles/llama.dir/models/plamo2.cpp.o
[ 34%] Building CXX object src/CMakeFiles/llama.dir/models/plamo3.cpp.o
[ 34%] Building CXX object src/CMakeFiles/llama.dir/models/plm.cpp.o
[ 34%] Building CXX object src/CMakeFiles/llama.dir/models/qwen.cpp.o
[ 35%] Building CXX object src/CMakeFiles/llama.dir/models/qwen2.cpp.o
[ 35%] Building CXX object src/CMakeFiles/llama.dir/models/qwen2moe.cpp.o
[ 35%] Building CXX object src/CMakeFiles/llama.dir/models/qwen2vl.cpp.o
[ 35%] Building CXX object src/CMakeFiles/llama.dir/models/qwen3.cpp.o
[ 36%] Building CXX object src/CMakeFiles/llama.dir/models/qwen35.cpp.o
[ 36%] Building CXX object src/CMakeFiles/llama.dir/models/qwen35moe.cpp.o
[ 36%] Building CXX object src/CMakeFiles/llama.dir/models/qwen3moe.cpp.o
[ 36%] Building CXX object src/CMakeFiles/llama.dir/models/qwen3next.cpp.o
[ 36%] Building CXX object src/CMakeFiles/llama.dir/models/qwen3vl-moe.cpp.o
[ 37%] Building CXX object src/CMakeFiles/llama.dir/models/qwen3vl.cpp.o
[ 37%] Building CXX object src/CMakeFiles/llama.dir/models/refact.cpp.o
[ 37%] Building CXX object src/CMakeFiles/llama.dir/models/rnd1.cpp.o
[ 37%] Building CXX object src/CMakeFiles/llama.dir/models/rwkv6-base.cpp.o
[ 38%] Building CXX object src/CMakeFiles/llama.dir/models/rwkv6.cpp.o
[ 38%] Building CXX object src/CMakeFiles/llama.dir/models/rwkv6qwen2.cpp.o
[ 38%] Building CXX object src/CMakeFiles/llama.dir/models/rwkv7-base.cpp.o
[ 38%] Building CXX object src/CMakeFiles/llama.dir/models/rwkv7.cpp.o
[ 38%] Building CXX object src/CMakeFiles/llama.dir/models/seed-oss.cpp.o
[ 39%] Building CXX object src/CMakeFiles/llama.dir/models/smallthinker.cpp.o
[ 39%] Building CXX object src/CMakeFiles/llama.dir/models/smollm3.cpp.o
[ 39%] Building CXX object src/CMakeFiles/llama.dir/models/stablelm.cpp.o
[ 39%] Building CXX object src/CMakeFiles/llama.dir/models/starcoder.cpp.o
[ 40%] Building CXX object src/CMakeFiles/llama.dir/models/starcoder2.cpp.o
[ 40%] Building CXX object src/CMakeFiles/llama.dir/models/step35-iswa.cpp.o
[ 40%] Building CXX object src/CMakeFiles/llama.dir/models/t5-dec.cpp.o
[ 40%] Building CXX object src/CMakeFiles/llama.dir/models/t5-enc.cpp.o
[ 40%] Building CXX object src/CMakeFiles/llama.dir/models/wavtokenizer-dec.cpp.o
[ 41%] Building CXX object src/CMakeFiles/llama.dir/models/xverse.cpp.o
[ 41%] Linking CXX shared library ../bin/libllama.so
[ 41%] Built target llama
[ 41%] Building CXX object examples/simple-chat/CMakeFiles/llama-simple-chat.dir/simple-chat.cpp.o
[ 41%] Building CXX object common/CMakeFiles/common.dir/arg.cpp.o
[ 41%] Building CXX object common/CMakeFiles/common.dir/chat-auto-parser-generator.cpp.o
[ 41%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/mtmd-audio.cpp.o
[ 41%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/mtmd.cpp.o
[ 41%] Building CXX object common/CMakeFiles/common.dir/chat-auto-parser-helpers.cpp.o
[ 41%] Building CXX object examples/simple/CMakeFiles/llama-simple.dir/simple.cpp.o
[ 41%] Building C object tests/CMakeFiles/test-c.dir/test-c.c.o
[ 42%] Linking C executable ../bin/test-c
[ 42%] Built target test-c
[ 43%] Building CXX object common/CMakeFiles/common.dir/chat-diff-analyzer.cpp.o
[ 43%] Linking CXX executable ../../bin/llama-simple
[ 43%] Built target llama-simple
[ 44%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/mtmd-image.cpp.o
[ 44%] Linking CXX executable ../../bin/llama-simple-chat
[ 44%] Built target llama-simple-chat
[ 44%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/mtmd-helper.cpp.o
[ 44%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/clip.cpp.o
[ 44%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/cogvlm.cpp.o
[ 45%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/conformer.cpp.o
[ 45%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/glm4v.cpp.o
[ 45%] Building CXX object common/CMakeFiles/common.dir/chat-peg-parser.cpp.o
[ 45%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/internvl.cpp.o
[ 45%] Building CXX object common/CMakeFiles/common.dir/chat.cpp.o
[ 45%] Building CXX object common/CMakeFiles/common.dir/common.cpp.o
[ 45%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/kimivl.cpp.o
[ 45%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/kimik25.cpp.o
[ 45%] Building CXX object common/CMakeFiles/common.dir/console.cpp.o
[ 46%] Building CXX object common/CMakeFiles/common.dir/debug.cpp.o
[ 47%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/nemotron-v2-vl.cpp.o
[ 47%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/llama4.cpp.o
[ 47%] Building CXX object common/CMakeFiles/common.dir/download.cpp.o
[ 47%] Building CXX object common/CMakeFiles/common.dir/hf-cache.cpp.o
[ 47%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/llava.cpp.o
[ 47%] Building CXX object common/CMakeFiles/common.dir/json-partial.cpp.o
[ 48%] Building CXX object common/CMakeFiles/common.dir/json-schema-to-grammar.cpp.o
[ 48%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/minicpmv.cpp.o
[ 49%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/paddleocr.cpp.o
[ 49%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/pixtral.cpp.o
[ 49%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/qwen2vl.cpp.o
[ 49%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/qwen3vl.cpp.o
[ 49%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/siglip.cpp.o
[ 49%] Building CXX object common/CMakeFiles/common.dir/llguidance.cpp.o
[ 50%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/whisper-enc.cpp.o
[ 50%] Building CXX object common/CMakeFiles/common.dir/log.cpp.o
[ 50%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/deepseekocr.cpp.o
[ 50%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/mobilenetv5.cpp.o
[ 50%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/youtuvl.cpp.o
[ 50%] Building CXX object common/CMakeFiles/common.dir/ngram-cache.cpp.o
[ 50%] Building CXX object common/CMakeFiles/common.dir/ngram-map.cpp.o
[ 51%] Building CXX object common/CMakeFiles/common.dir/ngram-mod.cpp.o
[ 51%] Building CXX object common/CMakeFiles/common.dir/peg-parser.cpp.o
[ 51%] Linking CXX shared library ../../bin/libmtmd.so
[ 51%] Built target mtmd
[ 51%] Building CXX object common/CMakeFiles/common.dir/preset.cpp.o
[ 51%] Building CXX object common/CMakeFiles/common.dir/regex-partial.cpp.o
[ 52%] Building CXX object common/CMakeFiles/common.dir/reasoning-budget.cpp.o
[ 52%] Building CXX object common/CMakeFiles/common.dir/sampling.cpp.o
[ 52%] Building CXX object common/CMakeFiles/common.dir/speculative.cpp.o
[ 52%] Building CXX object common/CMakeFiles/common.dir/unicode.cpp.o
[ 52%] Building CXX object common/CMakeFiles/common.dir/jinja/lexer.cpp.o
[ 53%] Building CXX object common/CMakeFiles/common.dir/jinja/parser.cpp.o
[ 53%] Building CXX object common/CMakeFiles/common.dir/jinja/runtime.cpp.o
[ 53%] Building CXX object common/CMakeFiles/common.dir/jinja/value.cpp.o
[ 53%] Building CXX object common/CMakeFiles/common.dir/jinja/string.cpp.o
[ 53%] Building CXX object common/CMakeFiles/common.dir/jinja/caps.cpp.o
[ 54%] Building CXX object common/CMakeFiles/common.dir/__/license.cpp.o
[ 54%] Linking CXX static library libcommon.a
[ 54%] Built target common
[ 54%] Building CXX object tests/CMakeFiles/test-reasoning-budget.dir/test-reasoning-budget.cpp.o
[ 54%] Building CXX object tests/CMakeFiles/test-grammar-parser.dir/test-grammar-parser.cpp.o
[ 54%] Building CXX object tests/CMakeFiles/test-sampling.dir/test-sampling.cpp.o
[ 54%] Building CXX object tests/CMakeFiles/test-tokenizer-0.dir/test-tokenizer-0.cpp.o
[ 54%] Building CXX object tests/CMakeFiles/test-llama-grammar.dir/test-llama-grammar.cpp.o
[ 54%] Building CXX object tests/CMakeFiles/test-chat.dir/test-chat.cpp.o
[ 54%] Building CXX object tests/CMakeFiles/test-grammar-integration.dir/test-grammar-integration.cpp.o
[ 54%] Building CXX object tests/CMakeFiles/test-json-schema-to-grammar.dir/test-json-schema-to-grammar.cpp.o
[ 54%] Building CXX object tests/CMakeFiles/test-reasoning-budget.dir/get-model.cpp.o
[ 55%] Linking CXX executable ../bin/test-reasoning-budget
[ 55%] Built target test-reasoning-budget
[ 55%] Building CXX object tests/CMakeFiles/test-json-schema-to-grammar.dir/get-model.cpp.o
[ 55%] Building CXX object tests/CMakeFiles/test-sampling.dir/get-model.cpp.o
[ 55%] Building CXX object tests/CMakeFiles/test-grammar-integration.dir/get-model.cpp.o
[ 55%] Building CXX object tests/CMakeFiles/test-grammar-parser.dir/get-model.cpp.o
[ 55%] Building CXX object tests/CMakeFiles/test-quantize-stats.dir/test-quantize-stats.cpp.o
[ 56%] Linking CXX executable ../bin/test-sampling
[ 56%] Linking CXX executable ../bin/test-grammar-parser
[ 56%] Built target test-sampling
[ 57%] Building CXX object tests/CMakeFiles/test-gbnf-validator.dir/test-gbnf-validator.cpp.o
[ 57%] Built target test-grammar-parser
[ 58%] Building CXX object tests/CMakeFiles/test-tokenizer-1-bpe.dir/test-tokenizer-1-bpe.cpp.o
[ 58%] Building CXX object tests/CMakeFiles/test-llama-grammar.dir/get-model.cpp.o
[ 59%] Linking CXX executable ../bin/test-llama-grammar
[ 59%] Built target test-llama-grammar
[ 59%] Linking CXX executable ../bin/test-tokenizer-0
[ 59%] Building CXX object tests/CMakeFiles/test-tokenizer-1-spm.dir/test-tokenizer-1-spm.cpp.o
[ 59%] Built target test-tokenizer-0
[ 59%] Building CXX object tests/CMakeFiles/test-llama-archs.dir/test-llama-archs.cpp.o
[ 59%] Linking CXX executable ../bin/test-gbnf-validator
[ 59%] Built target test-gbnf-validator
[ 60%] Building CXX object tests/CMakeFiles/test-llama-archs.dir/get-model.cpp.o
[ 60%] Building CXX object tests/CMakeFiles/test-chat.dir/get-model.cpp.o
[ 60%] Building CXX object tests/CMakeFiles/test-chat-peg-parser.dir/test-chat-peg-parser.cpp.o
[ 60%] Linking CXX executable ../bin/test-tokenizer-1-bpe
[ 60%] Built target test-tokenizer-1-bpe
[ 60%] Building CXX object tests/CMakeFiles/test-chat-peg-parser.dir/peg-parser/simple-tokenize.cpp.o
[ 60%] Linking CXX executable ../bin/test-tokenizer-1-spm
[ 60%] Built target test-tokenizer-1-spm
[ 60%] Building CXX object tests/CMakeFiles/test-jinja.dir/test-jinja.cpp.o
[ 61%] Building CXX object tests/CMakeFiles/test-chat-peg-parser.dir/get-model.cpp.o
[ 61%] Building CXX object tests/CMakeFiles/test-chat-auto-parser.dir/test-chat-auto-parser.cpp.o
[ 61%] Linking CXX executable ../bin/test-llama-archs
[ 61%] Built target test-llama-archs
[ 61%] Building CXX object tests/CMakeFiles/test-chat-template.dir/test-chat-template.cpp.o
[ 62%] Linking CXX executable ../bin/test-grammar-integration
[ 62%] Built target test-grammar-integration
[ 62%] Building CXX object tests/CMakeFiles/test-chat-template.dir/get-model.cpp.o
[ 63%] Building CXX object tests/CMakeFiles/test-chat-auto-parser.dir/get-model.cpp.o
[ 64%] Building CXX object tests/CMakeFiles/test-jinja.dir/get-model.cpp.o
[ 64%] Building CXX object tests/CMakeFiles/test-json-partial.dir/test-json-partial.cpp.o
[ 64%] Linking CXX executable ../bin/test-quantize-stats
[ 64%] Built target test-quantize-stats
[ 64%] Building CXX object tests/CMakeFiles/test-log.dir/test-log.cpp.o
[ 64%] Building CXX object tests/CMakeFiles/test-log.dir/get-model.cpp.o
[ 64%] Linking CXX executable ../bin/test-log
[ 64%] Built target test-log
[ 64%] Building CXX object tests/CMakeFiles/test-peg-parser.dir/test-peg-parser.cpp.o
[ 64%] Linking CXX executable ../bin/test-json-schema-to-grammar
[ 64%] Built target test-json-schema-to-grammar
[ 64%] Building CXX object tests/CMakeFiles/test-regex-partial.dir/test-regex-partial.cpp.o
[ 64%] Building CXX object tests/CMakeFiles/test-json-partial.dir/get-model.cpp.o
[ 65%] Linking CXX executable ../bin/test-json-partial
[ 65%] Built target test-json-partial
[ 66%] Building CXX object tests/CMakeFiles/test-thread-safety.dir/test-thread-safety.cpp.o
[ 66%] Building CXX object tests/CMakeFiles/test-regex-partial.dir/get-model.cpp.o
[ 66%] Linking CXX executable ../bin/test-regex-partial
[ 66%] Built target test-regex-partial
[ 66%] Building CXX object tests/CMakeFiles/test-arg-parser.dir/test-arg-parser.cpp.o
[ 66%] Linking CXX executable ../bin/test-chat-template
[ 66%] Building CXX object tests/CMakeFiles/test-thread-safety.dir/get-model.cpp.o
[ 66%] Linking CXX executable ../bin/test-thread-safety
[ 66%] Built target test-chat-template
[ 67%] Building CXX object tests/CMakeFiles/test-opt.dir/test-opt.cpp.o
[ 67%] Built target test-thread-safety
[ 67%] Building CXX object tests/CMakeFiles/test-gguf.dir/test-gguf.cpp.o
[ 67%] Building CXX object tests/CMakeFiles/test-arg-parser.dir/get-model.cpp.o
[ 68%] Linking CXX executable ../bin/test-arg-parser
[ 68%] Building CXX object tests/CMakeFiles/test-opt.dir/get-model.cpp.o
[ 68%] Linking CXX executable ../bin/test-opt
[ 68%] Built target test-opt
[ 68%] Building CXX object tests/CMakeFiles/test-backend-ops.dir/test-backend-ops.cpp.o
[ 69%] Building CXX object tests/CMakeFiles/test-peg-parser.dir/peg-parser/simple-tokenize.cpp.o
[ 69%] Building CXX object tests/CMakeFiles/test-peg-parser.dir/peg-parser/test-basic.cpp.o
[ 69%] Built target test-arg-parser
[ 70%] Building CXX object tests/CMakeFiles/test-backend-ops.dir/get-model.cpp.o
[ 70%] Building CXX object tests/CMakeFiles/test-model-load-cancel.dir/test-model-load-cancel.cpp.o
[ 70%] Building CXX object tests/CMakeFiles/test-gguf.dir/get-model.cpp.o
[ 71%] Linking CXX executable ../bin/test-gguf
[ 72%] Building CXX object tests/CMakeFiles/test-model-load-cancel.dir/get-model.cpp.o
[ 72%] Built target test-gguf
[ 72%] Linking CXX executable ../bin/test-model-load-cancel
[ 72%] Building CXX object tests/CMakeFiles/test-autorelease.dir/test-autorelease.cpp.o
[ 72%] Built target test-model-load-cancel
[ 72%] Building CXX object tests/CMakeFiles/test-backend-sampler.dir/test-backend-sampler.cpp.o
[ 72%] Building CXX object tests/CMakeFiles/test-autorelease.dir/get-model.cpp.o
[ 72%] Linking CXX executable ../bin/test-autorelease
[ 72%] Built target test-autorelease
[ 72%] Building CXX object tests/CMakeFiles/test-state-restore-fragmented.dir/test-state-restore-fragmented.cpp.o
[ 72%] Building CXX object tests/CMakeFiles/test-state-restore-fragmented.dir/get-model.cpp.o
[ 72%] Linking CXX executable ../bin/test-state-restore-fragmented
[ 72%] Built target test-state-restore-fragmented
[ 73%] Building CXX object tests/CMakeFiles/test-barrier.dir/test-barrier.cpp.o
[ 73%] Building CXX object tests/CMakeFiles/test-backend-sampler.dir/get-model.cpp.o
[ 73%] Linking CXX executable ../bin/test-backend-sampler
[ 73%] Built target test-backend-sampler
[ 74%] Building CXX object tests/CMakeFiles/test-quantize-fns.dir/test-quantize-fns.cpp.o
[ 74%] Building CXX object tests/CMakeFiles/test-barrier.dir/get-model.cpp.o
[ 74%] Linking CXX executable ../bin/test-barrier
[ 74%] Built target test-barrier
[ 74%] Building CXX object tests/CMakeFiles/test-quantize-perf.dir/test-quantize-perf.cpp.o
[ 74%] Building CXX object tests/CMakeFiles/test-quantize-fns.dir/get-model.cpp.o
[ 74%] Linking CXX executable ../bin/test-quantize-fns
[ 74%] Built target test-quantize-fns
[ 75%] Building CXX object tests/CMakeFiles/test-rope.dir/test-rope.cpp.o
[ 75%] Linking CXX executable ../bin/test-chat
[ 75%] Building CXX object tests/CMakeFiles/test-rope.dir/get-model.cpp.o
[ 75%] Linking CXX executable ../bin/test-rope
[ 75%] Built target test-rope
[ 75%] Building CXX object tests/CMakeFiles/test-quantize-perf.dir/get-model.cpp.o
[ 75%] Building CXX object tests/CMakeFiles/test-peg-parser.dir/peg-parser/test-gbnf-generation.cpp.o
[ 75%] Built target test-chat
[ 75%] Building C object tests/CMakeFiles/test-mtmd-c-api.dir/test-mtmd-c-api.c.o
[ 75%] Building CXX object tests/CMakeFiles/test-mtmd-c-api.dir/get-model.cpp.o
[ 75%] Linking CXX executable ../bin/test-mtmd-c-api
[ 75%] Built target test-mtmd-c-api
[ 75%] Building CXX object tests/CMakeFiles/gguf-model-data.dir/gguf-model-data.cpp.o
[ 76%] Linking CXX executable ../bin/test-quantize-perf
[ 76%] Built target test-quantize-perf
[ 76%] Building CXX object tests/CMakeFiles/test-alloc.dir/test-alloc.cpp.o
[ 76%] Linking CXX executable ../bin/test-chat-peg-parser
[ 77%] Building CXX object tests/CMakeFiles/test-alloc.dir/get-model.cpp.o
[ 77%] Linking CXX executable ../bin/test-alloc
[ 77%] Built target test-alloc
[ 78%] Building CXX object tests/CMakeFiles/export-graph-ops.dir/export-graph-ops.cpp.o
[ 78%] Built target test-chat-peg-parser
[ 78%] Building CXX object examples/batched/CMakeFiles/llama-batched.dir/batched.cpp.o
[ 78%] Linking CXX executable ../bin/test-chat-auto-parser
[ 78%] Built target test-chat-auto-parser
[ 78%] Building CXX object examples/debug/CMakeFiles/llama-debug.dir/debug.cpp.o
[ 78%] Building CXX object tests/CMakeFiles/test-peg-parser.dir/peg-parser/test-json-parser.cpp.o
[ 78%] Linking CXX executable ../../bin/llama-batched
[ 78%] Linking CXX executable ../bin/export-graph-ops
[ 78%] Linking CXX executable ../bin/test-jinja
[ 78%] Built target llama-batched
[ 78%] Building CXX object examples/embedding/CMakeFiles/llama-embedding.dir/embedding.cpp.o
[ 78%] Built target export-graph-ops
[ 78%] Built target test-jinja
[ 78%] Building CXX object examples/eval-callback/CMakeFiles/llama-eval-callback.dir/eval-callback.cpp.o
[ 78%] Building CXX object examples/idle/CMakeFiles/llama-idle.dir/idle.cpp.o
[ 78%] Linking CXX executable ../../bin/llama-idle
[ 79%] Linking CXX executable ../../bin/llama-embedding
[ 79%] Linking CXX executable ../../bin/llama-eval-callback
[ 79%] Built target llama-idle
[ 79%] Building CXX object examples/lookahead/CMakeFiles/llama-lookahead.dir/lookahead.cpp.o
[ 79%] Linking CXX static library libgguf-model-data.a
[ 79%] Built target gguf-model-data
[ 79%] Building CXX object tests/CMakeFiles/test-peg-parser.dir/peg-parser/test-json-serialization.cpp.o
[ 79%] Built target llama-embedding
[ 79%] Building CXX object examples/lookup/CMakeFiles/llama-lookup.dir/lookup.cpp.o
[ 79%] Built target llama-eval-callback
[ 79%] Building CXX object examples/lookup/CMakeFiles/llama-lookup-create.dir/lookup-create.cpp.o
[ 79%] Linking CXX executable ../../bin/llama-debug
[ 80%] Building CXX object tests/CMakeFiles/test-peg-parser.dir/peg-parser/test-python-dict-parser.cpp.o
[ 80%] Built target llama-debug
[ 80%] Building CXX object examples/lookup/CMakeFiles/llama-lookup-merge.dir/lookup-merge.cpp.o
[ 80%] Linking CXX executable ../../bin/llama-lookup-create
[ 81%] Linking CXX executable ../../bin/llama-lookup
[ 81%] Linking CXX executable ../../bin/llama-lookahead
[ 81%] Building CXX object tests/CMakeFiles/test-peg-parser.dir/peg-parser/test-unicode.cpp.o
[ 81%] Built target llama-lookahead
[ 81%] Built target llama-lookup-create
[ 81%] Building CXX object examples/lookup/CMakeFiles/llama-lookup-stats.dir/lookup-stats.cpp.o
[ 82%] Building CXX object examples/parallel/CMakeFiles/llama-parallel.dir/parallel.cpp.o
[ 82%] Built target llama-lookup
[ 82%] Building CXX object examples/passkey/CMakeFiles/llama-passkey.dir/passkey.cpp.o
[ 83%] Linking CXX executable ../../bin/llama-lookup-merge
[ 83%] Built target llama-lookup-merge
[ 84%] Building CXX object examples/retrieval/CMakeFiles/llama-retrieval.dir/retrieval.cpp.o
[ 84%] Linking CXX executable ../../bin/llama-lookup-stats
[ 84%] Linking CXX executable ../../bin/llama-passkey
[ 84%] Linking CXX executable ../../bin/llama-parallel
[ 84%] Linking CXX executable ../../bin/llama-retrieval
[ 84%] Built target llama-lookup-stats
[ 84%] Building CXX object examples/save-load-state/CMakeFiles/llama-save-load-state.dir/save-load-state.cpp.o
[ 84%] Built target llama-passkey
[ 85%] Building CXX object examples/speculative/CMakeFiles/llama-speculative.dir/speculative.cpp.o
[ 85%] Built target llama-parallel
[ 85%] Building CXX object examples/speculative-simple/CMakeFiles/llama-speculative-simple.dir/speculative-simple.cpp.o
[ 85%] Built target llama-retrieval
[ 85%] Building CXX object examples/gen-docs/CMakeFiles/llama-gen-docs.dir/gen-docs.cpp.o
[ 85%] Linking CXX executable ../../bin/llama-save-load-state
[ 85%] Linking CXX executable ../../bin/llama-gen-docs
[ 85%] Built target llama-save-load-state
[ 86%] Building CXX object examples/training/CMakeFiles/llama-finetune.dir/finetune.cpp.o
[ 86%] Building CXX object tests/CMakeFiles/test-peg-parser.dir/get-model.cpp.o
[ 86%] Building CXX object examples/diffusion/CMakeFiles/llama-diffusion-cli.dir/diffusion-cli.cpp.o
[ 86%] Building CXX object examples/convert-llama2c-to-ggml/CMakeFiles/llama-convert-llama2c-to-ggml.dir/convert-llama2c-to-ggml.cpp.o
[ 86%] Linking CXX executable ../../bin/llama-speculative-simple
[ 86%] Linking CXX executable ../bin/test-backend-ops
[ 86%] Linking CXX executable ../../bin/llama-speculative
[ 86%] Built target llama-gen-docs
[ 86%] Building CXX object pocs/vdot/CMakeFiles/llama-vdot.dir/vdot.cpp.o
[ 86%] Built target test-backend-ops
[ 86%] Building CXX object pocs/vdot/CMakeFiles/llama-q8dot.dir/q8dot.cpp.o
[ 86%] Built target llama-speculative-simple
[ 86%] Building CXX object tools/batched-bench/CMakeFiles/llama-batched-bench.dir/batched-bench.cpp.o
[ 86%] Built target llama-speculative
[ 86%] Building CXX object tools/gguf-split/CMakeFiles/llama-gguf-split.dir/gguf-split.cpp.o
[ 86%] Linking CXX executable ../../bin/llama-q8dot
[ 86%] Linking CXX executable ../../bin/llama-vdot
[ 86%] Linking CXX executable ../bin/test-peg-parser
[ 86%] Built target llama-q8dot
[ 86%] Building CXX object tools/imatrix/CMakeFiles/llama-imatrix.dir/imatrix.cpp.o
[ 86%] Built target llama-vdot
[ 86%] Building CXX object tools/llama-bench/CMakeFiles/llama-bench.dir/llama-bench.cpp.o
[ 86%] Built target test-peg-parser
[ 86%] Building CXX object tools/completion/CMakeFiles/llama-completion.dir/completion.cpp.o
[ 86%] Linking CXX executable ../../bin/llama-finetune
[ 86%] Linking CXX executable ../../bin/llama-convert-llama2c-to-ggml
[ 86%] Built target llama-convert-llama2c-to-ggml
[ 86%] Building CXX object tools/perplexity/CMakeFiles/llama-perplexity.dir/perplexity.cpp.o
[ 86%] Built target llama-finetune
[ 86%] Building CXX object tools/quantize/CMakeFiles/llama-quantize.dir/quantize.cpp.o
[ 87%] Linking CXX executable ../../bin/llama-gguf-split
[ 87%] Built target llama-gguf-split
[ 88%] Building CXX object tools/server/CMakeFiles/server-context.dir/server-task.cpp.o
[ 89%] Linking CXX executable ../../bin/llama-batched-bench
[ 89%] Built target llama-batched-bench
[ 89%] Building CXX object tools/tokenize/CMakeFiles/llama-tokenize.dir/tokenize.cpp.o
[ 89%] Linking CXX executable ../../bin/llama-tokenize
[ 89%] Built target llama-tokenize
[ 90%] Building CXX object tools/parser/CMakeFiles/llama-debug-template-parser.dir/debug-template-parser.cpp.o
[ 91%] Linking CXX executable ../../bin/llama-quantize
[ 91%] Linking CXX executable ../../bin/llama-diffusion-cli
[ 91%] Built target llama-quantize
[ 92%] Building CXX object tools/parser/CMakeFiles/llama-template-analysis.dir/template-analysis.cpp.o
[ 92%] Built target llama-diffusion-cli
[ 92%] Building CXX object tools/tts/CMakeFiles/llama-tts.dir/tts.cpp.o
[ 93%] Linking CXX executable ../../bin/llama-perplexity
[ 93%] Linking CXX executable ../../bin/llama-completion
[ 93%] Built target llama-perplexity
[ 94%] Building CXX object tools/mtmd/CMakeFiles/llama-mtmd-cli.dir/mtmd-cli.cpp.o
[ 94%] Built target llama-completion
[ 94%] Building CXX object tools/mtmd/CMakeFiles/llama-mtmd-debug.dir/debug/mtmd-debug.cpp.o
[ 94%] Linking CXX executable ../../bin/llama-imatrix
[ 94%] Linking CXX executable ../../bin/llama-mtmd-debug
[ 94%] Built target llama-imatrix
[ 95%] Building CXX object tools/cvector-generator/CMakeFiles/llama-cvector-generator.dir/cvector-generator.cpp.o
[ 95%] Built target llama-mtmd-debug
[ 95%] Building CXX object tools/export-lora/CMakeFiles/llama-export-lora.dir/export-lora.cpp.o
[ 95%] Linking CXX executable ../../bin/llama-debug-template-parser
[ 95%] Built target llama-debug-template-parser
[ 95%] Building CXX object tools/fit-params/CMakeFiles/llama-fit-params.dir/fit-params.cpp.o
[ 95%] Linking CXX executable ../../bin/llama-bench
[ 95%] Built target llama-bench
[ 95%] Building CXX object tools/results/CMakeFiles/llama-results.dir/results.cpp.o
[ 95%] Linking CXX executable ../../bin/llama-template-analysis
[ 95%] Built target llama-template-analysis
[ 95%] Building CXX object tests/CMakeFiles/test-gguf-model-data.dir/test-gguf-model-data.cpp.o
[ 95%] Linking CXX executable ../../bin/llama-mtmd-cli
[ 95%] Linking CXX executable ../bin/test-gguf-model-data
[ 95%] Linking CXX executable ../../bin/llama-export-lora
[ 95%] Linking CXX executable ../../bin/llama-cvector-generator
[ 95%] Linking CXX executable ../../bin/llama-fit-params
[ 95%] Built target test-gguf-model-data
[ 95%] Building CXX object tools/server/CMakeFiles/server-context.dir/server-queue.cpp.o
[ 95%] Built target llama-mtmd-cli
[ 95%] Building CXX object tools/server/CMakeFiles/server-context.dir/server-common.cpp.o
[ 95%] Built target llama-export-lora
[ 95%] Building CXX object tools/server/CMakeFiles/server-context.dir/server-context.cpp.o
[ 95%] Built target llama-cvector-generator
[ 96%] Building CXX object tools/server/CMakeFiles/server-context.dir/server-tools.cpp.o
[ 96%] Built target llama-fit-params
[ 96%] Linking CXX executable ../../bin/llama-results
[ 96%] Built target llama-results
[ 97%] Linking CXX executable ../../bin/llama-tts
[ 97%] Built target llama-tts
[ 97%] Linking CXX static library libserver-context.a
[ 97%] Built target server-context
[ 98%] Generating loading.html.hpp
[ 98%] Generating index.html.gz.hpp
[ 98%] Building CXX object tools/cli/CMakeFiles/llama-cli.dir/cli.cpp.o
[ 98%] Building CXX object tools/server/CMakeFiles/llama-server.dir/server-http.cpp.o
[ 98%] Building CXX object tools/server/CMakeFiles/llama-server.dir/server-models.cpp.o
[ 98%] Building CXX object tools/server/CMakeFiles/llama-server.dir/server.cpp.o
[ 99%] Linking CXX executable ../../bin/llama-cli
[ 99%] Built target llama-cli
[100%] Linking CXX executable ../../bin/llama-server
[100%] Built target llama-server
Command being timed: "cmake --build build --config Release -j 8"
User time (seconds): 17772.00
System time (seconds): 743.81
Percent of CPU this job got: 553%
Elapsed (wall clock) time (h:mm:ss or m:ss): 55:43.08
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 844140
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 1210
Minor (reclaiming a frame) page faults: 20721621
Voluntary context switches: 13820
Involuntary context switches: 4140037
Swaps: 0
File system inputs: 0
File system outputs: 0
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
=== Verify ===
build/bin/llama-cli: ELF 64-bit LSB pie executable, UCB RISC-V, RVC, double-float ABI, version 1 (GNU/Linux), dynamically linked, interpreter /lib/ld-linux-riscv64-lp64d.so.1, BuildID[sha1]=ab74051266b8816798afc156c90d29e12143a4d9, for GNU/Linux 4.15.0, not stripped
build/bin/llama-server: ELF 64-bit LSB pie executable, UCB RISC-V, RVC, double-float ABI, version 1 (GNU/Linux), dynamically linked, interpreter /lib/ld-linux-riscv64-lp64d.so.1, BuildID[sha1]=3a58d2d491a0a9759bfb213f96c0810a11d40f1f, for GNU/Linux 4.15.0, not stripped
-rwxrwxr-x 1 poddingue poddingue 4.6M Mar 28 10:34 build/bin/llama-cli
-rwxrwxr-x 1 poddingue poddingue 6.5M Mar 28 10:35 build/bin/llama-server
version: 1 (b0f0dd3)
built with GNU 14.2.0 for Linux riscv64
BUILD_DONE
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment