Skip to content

Instantly share code, notes, and snippets.

View nihui's full-sized avatar

nihui

7.6k followers · 37 following
  • Shanghai
  • 05:53 (UTC +08:00)
  • X @nihui
View GitHub Profile
@nihui
nihui / binutils-bfd-allow-link-rvv-xtheadvector.patch
Created November 30, 2024 06:35
binutils-bfd-allow-link-rvv-xtheadvector.patch
@nihui
nihui / ncnn-res.md
Last active June 18, 2022 04:51
ncnn memory usage 
#include <malloc.h>

// call malloc_trim(0);
static double get_memory_resident()
{
    unsigned long size;
    unsigned long resident;
    unsigned long share;
 unsigned long text;
@nihui
nihui / mul.cpp
Last active May 10, 2022 13:33
int8 vector multiplication in loongson mmi and mips msa
// g++ mul.cpp -o mul -mmsa -mloongson-mmi -O3
// https://github.com/Tencent/ncnn/blob/master/src/layer/mips/loongson_mmi.h
// root@ls2k:~/ncnn/build# ./quant
// mul_s8x8 385.743
// mul_s8x8_mmi 611.364
// mul_s8x8_msa 173.241
// -66 2 0 4 10 18 28 40
@nihui
nihui / avx512_transpose.cpp
Last active October 9, 2024 03:56
avx512 16x24 16x16 16x12 16x8 16x4 16x2 8x24 8x16 8x12 8x8 8x4 8x2 matrix transpose
// g++ -mfma -mf16c -mavx512f -mavx512vnni -mavx512vl
#include <immintrin.h>
#include <stdio.h>
static void print(const __m512& _x)
{
__attribute__((aligned(64)))
float a[16];
@nihui
nihui / testpt.cpp
Created January 27, 2022 07:08
libtorch inference test
#include <torch/script.h>
int main()
{
c10::InferenceMode guard(true);
torch::NoGradGuard no_grad;
torch::jit::Module mod2 = torch::jit::load("stylegan.pt");
mod2.eval();
@nihui
nihui / ncnn-c_api-customop.c
Created January 21, 2022 14:34
register custom layer with ncnn c api
#include <stdio.h>
// ncnn
#include <c_api.h>
/** test.param content
7767517
3 3
Input in0 0 1 input0
@nihui
nihui / github-ssh-push.md
Last active October 1, 2021 07:14
github-ssh-push.md 
$ git push
remote: Support for password authentication was removed on August 13, 2021. Please use a personal access token instead.
remote: Please see https://github.blog/2020-12-15-token-authentication-requirements-for-git-operations/ for more information.
fatal: 'https://github.com/nihui/ncnn.git/' 鉴权失败

$ git remote -v
origin https://github.com/nihui/ncnn.git (fetch)
@nihui
nihui / simple-https-server.py
Last active February 4, 2023 16:53
simple https server
from http.server import HTTPServer, SimpleHTTPRequestHandler
import ssl, os
os.system("openssl req -nodes -x509 -newkey rsa:4096 -keyout key.pem -out cert.pem -days 365 -subj '/CN=mylocalhost'")
port = 8888
httpd = HTTPServer(('0.0.0.0', port), SimpleHTTPRequestHandler)
httpd.socket = ssl.wrap_socket(httpd.socket, keyfile='key.pem', certfile="cert.pem", server_side=True)
print(f"Server running on https://0.0.0.0:{port}")
httpd.serve_forever()
@nihui
nihui / github-pr.md
Last active September 9, 2024 09:06
github-pr.md
@nihui
nihui / ncnn_teardown.md
Created November 22, 2020 02:58 — forked from kketernality/ncnn_teardown.md

Detail behind NCNN's factory pattern

NCNN adopts the factory pattern to create the layers of a nueral network. It's also the way the well-known library Caffe takes. It differs from Caffe in the implementation of the registry table. On one hand, the Caffe registry is populated in runtime as the side effect of initializion of global variable (which is a popular way for library initialization). On the other hand, the NCNN registry is determined in compile time. The registry is generated in a brilliant way using CMake instead of a hand-crafted table. NCNN's approach provides several benefits compared to Caffe's approach.

First, it's suitable for building a static library. When building a static library, the linker will strip any unused global variable to minimize the size of the library. This makes sense but it also strips the global variable which need to be inintialized to insert te layer creator into the registry. Tricky linker flags and related instrutions are required to resolve this issue. By creating