extremecoders-re

Setting up Qemu with a tap interface

There are two parts to networking within QEMU:

• The virtual network device that is provided to the guest (e.g. a PCI network card).
• The network backend that interacts with the emulated NIC (e.g. puts packets onto the host's network).

Example: User mode network

nikhilweee

import torch
import subprocess
import time
import logging

# Takes about 8GB
ndim = 25_000
logging.basicConfig(format='[%(asctime)s] %(filename)s [%(levelname).1s] %(message)s', level=logging.DEBUG)

def get_gpu_usage():

pourmand1376

I wanted to install GIT-Lfs on my user account without access to server root account. I write this to my future self.

1. Download tar.gz file from git-lfs website.

wget https://github.com/git-lfs/git-lfs/releases/download/v3.2.0/git-lfs-linux-amd64-v3.2.0.tar.gz

2.Untar it

tar xvf git-lfs-linux-amd64-v3.2.0.tar.gz

flishwang

import torch
from vllm.v1.worker.gpu_worker import Worker, logger
from vllm.device_allocator.cumem import CuMemAllocator
from vllm.v1.kv_cache_interface import KVCacheConfig
from vllm.utils import GiB_bytes
from typing import Optional
import gc
from vllm.device_allocator.cumem import libcudart, is_pin_memory_available, unmap_and_release