-
Ask, dont assume. If something's unclear, ask before writing a line and no silent guesses about intent, architecture, or requirements.
-
Simplest solution first and implement the minimum thing that works. No abstractions you didn't request.
-
Dont touch unrelated code and if a file isnt part of the current task, leave it.
-
Flag uncertainty explicitly or if you're not confident, say so before proceeding as confidence without certainty causes more damage than admitting a gap.
LLM memory usage = model weights + optimizer/kv-cache + activations for max tokens.
With your 8B model (~16–18 GB for FP16), asking for 10,500 tokens will likely exceed 19.5 GB, especially with --gpu-memory-utilization=0.99.
Calculation example:
- Your model: 8B (~16 GB FP16 weights)
- Max tokens: 10,500
- KV-cache VRAM ≈ 10,500 × 0.0007 GB ≈ 7.35 GB additional VRAM
- Total VRAM needed ≈ 16 GB + 7.35 GB ≈ 23.35 GB → > 19.5 GB, hence the OOM
Option<T>
Represents “something or nothing”. Optional function arguments, nullable values.
fn maybe_double(x: Option<i32>) -> Option<i32> {
x.map(|v| v * 2)
}
assert_eq!(maybe_double(Some(3)), Some(6));
assert_eq!(maybe_double(None), None);Why?
Rust is built around a handful of core rules that make it safe, fast, and concurrency‑friendly.
Mastering these 7 principles is enough to write idiomatic, error‑free Rust and to understand why the compiler sometimes complains.
| # | Principle | What it means (in plain English) |
|---|---|---|
| 1 | Ownership & Single‑Owner | Every value has exactly one owner. When that owner goes out of scope, the value is dropped (freed). |
| 2 | Borrowing & References | You can borrow a value instead of moving it. A borrow is either immutable (&T) or mutable (&mut T). |
| Factor | Germany | UK | Notes |
|---|---|---|---|
| Company Formation Speed | 2 | 5 | UK can be incorporated online in <24h; Germany often takes weeks. |
| Min. Capital Requirement | 2 | 5 | Germany GmbH: €25k (min €12.5k upfront); UK Ltd: £1. |
| Corporate Tax Burden | 3 | 4 | Germany ~30%, UK 25% (small profits 19%). |
| Stock Option Friendliness | 2 | 5 | UK EMI scheme very favorable; Germany improving but still complex. |
- AI21 Labs: Israeli AI research firm built for enterprise NLP, creators of Jurassic‑1/2 models and the Wordtune writing assistant. https://www.ai21.com/
- AionLabs: AI‑tooling startup (limited public data; possibly involved in developer integrations). Website not found.
- Alibaba Cloud Intelligence: Alibaba Cloud’s AI‑driven cloud infrastructure and managed AI services. https://www.alibabacloud.com/
- Amazon Bedrock: AWS-managed foundation model service offering models from Anthropic, AI21, Meta, and Stability AI, plus tools for fine‑tuning and deployment. https://aws.amazon.com/bedrock/
- Anthropic: AI safety–focused LLM provider best known for Claude models. https://www.anthropic.com/
- AtlasCloud: (No public company profile available.)
- Atoma: (No official public profile found.)
- Avian.io: (Insufficient public-facing documentation available.)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| .editorconfig | |
| .env | |
| .lintstagedrc | |
| .nvmrc | |
| .yarnrc.yml | |
| .gitignore | |
| .prettierrc | |
| components.json | |
| eslint.config.mjs | |
| nodemon.config.json |
https://linuxcontainers.org/incus
incus admin init
NewerOlder