Machine | Num CPU cores | CPU | CPU-link | Num GPU Cores | GPU | GPU-link | Neural Engine | Neural Engine-link |
---|---|---|---|---|---|---|---|---|
MacBook Pro M1 Pro 14 inch, 2021 | 10 | 1809 | Link | 16 | 5192 | Link | 6462 | Link |
MacBook Pro M3 14 inch, 2023 | 8 | 2356 | Link | 10 | 5747 | [Link](https://bro |
Model | Task | Num Questions | Num Answers | Total Generations | Backend |
---|---|---|---|---|---|
Llama 2 7B .gguf format | Text Generation | 20 | 5 | 20*5 = 100 | llama-cpp-python |
Model | Dataset | Sequence Size | Epochs | Num Samples | Num Classes | Problem Type |
---|---|---|---|---|---|---|
SmallTransformer (custom) | IMDB | 200 | 5 | 25,000 train, 25,000 test | 2 | Text Classification |
Model | Dataset | Sequence Size | Epochs | Num Samples | Num Classes | Problem Type |
---|---|---|---|---|---|---|
DistilBERT (fine-tune top 2 layers + top Transformer block) | IMDB | 512 | 5 | 25,000 train, 25,000 test | 2 | Text Classification |
Experiment | Model | Dataset | Num Samples | Problem Type | Backend |
---|---|---|---|---|---|
1 | ResNet50 (CNN) | CIFAR100 | 50,000 train, 10,000 test | Image Classification | PyTorch |
2 | ResNet50 | Food101 | 75,750 train, 25,250 test | Image Classification | PyTorch |
3 | DistilBERT (Transformer) | IMDB | 25,000 train, 25,000 test | Text Classification | PyTorch |
4 | ResNet50 | CIFAR100 | 50,000 train, 10,000 test | Image Classification | TensorFlow |
5 | ResNet50 | Food101 | 75,750 train, 25,250 test | Image Classification | TensorFlow |
6 | SmallTransformer | IMDB | 25,000 train, 25,000 test | Text Classification | TensorFlow |
7 | Llama 2 7B Q4_0.gguf | N/A | 100 (generate 100 answers) | Text Generation | llama.cpp |
8 (bonus) | Geekbench ML | Multiple | Multiple | Multiple |
Machine | CPU | GPU | RAM | Storage | Price (USD) |
---|---|---|---|---|---|
M1 Pro 14" 2021 | 10-core CPU | 16-core GPU | 32GB | 4TB SSD | ~$3,500 |
M3 14" 2023 | 8-core CPU | 10-core GPU | 8GB | 512GB SSD | $1,599 |
M3 Pro 14" 2023 | 11-core CPU | 14-core GPU | 18GB | 512GB SSD | $1,999 |
M3 Max 14" 2023 | 14-core CPU | 30-core GPU | 36GB | 1TB SSD | $3,199 |
Deep Learning PC | Intel i9 | NVIDIA TITAN RTX (24GB) | 32GB | 1TB SSD | ~$3,000 |
Google Colab Free Tier | 2-core CPU | NVIDIA Tesla V100 (16GB) | 12GB | 100GB SSD | Free or $10/month for more compute |
NewerOlder