encredible

🚀 Gaiel Series 3-Mac Cluster Distributed Inference Benchmark Report

Hardware Cluster:

• 💻 MacBook Pro (Apple M5 Pro, 24 GB Unified Memory)
• 💻 MacBook Air (Apple M5, 24 GB Unified Memory)
• 🖥️ Mac mini (Apple M4, 16 GB Unified Memory)
• Total Unified RAM: 64 GB
• Interconnect: Thunderbolt 4/5 Low-Latency Bridge + High-Speed LAN

---

encredible

Gaiel Series Korean Intelligence Benchmark (LogicKor)

Evaluated with GPT-4o Judge across 6 core Korean language & reasoning domains.

Overall Score Leaderboard

Model	Single Turn	Multi Turn	Overall Score (10점 만점)
Gaiel-1.5B-Korean-Tuned-MLX	2.14	1.59	1.87
Gaiel-7B-Korean-Tuned-MLX	4.75	3.60	4.18

encredible

Gaiel Series Korean Intelligence Benchmark (LogicKor)

Evaluated with GPT-4o Judge across 6 core Korean language & reasoning domains.

Overall Score Leaderboard

Model	Single Turn	Multi Turn	Overall Score (10점 만점)
Gaiel-1.5B-Korean-Tuned-MLX	2.15	1.60	1.87
Gaiel-7B-Korean-Tuned-MLX	4.75	3.60	4.18

encredible

Gaiel Series Korean Intelligence Benchmark (LogicKor)

Evaluated with GPT-4o Judge across 6 core Korean language & reasoning domains.

Overall Score Leaderboard

Model	Single Turn	Multi Turn	Overall Score (10점 만점)
Gaiel-1.5B-Korean-Tuned-MLX	0.00	0.00	0.00
Gaiel-7B-Korean-Tuned-MLX	4.75	3.60	4.18

encredible

Gaiel Series Korean Intelligence Benchmark (LogicKor)

Evaluated with GPT-4o Judge across 6 core Korean language & reasoning domains.

Overall Score Leaderboard

Model	Single Turn	Multi Turn	Overall Score (10점 만점)
Gaiel-1.5B-Korean-Tuned-MLX	0.00	0.00	0.00
Gaiel-7B-Korean-Tuned-MLX	4.75	3.60	4.18

encredible

Gaiel Series Korean Intelligence Benchmark (LogicKor)

Evaluated with GPT-4o Judge across 6 core Korean language & reasoning domains.

Overall Score Leaderboard

Model	Single Turn	Multi Turn	Overall Score (10점 만점)
Gaiel-7B-Korean-Tuned-MLX	4.78	3.59	4.19
Gaiel-32B-Korean-Tuned-MLX	8.67	7.41	8.04

encredible

Gaiel MLX Benchmark Results (Cluster: Mac mini + MacBook Air + MacBook Pro)

encredible/Gaiel-1.5B-Korean-Tuned-MLX

{
  "runs": [
    {
      "elapsed_s": 4.551236792001873,
      "output_text_preview": "A: \"a\" is a single character with a count of one. 0 characters are needed to represent this. \n\nB: \"a\" is the same as \"a a\". 0 characters are needed to represent this. \n\nC: \"abc\" is a three-character s",

encredible

Gaiel MLX Benchmark Results (Cluster: Mac mini + MacBook Air + MacBook Pro)

encredible/Gaiel-1.5B-Korean-Tuned-MLX

encredible/Gaiel-7B-Korean-Tuned-MLX

encredible/Gaiel-32B-Korean-Tuned-MLX

encredible/Gaiel-72B-Korean-Tuned-MLX

Status: Model exceeds currently available cluster RAM limit for unquantized inference (Requires additional unified memory or 4-bit quantization).

encredible

Gaiel MLX Benchmark Results (Cluster: Mac mini + MacBook Air + MacBook Pro)

encredible/Gaiel-1.5B-Korean-Tuned-MLX

{
  "runs": [
    {
      "elapsed_s": 4.551236792001873,
      "output_text_preview": "A: \"a\" is a single character with a count of one. 0 characters are needed to represent this. \n\nB: \"a\" is the same as \"a a\". 0 characters are needed to represent this. \n\nC: \"abc\" is a three-character s",
      "stats": {

encredible

Gaiel MLX Benchmark Results

encredible/Gaiel-1.5B-Korean-Tuned-MLX

{
  "runs": [],
  "cluster": {
    "nodeIdentities": {
      "d3e74486ca588735ca37e0c78be109cd": {
        "modelId": "MacBook Pro",