Skip to content

Instantly share code, notes, and snippets.

View hongsw's full-sized avatar
๐Ÿ•น๏ธ
Focusing

Seungwoo hong hongsw

๐Ÿ•น๏ธ
Focusing
View GitHub Profile
flowchart TD
    %% ์ค‘์‹ฌ ๋…ธ๋“œ
    OSS[์˜คํ”ˆ์†Œ์Šค ์†Œํ”„ํŠธ์›จ์–ด ๊ต์œก ๊ฒฝ๋กœ] 
    
    %% ์„œ๋ธŒ๊ทธ๋ž˜ํ”„ ๋ ˆ๋ฒจ ์ •์˜
    subgraph ๋ ˆ๋ฒจ1[๋ ˆ๋ฒจ 1 - ํ•ต์‹ฌ ๊ธฐ๋ฐ˜ ๊ธฐ์ˆ ]
        direction TB
        TERMINAL[ํ„ฐ๋ฏธ๋„ ๊ธฐ๋ณธ]
        SHELL[์‰˜ ์Šคํฌ๋ฆฝํŠธ]
@hongsw
hongsw / From_Mathematical_Foundations_to_Modern_AI_Transformer_Evolution_Diagram.md
Last active April 5, 2025 05:49
"์ž์—ฐ์–ด ์ฒ˜๋ฆฌ์˜ ๋Œ€์ˆ˜ํ•™์  ๊ธฐ๋ฐ˜๋ถ€ํ„ฐ ํ˜„๋Œ€ ์ธ๊ณต์ง€๋Šฅ๊นŒ์ง€: Transformer ์•„ํ‚คํ…์ฒ˜์˜ ์ง„ํ™”์™€ ์˜ํ–ฅ๋ ฅ์— ๊ด€ํ•œ ํ†ต์‹œ์  ์กฐ๋ง๋„" ์ด ์ด๋ฆ„์€ ๋‹ค์ด์–ด๊ทธ๋žจ์ด ๋‹ค๋ฃจ๋Š” ๊ด‘๋ฒ”์œ„ํ•œ ์‹œ๊ฐ„์  ์ŠคํŽ™ํŠธ๋Ÿผ(๋Œ€์ˆ˜ํ•™์  ๊ธฐ๋ฐ˜๋ถ€ํ„ฐ ํ˜„๋Œ€ AI๊นŒ์ง€), ์ค‘์‹ฌ ์ฃผ์ œ(Transformer ์•„ํ‚คํ…์ฒ˜), ๊ทธ๋ฆฌ๊ณ  ๋‹ค์ด์–ด๊ทธ๋žจ์˜ ์„ฑ๊ฒฉ(๋‹ค์–‘ํ•œ ๊ธฐ์ˆ ๊ณผ ๋ชจ๋ธ์˜ ๋ฐœ์ „ ๊ณผ์ •๊ณผ ์˜ํ–ฅ ๊ด€๊ณ„๋ฅผ ๋ณด์—ฌ์ฃผ๋Š” ํ†ต์‹œ์  ์กฐ๋ง)์„ ๋ชจ๋‘ ํฌ๊ด„ํ•ฉ๋‹ˆ๋‹ค.
flowchart TB
    subgraph "์ž์—ฐ์–ด ์ฒ˜๋ฆฌ ์ „ํ†ต์  ์ ‘๊ทผ๋ฒ• (1950s~1980s)"
        RULE["๊ทœ์น™ ๊ธฐ๋ฐ˜ ์‹œ์Šคํ…œ<br>- ๋ฌธ๋ฒ• ๊ทœ์น™ ์ˆ˜๋™ ์ •์˜<br>- ์ „๋ฌธ๊ฐ€ ์ง€์‹ ๊ธฐ๋ฐ˜<br>- ํ™•์žฅ์„ฑ ํ•œ๊ณ„"]
        SYM["๊ธฐํ˜ธ์ฃผ์˜ ์ ‘๊ทผ๋ฒ•<br>- ํ˜•์‹ ์–ธ์–ด ๋ฐ ๋ฌธ๋ฒ•<br>- ๋…ผ๋ฆฌ ๊ธฐ๋ฐ˜ ์ถ”๋ก <br>- ์• ๋งค์„ฑ ์ฒ˜๋ฆฌ ์–ด๋ ค์›€"]
        PARSE["๊ตฌ๋ฌธ ๋ถ„์„ ํŠธ๋ฆฌ<br>- ๋ฌธ์žฅ ๊ตฌ์กฐ ํ‘œํ˜„<br>- ๊ณ„์ธต์  ๋ถ„์„<br>- ์˜๋ฏธ ํŒŒ์•… ์ œํ•œ"]
    end

    subgraph "์ˆ˜ํ•™์  ๊ธฐ๋ฐ˜"
        subgraph "์„ ํ˜•๋Œ€์ˆ˜ํ•™ (Linear Algebra)"

CBOW์—์„œ Skip-gram์œผ๋กœ ๋ณ€ํ™˜ํ•  ๋•Œ ๋‹ฌ๋ผ์ง„ ์ฃผ์š” ๋ถ€๋ถ„์„ ์ „ํ›„ ๋น„๊ต๋กœ ์„ค๋ช…ํ•ด๋“œ๋ฆฌ๊ฒ ์Šต๋‹ˆ๋‹ค:

1. ์ž…๋ ฅ๊ณผ ํƒ€๊ฒŸ ๊ต์ฒด

CBOW ์ฝ”๋“œ:

# 2. ๋ฌธ๋งฅ ๋‹จ์–ด์™€ ํƒ€๊ฒŸ ๋‹จ์–ด ์„ค์ •
context_words = ["this", "is", "a", "comparison"]
target_word = "visual"  # ์ •๋‹ต ๋‹จ์–ด
target_idx = vocab.index(target_word)

๐Ÿงญ ๋ฏธ์…˜: ์‹คํ–‰ํŒŒ์ผ ๊ฒฝ๋กœ๋ฅผ PATH์— ์ถ”๊ฐ€ํ•˜๋ผ

๐ŸŽฏ ๋ชฉํ‘œ

  • ํŠน์ • ์‹คํ–‰ํŒŒ์ผ(์˜ˆ: mytool)์„ ์–ด๋””์„œ๋“  ์‹คํ–‰ ๊ฐ€๋Šฅํ•˜๊ฒŒ ๋งŒ๋“ ๋‹ค.

๐Ÿงฑ ์‚ฌ์ „ ๊ฐœ๋… (ํžŒํŠธ๋งŒ ์ œ๊ณต)

  • PATH๋ž€?
@hongsw
hongsw / macos_path_setting.md
Created March 27, 2025 08:36
macos_path_setting.md

macOS์—์„œ uv ์„ค์น˜ ๋ฐ PATH ์„ค์ • ๊ฐ€์ด๋“œ

์ด ๋ฌธ์„œ๋Š” macOS์—์„œ uv๋ฅผ ์„ค์น˜ํ•˜๊ณ  ์˜ฌ๋ฐ”๋ฅด๊ฒŒ PATH์— ์„ค์ •ํ•˜์—ฌ ํ•ญ์ƒ ์ ‘๊ทผ ๊ฐ€๋Šฅํ•˜๋„๋ก ๋งŒ๋“œ๋Š” ๋ฐฉ๋ฒ•์„ ์„ค๋ช…ํ•ฉ๋‹ˆ๋‹ค.

์‰˜ ์„ค์ • ํŒŒ์ผ ๊ฐœ์š”

macOS์—์„œ ์‚ฌ์šฉ๋˜๋Š” ์ฃผ์š” ์‰˜ ์„ค์ • ํŒŒ์ผ์˜ ์ฐจ์ด์ ์€ ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค:

.profile ํŒŒ์ผ (์˜ˆ: .bash_profile, .zprofile)

  • ๋กœ๊ทธ์ธ ์„ธ์…˜์—์„œ๋งŒ ๋กœ๋“œ๋จ (์‚ฌ์šฉ์ž๊ฐ€ ์‹œ์Šคํ…œ์— ๋กœ๊ทธ์ธํ•  ๋•Œ)
@hongsw
hongsw / update-asdf-0.16-zshrc.sh
Created March 21, 2025 02:09
Purpose of the Script This script automates the configuration changes required when upgrading to ASDF version 0.16.0 from earlier versions. The purpose is to: Safely back up the user's existing .zshrc configuration file Remove any outdated ASDF-related configuration lines Add the new required environment variables and PATH modifications for ASDFโ€ฆ
#!/bin/bash
# Create backup filename with current date and time
BACKUP_FILE=~/.zshrc.backup.$(date +%Y%m%d%H%M%S)
# Backup original file
cp ~/.zshrc "$BACKUP_FILE"
echo "Existing .zshrc file has been backed up to $BACKUP_FILE"
# Remove existing ASDF-related settings and create new file
@hongsw
hongsw / grpo_demo.py
Created February 2, 2025 12:24 — forked from willccbb/grpo_demo.py
GRPO Llama-1B
# train_grpo.py
import re
import torch
from datasets import load_dataset, Dataset
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import LoraConfig
from trl import GRPOConfig, GRPOTrainer
# Load and prep dataset
@hongsw
hongsw / history.korea.txt
Last active December 8, 2024 03:40
# ๊ด‘ํ•ด๊ตฐ์ผ๊ธฐ[์ค‘์ดˆ๋ณธ]18๊ถŒ, ๊ด‘ํ•ด 1๋…„ 7์›”
# ๊ด‘ํ•ด๊ตฐ์ผ๊ธฐ[์ค‘์ดˆ๋ณธ]18๊ถŒ, ๊ด‘ํ•ด 1๋…„ 7์›”
๋น„๋ณ€์‚ฌ๊ฐ€ ์ง„ํœผ์‚ฌ๋ฅผ ์ฐจ์ถœํ•˜์—ฌ ์„œ๋กœ ์ง€๋ฐฉ์˜ ํ•œ์žฌ์ฑ…์„ ๊ทœํšํ•  ๊ฒƒ์„ ์•„๋ขฐ๋‹ค
์ด์กฐ๊ฐ€ ๋Œ€์ œํ•™ ์œ ๊ทผ์˜ ์ฐจ์ž์— ๋Œ€ํ•œ ๋Œ€์‹ ๋“ค์˜ ์˜๋…ผ์„ ์•„๋ขฐ๋‹ค
์‚ฌํ—Œ๋ถ€๊ฐ€ ์—ญ๊ด€ ํ‘œํ—Œ ๋“ฑ์„ ํŒŒ์ง์‹œํ‚ฌ ๊ฒƒ์„ ์•„๋ขฐ๋‹ค
์‚ฌ๊ฐ„์›์ด ๋ฌธ๊ด€ยท๋ฌด๊ด€ยท์Œ๊ด€์„ ๋ฌผ๋ก ํ•˜๊ณ  ์žฌ๋Šฅ์„ ํ—ค์•„๋ ค ์ˆ˜๋ น์„ ์ž„๋ช…ํ•  ๊ฒƒ์„ ์•„๋ขฐ๋‹ค
์‹ ํ ยท์„œ์„ฑยท๊ฐ•ํ™์ค‘ ๋“ฑ์—๊ฒŒ ๊ด€์ง์„ ์ œ์ˆ˜ํ•˜๋‹ค
๋ฐ•์ง„์›ยท์œ ๊ณต๋Ÿ‰ยท๊ฒฝ์„ฌยท์ด์ด์ฒจ ๋“ฑ์—๊ฒŒ ๊ด€์ง์„ ์ œ์ˆ˜ํ•˜๋‹ค
์˜์˜์ • ์ด์›์ต์ด ์‚ฌ์ง์†Œ๋ฅผ ์˜ฌ๋ฆฌ๋‹ค
์‚ฌํ—Œ๋ถ€๊ฐ€ ์—ฐ๊ณ„ํ•˜์—ฌ ์ž„์ถ˜๋ฐœ ๋“ฑ์˜ ํŒŒ์ง์„ ์ฒญํ•˜๋‹ค
์‚ฌํ—Œ๋ถ€๊ฐ€ ํŒŒ์ง์„ ๊ณ„์ฒญํ•˜๋‹ค