Skip to content

Instantly share code, notes, and snippets.

@racinmat
Last active July 6, 2024 12:58
Show Gist options
  • Select an option

  • Save racinmat/fd2ded3ab89c4bf87a536930f19d89cb to your computer and use it in GitHub Desktop.

Select an option

Save racinmat/fd2ded3ab89c4bf87a536930f19d89cb to your computer and use it in GitHub Desktop.
Odkazy z přednášky na FF 2024 - Dočkáme se AI waifu?

Prezentace na google drive

https://docs.google.com/presentation/d/1CJxIH_ipe696XkfPOKQ-uHbF2CUnyOO4/edit?usp=sharing&ouid=102632222370728552977&rtpof=true&sd=true

Mé předchozí přednášky

workshopy

ne-akademické články

obrázky na rozpoznávání

generátory

generátory videa

datasety

žaloby

repa modelů

web ui: https://github.com/AUTOMATIC1111/stable-diffusion-webui

papery

jazkové modely

benchmarky a datasety

ostatní generativní modely

youtube kanály

discord servery

Japonsko

stahování a úprava videí

používám yt-dlp https://github.com/yt-dlp/yt-dlp

yt-dlp https://www.youtube.com/watch?v=WA-mRcNMo4E
yt-dlp https://www.youtube.com/watch?v=SBugCsZjXIY --download-sections "*00:02:30.0-00:03:30.0" --write-sub --write-auto-sub --sub-lang "en.*" # nějak blbnulo časování, prázdný kus na začátku
yt-dlp https://www.youtube.com/watch?v=SBugCsZjXIY --download-sections --write-sub --write-auto-sub --sub-lang "en.*"

embedding titulků ve vlc https://www.movavi.com/learning-portal/how-to-add-subtitles-in-vlc-permanently.html střihání ve vlc https://www.movavi.com/learning-portal/how-to-trim-videos-with-vlc.html

hrozby

falešný únos pomocí klonování hlasu https://edition.cnn.com/2023/04/29/us/ai-scam-calls-kidnapping-cec/index.html

animefest

AI waifu

character creation

Po přesáhnutí max tokenů se defaulně zahazuje část textu, historie chatu Context window silly tavern behavior Rozbor složení promptů: https://www.reddit.com/r/SillyTavernAI/comments/18agtc9/im_still_exploring_silly_tavern_question_about/ Popis kontext size a jak se věci odebírají při přesažení Character writing guide | PygmalionAI Wiki (schneedc.com) Je to součást stránky Character Design | docs.ST.app (sillytavern.app) Character creation: Ali:Chat Style (v1.5) (rentry.co) World Info Encyclopedia (rentry.co) World Info | docs.ST.app (sillytavern.app) Lots of world info databases /aids/ Lorebook Repository

TTS, STT

AI waifu: How I Programmed My Own AI Girlfriend

Relevant stuff: STT: whisper https://github.com/openai/whisper, can do STT while translating Whisper demo with microphone https://github.com/mallorbc/whisper_mic LLM: only gpt3 or character AI, it's old video Scraped gawr gura voice Developer: https://github.com/SchizoDev nothing interesting there See TTS section Talking head list: https://github.com/harlanhong/awesome-talking-head-generation Not mentioned what used exactl,y based on screenshot looks like https://github.com/Chrisyk/AI-Assistant or https://github.com/Rubiksman78/RenAI-Chat <- this one is STT+LLM+TTS in renpy, nice He uses https://github.com/pkhungurn/talking-head-anime-3-demo/tree/main to make moving head from single image https://pkhungurn.github.io/ has several interesting repos on this very topic

https://github.com/Koischizo/AI-Vtuber reads chat from youtube, responds using gpt-3, ElevenLabs TTS, also contains some model

Continuation: My AI Girlfriend Got Even Better

Mentioned https://github.com/NVIDIA/tacotron2 for TTS - 4 years old Other https://github.com/neonbjb/tortoise-tts younger Integrated to coqui https://docs.coqui.ai/en/latest/models/tortoise.html https://elevenlabs.io/ are commercial

Livewhisper https://github.com/Nikorasu/LiveWhisper is live and more real-time, 2 years old https://github.com/facebookresearch/llama is just llama official inference https://github.com/yuyuyzl/EasyVtuber seems like talking head 3 fork Singing voice conversion https://github.com/svc-develop-team/so-vits-svc See readme, has e.g. Realtime version https://github.com/w-okada/voice-changer

https://github.com/Koischizo is other github account of same person The channel https://www.youtube.com/c/Koischizo is the resultimage

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment