putting this in a gist so I don't have to keep looking for it. via: https://discord.com/channels/869630568818696202/899135695677968474/943391522353721384

moar.yaml

scene1 {transition: t0} | scene2 {transition: t1} | scene3 {transition: t0} | scene4

scenes:
  scene1:
    prompts:
    - foo
    - bar
  scene2:
    prompts:
    - baz
transitions:
  t0:
    frames: 10
    easing: sin2
  t1:
    frames: 20
    easing: sin2

----------------------

transition parameters should be default-able

sequence:
  - scene1
  - scene2
    transition:
      frames: 20
  - scene3

default_settings:
  transition:
    frames: 10
    easing: sin2
    
scenes:
  scene1:
    prompts:
    - foo
    - bar
  scene2:
    prompts:
    - baz

# open question: prompts shared across subsequences vs. prompts specific to a subsequence

pytti-dsl-brainstorming.yaml

scenes:
  prefixes:
    - a photo of
    - a photorealistic rendering of
  suffixes:
    - ultra-high resolution 8k UHD
    - trending on artstation
    - modeled in blender
  frames: 10
  steps_per_frame: 50
  transform:
    2d:
      zoom: -10
- scene:
    prompt: a day at the beach
    frames: 20
      transform:
        3d:
          rotate: [.1, .2, .3, .4]
- scene:
    steps_per_frame: 80
    prompt: a wintery landscape
    prompt: snow-covered mountains
      weight: .5
    # prefer snow-covered trees to empty white space
    prompt: a snowy forest
      weight: 1.5
      semantic_mask:
        prompt: a snowy field
        prompt: an empty field covered in snow
- scene:
    prompt: a barren landscape
    prompt: an apocalyptic wasteland
    prompt: a long abandoned industrial wasteland
    prompt: the decaying remains of an advanced civilization
    prompt: alien ruins
    transform:
      2d:
        zoom: -10 + 5*t
init_image: someurl.com/myimage.png
models:
  crossmodal_image_text:
    - clip: ViTB16
    - clip: RN50x4
  depth:
    - adabins: adabins_nyu
  flow:
    - GMA: gma
  image_model:
    - VQGAN: ImageNet

storyboard_vktrs.yaml

params:
  _: ''
  video_url: https://www.youtube.com/watch?v=cyFvGL3Z5F8
  audio_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/audio.mp3
  whisper_seg: true
  video_duration: 60.0
  whisper:
    segmentation_model: tiny
    transcription_model: large
    transcriptions:
      tiny: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/whispers/tiny.vtt
      large: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/whispers/large.vtt
  theme_prompt: deepdream, mural designed by a local artist
  height: 512
  width: 512
  display_frames_as_we_get_them: true
  fps: 12
  n_variations: 10
  image_consistency: 0.75
  max_video_duration_in_seconds: 300
  max_frames: 3600
prompt_starts:
- ts: 0
  td: 0.0
  prompt: I ordered a club sandwich all the time and Im not even a member man
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/0-anchor.png
  anim_start: 0.0
  frames: 84
  anim_duration: 6.999972
  duration: 7.0
- ts: 7.0
  td: 7.0
  prompt: I dont know how I get away with it
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/1-anchor.png
  anim_start: 6.999972
  frames: 24
  anim_duration: 1.999992
  duration: 2.0
- ts: 9.0
  td: 9.0
  prompt: I like my sandwiches with three pieces of bread
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/2-anchor.png
  anim_start: 8.999964
  frames: 36
  anim_duration: 2.999988
  duration: 3.0
- ts: 12.0
  td: 12.0
  prompt: so do I well lets form a club there
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/3-anchor.png
  anim_start: 11.999952
  frames: 24
  anim_duration: 1.999992
  duration: 2.0
- ts: 14.0
  td: 14.0
  prompt: Okay but we need some more stipulations yes we do
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/4-anchor.png
  anim_start: 13.999944
  frames: 36
  anim_duration: 2.999988
  duration: 3.0
- ts: 17.0
  td: 17.0
  prompt: Instead of cutting the sandwich once lets cut it again
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/5-anchor.png
  anim_start: 16.999932
  frames: 36
  anim_duration: 2.999988
  duration: 3.0
- ts: 20.0
  td: 20.0
  prompt: Yes four triangles
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/6-anchor.png
  anim_start: 19.99992
  frames: 48
  anim_duration: 3.999984
  duration: 4.0
- ts: 24.0
  td: 24.0
  prompt: and we will
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/7-anchor.png
  anim_start: 23.999904
  frames: 36
  anim_duration: 2.999988
  duration: 3.0
- ts: 27.0
  td: 27.0
  prompt: position them into a circle and in the middle we will dump chips
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/8-anchor.png
  anim_start: 26.999892
  frames: 48
  anim_duration: 3.999984
  duration: 4.0
- ts: 31.0
  td: 31.0
  prompt: or potato salad okay
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/9-anchor.png
  anim_start: 30.999876
  frames: 36
  anim_duration: 2.999988
  duration: 3.0
- ts: 34.0
  td: 34.0
  prompt: Let me ask you a question how you feel about frilly toothpicks Im form
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/10-anchor.png
  anim_start: 33.999864
  frames: 84
  anim_duration: 6.999972
  duration: 7.0
- ts: 41.0
  td: 41.0
  prompt: Well this club is form Spread the word on menus nationwide
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/11-anchor.png
  anim_start: 40.999836
  frames: 84
  anim_duration: 6.999972
  duration: 7.0
- ts: 48.0
  td: 48.0
  prompt: I like my sandwiches with alfalfa sprouts Well youre not in the fucking
    club
  frame0_fpath: /content/drive/MyDrive/AI/VideoKilledTheRadioStar/mitch-hedberg-club-sandwich/frames/12-anchor.png
  anim_start: 47.999808
  frames: 144
  anim_duration: 11.999952
  duration: 12.0