Skip to content

Instantly share code, notes, and snippets.

@matthewchung74

matthewchung74/modulelist.py

Created February 5, 2021 23:43
Show Gist options
  • Save matthewchung74/07bc3e31d4c949f2b7b5a136873f33f1 to your computer and use it in GitHub Desktop.
Save matthewchung74/07bc3e31d4c949f2b7b5a136873f33f1 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
modulelist.py
self.blocks = nn.ModuleList([
Block(
dim=embed_dim, num_heads=num_heads, mlp_ratio=mlp_ratio, qkv_bias=qkv_bias, qk_scale=qk_scale,
drop=drop_rate, attn_drop=attn_drop_rate, drop_path=dpr[i], norm_layer=norm_layer)
for i in range(depth)])
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment