This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
import logging | |
from collections.abc import Sized | |
from time import time | |
from typing import Iterable, TypeVar | |
T = TypeVar("T") | |
class textpbar: | |
"""A text-based version of a progress bar.""" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
import inspect | |
from typing import Set | |
from functools import partial | |
import torch | |
from torch import Tensor | |
class ConstraintTrackingTensor(Tensor): | |
_constraints: Set[int] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# b - batch size | |
# d - feature dimension | |
# t - learned temperature parameter | |
# image_encoder - ResNet or Vision Transformer | |
# text_encoder - CBOW or Text Transformer | |
# I[B, h, w, c] - minibatch of aligned images | |
# T[B, l] - minibatch of aligned texts | |
# extract feature representations of each modality | |
F_i = image_encoder(I) # [b, d] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Ut rutrum lorem lacus, varius accumsan sem fermentum vitae. Sed nec nisl at sapien laoreet interdum. Duis egestas ex id nibh dapibus ultricies. Nulla non elit ac nisi ornare ultricies vel vel libero. Donec mollis pulvinar erat non hendrerit. Donec condimentum maximus efficitur. Nulla laoreet pellentesque est, sed volutpat risus posuere pretium. Donec mattis diam a orci dictum pharetra. Donec mollis quam pharetra purus rhoncus consequat vel sit amet nunc. In venenatis purus in dapibus iaculis. Vestibulum auctor erat vitae iaculis elementum. | |
Nulla interdum mollis erat, vel bibendum metus sollicitudin in. Pellentesque habitant morbi tristique senectus et netus et malesuada fames ac turpis egestas. Sed imperdiet sem et ultricies tincidunt. Lorem ipsum dolor sit amet, consectetur adipiscing elit. Suspendisse faucibus consequat dictum. Ut eget luctus orci. Aliquam dictum nunc id congue cursus. Praesent ornare rutrum leo vitae blandit. Aliquam et libero justo. Aliquam vestibulum mi a tristique sollicitudin. Nullam |