Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Select an option

  • Save n0obcoder/9baa58eed9aa6325ace326fe6bcf0b85 to your computer and use it in GitHub Desktop.

Select an option

Save n0obcoder/9baa58eed9aa6325ace326fe6bcf0b85 to your computer and use it in GitHub Desktop.
for key in model.fc.state_dict():
print('key: ', key)
param = model.fc.state_dict()[key]
print('param.shape: ', param.shape)
print('param.requires_grad: ', param.requires_grad)
print('param.shape, param.requires_grad: ', param.shape, param.requires_grad)
print('isinstance(param, nn.Module) ', isinstance(param, nn.Module))
print('isinstance(param, nn.Parameter) ', isinstance(param, nn.Parameter))
print('isinstance(param, torch.Tensor): ', isinstance(param, torch.Tensor))
print('=====')
key: weight
param.shape: torch.Size([128, 295936])
param.requires_grad: False
param.shape, param.requires_grad: torch.Size([128, 295936]) False
isinstance(param, nn.Module) False
isinstance(param, nn.Parameter) False
isinstance(param, torch.Tensor): True
=====
key: bias
param.shape: torch.Size([128])
param.requires_grad: False
param.shape, param.requires_grad: torch.Size([128]) False
isinstance(param, nn.Module) False
isinstance(param, nn.Parameter) False
isinstance(param, torch.Tensor): True
=====
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment