Mark Neumann DeNeutoy

Research and Engineering at Orbital Materials. Making deep nets do stuff. BC: Allen Institute for AI - ELMo, AllenNLP, Scispacy.

DeNeutoy / logsumexp_experiments.py

Last active April 30, 2019 20:01 — forked from sjmielke/logsumexp_experiments.py

https://twitter.com/sjmielke/status/1123035927612411905

	from mpmath import mp
	mp.dps = 100

	import torch

	# Take some list of values that shrink to be really small in log space:
	torch_lps = torch.log_softmax(-torch.arange(20.0, dtype=torch.float64), dim=0)

	mpmath_lps = -torch.arange(20.0, dtype=torch.float64)
	Z = sum([mp.exp(mp.mpf(mpmath_lps[i].item())) for i in range(len(mpmath_lps))])