What is base for logprobs?

[wongjingping]

Hi there, I wanted to check what is the base for logprobs ie to get the normalized probability, do I do 2**(logprob) or 10**(logprob) or exp(logprob)?

[xiaobanni]

Also curious. Is there an answer now?

[wongjingping]

Based on this line it seems like it's using the natural log

logprobs = torch.log_softmax(logits, dim=-1, dtype=torch.float)

Based on the pytorch docs the log_softmax performs the natural log.