Add sequence probability support for PyTorch CRF model #421
Description
For active learning, there a couple of strategies that we currently utilize using the CRF suite model's marginal probabilities. Studies have shown that returning sequence-level probabilities instead of token-level marginal probabilities works much better and this is something that can be implemented in a future release. So in order to modify this function, in addition to the best transition score (t,j) and corresponding backward link for the transition, we’ll have to store top-n transition scores and the corresponding n backward links, and then trace all n-paths, resulting in the n-best sequences and corresponding probabilities.