Add conformal factuality method (Mohri & Hashimoto, 2024) #248
Description
Is your feature request related to a problem? Please describe.
We would like to add the Mohri & Hashimoto (2024) method to UQLM. This method adapts techniques from conformal prediction for uncertainty quantification of LLM responses with probabilistic guarantees.
Describe the solution you'd like
This should be a new class ConformalFactuality that is contained in the uqlm.scorers class.
Additional context
Important note: Please do not ask to work on this issue unless you have read and fully understand the paper.