Evaluate your LLM's response with Prometheus and GPT4 💯
-
Updated
Sep 9, 2024 - Python
#
llm-as-evaluator
Here are 8 public repositories matching this topic...
Deliver safe & effective language models
nlp
artificial-intelligence
benchmarks
benchmark-framework
model-assessment
ai-safety
mlops
responsible-ai
ml-safety
trustworthy-ai
ethics-in-ai
ml-testing
large-language-models
llm
ai-testing
llm-test
llm-evaluation-toolkit
llm-as-evaluator
llm-testing
-
Updated
Nov 12, 2024 - Python
xFinder: Robust and Pinpoint Answer Extraction for Large Language Models
benchmark
regex
reliability
evaluation
dataset
gpt
phi
large-language-models
llm
open-compass
chatglm
qwen
lm-evaluation
llm-as-a-judge
llm-as-evaluator
xfinder
reliable-evaluation
key-answer-extraction
judge-model
-
Updated
Oct 28, 2024 - Python
This is the repo for the survey of Bias and Fairness in IR with LLMs.
information-retrieval
recommender-systems
bias
ir
fairness
large-language-models
llm
chatgpt
llm4rec
llm4rs
llm-as-a-judge
llm-as-evaluator
llm4ir
-
Updated
Oct 29, 2024
Code and data for "Timo: Towards Better Temporal Reasoning for Language Models" (COLM 2024)
temporal-reasoning
sota-model
llms
rlhf
rlaif
llm-as-a-judge
llm-as-evaluator
self-critic-framework
colm2024
-
Updated
Oct 23, 2024 - Python
Code and data for Koo et al's ACL 2024 paper "Benchmarking Cognitive Biases in Large Language Models as Evaluators"
nlp
evaluation
bias
bias-detection
llm
llms
llm-evaluation
llms-benchmarking
llm-as-judge
llm-as-a-judge
llm-as-evaluator
-
Updated
Feb 16, 2024 - Jupyter Notebook
Use groq for evaluations
-
Updated
Jul 11, 2024 - Python
Antibodies for LLMs hallucinations (grouping LLM as a judge, NLI, reward models)
-
Updated
Jun 13, 2024 - Python
Improve this page
Add a description, image, and links to the llm-as-evaluator topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llm-as-evaluator topic, visit your repo's landing page and select "manage topics."