Skip to content

Commit d803496

Browse files
committed
Clean up RagasEvaluator interfaces
Refactor RagasEvaluator Class for use for `ilab` interface. Signed-off-by: Ali Maredia <[email protected]>
1 parent 46b86fd commit d803496

File tree

2 files changed

+209
-116
lines changed

2 files changed

+209
-116
lines changed

src/instructlab/eval/exceptions.py

+24
Original file line numberDiff line numberDiff line change
@@ -158,3 +158,27 @@ class EmptyTaxonomyError(EvalError):
158158
def __init__(self) -> None:
159159
super().__init__()
160160
self.message = "Provided taxonomy doesn't contain any skill qna.yaml files"
161+
162+
163+
class ModelResponseGenerationError(EvalError):
164+
"""
165+
Error raised when getting a response from an OpenAI client
166+
Attributes
167+
message error message to be printed on raise
168+
"""
169+
170+
def __init__(self, message) -> None:
171+
super().__init__()
172+
self.message = message
173+
174+
175+
class ModelListGenerationError(EvalError):
176+
"""
177+
Error raised when getting a list of models from an OpenAI client
178+
Attributes
179+
message error message to be printed on raise
180+
"""
181+
182+
def __init__(self, message) -> None:
183+
super().__init__()
184+
self.message = message

0 commit comments

Comments
 (0)