Skip to content

Commit 7afd5e9

Browse files
author
Adam Holm
committed
Add testing step and update to SK v1.50.0
- Updated `LlmAsJudgePackPublish.yml` to include a testing step after build. - Modified `.gitignore` to ignore `packageIcon-old.png`. - Enhanced documentation in `EvalService.cs` by adding an optional `serviceId` parameter. - Updated `packageIcon.png` with new content. - Changed project title in `LlmAsJudgeEvalsAsPlugins.csproj` to include OpenAIClient and IChatClient. - Incremented version from `1.0.7` to `1.0.8` and updated package references to `Microsoft.SemanticKernel` and `Microsoft.SemanticKernel.Yaml` version `1.50.0`. - Reformatted `PackageTags` to use semicolons instead of commas.
1 parent 4a1e83f commit 7afd5e9

File tree

5 files changed

+10
-5
lines changed

5 files changed

+10
-5
lines changed

.github/workflows/LlmAsJudgePackPublish.yml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,9 @@ jobs:
2424
- name: Build the project
2525
run: dotnet build --configuration Release
2626

27+
- name: Test the project
28+
run: dotnet test --configuration Release --no-build --verbosity normal
29+
2730
- name: Pack the project
2831
run: dotnet pack --configuration Release --no-build --output ./output
2932

.gitignore

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -369,3 +369,4 @@ FodyWeavers.xsd
369369
/Demo/LlmAsJudgeEvalsAsPlugins.Demo/eval_output.json
370370
/Demo/LlmAsJudgeEvalsAsPlugins.Demo/eval_output_baseline.json
371371
/Demo/LlmAsJudgeEvalsAsPlugins.Demo/eval_output_finetune.json
372+
/LlmAsJudgeEvalsAsPlugins/Images/packageIcon-old.png

LlmAsJudgeEvalsAsPlugins/EvalService.cs

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -169,6 +169,7 @@ public async Task<ResultScore> ExecuteEval(IInputModel inputModel, PromptExecuti
169169
/// </summary>
170170
/// <param name="inputModel">The input model for the evaluation.</param>
171171
/// <param name="settings">optional <see cref="T:Microsoft.SemanticKernel.PromptExecutionSettings"/>. Defaults to preset <see cref="T:Microsoft.SemanticKernel.Connectors.OpenAI.OpenAIPromptExecutionSettings"/></param>
172+
/// <param name="serviceId">optional service id for keyed <see cref="IChatCompletionService"/></param>
172173
/// <returns>The result score of the evaluation.</returns>
173174
public async Task<ResultScore> ExecuteScorePlusEval(IInputModel inputModel, PromptExecutionSettings? settings = null, string? serviceId = null)
174175
{
1.23 MB
Loading

LlmAsJudgeEvalsAsPlugins/LlmAsJudgeEvalsAsPlugins.csproj

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -6,14 +6,14 @@
66
<Nullable>enable</Nullable>
77
<NoWarn>SKEXP0010</NoWarn>
88
<RootNamespace>HillPhelmuth.SemanticKernel.LlmAsJudgeEvals</RootNamespace>
9-
<Title>Run "LLM as Judge" Evals Using Semantic Kernel</Title>
9+
<Title>Run "LLM as Judge" Evals Using Semantic Kernel, OpenAIClient, or IChatClient</Title>
1010
<PackageProjectUrl>https://github.com/HillPhelmuth/LlmAsJudgeEvalPlugins</PackageProjectUrl>
1111
<RepositoryUrl>https://github.com/HillPhelmuth/LlmAsJudgeEvalPlugins</RepositoryUrl>
1212
<PackageIcon>packageIcon.png</PackageIcon>
1313
<Authors>HillPhelmuth</Authors>
1414
<Description>Enable seamless execution of LLM (Large Language Model) evaluations using Semantic Kernel. This library provides tools and abstractions for running automated assessments where LLMs serve as judges, offering structured, consistent, and scalable evaluation methods. Ideal for AI-driven projects that require evaluative feedback, scoring, or comparative analysis across various use cases. Easily integrates with Semantic Kernel for smooth, flexible LLM operations in .NET environments.</Description>
1515
<PackageReadmeFile>Readme.md</PackageReadmeFile>
16-
<PackageTags>LLM, Semantic Kernel, AI, Evaluation, Judge, Machine Learning, NLP, Natural Language Processing, AI Evaluation, Automated Scoring, .NET, C#, AI Feedback, Semantic, Language Model, LLM Judge, Large Language Model</PackageTags>
16+
<PackageTags>LLM; Semantic Kernel; AI; Evaluation; Judge; Machine Learning; NLP; Natural Language Processing; AI Evaluation; Automated Scoring; .NET; C#; AI Feedback; Semantic; Language Model; LLM Judge; Large Language Model; OpenAI; gpt; Evals </PackageTags>
1717
<PackageLicenseExpression>MIT</PackageLicenseExpression>
1818
<IncludeSymbols>True</IncludeSymbols>
1919
<SymbolPackageFormat>snupkg</SymbolPackageFormat>
@@ -26,7 +26,7 @@
2626
</PropertyGroup>
2727
<PropertyGroup Condition="'$(Configuration)' == 'Release'">
2828
<GeneratePackageOnBuild>True</GeneratePackageOnBuild>
29-
<Version>1.0.7</Version>
29+
<Version>1.0.8</Version>
3030
</PropertyGroup>
3131

3232

@@ -44,8 +44,8 @@
4444

4545

4646
<ItemGroup>
47-
<PackageReference Include="Microsoft.SemanticKernel" Version="1.47.0" />
48-
<PackageReference Include="Microsoft.SemanticKernel.Yaml" Version="1.47.0" />
47+
<PackageReference Include="Microsoft.SemanticKernel" Version="1.50.0" />
48+
<PackageReference Include="Microsoft.SemanticKernel.Yaml" Version="1.50.0" />
4949
</ItemGroup>
5050

5151
<ItemGroup>

0 commit comments

Comments
 (0)