Skip to content

Releases: awslabs/agent-evaluation

v0.3.0

11 Dec 15:50
Compare
Choose a tag to compare

What's Changed

Added

  • Added pass rate metric to summary (#60)
  • Added support of session attributes for bedrock agent target([#77] (#77))
  • Added Target for Prompt Flows (#96)

Fixed

  • Bedrock agent required arguments documented as optional (#92)
  • Fix test result attribute in summary template (#90)

Changed

  • Renamed TestResult.success to TestResult.passed (#62)
  • Moved agenteval.TargetResponse to agenteval.targets.TargetResponse. Documentation for creating custom targets also updated to reflect this change (#62)
  • Renamed the target config type from bedrock-knowledgebase to bedrock-knowledge-base (#62)

New Contributors

Full Changelog: v0.2.0...v0.3.0

v0.2.0

13 May 21:14
4ee7e8a
Compare
Choose a tag to compare

Changed

  • Convert the q_business_user_id configuration as optional to support applications that require AWS IAM Identity Center (#56)
  • Changed TargetResponse to a top-level import (#57)

Fixed

  • Documentation for creating custom targets (#57)

v0.1.0

03 May 22:24
16f5c7b
Compare
Choose a tag to compare

Initial release.