Skip to content

Regression Test for 2.2.3 release #224

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 115 commits into from
Closed

Regression Test for 2.2.3 release #224

wants to merge 115 commits into from

Conversation

fraz-prod
Copy link
Contributor

@fraz-prod fraz-prod commented Jun 4, 2025 •
edited
Loading

Pull Request Template

Description

This PR is featuring regression test for multiple agent for release 2.2.3

Type of Change

Please delete options that are not relevant.

  • New feature (non-breaking change which adds functionality)

How Has This Been Tested?

set authenticate key and base url in environment variable and same environment variable name must be present in test/examples of particular agent file

Checklist:

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes
  • Any dependent changes have been merged and published in downstream modules

Impact on Roadmap

this will help to check if in new release any old features is break or not

SiddharthaKostiRaga and others added 30 commits April 30, 2025 14:32
@SiddharthaKostiRaga
feat: initial work
14b7888
@SiddharthaKostiRaga
dumping json to debug
1bd6518
@SiddharthaKostiRaga
fix: add hash_id and name_occurrences to each span
3df62ba
@Ritika1311
removed unused import statement
989d873
@Ritika1311
remove pdb statement
d2b012f
@Ritika1311
changed trace format for agentic application
fec6112
@SiddharthaKostiRaga
fix: commented upload_trace_metric which is not getting used rn
4edf423
@SiddharthaKostiRaga
fix: commented upload trace metrics process
d224cb2
@SiddharthaKostiRaga
fix: 1. used agentic upload process for rag 2. add tracer_type in tra…
50e4046 
…ce_json file
@kiranscaria
add fallback for get_presigned_url, if post fails use get
4c4604f 
Signed-off-by: kiranscaria <[email protected]>
@kiranscaria
add fallback for get_presigned_url, if post fails use get for code up…
2352c49 
…load & agentic trace upload

Signed-off-by: kiranscaria <[email protected]>
@kiranscaria
Merge pull request #176 from aristotle-ai/bug/url_get_to_post
3b4eac7 
fix(presigned-url): prefer POST, fallback to GET for presigned-URL creation
@SiddharthaKostiRaga
feat: support for dynamically add_metadata in traces
55986b8
@SiddharthaKostiRaga
Merge branch 'main' of https://github.com/aristotle-ai/RagaAI-Catalyst …
04ece1f 
…into updated_trace_format
@SiddharthaKostiRaga
fix: changed value error to warning, to continue the trace wo stopping
7b4f9c0
@SiddharthaKostiRaga
fix: removed tracer_type restriction when updating metadata using add…
9c780c2 
…_metadata
@SiddharthaKostiRaga
feat: add support to add metadata columns in schema meapping during c…
d0ce293 
…sv uplaod
@SiddharthaKostiRaga
feat: support to add user context in trace json file
29a5a53
@SiddharthaKostiRaga
feat: support to add user gt in trace json file
5e9b7a1
@SiddharthaKostiRaga
refactor: change custom spans fetching key value from text->input.value
6a7a1ab
@SiddharthaKostiRaga
updated trace format rag extraction logic for reference
0fb13b1
@SiddharthaKostiRaga
fix: fetch 'openinference.span.kind' instead of 'kind' from spans
3aede10
@SiddharthaKostiRaga
fix: change mismatched key for fetching spanHash
dde2c01
@Ritika1311
extrenal_id bug
10fb630
@Ritika1311
removed extrenal_id change for rag_trace script
c12e0f0
@SiddharthaKostiRaga
doc: removed with tracer syntax from examples
1a78309
@SiddharthaKostiRaga
fix: add name_occurences as well with name when getting span_hash_id
ffcfcfa
@kiranscaria
Merge pull request #178 from aristotle-ai/external_id_issue
055a33d 
extrenal_id bug
@SiddharthaKostiRaga
fix: remove checking for '_' in in schema mapping and using .lower()
16adea8
@SiddharthaKostiRaga
fix: changed span_hash_id to hash_id
403a8c8
nsaboo-ragaai and others added 28 commits May 28, 2025 13:31
@nsaboo-ragaai
Merge pull request #194 from aristotle-ai/add_top_level_try_catch
4f7af09 
Top level try catch
@nsaboo-ragaai
bump beta version 2.2.3.beta.1
4619859
@SiddharthaKostiRaga
refactor: remove column filtering when returning df in evaluation.get…
5886dc5 
…_results
@SiddharthaKostiRaga
refacor: update model cost config having gpt4.1 family model details
aa6ce36
@SiddharthaKostiRaga
fix: fetch model_name from ls_model_name if llm.model_name is not ava…
6252454 
…ilable
@SiddharthaKostiRaga
Merge pull request #195 from aristotle-ai/bug/gpt4_1_model_cost
0cf77c7 
gpt4.1 family model support in litellm cost calc
@SiddharthaKostiRaga
bump beta version 2.2.3.beta.2
511ce14
@SiddharthaKostiRaga
Merge branch 'main' of https://github.com/aristotle-ai/RagaAI-Catalyst …
10d8d10 
…into evaluation/get_result_filter_no_col
@SiddharthaKostiRaga
fix: removed unnecessary calc of column_list
5adc6d8
@SiddharthaKostiRaga
refactor: convert set_model_cost to no-op function
87f1ab0
@SiddharthaKostiRaga
refactor: commented the set_model_cost logic and return None
2fdb2bb
@SiddharthaKostiRaga
Merge pull request #196 from aristotle-ai/evaluation/get_result_filte…
332bd62 
…r_no_col

Evaluation/get_result filter no column
@SiddharthaKostiRaga
Merge pull request #197 from aristotle-ai/set_model_cost_no_op
aa4a4f7 
set_model_cost to no-op function
@SiddharthaKostiRaga
bump beta version 2.2.3.beta.3
90059dd
@SiddharthaKostiRaga
refactor: add deprecated message in set_model_cost
4fcaeb7
@SiddharthaKostiRaga
fix: replace exception from logger in ragaai_catalyst
16d4e90
@SiddharthaKostiRaga
Merge pull request #198 from aristotle-ai/set_model_cost_no_op
f16e3ba 
refactor: add deprecated message in set_model_cost
@SiddharthaKostiRaga
Merge pull request #199 from aristotle-ai/add_top_level_try_catch
783d7a4 
fix: replace exception from logger in ragaai_catalyst
@SiddharthaKostiRaga
bump beta version 2.2.3.beta.4
34278dc
@SiddharthaKostiRaga
fix: exclude trace_id, span_id and meme_type from masking
438267c
@nsaboo-ragaai
Merge pull request #203 from aristotle-ai/bug/masking_exclude_vital_c…
100a04f 
…olumns

exclude trace_id, span_id and meme_type from masking
@nsaboo-ragaai
bump version to 2.2.3.beta.5
ece40e1
@kiranscaria
bug-fix: calculate cost for only llm spans
532a4d1 
Signed-off-by: kiranscaria <[email protected]>
@nsaboo-ragaai
Merge pull request #205 from aristotle-ai/bug-fix/calculate_cost
7732660 
bug-fix: calculate cost for only llm spans
@nsaboo-ragaai
bump version to 2.2.3.beta.6
fbc1cea
@nsaboo-ragaai
Release sdk version 2.2.3
9ea27aa
@fraz-prod
release 2.2.3 regression test for diagonosis agent
65b2fa8
@fraz-prod
Merge branch 'raga-ai-hub:main' into pytest/regression
3939054
@fraz-prod fraz-prod closed this Jun 4, 2025
@fraz-prod fraz-prod deleted the pytest/regression branch June 4, 2025 20:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@fraz-prod @SiddharthaKostiRaga @Ritika1311 @kiranscaria @agent-eval @jyotsanaSingh-git @nsaboo-ragaai