Skip to content

issues Search Results · repo:metauto-ai/agent-as-a-judge language:Python

Filter by

6 results
 (48 ms)

6 results

inmetauto-ai/agent-as-a-judge (press backspace or delete to remove)

metauto-ai/agent-as-a-judge
Question about figure 7 (PR Curves)

Hi, thank you for this interesting work! How were the precision-recall curves in Figure 7 calculated? Specifically, were thresholds or confidence scores used to generate the precision-recall pairs, or ...
  • codingsoo
  • 1
  • Opened 
    on Jan 1
  • #24

metauto-ai/agent-as-a-judge
How to use code to collect trajectory？ How to use LLM-as-a-judge to evaluate the code generation result？

Hello, thank you for your great work. @mczhuge #First question: In your paper s fifth page, there is a sentence: we record key decisions and actions made by the agentic systems through some custom instrumentation ...
  • zhang123434
  • 3
  • Opened 
    on Nov 9, 2024
  • #20

metauto-ai/agent-as-a-judge
Error File does not exist

using gpt-4o-mini still produces the following error: img width= 1645 alt= image src= https://github.com/user-attachments/assets/286d2653-5195-4acb-8fac-da04fbc9b732 could you first make gpt-4o-mini can ...
  • femto
  • 6
  • Opened 
    on Oct 24, 2024
  • #15

metauto-ai/agent-as-a-judge
Seemed Can't install

Python 3.11.4, after poetry install, • Installing tensorflow (2.17.0): Failed RuntimeError Unable to find installation candidates for tensorflow (2.17.0) at ~/.pyenv/versions/3.11.4/lib/python3.11/site-packages/poetry/installation/chooser.py:76 ...
  • femto
  • 7
  • Opened 
    on Oct 19, 2024
  • #11

metauto-ai/agent-as-a-judge
'JudgeAgent' object has no attribute 'get_evidence'

PYTHONPATH=. python scripts/run_ask.py --workspace $(pwd)/benchmark/workspaces/OpenHands/39_Drug_Response_Prediction_SVM_GDSC_ML --question What does this workspace contain? Traceback (most recent call ...
  • lsm1103
  • 1
  • Opened 
    on Oct 17, 2024
  • #9

metauto-ai/agent-as-a-judge
前排火了叫我

image
  • libaxuan
  • 1
  • Opened 
    on Oct 16, 2024
  • #8
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Press the
/
key to activate the search input again and adjust your query.
Issue origami icon

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues
ProTip! 
Restrict your search to the title by using the in:title qualifier.
Issue search results · GitHub