Support for sending utilization metrics via Otel

[dcieslak19973]

Feature request

Firms may be interested in measuring impact of AI tools; having pr-agent able to send usage stats to Otel would allow reporting out of DataDog, etc.

Motivation

Measuring the utilization/adoption of AI tooling

[qodo-merge-for-open-source]

💡 Auto-generated documentation-based answer:

Based on the documentation, PR-Agent/Qodo Merge does not currently have built-in support for sending utilization metrics via OpenTelemetry (Otel) to external monitoring systems like DataDog.

However, there are some related capabilities and potential workarounds:

Current Monitoring/Analytics Features

For Qodo Merge users (💎):

• Advanced usage statistics at user, repository, and company levels
• Detailed metrics about Qodo Merge usage and general statistics/insights
• Impact evaluation metrics that track implemented suggestions and measure ROI

Potential Integration Options

LiteLLM Integration:
The documentation mentions that various logging observability tools can be used with the default LiteLLM AI Handler by configuring LiteLLM callback settings. For example, to use LangSmith:

[litellm]
enable_callbacks = true
success_callback = ["langsmith"]
failure_callback = ["langsmith"]
service_callback = []

While this doesn't directly support Otel, it shows that PR-Agent has some extensibility for observability integrations through LiteLLM.

Recommendation

This appears to be a valid feature request that is not currently supported. You may want to:

1. Submit this as a feature request to the PR-Agent GitHub repository
2. For enterprise customers, contact Qodo directly to discuss custom observability integrations
3. Consider implementing custom logging/metrics collection in your deployment environment to track PR-Agent usage

The request aligns well with enterprise needs for measuring AI tool adoption and ROI, which would complement the existing impact evaluation features.

Relevant Sources:

• https://qodo-merge-docs.qodo.ai//usage-guide/additional_configurations#integrating-with-logging-observability-platforms
• https://qodo-merge-docs.qodo.ai//overview/pr_agent_pro#additional-features
• https://qodo-merge-docs.qodo.ai//core-abilities/impact_evaluation#impact-evaluation