Skip to content

Feature/gretel opik integration #2581

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

MAVRICK-1
Copy link
Contributor

@MAVRICK-1 MAVRICK-1 commented Jun 25, 2025

Details

Issues

Resolves #2541

Testing

Screencast.from.2025-06-25.23-59-07.webm

Screenshot from 2025-06-25 23-44-21

/claim #2541

@MAVRICK-1
Copy link
Contributor Author

MAVRICK-1 commented Jun 25, 2025

cc @vincentkoc @jverre

@vincentkoc
Copy link
Collaborator

vincentkoc commented Jun 25, 2025

@MAVRICK-1 Hi Rishi, appreciate the contribution, please give us time to review. And as per the bounty guidelines you need to ask before submitting to avoid one person blocking all the bounties as you have others in-review. Please bare with us

@MAVRICK-1
Copy link
Contributor Author

@vincentkoc sorry 😔, I will keep in mind

@vincentkoc
Copy link
Collaborator

image
Verified as working, @MAVRICK-1 can you just embed the image into the notebook same as the previous PR?

@aadereiko aadereiko requested a review from Copilot June 27, 2025 10:59
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds a new Jupyter notebook that provides a step-by-step cookbook for integrating synthetic Q&A data from Gretel AI into Opik, covering authentication, model discovery, generation, format conversion, dataset push, and verification.

  • Introduces find_working_navigator_model, generate_qa_dataset_robust, convert_gretel_to_opik_format, push_to_opik, and verify_opik_dataset helper functions
  • Demonstrates end-to-end workflow with live generation and file-based import support
  • Provides user guidance, error handling, and metadata enrichment for Opik datasets
Comments suppressed due to low confidence (1)

apps/opik-documentation/documentation/docs/cookbook/gretel_opik_integration_cookbook.ipynb:382

  • [nitpick] Core conversion logic does not have accompanying unit tests. It would improve reliability to add tests that verify automatic column detection and correct output formatting, covering edge cases (e.g., missing columns or empty rows).
    "def convert_gretel_to_opik_format(df, model_name=\"unknown\"):\n",

@MAVRICK-1
Copy link
Contributor Author

@vincentkoc done

@vincentkoc
Copy link
Collaborator

@vincentkoc done

Thanks ill review

@MAVRICK-1 MAVRICK-1 requested a review from vincentkoc July 5, 2025 08:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FR]: Integration Cookbook - Gretel Dataset to Opik Datasets
2 participants