Skip to content

[FR]: Integration Cookbook - Gretel Dataset to Opik Datasets #2541

@vincentkoc

Description

@vincentkoc

Proposal summary

For this issue we would love to see datasets from Gretel (https://gretel.ai/) imported in as an Opik Dataset. You will also need to add any additional steps for dataset conversion and auth for the external integration. Also see some of their cookbook examples: https://github.com/gretelai/gretel-blueprints/blob/main/docs/notebooks/demo/rag/gretel-webinar-navigator-rag.ipynb

We would like to extend our intergrations to allow for a more diverse set of intergrations. We would love to be able to import data from a 3rd party data source which could be annotated datasets used for testing a model and this is imported in as an Opik Dataset. Ideally this is a simple working solution as a Cookbook (Juypter Notebook) using the Python SDK rather than having some complex frontend.

Working solution would have a notebook where you can import/pull a dataset and push to Comet Opik Datasets. Here is a working example of this from the Agent Optimizer where we push a synthetic dataset which you can see: https://colab.research.google.com/github/comet-ml/opik/blob/main/sdks/opik_optimizer/notebooks/OpikSyntethicDataOptimizer.ipynb#scrollTo=ayY1cxBLPq7b - In bounty submission please show the dataset in the Opik UI

Motivation

Support more wider dataset import options for model testing, playground, onlin eval and agent optimization SDK use-cases.

Metadata

Metadata

Assignees

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions