Description
Proposal summary
For this issue we would love to see datasets from Gretel (https://gretel.ai/) imported in as an Opik Dataset. You will also need to add any additional steps for dataset conversion and auth for the external integration. Also see some of their cookbook examples: https://github.com/gretelai/gretel-blueprints/blob/main/docs/notebooks/demo/rag/gretel-webinar-navigator-rag.ipynb
We would like to extend our intergrations to allow for a more diverse set of intergrations. We would love to be able to import data from a 3rd party data source which could be annotated datasets used for testing a model and this is imported in as an Opik Dataset. Ideally this is a simple working solution as a Cookbook (Juypter Notebook) using the Python SDK rather than having some complex frontend.
Working solution would have a notebook where you can import/pull a dataset and push to Comet Opik Datasets. Here is a working example of this from the Agent Optimizer where we push a synthetic dataset which you can see: https://colab.research.google.com/github/comet-ml/opik/blob/main/sdks/opik_optimizer/notebooks/OpikSyntethicDataOptimizer.ipynb#scrollTo=ayY1cxBLPq7b - In bounty submission please show the dataset in the Opik UI
Motivation
Support more wider dataset import options for model testing, playground, onlin eval and agent optimization SDK use-cases.