New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update SimpleQAEval to use direct CSV URL instead of blobfile #26

Open

ZhangYiqun018 wants to merge 1 commit into openai:main from ZhangYiqun018:simpleqa-remove-bf

ZhangYiqun018 commented Oct 31, 2024

Update SimpleQAEval to use direct CSV URL instead of blobfile

Changes made:

Replace Azure blob storage path (az://) with direct HTTPS URL for accessing the SimpleQA dataset
Remove blobfile dependency as it's no longer needed
Use pandas.read_csv() to directly fetch the dataset

The modified URL will be:
https://openaipublic.blob.core.windows.net/simple-evals/simple_qa_test_set.csv

This change simplifies the data loading process and removes the need for Azure blob storage authentication.

Related to issue: #25


          Update SimpleQAEval to use direct CSV URL instead of blobfile

139cccb

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet