v0.6.8

[colin-ho]

What's Changed 🚀

✨ Features

• feat: Allow images in prompt @colin-ho (feat: Allow images in prompt #5466)
• feat: add pre-existence checks for lance_data_sink @huleilei (feat: add pre-existence checks for lance_data_sink #5381)
• feat: Support setting actor_udf_ready_timeout via Env @plotor (feat: Support setting actor_udf_ready_timeout via Env #5426)
• feat: retryable udfs @universalmind303 (feat: retryable udfs #5392)
• feat: Add a Bigtable data sink @desmondcheongzx (feat: Add a Bigtable data sink #5431)
• feat: classify_image expression @universalmind303 (feat: classify_image expression #5428)
• feat: Add support for Metrics tab in quickstart Ray dashboard @jeevb (feat: Add support for Metrics tab in quickstart Ray dashboard #5429)
• feat(lance): distributed FTS index creation via Daft UDF with fragment-level parallelism @huleilei (feat(lance): distributed FTS index creation via Daft UDF with fragment-level parallelism #5236)
• feat: add mimetype detection for daft.file @universalmind303 (feat: add mimetype detection for daft.file #5411)

🐛 Bug Fixes

• fix: report a more reasonable error message when select * from <some_keywords> @VOID001 (fix: report a more reasonable error message when select * from <some_keywords> #5440)
• fix: Fix async udf with use_process @colin-ho (fix: Fix async udf with use_process #5457)
• fix: Drop table error in current active session @plotor (fix: Drop table error in current active session #5439)
• fix: add retry on "unable to open file" @kevinzwang (fix: add retry on "unable to open file" #5442)
• fix: Allow publishing quickstart helm chart to GHCR @jeevb (fix: Allow publishing quickstart helm chart to GHCR #5437)
• fix: convert num_rows to int when query count(*) from clickhouse @dujl (fix: convert num_rows to int when query count(*) from clickhouse #5421)
• fix: Actually clone the repo before publishing quickstart helm chart @jeevb (fix: Actually clone the repo before publishing quickstart helm chart #5433)
• fix: file reads for huggingface @universalmind303 (fix: file reads for huggingface #5427)
• fix: Make benchmarking Ray cluster setup commands idempotent @jeevb (fix: Make benchmarking Ray cluster setup commands idempotent #5425)
• fix(lance): correct limit pushdown semantics with filters @huleilei (fix(lance): correct limit pushdown semantics with filters #5408)

🚀 Performance

• perf: Call async udfs asynchronously @colin-ho (perf: Call async udfs asynchronously #5451)
• perf: Elide shuffle for window if already partitioned @colin-ho (perf: Elide shuffle for window if already partitioned #5450)
• perf: defer allocation when creating series from literals @universalmind303 (perf: defer allocation when creating series from literals #5391)
• perf: Double workers per udf actor handle @colin-ho (perf: Double workers per udf actor handle #5415)

♻️ Refactor

• refactor: Make helper function for calling async python functions from rust @colin-ho (refactor: Make helper function for calling async python functions from rust #5432)
• refactor: combine sentence_transformers + transformers, and clean up … @universalmind303 (refactor: combine sentence_transformers + transformers, and clean up … #5422)

📖 Documentation

• docs: adds ai functions, ai providers, contributing, and docstrings with nav @everettVT (docs: adds ai functions, ai providers, contributing, and docstrings with nav #5438)
• docs: warning for Common Crawl dataset API instability @malcolmgreaves (docs: warning for Common Crawl dataset API instability #5436)
• docs: update the example to access S3-compatible services @huleilei (docs: update the example to access S3-compatible services #5405)
• docs(connectors): add connector page for Lance format @huleilei (docs(connectors): add connector page for Lance format #5397)

Full Changelog: v0.6.7...v0.6.8

---

This discussion was created from the release v0.6.8.