v0.6.2

[colin-ho]

What's Changed 🚀

✨ Features

• feat: add File.to_tempfile method and optimize range requests @universalmind303 (feat: add File.to_tempfile method and optimize range requests #5226)
• feat: migrate nested constructors, get, slice, to_unix_epoch, partitioning functions @kevinzwang (feat: migrate nested constructors, get, slice, to_unix_epoch, partitioning functions #5233)
• feat: implement Lance filter+count pushdown optimization @huleilei (feat: implement Lance filter+count pushdown optimization #5152)
• feat: migrate remaining basic expressions @kevinzwang (feat: migrate remaining basic expressions #5234)
• feat: Add regexp_count @srilman (feat: Add regexp_count #5191)
• feat: retry eof error in S3 multipart upload @kevinzwang (feat: retry eof error in S3 multipart upload #5179)
• feat(flotilla): Distributed Pivot @srilman (feat(flotilla): Distributed Pivot #5199)
• feat: allow for functions module to be accessed from daft import @kevinzwang (feat: allow for functions module to be accessed from daft import #5219)
• feat: migrate first batch of daft functions @kevinzwang (feat: migrate first batch of daft functions #5086)
• fix: remove io_config from global scan operator @Jay-ju (fix: remove io_config from global scan operator #4676)
• feat: implement cross join in distributed flotilla engine @ohbh (feat: implement cross join in distributed flotilla engine #5180)
• feat: make multipart part size configurable @stayrascal (feat: make multipart part size configurable #5051)

🐛 Bug Fixes

• fix: write_iceberg should handle write.data.path @eric-maynard (fix: write_iceberg should handle write.data.path  #5153)
• fix: Cast to table schema in lance write @colin-ho (fix: Cast to table schema in lance write #5221)
• fix: rename index function to find @kevinzwang (fix: rename index function to find #5218)
• fix: remove unnecessary field renaming in ListMap scalar UDF @ltdthanhdat (fix: remove unnecessary field renaming in ListMap scalar UDF #5205)
• fix: remove io_config from global scan operator @Jay-ju (fix: remove io_config from global scan operator #4676)

🚀 Performance

• perf: Drop local limit tasks global limit reached @colin-ho (perf: Drop local limit tasks global limit reached #5194)

📖 Documentation

• docs: add file datatype to urls&files docs page @universalmind303 (docs: add file datatype to urls&files docs page #5240)
• docs: add pipeline visualization and fix grammar in batch inference docs @ykdojo (docs: add pipeline visualization and fix grammar in batch inference docs #5239)
• docs: add Examples link to getting started sections @ykdojo (docs: add Examples link to getting started sections #5202)
• docs: fix additional incorrect references to Iceberg as a catalog @ykdojo (docs: fix additional incorrect references to Iceberg as a catalog #5198)
• docs: clarify data catalog vs table format in README @ykdojo (docs: clarify data catalog vs table format in README #5197)
• docs: remove outdated engine comparison page @ykdojo (docs: remove outdated engine comparison page #5196)
• docs: Add embed_image to the user guide @desmondcheongzx (docs: Add embed_image to the user guide #5195)
• docs: update minhash dedupe example and tutorial @everettVT (docs: update minhash dedupe example and tutorial  #5192)
• docs: Add Minhash Dedupe Example @everettVT (docs: Add Minhash Dedupe Example #5165)

👷 CI

• ci: enable AI integration tests in PR @kevinzwang (ci: enable AI integration tests in PR #5217)
• ci: move transformers tests to integration tests @rchowell (ci: move transformers tests to integration tests #5186)

🔧 Maintenance

• chore: Don't log failures in url download if on_error="null" @colin-ho (chore: Don't log failures in url download if on_error="null" #5231)
• chore: Make the runner a separate global singleton @srilman (chore: Make the runner a separate global singleton #5185)
• chore: remove expr.str.regexp_split since we will immediately deprecate it @kevinzwang (chore: remove expr.str.regexp_split since we will immediately deprecate it #5216)
• chore: Rewrite the dashboard server to use Axum @srilman (chore: Rewrite the dashboard server to use Axum #5212)
• chore: Remove reset_runner option @srilman (chore: Remove reset_runner option #5184)
• chore: Split .str.split into .str.split and .str.regexp_split @srilman (chore: Split .str.split into .str.split and .str.regexp_split #5211)
• chore: enable logging configuration during launch udf worker @stayrascal (chore: enable logging configuration during launch udf worker #5168)

⏪ Reverts

• revert: "fix: remove io_config from global scan operator" @universalmind303 (revert: "fix: remove io_config from global scan operator" #5203)

Full Changelog: v0.6.1...v0.6.2

---

This discussion was created from the release v0.6.2.