Table Scan Performance Tests

[sdd]

This PR adds some performance testing capabilities. It includes the following features:

• docker-compose environment that includes containers for Minio, Spark, HAProxy and the Iceberg REST Catalog
• Uses HAProxy to simulate real-world latency and bandwidth constraints of connections to services like S3
• Includes scripting to create an Iceberg table in the performance testing environment and populate it with data from the widely-used NYC Taxi dataset
• Adds a justfile for ease of creating, initialising, starting, stopping and tearing down the performance testing environment
• Adds some Criterion benchmarks that use the performance testing environment to test the performance of TableScan.plan_files in four different representative scenarios
• Adds some Criterion benchmarks that use the performance testing environment to test the performance of TableScan.to_arrow in four different representative scenarios

The performance tests can be set up and ran by running just perf-run. This will trigger the following actions before actually running the tests. It checks each item to see if it actually needs to be run, skipping if already done on a previous run:

• Download NYC taxi data parquets
• Spin up docker containers
• Create a table
• Insert test data from the parquets

[sdd]

@Xuanwo and @liurenjie1024: This is now passing and ready for review.

[Xuanwo]

Thanks a lot for driving this work!

[liurenjie1024]

Thanks @sdd for this pr. I just skimmed through it and got your points here. I have some concerns with this approach, for example, I feel this approach is difficult to maintain and extend to other cases. I'm more interested in integrated with datafusion to do such thing, like integration tests and benchmark. What do you think?