Performance Benchmarks: Comparison with `pySMT`, `pySAT`, and `Z3.jl`

[Fe-r-oz]

Currently, Satisfiability does not provide performance benchmarks. Implementing benchmarks against popular libraries like pySMTand pySAT would provide valuable insights into its performance and help users assess its efficiency and scalability.

If this request is about a new feature, please describe what you would like to see implemented.

I would like to see a benchmarking suite added to Satisfiability that compares its performance against libraries such as pySMT and pySAT and others. Additionally, benchmarking against the wrapped C API of Z3, such as Z3.jl, could also be highly persuasive for 'non-technical' users. This could include tests for execution time, memory usage, and scalability across a range of typical use cases. I would be glad to contribute by developing the benchmarking suite if this proposal aligns with your interests. Thank you for considering it!

Solution

• Benchmark against Z3.jl
• Benchmark against pySAT
• Benchmark against pySMT

[elsoroka]

Great idea - there was some benchmarking done for a paper so I should dig that out and set it up.