The essentials that I want to benchmark are LingoDB, PostgreSQL and LingoDB. I was given a test server by the university, but there’s a critical issue. I don’t have sudo access, and 99.95% of the work to do these benchmarks needs me to have sudo. It’s literal hours to install the packages needed for benchmarking, and when I do install things it affects the entire system (new DB ports and so on).
My supervisor recommended running TPC H with a scale factor of 1, then 10. Issue is, if I do scale factor 10 my system runs out of memory and crashes.
Lingo DB provides quite good support for benchmarking, but the others are all a mission to get working. My supervisor gave me materials for benchmarking a lot of these, but it doesn’t have all of the TPC H queries that I’m after
So I’m opting to use Mutable’s benchmarking folder for now. It supports benchmarks for Mutable, DuckDB, PostgreSQL, and HyPer!
Managed to make quite nice progress which is visible on the slides.