MiniZinc Challenge 2024 Results
- MiniZinc Challenge
- »Challenge 2024
- »Results
Entrants
The entrants for this year (with their descriptions, when provided):
- Choco-solver (CP) (description).
- Choco-solver (CP-SAT) (description).
- Gecode/Dexter (description).
- iZplus (description).
- JaCoP (description).
- OptiMathSAT INT (description).
- OptiMathSAT INT-SMT2 (description).
- OptiMathSAT BV (description).
- OR-Tools CP-SAT (description).
- OR-Tools CP-SAT LS (description).
- PicatSAT (description).
- Pumpkin (description).
- SICStus Prolog (description).
- Yuck (description).
In addition, the challenge organisers entered the following FlatZinc and MiniZinc implementations:
- Chuffed (description). A C++ FD solver using lazy clause generation.
- Gecode (description). A C++ FD solver.
- CpoFzn (description). Uses IBM ILOG CP Optimizer version 22.11.
- MZN/Cbc (description). Translates to MILP, uses Cbc version 2.10.11.
- MZN/CPLEX (description). Translates to MILP, uses IBM ILOG CPLEX Optimizer version 22.11.
- MZN/Gurobi (description). Translates to MILP, uses Gurobi version 11.0.3.
- MZN/HiGHS (description). Translates to MILP, uses HiGHS version 1.7.2.
- MZN/SCIP (description). Translates to MILP, uses SCIP version 9.1.0.
As per the challenge rules, these entries are not eligible for prizes, but do modify the scoring results.
Summary of Results
The results for the MiniZinc Challenge 2024 are
| Category | Gold | Silver | Bronze |
|---|---|---|---|
| Fixed | OR-Tools CP-SAT | Choco-solver CP-SAT | SICStus Prolog |
| Free | OR-Tools CP-SAT | PicatSAT | iZplus |
| Parallel | OR-Tools CP-SAT | PicatSAT | Choco-solver CP |
| Open | OR-Tools CP-SAT | PicatSAT | Choco-solver CP |
| Local Search | OR-Tools CP-SAT LS | Yuck |
Description of Results
All times are given in milliseconds.
A score of 0.0 indicates a worse answer in quality (worse objective, no proof of optimality, or no answer for satisfaction problems).
A score of 1.0 indicates a better solution in quality. When the quality is the same, the 1.0 purse is split with respect to time used.
If a promoted entry does not recognize an option (or states that it is just ignored), times and solutions from the previous category are used for scoring. The suffixes -fd, -free, -par or -open (for the parallel portfolio solver entered) at the end of the solver names indicate which configuration the solvers were run with.
The time limit includes both MiniZinc compilation and solving.
In the Status column:
- S indicates that a solution was found,
- C indicates that the search was complete,
- ERR indicates an incorrect answer or the solver aborted,
- ERR indicates that flattening aborted (time-out or out-of-memory),
- UNK indicates that no answer was returned in the time limit.
Download all problems
All problems are available in a zipped tar-ball here.
Detailed Results
Select a list of solvers and benchmarks and click on “Compute Results” to score the solvers against each other on the selected benchmarks. The entrants for each of the FD search, free search and parallel search categories can be selected with the corresponding buttons.
|
|
Global constraint per model
The following table lists the global constraints used by each model in this year's challenge. In addition, the columns RC and SBC, respectively, indicate whether the model contains redundant or/and symmetry breaking constraints.
| Problem | Type | Kind | RC | SBC | MiniZinc Globals |
|---|---|---|---|---|---|
| accap | real | min | diffn | ||
| aircraft-disassembly | real | min | cumulative | ||
| cable-tree-wiring | real | min | ✓ | all_different | |
| community-detection | combi | max | value_precede_chain, global_cardinality_low_up | ||
| compression | combi | min | global_cardinality | ||
| concert-hall-cap | combi | max | ✓ | all_different_except_0, value_precede_chain | |
| fox-geese-corn | puzzle | max | ✓ | ||
| graph-clear | combi | min | all_different | ||
| harmony | puzzle | min | all_equal, count_eq, min, strictly_decreasing | ||
| hoist-benchmark | real | min | ✓ | ||
| monitor-placement-1id | real | min | |||
| neighbours | puzzle | max | ✓ | ✓ | lex_lesseq |
| network_50_cstr | real | min | |||
| peacable_queens | puzzle | max | count, regular, value_precede | ||
| portal | puzzle | min | |||
| tiny-cvrp | real | min | |||
| train-scheduling | real | min | all_different, cumulative, disjunctive | ||
| triangular | puzzle | max | inverse | ||
| word-equations | combi | max | nvalue | ||
| yumi-dynamic | real | min | all_equal, all_different, circuit, cumulative, diffn, increasing, table, value_precede, value_precede_chain |
The files on this page are for MiniZinc version 2.8.5.