| MiniZinc model | Instance | eclipse_fd | [score] | eclipse_ic | [score] | g12_fd | [score] | gecode | [score] |
|---|---|---|---|---|---|---|---|---|---|
| debruijn_binary.mzn | 02_03.dzn | Abort | 0.23s | 52.8 | 0.54s | 47.2 | Abort | ||
| 02_07.dzn | Abort | 1.73s | 45.8 | 0.94s | 54.2 | Abort | |||
| 02_08.dzn | Abort | 7.47s | 34.1 | 0.89s | 65.9 | Abort | |||
| 02_09.dzn | Abort | 34.18s | 28.6 | 1.73s | 71.4 | Abort | |||
| 02_10.dzn | Abort | 167.43s | 27.8 | 9.09s | 72.2 | Abort | |||
| 03_06.dzn | Abort | 39.09s | 18.1 | 4.49s | 27.0 | 0.49s | 54.9 | ||
| 03_07.dzn | Abort | Out of Memory | Time Out | 2.98s | 100.0 | ||||
| 03_08.dzn | Abort | Out of Memory | Time Out | Time Out | |||||
| 04_06.dzn | Abort | Out of Memory | Time Out | Abort | |||||
| 04_07.dzn | Abort | Out of Memory | Time Out | Abort | |||||
| 04_08.dzn | Abort | Out of Memory | Abort | Abort | |||||
| nmseq.mzn | 020.dzn | 0.65s | 31.2 | Abort | 0.99s | 28.7 | 0.03s | 40.0 | |
| 040.dzn | 7.89s | 21.5 | Abort | 2.85s | 27.9 | 0.27s | 50.6 | ||
| 060.dzn | 48.61s | 27.2 | Abort | Time Out | 1.27s | 72.8 | |||
| 080.dzn | 182.41s | 18.0 | Abort | 47.27s | 21.7 | 4.51s | 60.4 | ||
| 100.dzn | 473.98s | 26.6 | Abort | Time Out | 14.51s | 73.4 | |||
| 150.dzn | Time Out | Time Out | Time Out | 102.79s | 100.0 | ||||
| 200.dzn | Time Out | Time Out | Time Out | 330.92s | 100.0 | ||||
| 300.dzn | Time Out | Time Out | Time Out | Time Out | |||||
| 400.dzn | Time Out | Time Out | Time Out | Time Out | |||||
| 500.dzn | Out of Memory | Out of Memory | Time Out | Time Out | |||||
| pentominoes-int.mzn | 01.dzn | 0.28s | 25.7 | 0.50s | 23.8 | 0.96s | 21.1 | 0.00s | 29.4 |
| 02.dzn | 17.02s | 19.6 | 429.18s | 16.8 | Time Out | 0.14s | 63.6 | ||
| 03.dzn | 1.98s | 21.4 | 4.27s | 17.5 | 1.73s | 22.2 | 0.01s | 38.8 | |
| 04.dzn | Time Out | Out of Memory | Time Out | 186.19s | 100.0 | ||||
| 05.dzn | 296.44s | 25.8 | Time Out | Time Out | 4.00s | 74.2 | |||
| 06.dzn | 13.38s | 20.6 | 200.04s | 16.9 | Time Out | 0.23s | 62.5 | ||
| 07.dzn | Time Out | Time Out | Time Out | 37.33s | 100.0 | ||||
| quasigroup7.mzn | 05.dzn | 0.82s | 22.8 | 1.23s | 20.9 | 0.52s | 24.9 | 0.00s | 31.3 |
| 06.dzn | 7.40s | 15.8 | 11.22s | 14.7 | 0.57s | 29.9 | 0.01s | 39.6 | |
| 07.dzn | 140.48s | 12.7 | 206.94s | 12.7 | 0.60s | 33.7 | 0.19s | 40.9 | |
| 08.dzn | Time Out | Time Out | 1.01s | 59.4 | 3.42s | 40.6 | |||
| 09.dzn | Time Out | Time Out | 0.60s | 50.3 | 0.64s | 49.7 | |||
| 10.dzn | Time Out | Time Out | Time Out | Time Out | |||||
| 11.dzn | Time Out | Time Out | Time Out | Time Out | |||||
| 12.dzn | Time Out | Time Out | Time Out | Time Out | |||||
| 13.dzn | Time Out | Time Out | Time Out | Time Out | |||||
| 14.dzn | Time Out | Time Out | Time Out | Time Out | |||||
| radiation.mzn | 01.dzn | Abort | 22.15s | 22.6 | 5.45s | 38.0 | 5.05s | 39.4 | |
| 02.dzn | Abort | Time Out | 811.47s | 100.0 | Time Out | ||||
| 03.dzn | Abort | Time Out | 233.47s | 56.2 | 386.68s | 43.8 | |||
| 04.dzn | Abort | 26.73s | 21.8 | 6.51s | 35.8 | 4.59s | 42.4 | ||
| 05.dzn | Abort | 1.17s | 29.0 | 1.00s | 30.0 | 0.10s | 41.0 | ||
| 06.dzn | Abort | 11.77s | 24.0 | 3.40s | 38.0 | 3.41s | 38.0 | ||
| 07.dzn | Abort | 21.40s | 21.8 | 5.58s | 34.3 | 3.26s | 43.9 | ||
| 08.dzn | Abort | 75.13s | 22.6 | 17.50s | 40.9 | 21.53s | 36.6 | ||
| 09.dzn | Abort | Time Out | 567.81s | 100.0 | Time Out | ||||
| rcpsp.mzn | 00.dzn | Abort | Abort | Time Out | Time Out | ||||
| 01.dzn | Abort | Abort | Time Out | Time Out | |||||
| 02.dzn | Abort | Abort | 9.22s | 100.0 | Time Out | ||||
| 03.dzn | Abort | Abort | Time Out | Time Out | |||||
| 04.dzn | Abort | Abort | Time Out | Time Out | |||||
| 05.dzn | Abort | Abort | Time Out | Time Out | |||||
| 06.dzn | Abort | Abort | Time Out | Time Out | |||||
| 07.dzn | Abort | Abort | Time Out | Time Out | |||||
| 08.dzn | Abort | Abort | Time Out | Time Out | |||||
| 09.dzn | Abort | Abort | Time Out | Time Out | |||||
| search_stress.mzn | 04_04.dzn | 0.32s | 24.7 | 0.38s | 24.1 | 0.56s | 22.8 | 0.01s | 28.4 |
| 08_04.dzn | 143.7s | 16.7 | 208.6s | 15.4 | 32.6s | 30.5 | 23.3s | 37.4 | |
| 08_08.dzn | Time Out | Time Out | Time Out | Time Out | |||||
| shortest_path.mzn | 00.dzn | 2.24s | 27.3 | 3.36s | 24.6 | Time Out | 0.10s | 48.1 | |
| 01.dzn | 2.96s | 21.6 | 4.29s | 19.3 | 19.76s | 14.2 | 0.11s | 44.9 | |
| 02.dzn | 3.93s | 18.3 | 1.86s | 22.6 | 3.88s | 18.4 | 0.02s | 40.7 | |
| 03.dzn | Time Out | Time Out | Time Out | 892.84s | 100.0 | ||||
| 04.dzn | Time Out | Time Out | 1.70s | 74.8 | 861.53s | 25.2 | |||
| 05.dzn | Time Out | Time Out | Time Out | 243.45s | 100.0 | ||||
| 06.dzn | 0.92s | 23.7 | 1.12s | 22.7 | 1.86s | 20.0 | 0.02s | 33.6 | |
| 07.dzn | Time Out | Time Out | Time Out | 38.79s | 100.0 | ||||
| 08.dzn | Time Out | Time Out | Time Out | 34.44s | 100.0 | ||||
| 09.dzn | Time Out | Time Out | Time Out | 790.36s | 100.0 | ||||
| slow_convergence.mzn | 0100.dzn | 0.32s | 25.2 | 0.37s | 24.7 | 0.90s | 21.3 | 0.02s | 28.9 |
| 0200.dzn | 0.26s | 25.3 | 0.25s | 25.4 | 0.90s | 21.0 | 0.01s | 28.4 | |
| 0300.dzn | 1.44s | 23.3 | 1.96s | 21.4 | 1.73s | 22.1 | 0.27s | 33.2 | |
| 0400.dzn | 2.48s | 23.0 | 3.33s | 20.9 | 3.83s | 20.0 | 0.54s | 36.1 | |
| 0500.dzn | 3.99s | 22.4 | 5.15s | 20.6 | 6.39s | 19.2 | 0.96s | 37.8 | |
| 0600.dzn | 5.72s | 22.3 | 7.47s | 20.3 | 9.96s | 18.5 | 1.50s | 38.9 | |
| 0700.dzn | 7.96s | 27.4 | 10.19s | 25.2 | Time Out | 2.12s | 47.4 | ||
| 0800.dzn | 10.16s | 22.2 | 12.79s | 20.4 | 19.01s | 17.9 | 3.04s | 39.4 | |
| 0900.dzn | 13.22s | 27.5 | 16.86s | 25.3 | Time Out | 4.08s | 47.1 | ||
| 1000.dzn | 16.60s | 22.2 | 20.96s | 20.3 | 30.65s | 17.9 | 5.33s | 39.6 | |
| trucking.mzn | 01.dzn | 0.33s | 25.0 | 0.48s | 23.7 | 0.65s | 22.6 | 0.02s | 28.8 |
| 02.dzn | 0.31s | 24.9 | 0.42s | 23.9 | 0.61s | 22.6 | 0.01s | 28.6 | |
| 03.dzn | 0.32s | 32.3 | 0.47s | 30.7 | Time Out | 0.02s | 36.9 | ||
| 04.dzn | 1.42s | 23.5 | 2.95s | 19.2 | 1.82s | 22.0 | 0.17s | 35.3 | |
| 05.dzn | 14.28s | 19.5 | 33.33s | 15.6 | 17.24s | 18.4 | 2.14s | 46.5 | |
| 11.dzn | Time Out | Time Out | Time Out | 896.96s | 100.0 | ||||
| 12.dzn | Time Out | Time Out | Time Out | 894.85s | 100.0 | ||||
| 13.dzn | Time Out | Time Out | Time Out | 868.75s | 100.0 | ||||
| 14.dzn | Time Out | Time Out | Time Out | 877.71s | 100.0 | ||||
| 15.dzn | Time Out | Time Out | Time Out | 840.88s | 100.0 |
| Contestant | Total Score |
|---|---|
| eclipse_fd | 787.3 |
| eclipse_ic | 938.8 |
| g12_fd | 1655.1 |
| gecode | 3418.8 |
These results are based on Eclipse version 5.10, an up-to-date release of Gecode,and the 05-09-2008 trunk version of G12.
Due to the mechanism used by the g12_fd benchmarks, some time-outs reported for G12 are actually out-of-memory failures.
Note that the Eclipse aborts are due to ‘instantiation faults’ which we believe may be due to a minor bug in the Eclipse implementation of FlatZinc.
The gecode aborts on the rcpsp problems are caused by trying to print out the value of non-ground variables.
Since all submitted solvers either prove optimality or have no competitors (except in one case), scoring is the same for both optimisation problems and satisfaction problems. 50 points are shared equally among the solvers finding a solution to a particular test. A further 50 points are shared according to how quickly a solver found the solution relative to the others (full details are available on the Challenge web page).
On the shortest_path problem 04.dzn, g12_fd claims to have found the optimal result; gecodef also gets a result which it does not claim is optimal, which is an order of magnitude worse. The g12_fd result was tested by feeding it into the gecode solver which confirmed its feasibility.
The files on this page are for MiniZinc version 0.8. Versions of these files for the current version of MiniZinc are available as part of the G12 MiniZinc distribution.