MiniZinc - Challenge 2009 Results

MiniZinc Challenge 2009 Results

Entrants

There were two entrants this year:

Gecode
SICStus

In addition, the challenge organisers entered the following three FlatZinc implementations:

ECLiPSe
G12/FD
G12/LazyFD

As per the challenge rules, these entries are not eligible for prizes, but do modify the scoring results.

Description of Results

Times are in seconds. There are 100 points for each problem instance. In the SCB column: S indicates a solution was found; C indicates a complete search; and B indicates the best solution to an optimisation problem.

A run that records a time of less than 900 seconds without returning a solution or completing its search indicates that the run was aborted for some other reason (e.g., running out of memory).

Some solvers could not run certain problems (e.g., g12_lazyfd could not run fillomino because some model variables are unbounded); these scores are marked -N/A-.

Some solvers produced incorrect results (a summary is available below); these scores are marked -BAD-. unbounded); these scores are marked -N/A-.

Summary of Results

fd_search

sicstus	1651.8
eclipse_ic	322.1
gecode	4008.8
g12_fd	2040.6
g12_lazyfd	1376.6

free_search

sicstus	1841.0
gecode	4535.5
g12_fd	1112.4
g12_lazyfd	2511.1

Detailed Results

fd_search

Problem	Instance	Solver	Time (s)	SCB	Score

black-hole	01	sicstus	2		-BAD-
		eclipse_ic	900		0.0
		gecode	1	S	74.4
		g12_fd	900		0.0
		g12_lazyfd	175	S	25.6

black-hole	03	sicstus	2		-BAD-
		eclipse_ic	900		0.0
		gecode	0	S	65.0
		g12_fd	230	S	16.9
		g12_lazyfd	32	S	18.1

black-hole	05	sicstus	2		-BAD-
		eclipse_ic	900		0.0
		gecode	1	S	74.3
		g12_fd	900		0.0
		g12_lazyfd	150	S	25.7

black-hole	07	sicstus	2		-BAD-
		eclipse_ic	900		0.0
		gecode	0	S	74.4
		g12_fd	900		0.0
		g12_lazyfd	85	S	25.6

black-hole	09	sicstus	2		-BAD-
		eclipse_ic	900		0.0
		gecode	33	S	66.7
		g12_fd	900		0.0
		g12_lazyfd	171	S	33.3

black-hole	11	sicstus	2		-BAD-
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

black-hole	13	sicstus	2		-BAD-
		eclipse_ic	900		0.0
		gecode	0	S	65.4
		g12_fd	333	S	16.8
		g12_lazyfd	42	S	17.8

black-hole	15	sicstus	2		-BAD-
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

black-hole	17	sicstus	3		0.0
		eclipse_ic	5	SC	16.1
		gecode	0	SC	34.3
		g12_fd	0	SC	34.3
		g12_lazyfd	7	SC	15.2

black-hole	19	sicstus	2		-BAD-
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

fillomino	08	sicstus	8	S	26.6
		eclipse_ic	900		0.0
		gecode	3	S	38.9
		g12_fd	4	S	34.5
		g12_lazyfd	0		-N/A-

fillomino	11	sicstus	41	S	28.6
		eclipse_ic	900		0.0
		gecode	17	S	44.6
		g12_fd	49	S	26.7
		g12_lazyfd	0		-N/A-

fillomino	13	sicstus	164	S	27.5
		eclipse_ic	900		0.0
		gecode	74	S	40.5
		g12_fd	115	S	32.1
		g12_lazyfd	1		-N/A-

fillomino	14	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	485	S	56.5
		g12_fd	823	S	43.5
		g12_lazyfd	0		-N/A-

fillomino	15	sicstus	21	S	29.6
		eclipse_ic	900		0.0
		gecode	7	S	52.2
		g12_fd	183	S	18.2
		g12_lazyfd	0		-N/A-

fillomino	16	sicstus	68	S	28.9
		eclipse_ic	900		0.0
		gecode	23	S	51.8
		g12_fd	317	S	19.3
		g12_lazyfd	0		-N/A-

fillomino	17	sicstus	37	S	26.6
		eclipse_ic	900		0.0
		gecode	10	S	51.1
		g12_fd	67	S	22.2
		g12_lazyfd	0		-N/A-

fillomino	18	sicstus	65	S	29.5
		eclipse_ic	900		0.0
		gecode	32	S	42.3
		g12_fd	72	S	28.2
		g12_lazyfd	1		-N/A-

fillomino	20	sicstus	21	S	23.9
		eclipse_ic	900		0.0
		gecode	6	S	39.5
		g12_fd	7	S	36.6
		g12_lazyfd	0		-N/A-

fillomino	21	sicstus	117	S	28.1
		eclipse_ic	900		0.0
		gecode	61	S	38.4
		g12_fd	79	S	33.5
		g12_lazyfd	0		-N/A-

nonogram	non_awful_2	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

nonogram	non_awful_4	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

nonogram	non_fast_1	sicstus	290	S	13.3
		eclipse_ic	900		0.0
		gecode	4	S	58.0
		g12_fd	300	S	13.3
		g12_lazyfd	77	S	15.4

nonogram	non_fast_10	sicstus	398	S	14.7
		eclipse_ic	900		0.0
		gecode	24	S	48.0
		g12_fd	216	S	16.6
		g12_lazyfd	107	S	20.7

nonogram	non_fast_11	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	6	S	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

nonogram	non_fast_5	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	41	S	63.6
		g12_fd	900		0.0
		g12_lazyfd	141	S	36.4

nonogram	non_fast_7	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	150	S	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

nonogram	non_fast_9	sicstus	858	S	18.2
		eclipse_ic	900		0.0
		gecode	30	S	60.3
		g12_fd	900		0.0
		g12_lazyfd	283	S	21.4

nonogram	non_med_2	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	297	S	54.4
		g12_fd	900		0.0
		g12_lazyfd	426	S	45.6

nonogram	non_med_4	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	225	S	58.5
		g12_fd	900		0.0
		g12_lazyfd	456	S	41.5

open_stacks	gp50by50_1	sicstus	142	SCB	30.2
		eclipse_ic	900		0.0
		gecode	184	SCB	23.3
		g12_fd	92	SCB	46.4
		g12_lazyfd	1		-N/A-

open_stacks	nrwsLarger4_1	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	900	SB	100.0
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

open_stacks	problem_15_15_1	sicstus	315	SCB	26.8
		eclipse_ic	900		0.0
		gecode	227	SCB	37.2
		g12_fd	235	SCB	35.9
		g12_lazyfd	1		-N/A-

open_stacks	problem_20_10_1	sicstus	4	SCB	19.1
		eclipse_ic	74	SCB	1.3
		gecode	1	SCB	47.8
		g12_fd	2	SCB	31.8
		g12_lazyfd	0		-N/A-

open_stacks	wbo_15_30_1	sicstus	26	SCB	30.2
		eclipse_ic	900		0.0
		gecode	21	SCB	37.1
		g12_fd	24	SCB	32.7
		g12_lazyfd	0		-N/A-

open_stacks	wbo_30_15_1	sicstus	7	SCB	15.6
		eclipse_ic	111	SCB	1.1
		gecode	2	SCB	41.6
		g12_fd	2	SCB	41.6
		g12_lazyfd	0		-N/A-

open_stacks	wbo_30_30_1	sicstus	900	S	38.9
		eclipse_ic	900		0.0
		gecode	900	SB	61.1
		g12_fd	900		0.0
		g12_lazyfd	1		-N/A-

open_stacks	wbop_20_10_1	sicstus	2	SCB	17.4
		eclipse_ic	11	SCB	4.3
		gecode	1	SCB	26.1
		g12_fd	0	SCB	52.2
		g12_lazyfd	0		-N/A-

open_stacks	wbp_20_10_1	sicstus	2	SCB	14.1
		eclipse_ic	32	SCB	1.3
		gecode	0	SCB	42.3
		g12_fd	0	SCB	42.3
		g12_lazyfd	0		-N/A-

open_stacks	wbp_30_10_1	sicstus	6	SCB	19.4
		eclipse_ic	117	SCB	1.2
		gecode	2	SCB	45.4
		g12_fd	3	SCB	34.0
		g12_lazyfd	0		-N/A-

p1f	03	sicstus	0	SC	28.6
		eclipse_ic	1	SC	14.3
		gecode	0	SC	28.6
		g12_fd	0	SC	28.6
		g12_lazyfd	0		-N/A-

p1f	04	sicstus	0	SCB	28.6
		eclipse_ic	1	SCB	14.3
		gecode	0	SCB	28.6
		g12_fd	0	SCB	28.6
		g12_lazyfd	0		-N/A-

p1f	05	sicstus	1	SC	16.7
		eclipse_ic	1	SC	16.7
		gecode	0	SC	33.3
		g12_fd	0	SC	33.3
		g12_lazyfd	0		-N/A-

p1f	06	sicstus	0	SCB	31.2
		eclipse_ic	4	SCB	6.2
		gecode	0	SCB	31.2
		g12_fd	0	SCB	31.2
		g12_lazyfd	0		-N/A-

p1f	07	sicstus	1	SC	18.8
		eclipse_ic	5	SC	6.2
		gecode	0	SC	37.5
		g12_fd	0	SC	37.5
		g12_lazyfd	0		-N/A-

p1f	08	sicstus	1	SCB	29.4
		eclipse_ic	900		0.0
		gecode	0	SCB	58.8
		g12_fd	4	SCB	11.8
		g12_lazyfd	1		-N/A-

p1f	09	sicstus	1	SC	24.9
		eclipse_ic	95	SC	0.5
		gecode	0	SC	49.7
		g12_fd	1	SC	24.9
		g12_lazyfd	0		-N/A-

p1f	10	sicstus	21	SCB	33.3
		eclipse_ic	900		0.0
		gecode	10	SCB	66.7
		g12_fd	900	S	0.0
		g12_lazyfd	0		-N/A-

p1f	11	sicstus	3	SC	20.0
		eclipse_ic	900		0.0
		gecode	1	SC	40.0
		g12_fd	1	SC	40.0
		g12_lazyfd	1		-N/A-

p1f	12	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	900	SB	100.0
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

prop_stress	0100	sicstus	2	SC	19.2
		eclipse_ic	7	SC	13.4
		gecode	3	SC	16.9
		g12_fd	0	SC	37.5
		g12_lazyfd	8	SC	13.1

prop_stress	0200	sicstus	13	SC	25.5
		eclipse_ic	47	SC	16.3
		gecode	60	SC	15.5
		g12_fd	5	SC	42.8
		g12_lazyfd	31		0.0

prop_stress	0300	sicstus	37	SC	24.9
		eclipse_ic	156	SC	15.5
		gecode	489	SC	13.5
		g12_fd	13	SC	46.1
		g12_lazyfd	23		0.0

prop_stress	0400	sicstus	78	SC	32.8
		eclipse_ic	369	SC	20.1
		gecode	900		0.0
		g12_fd	41	SC	47.1
		g12_lazyfd	20		0.0

prop_stress	0500	sicstus	139	SC	66.9
		eclipse_ic	723	SC	33.1
		gecode	900		0.0
		g12_fd	243		0.0
		g12_lazyfd	24		0.0

prop_stress	0600	sicstus	227	SC	100.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	380		0.0
		g12_lazyfd	24		0.0

prop_stress	0700	sicstus	347	SC	100.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	157		0.0
		g12_lazyfd	26		0.0

prop_stress	0800	sicstus	502	SC	100.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	136		0.0
		g12_lazyfd	26		0.0

prop_stress	0900	sicstus	697	SC	100.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	132		0.0
		g12_lazyfd	31		0.0

prop_stress	1000	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	183		0.0
		g12_lazyfd	30		0.0

rectangle-packing	rpp05_true	sicstus	0	S	21.1
		eclipse_ic	1	S	15.6
		gecode	0	S	21.1
		g12_fd	0	S	21.1
		g12_lazyfd	0	S	21.1

rectangle-packing	rpp09_false	sicstus	0		0.0
		eclipse_ic	1	S	20.8
		gecode	0	S	29.2
		g12_fd	0	S	29.2
		g12_lazyfd	1	S	20.8

rectangle-packing	rpp12_true	sicstus	1		0.0
		eclipse_ic	2	S	19.6
		gecode	0	S	33.9
		g12_fd	1	S	23.2
		g12_lazyfd	1	S	23.2

rectangle-packing	rpp14_false	sicstus	1		0.0
		eclipse_ic	3	S	19.6
		gecode	1	S	26.8
		g12_fd	1	S	26.8
		g12_lazyfd	1	S	26.8

rectangle-packing	rpp15_true	sicstus	1		0.0
		eclipse_ic	17	S	15.6
		gecode	1	S	40.1
		g12_fd	9	S	18.0
		g12_lazyfd	3	S	26.3

rectangle-packing	rpp19_false	sicstus	1		0.0
		eclipse_ic	900		0.0
		gecode	280	S	53.3
		g12_fd	900		0.0
		g12_lazyfd	366	S	46.7

rectangle-packing	rpp22_true	sicstus	2		0.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

rectangle-packing	rpp24_false	sicstus	2		0.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

rectangle-packing	rpp26_true	sicstus	3		0.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

rectangle-packing	rpp30_false	sicstus	4		0.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

roster	chicroster_dataset_11	sicstus	13	SCB	4.5
		eclipse_ic	2		-BAD-
		gecode	1	SCB	31.8
		g12_fd	1	SCB	31.8
		g12_lazyfd	1	SCB	31.8

roster	chicroster_dataset_14	sicstus	14	SCB	3.5
		eclipse_ic	2		-BAD-
		gecode	0	SCB	52.6
		g12_fd	1	SCB	26.3
		g12_lazyfd	2	SCB	17.5

roster	chicroster_dataset_17	sicstus	17	SCB	4.0
		eclipse_ic	2		-BAD-
		gecode	1	SCB	36.0
		g12_fd	1	SCB	36.0
		g12_lazyfd	2	SCB	24.0

roster	chicroster_dataset_3	sicstus	4	SCB	9.1
		eclipse_ic	1		-BAD-
		gecode	0	SCB	45.5
		g12_fd	1	SCB	22.7
		g12_lazyfd	1	SCB	22.7

roster	chicroster_dataset_5	sicstus	5	SCB	7.7
		eclipse_ic	1		-BAD-
		gecode	0	SCB	46.2
		g12_fd	1	SCB	23.1
		g12_lazyfd	1	SCB	23.1

roster	chicroster_dataset_7	sicstus	6	SCB	6.7
		eclipse_ic	1		-BAD-
		gecode	1	SCB	23.3
		g12_fd	0	SCB	46.7
		g12_lazyfd	1	SCB	23.3

roster	chicroster_dataset_8	sicstus	18	SCB	5.7
		eclipse_ic	1		-BAD-
		gecode	2	SCB	36.3
		g12_fd	4	SCB	21.8
		g12_lazyfd	2	SCB	36.3

roster	chicroster_dataset_large_13	sicstus	900		0.0
		eclipse_ic	2		-BAD-
		gecode	900	SB	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

roster	chicroster_dataset_large_15	sicstus	900		0.0
		eclipse_ic	1		-BAD-
		gecode	900	SB	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

roster	chicroster_dataset_large_19	sicstus	900	S	0.0
		eclipse_ic	2		-BAD-
		gecode	900	SB	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

search_stress2	02_07	sicstus	0	SC	25.0
		eclipse_ic	1		0.0
		gecode	0	SC	25.0
		g12_fd	0	SC	25.0
		g12_lazyfd	0	SC	25.0

search_stress2	03_06	sicstus	1	SC	19.6
		eclipse_ic	1		0.0
		gecode	0	SC	26.8
		g12_fd	0	SC	26.8
		g12_lazyfd	0	SC	26.8

search_stress2	04_05	sicstus	0	SC	25.0
		eclipse_ic	1		0.0
		gecode	0	SC	25.0
		g12_fd	0	SC	25.0
		g12_lazyfd	0	SC	25.0

search_stress2	04_06	sicstus	0	SC	25.0
		eclipse_ic	2		0.0
		gecode	0	SC	25.0
		g12_fd	0	SC	25.0
		g12_lazyfd	0	SC	25.0

search_stress2	05_05	sicstus	0	SC	29.1
		eclipse_ic	900		0.0
		gecode	0	SC	29.1
		g12_fd	49	SC	12.8
		g12_lazyfd	0	SC	29.1

search_stress2	05_06	sicstus	0	SC	33.3
		eclipse_ic	900		0.0
		gecode	0	SC	33.3
		g12_fd	900		0.0
		g12_lazyfd	0	SC	33.3

search_stress2	06_04	sicstus	5	SC	14.0
		eclipse_ic	16	SC	11.4
		gecode	2	SC	18.1
		g12_fd	1	SC	22.1
		g12_lazyfd	0	SC	34.3

search_stress2	06_05	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	586	SC	16.8
		g12_fd	344	SC	16.8
		g12_lazyfd	0	SC	66.4

search_stress2	06_06	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	0	SC	-BAD-

search_stress2	07_02	sicstus	0	SC	21.1
		eclipse_ic	1	SC	15.6
		gecode	0	SC	21.1
		g12_fd	0	SC	21.1
		g12_lazyfd	0	SC	21.1

still_life	still_life_5	sicstus	1	SCB	12.5
		eclipse_ic	1	SCB	12.5
		gecode	0	SCB	25.0
		g12_fd	0	SCB	25.0
		g12_lazyfd	0	SCB	25.0

still_life	still_life_6	sicstus	1	SCB	15.8
		eclipse_ic	5	SCB	5.3
		gecode	0	SCB	31.6
		g12_fd	0	SCB	31.6
		g12_lazyfd	1	SCB	15.8

still_life	still_life_7	sicstus	5	SCB	20.7
		eclipse_ic	29	SCB	4.1
		gecode	2	SCB	41.4
		g12_fd	3	SCB	31.1
		g12_lazyfd	46	SCB	2.6

still_life	still_life_9	sicstus	900		0.0
		eclipse_ic	900		0.0
		gecode	900	SB	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

vrp	A-n34-k5.vrp	sicstus	900	S	0.0
		eclipse_ic	900		0.0
		gecode	900	SB	39.1
		g12_fd	900	S	37.1
		g12_lazyfd	900	S	23.7

vrp	A-n44-k7.vrp	sicstus	900	S	0.0
		eclipse_ic	900		0.0
		gecode	900	SB	43.9
		g12_fd	900	S	30.0
		g12_lazyfd	900	S	26.1

vrp	A-n55-k9.vrp	sicstus	900	S	0.0
		eclipse_ic	900		0.0
		gecode	900	SB	39.4
		g12_fd	900	S	36.7
		g12_lazyfd	900	S	23.9

vrp	A-n65-k9.vrp	sicstus	900	S	21.7
		eclipse_ic	900		0.0
		gecode	900	SB	35.3
		g12_fd	900	S	22.8
		g12_lazyfd	900	S	20.1

vrp	B-n39-k5.vrp	sicstus	900	S	0.0
		eclipse_ic	900		0.0
		gecode	900	SB	33.3
		g12_fd	900	SB	33.3
		g12_lazyfd	900	SB	33.3

vrp	B-n50-k8.vrp	sicstus	900	S	0.0
		eclipse_ic	900		0.0
		gecode	900	SB	37.3
		g12_fd	900	SB	37.3
		g12_lazyfd	900	S	25.3

vrp	B-n64-k9.vrp	sicstus	900	S	0.0
		eclipse_ic	900		0.0
		gecode	900	SB	38.8
		g12_fd	900	S	37.6
		g12_lazyfd	900	S	23.6

vrp	P-n19-k2.vrp	sicstus	900	S	18.4
		eclipse_ic	900		0.0
		gecode	900	SB	31.9
		g12_fd	900	S	28.4
		g12_lazyfd	900	S	21.2

vrp	P-n45-k5.vrp	sicstus	900	S	0.0
		eclipse_ic	900		0.0
		gecode	900	SB	42.8
		g12_fd	900	S	31.7
		g12_lazyfd	900	S	25.6

vrp	P-n55-k7.vrp	sicstus	900	S	0.0
		eclipse_ic	900		0.0
		gecode	900	SB	37.3
		g12_fd	900	SB	37.3
		g12_lazyfd	900	S	25.3

free_search

Problem	Instance	Solver	Time (s)	SCB	Score

black-hole	01	sicstus	3		-BAD-
		gecode	1	S	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

black-hole	03	sicstus	2		-BAD-
		gecode	0	S	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

black-hole	05	sicstus	2		-BAD-
		gecode	1	S	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

black-hole	07	sicstus	2		-BAD-
		gecode	1	S	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

black-hole	09	sicstus	2		-BAD-
		gecode	33	S	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

black-hole	11	sicstus	2		-BAD-
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

black-hole	13	sicstus	2		-BAD-
		gecode	0	S	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

black-hole	15	sicstus	2		-BAD-
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

black-hole	17	sicstus	2		0.0
		gecode	0	SC	49.4
		g12_fd	1	SC	33.1
		g12_lazyfd	38	SC	17.5

black-hole	19	sicstus	2		-BAD-
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

fillomino	08	sicstus	9	S	22.5
		gecode	3	S	31.4
		g12_fd	1	S	46.1
		g12_lazyfd	0		-N/A-

fillomino	11	sicstus	41		0.0
		gecode	18	S	73.1
		g12_fd	481	S	26.9
		g12_lazyfd	1		-N/A-

fillomino	13	sicstus	164	S	26.1
		gecode	75	S	37.2
		g12_fd	77	S	36.7
		g12_lazyfd	0		-N/A-

fillomino	14	sicstus	900		0.0
		gecode	486	S	100.0
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

fillomino	15	sicstus	21	S	21.2
		gecode	7	S	29.1
		g12_fd	2	S	49.7
		g12_lazyfd	0		-N/A-

fillomino	16	sicstus	68	S	23.6
		gecode	23	S	36.7
		g12_fd	20	S	39.6
		g12_lazyfd	0		-N/A-

fillomino	17	sicstus	37	S	36.2
		gecode	10	S	63.8
		g12_fd	900		0.0
		g12_lazyfd	1		-N/A-

fillomino	18	sicstus	64	S	41.8
		gecode	32	S	58.2
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

fillomino	20	sicstus	21	S	38.3
		gecode	7	S	61.7
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

fillomino	21	sicstus	118	S	26.7
		gecode	60	S	36.2
		g12_fd	57	S	37.2
		g12_lazyfd	0		-N/A-

nonogram	non_awful_2	sicstus	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	213	S	100.0

nonogram	non_awful_4	sicstus	900		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	159	S	100.0

nonogram	non_fast_1	sicstus	292	S	17.5
		gecode	4	S	62.7
		g12_fd	900		0.0
		g12_lazyfd	71	S	19.9

nonogram	non_fast_10	sicstus	401	S	27.8
		gecode	23	S	72.2
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

nonogram	non_fast_11	sicstus	900		0.0
		gecode	6	S	73.2
		g12_fd	900		0.0
		g12_lazyfd	183	S	26.8

nonogram	non_fast_5	sicstus	900		0.0
		gecode	40	S	64.2
		g12_fd	900		0.0
		g12_lazyfd	147	S	35.8

nonogram	non_fast_7	sicstus	900		0.0
		gecode	147	S	47.4
		g12_fd	900		0.0
		g12_lazyfd	119	S	52.6

nonogram	non_fast_9	sicstus	863	S	26.7
		gecode	30	S	73.3
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

nonogram	non_med_2	sicstus	900		0.0
		gecode	294	S	39.5
		g12_fd	900		0.0
		g12_lazyfd	119	S	60.5

nonogram	non_med_4	sicstus	900		0.0
		gecode	226	S	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

open_stacks	gp50by50_1	sicstus	140	SCB	53.5
		gecode	161	SCB	46.5
		g12_fd	900		0.0
		g12_lazyfd	2		-N/A-

open_stacks	nrwsLarger4_1	sicstus	900		0.0
		gecode	900	SB	100.0
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

open_stacks	problem_15_15_1	sicstus	315	SCB	42.1
		gecode	229	SCB	57.9
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

open_stacks	problem_20_10_1	sicstus	3	SCB	42.9
		gecode	2	SCB	57.1
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

open_stacks	wbo_15_30_1	sicstus	27	SCB	44.0
		gecode	21	SCB	56.0
		g12_fd	900		0.0
		g12_lazyfd	1		-N/A-

open_stacks	wbo_30_15_1	sicstus	7	SCB	20.0
		gecode	1	SCB	80.0
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

open_stacks	wbo_30_30_1	sicstus	900	S	38.9
		gecode	900	SB	61.1
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

open_stacks	wbop_20_10_1	sicstus	2	SCB	40.0
		gecode	1	SCB	60.0
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

open_stacks	wbp_20_10_1	sicstus	2	SCB	25.0
		gecode	0	SCB	75.0
		g12_fd	900		0.0
		g12_lazyfd	1		-N/A-

open_stacks	wbp_30_10_1	sicstus	6	SCB	30.0
		gecode	2	SCB	70.0
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

p1f	03	sicstus	0	SC	40.0
		gecode	1	SC	20.0
		g12_fd	0	SC	40.0
		g12_lazyfd	0		-N/A-

p1f	04	sicstus	0	SCB	49.1
		gecode	0	SCB	49.1
		g12_fd	27	SCB	1.8
		g12_lazyfd	0		-N/A-

p1f	05	sicstus	1	SC	33.3
		gecode	0	SC	66.7
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

p1f	06	sicstus	0	SCB	50.0
		gecode	0	SCB	50.0
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

p1f	07	sicstus	1	SC	33.3
		gecode	0	SC	66.7
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

p1f	08	sicstus	1	SCB	33.3
		gecode	0	SCB	66.7
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

p1f	09	sicstus	2	SC	25.0
		gecode	0	SC	75.0
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

p1f	10	sicstus	20	SCB	34.4
		gecode	10	SCB	65.6
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

p1f	11	sicstus	3	SC	33.3
		gecode	1	SC	66.7
		g12_fd	900		0.0
		g12_lazyfd	1		-N/A-

p1f	12	sicstus	900		0.0
		gecode	900	SB	100.0
		g12_fd	900		0.0
		g12_lazyfd	0		-N/A-

prop_stress	0100	sicstus	3	SC	24.3
		gecode	4	SC	21.9
		g12_fd	1	SC	36.1
		g12_lazyfd	8	SC	17.7

prop_stress	0200	sicstus	13	SC	29.1
		gecode	62	SC	19.4
		g12_fd	4	SC	51.5
		g12_lazyfd	27		0.0

prop_stress	0300	sicstus	37	SC	30.5
		gecode	501	SC	17.7
		g12_fd	14	SC	51.8
		g12_lazyfd	27		0.0

prop_stress	0400	sicstus	78		0.0
		gecode	900		0.0
		g12_fd	40	SC	100.0
		g12_lazyfd	25		0.0

prop_stress	0500	sicstus	139	SC	100.0
		gecode	900		0.0
		g12_fd	255		0.0
		g12_lazyfd	33		0.0

prop_stress	0600	sicstus	226	SC	100.0
		gecode	900		0.0
		g12_fd	260		0.0
		g12_lazyfd	24		0.0

prop_stress	0700	sicstus	348	SC	100.0
		gecode	900		0.0
		g12_fd	161		0.0
		g12_lazyfd	36		0.0

prop_stress	0800	sicstus	503	SC	100.0
		gecode	900		0.0
		g12_fd	244		0.0
		g12_lazyfd	28		0.0

prop_stress	0900	sicstus	697	SC	100.0
		gecode	900		0.0
		g12_fd	690		0.0
		g12_lazyfd	29		0.0

prop_stress	1000	sicstus	900		0.0
		gecode	900		0.0
		g12_fd	217		0.0
		g12_lazyfd	44		0.0

rectangle-packing	rpp05_true	sicstus	1	S	21.3
		gecode	0	S	30.1
		g12_fd	0	S	30.1
		g12_lazyfd	2	S	18.4

rectangle-packing	rpp09_false	sicstus	0		0.0
		gecode	0	S	33.3
		g12_fd	0	S	33.3
		g12_lazyfd	0	S	33.3

rectangle-packing	rpp12_true	sicstus	1		0.0
		gecode	0	S	58.3
		g12_fd	900		0.0
		g12_lazyfd	1	S	41.7

rectangle-packing	rpp14_false	sicstus	1		0.0
		gecode	1	S	50.0
		g12_fd	900		0.0
		g12_lazyfd	1	S	50.0

rectangle-packing	rpp15_true	sicstus	1		0.0
		gecode	1	S	55.0
		g12_fd	900		0.0
		g12_lazyfd	2	S	45.0

rectangle-packing	rpp19_false	sicstus	1		0.0
		gecode	284	S	25.9
		g12_fd	900		0.0
		g12_lazyfd	4	S	74.1

rectangle-packing	rpp22_true	sicstus	2		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	6	S	100.0

rectangle-packing	rpp24_false	sicstus	2		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	6	S	100.0

rectangle-packing	rpp26_true	sicstus	3		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	8	S	100.0

rectangle-packing	rpp30_false	sicstus	3		0.0
		gecode	900		0.0
		g12_fd	900		0.0
		g12_lazyfd	11	S	100.0

roster	chicroster_dataset_11	sicstus	12	SCB	4.7
		gecode	0	SCB	60.7
		g12_fd	1	SCB	30.3
		g12_lazyfd	13	SCB	4.3

roster	chicroster_dataset_14	sicstus	13	SCB	9.3
		gecode	1	SCB	64.8
		g12_fd	900		0.0
		g12_lazyfd	4	SCB	25.9

roster	chicroster_dataset_17	sicstus	16	SCB	5.0
		gecode	0	SCB	84.5
		g12_fd	900		0.0
		g12_lazyfd	7	SCB	10.6

roster	chicroster_dataset_3	sicstus	4	SCB	16.7
		gecode	1	SCB	41.7
		g12_fd	900		0.0
		g12_lazyfd	1	SCB	41.7

roster	chicroster_dataset_5	sicstus	5	SCB	6.2
		gecode	0	SCB	37.5
		g12_fd	0	SCB	37.5
		g12_lazyfd	1	SCB	18.8

roster	chicroster_dataset_7	sicstus	6	SCB	9.7
		gecode	0	SCB	67.7
		g12_fd	900		0.0
		g12_lazyfd	2	SCB	22.6

roster	chicroster_dataset_8	sicstus	18	SCB	8.3
		gecode	3	SCB	39.3
		g12_fd	900		0.0
		g12_lazyfd	2	SCB	52.4

roster	chicroster_dataset_large_13	sicstus	900		0.0
		gecode	900	SB	100.0
		g12_fd	900		0.0
		g12_lazyfd	900	S	0.0

roster	chicroster_dataset_large_15	sicstus	900		0.0
		gecode	900	S	24.5
		g12_fd	900		0.0
		g12_lazyfd	64	SCB	75.5

roster	chicroster_dataset_large_19	sicstus	900	S	0.0
		gecode	900	SB	100.0
		g12_fd	900		0.0
		g12_lazyfd	900		0.0

search_stress2	02_07	sicstus	0	C	0.0
		gecode	0	C	0.0
		g12_fd	0	C	0.0
		g12_lazyfd	0	S	100.0

search_stress2	03_06	sicstus	0	C	0.0
		gecode	0	C	0.0
		g12_fd	0	C	0.0
		g12_lazyfd	0	S	100.0

search_stress2	04_05	sicstus	0	C	0.0
		gecode	0	C	0.0
		g12_fd	0	C	0.0
		g12_lazyfd	0	S	100.0

search_stress2	04_06	sicstus	1	C	0.0
		gecode	0	C	0.0
		g12_fd	1	C	0.0
		g12_lazyfd	0	S	100.0

search_stress2	05_05	sicstus	0	SC	25.0
		gecode	0	SC	25.0
		g12_fd	0	SC	25.0
		g12_lazyfd	0	SC	25.0

search_stress2	05_06	sicstus	0	SC	31.5
		gecode	0	SC	31.5
		g12_fd	7	SC	14.9
		g12_lazyfd	1	SC	22.0

search_stress2	06_04	sicstus	5	C	0.0
		gecode	2	C	0.0
		g12_fd	0	C	0.0
		g12_lazyfd	0	S	100.0

search_stress2	06_05	sicstus	900		0.0
		gecode	590	C	0.0
		g12_fd	6	C	0.0
		g12_lazyfd	0	S	100.0

search_stress2	06_06	sicstus	900		0.0
		gecode	900		0.0
		g12_fd	790	C	0.0
		g12_lazyfd	0	S	-BAD-

search_stress2	07_02	sicstus	0	SC	25.0
		gecode	0	SC	25.0
		g12_fd	0	SC	25.0
		g12_lazyfd	0	SC	25.0

still_life	still_life_5	sicstus	0	SCB	25.0
		gecode	0	SCB	25.0
		g12_fd	0	SCB	25.0
		g12_lazyfd	0	SCB	25.0

still_life	still_life_6	sicstus	1		0.0
		gecode	0	SCB	46.2
		g12_fd	0	SCB	46.2
		g12_lazyfd	5	SCB	7.7

still_life	still_life_7	sicstus	5	SCB	28.1
		gecode	2	SCB	56.2
		g12_fd	10	SCB	15.3
		g12_lazyfd	395	SCB	0.4

still_life	still_life_9	sicstus	900		0.0
		gecode	900	SB	100.0
		g12_fd	900	S	0.0
		g12_lazyfd	900	S	0.0

vrp	A-n34-k5.vrp	sicstus	900	S	0.0
		gecode	900	S	28.2
		g12_fd	900	S	26.7
		g12_lazyfd	900	SB	45.1

vrp	A-n44-k7.vrp	sicstus	900	S	0.0
		gecode	900	S	28.5
		g12_fd	900	S	26.6
		g12_lazyfd	900	SB	44.9

vrp	A-n55-k9.vrp	sicstus	900	S	0.0
		gecode	900	S	29.3
		g12_fd	900	S	26.3
		g12_lazyfd	900	SB	44.4

vrp	A-n65-k9.vrp	sicstus	900	S	20.3
		gecode	900	S	21.2
		g12_fd	900	S	22.9
		g12_lazyfd	900	SB	35.6

vrp	B-n39-k5.vrp	sicstus	900	S	0.0
		gecode	900	S	26.6
		g12_fd	900	S	28.6
		g12_lazyfd	900	SB	44.8

vrp	B-n50-k8.vrp	sicstus	900	S	0.0
		gecode	900	S	37.9
		g12_fd	900	SB	38.6
		g12_lazyfd	900	S	23.5

vrp	B-n64-k9.vrp	sicstus	900	S	24.3
		gecode	900	SB	29.6
		g12_fd	900	S	28.9
		g12_lazyfd	900	S	17.3

vrp	P-n19-k2.vrp	sicstus	900	S	20.1
		gecode	900	S	25.5
		g12_fd	900	S	19.8
		g12_lazyfd	900	SB	34.6

vrp	P-n45-k5.vrp	sicstus	900	S	0.0
		gecode	900	SB	41.3
		g12_fd	900	S	33.9
		g12_lazyfd	900	S	24.8

vrp	P-n55-k7.vrp	sicstus	900	S	0.0
		gecode	900	S	27.2
		g12_fd	900	S	27.1
		g12_lazyfd	900	SB	45.8

parallel_search

Problem	Instance	Solver	Time (s)	SCB

black-hole	01	gecode	0	S
		[non-par.]	1

black-hole	03	gecode	0	S
		[non-par.]	0

black-hole	05	gecode	1	S
		[non-par.]	1

black-hole	07	gecode	0	S
		[non-par.]	0

black-hole	09	gecode	21	S
		[non-par.]	33

black-hole	11	gecode	453
		[non-par.]	900

black-hole	13	gecode	1	S
		[non-par.]	0

black-hole	15	gecode	457
		[non-par.]	900

black-hole	17	gecode	0	SC
		[non-par.]	0

black-hole	19	gecode	463
		[non-par.]	900

fillomino	08	gecode	2	S
		[non-par.]	3

fillomino	11	gecode	4	S
		[non-par.]	17

fillomino	13	gecode	9	S
		[non-par.]	74

fillomino	14	gecode	188	S
		[non-par.]	485

fillomino	15	gecode	2	S
		[non-par.]	7

fillomino	16	gecode	12	S
		[non-par.]	23

fillomino	17	gecode	3	S
		[non-par.]	10

fillomino	18	gecode	17	S
		[non-par.]	32

fillomino	20	gecode	5	S
		[non-par.]	6

fillomino	21	gecode	33	S
		[non-par.]	61

nonogram	non_awful_2	gecode	3	S
		[non-par.]	900

nonogram	non_awful_4	gecode	6	S
		[non-par.]	900

nonogram	non_fast_1	gecode	4	S
		[non-par.]	4

nonogram	non_fast_10	gecode	6	S
		[non-par.]	24

nonogram	non_fast_11	gecode	4	S
		[non-par.]	6

nonogram	non_fast_5	gecode	6	S
		[non-par.]	41

nonogram	non_fast_7	gecode	3	S
		[non-par.]	150

nonogram	non_fast_9	gecode	16	S
		[non-par.]	30

nonogram	non_med_2	gecode	273	S
		[non-par.]	297

nonogram	non_med_4	gecode	7	S
		[non-par.]	225

open_stacks	gp50by50_1	gecode	165	SCB
		[non-par.]	184

open_stacks	nrwsLarger4_1	gecode	452	SB
		[non-par.]	900

open_stacks	problem_15_15_1	gecode	121	SCB
		[non-par.]	227

open_stacks	problem_20_10_1	gecode	0	SCB
		[non-par.]	1

open_stacks	wbo_15_30_1	gecode	14	SCB
		[non-par.]	21

open_stacks	wbo_30_15_1	gecode	2	SCB
		[non-par.]	2

open_stacks	wbo_30_30_1	gecode	456	SB
		[non-par.]	900

open_stacks	wbop_20_10_1	gecode	0	SCB
		[non-par.]	1

open_stacks	wbp_20_10_1	gecode	1	SCB
		[non-par.]	0

open_stacks	wbp_30_10_1	gecode	1	SCB
		[non-par.]	2

p1f	03	gecode	0	SC
		[non-par.]	0

p1f	04	gecode	0	SCB
		[non-par.]	0

p1f	05	gecode	0	SC
		[non-par.]	0

p1f	06	gecode	0	SCB
		[non-par.]	0

p1f	07	gecode	0	SC
		[non-par.]	0

p1f	08	gecode	0	SCB
		[non-par.]	0

p1f	09	gecode	0	SC
		[non-par.]	0

p1f	10	gecode	11	SCB
		[non-par.]	10

p1f	11	gecode	1	SC
		[non-par.]	1

p1f	12	gecode	459	SB
		[non-par.]	900

prop_stress	0100	gecode	3	SC
		[non-par.]	3

prop_stress	0200	gecode	59	SC
		[non-par.]	60

prop_stress	0300	gecode	506	SC
		[non-par.]	489

prop_stress	0400	gecode	900
		[non-par.]	900

prop_stress	0500	gecode	900
		[non-par.]	900

prop_stress	0600	gecode	900
		[non-par.]	900

prop_stress	0700	gecode	900
		[non-par.]	900

prop_stress	0800	gecode	900
		[non-par.]	900

prop_stress	0900	gecode	900
		[non-par.]	900

prop_stress	1000	gecode	900
		[non-par.]	900

rectangle-packing	rpp05_true	gecode	0	S
		[non-par.]	0

rectangle-packing	rpp09_false	gecode	0	S
		[non-par.]	0

rectangle-packing	rpp12_true	gecode	0	S
		[non-par.]	0

rectangle-packing	rpp14_false	gecode	0	S
		[non-par.]	1

rectangle-packing	rpp15_true	gecode	2	S
		[non-par.]	1

rectangle-packing	rpp19_false	gecode	178	S
		[non-par.]	280

rectangle-packing	rpp22_true	gecode	459
		[non-par.]	900

rectangle-packing	rpp24_false	gecode	452
		[non-par.]	900

rectangle-packing	rpp26_true	gecode	452
		[non-par.]	900

rectangle-packing	rpp30_false	gecode	453
		[non-par.]	900

roster	chicroster_dataset_11	gecode	1	SCB
		[non-par.]	1

roster	chicroster_dataset_14	gecode	0	SCB
		[non-par.]	0

roster	chicroster_dataset_17	gecode	1	SCB
		[non-par.]	1

roster	chicroster_dataset_3	gecode	0	SCB
		[non-par.]	0

roster	chicroster_dataset_5	gecode	0	SCB
		[non-par.]	0

roster	chicroster_dataset_7	gecode	1	SCB
		[non-par.]	1

roster	chicroster_dataset_8	gecode	2	SCB
		[non-par.]	2

roster	chicroster_dataset_large_13	gecode	459	SB
		[non-par.]	900

roster	chicroster_dataset_large_15	gecode	452
		[non-par.]	900

roster	chicroster_dataset_large_19	gecode	453	SB
		[non-par.]	900

still_life	still_life_5	gecode	0	SCB
		[non-par.]	0

still_life	still_life_6	gecode	0	SCB
		[non-par.]	0

still_life	still_life_7	gecode	1	SCB
		[non-par.]	2

still_life	still_life_9	gecode	452	SB
		[non-par.]	900

vrp	A-n34-k5.vrp	gecode	712	SB
		[non-par.]	900

vrp	A-n44-k7.vrp	gecode	803	SB
		[non-par.]	900

vrp	A-n55-k9.vrp	gecode	870	SB
		[non-par.]	900

vrp	A-n65-k9.vrp	gecode	454	SB
		[non-par.]	900

vrp	B-n39-k5.vrp	gecode	480	SB
		[non-par.]	900

vrp	B-n50-k8.vrp	gecode	457	SB
		[non-par.]	900

vrp	B-n64-k9.vrp	gecode	458	SB
		[non-par.]	900

vrp	P-n19-k2.vrp	gecode	477	SB
		[non-par.]	900

vrp	P-n45-k5.vrp	gecode	781	SB
		[non-par.]	900

vrp	P-n55-k7.vrp	gecode	464	SB
		[non-par.]	900

Erroneous Results

g12_lazyfd could not run fillomino, p1f, or open_stacks because these models contain unbounded variables.

g12_lazyfd incorrectly reports solutions for search_stress2 problems 06_06, 07_07, 08_08, 10_10, 11_11, 12_12, 14_14, and 15_15.

sicstus incorrectly reports unsatisfiability for black-hole problems, except for 17 which is unsatisfiable.

eclipse_ic incorrectly reports unsatisfiability for roster.

Global constraints used in each model

The following table lists the global constraints used by each model in this year's challenge.

Model	Global constraints used
black-hole	inverse, table
fillomino
nonogram	regular
open-stacks	all_different
p1f	all_different, inverse, lex_less
prop_stress
rectangle-packing	cumulative
roster	at_least, at_most, exactly
search_stress2
still-life
vrp

Builtin global constraints per FlatZinc solver

The following table lists the global constraints that are provided as builtins by each solver.

Solver	Builtin global constraints
ECLiPSe/IC	all_different, all_disjoint, at_least, at_most, count, cumulative, disjoint, exactly, link_set_to_booleans, maximum, sort
G12/FD	all_different, cumulative
G12/LazyFD	all_different
Gecode	all_different, among, at_least, at_most, count, cumulative, disjoint, distribute, exactly, increasing, inverse, lex_lesseq, lex_less, maximum, minimum, nvalue, partition_set, regular, sort, sum_pred, table
SICStus	all_different, at_least, at_most, cumulative, exactly, global_cardinality, inverse, lex_lesseq, lex_less, maximum, nvalue, sort table

The files on this page are for MiniZinc version 1.0.

Versions of these files for the current version of MiniZinc are available as part of the G12 MiniZinc distribution.