CPLEX crashed after solving a problem when using the drop command of AMPL
154 views
Skip to first unread message
Tiancivalen
May 15, 2016, 11:10:32 PM5/15/16
to AMPL Modeling Language
Hi all,
I used the fix and drop command to dynamically change the model in an iterative solving process.
If I just use the fix command, it will be all right, but the running time will be very long. So, I then tried to use the drop command to reduce the size of the problem instance for each iteration. However, when the drop command is used, CPLEX will crash unexpectedly usually after solving some problem instance, the error code is 3221225477. The output of CPLEX just before crash is like follwing:
CPLEX 12.6.3.0: mipdisplay=2
integrality=1e-07
absmipgap=0
mipgap=0
MIP Presolve eliminated 944 rows and 497 columns.
MIP Presolve modified 13169 coefficients.
Reduced MIP has 7305 rows, 12262 columns, and 69279 nonzeros.
Reduced MIP has 12120 binaries, 66 generals, 0 SOSs, and 20945 indicators.
Probing fixed 11400 vars, tightened 97 bounds.
Probing time = 0.75 sec. (262.33 ticks)
Cover probing fixed 3 vars, tightened 709 bounds.
MIP Presolve eliminated 7108 rows and 12077 columns.
MIP Presolve modified 114 coefficients.
Reduced MIP has 176 rows, 145 columns, and 836 nonzeros.
Reduced MIP has 119 binaries, 11 generals, 0 SOSs, and 310 indicators.
Probing fixed 0 vars, tightened 10 bounds.
Probing changed sense of 2 constraints.
Probing time = 0.02 sec. (2.81 ticks)
Cover probing fixed 0 vars, tightened 11 bounds.
MIP Presolve eliminated 9 rows and 2 columns.
MIP Presolve modified 16 coefficients.
Reduced MIP has 167 rows, 143 columns, and 817 nonzeros.
Reduced MIP has 117 binaries, 11 generals, 0 SOSs, and 310 indicators.
Probing fixed 0 vars, tightened 1 bounds.
Probing time = 0.00 sec. (2.65 ticks)
Cover probing fixed 0 vars, tightened 4 bounds.
Clique table members: 3469.
MIP emphasis: balance optimality and feasibility.
MIP search method: dynamic search.
Parallel mode: deterministic, using up to 8 threads.
Root relaxation solution time = 0.00 sec. (0.81 ticks)
Nodes Cuts/
Node Left Objective IInf Best Integer Best Bound ItCnt Gap
* 0+ 0 205885.9988 203468.9982 1.17%
0 0 204017.4535 9 205885.9988 204017.4535 88 0.91%
* 0+ 0 204025.9988 204017.4535 0.00%
0 0 cutoff 204025.9988 204025.9988 94 0.00%
Elapsed time = 3.89 sec. (2462.41 ticks, tree = 0.01 MB)
Clique cuts applied: 7
Implied bound cuts applied: 8
Mixed integer rounding cuts applied: 2
Lift and project cuts applied: 1
Gomory fractional cuts applied: 1
Root node processing (before b&c):
Real time = 3.89 sec. (2462.58 ticks)
Parallel b&c, 8 threads:
Real time = 0.00 sec. (0.00 ticks)
Sync time (average) = 0.00 sec.
Wait time (average) = 0.00 sec.
------------
Total (root+branch&cut) = 3.89 sec. (2462.58 ticks)
CPLEX 12.6.3.0: optimal integer solution; objective 204025.9988
94 MIP simplex iterations
0 branch-and-bound nodes
No basis.
>Exit code: 3221225477
Could any one explain why?
Besides, I've tried the version of CPLEX from 12.5.1 to12.6.3, but such crashes always occur. It seems that something weird happened when using the drop command that made CPLEX failed to clean up the memory in its normal way. But how to overcome such a problem?
Thanks a lot for anyone who can help.
Regards,
Tianci
I used the fix and drop command to dynamically change the model in an iterative solving process.
If I just use the fix command, it will be all right, but the running time will be very long. So, I then tried to use the drop command to reduce the size of the problem instance for each iteration. However, when the drop command is used, CPLEX will crash unexpectedly usually after solving some problem instance, the error code is 3221225477. The output of CPLEX just before crash is like follwing:
CPLEX 12.6.3.0: mipdisplay=2
integrality=1e-07
absmipgap=0
mipgap=0
MIP Presolve eliminated 944 rows and 497 columns.
MIP Presolve modified 13169 coefficients.
Reduced MIP has 7305 rows, 12262 columns, and 69279 nonzeros.
Reduced MIP has 12120 binaries, 66 generals, 0 SOSs, and 20945 indicators.
Probing fixed 11400 vars, tightened 97 bounds.
Probing time = 0.75 sec. (262.33 ticks)
Cover probing fixed 3 vars, tightened 709 bounds.
MIP Presolve eliminated 7108 rows and 12077 columns.
MIP Presolve modified 114 coefficients.
Reduced MIP has 176 rows, 145 columns, and 836 nonzeros.
Reduced MIP has 119 binaries, 11 generals, 0 SOSs, and 310 indicators.
Probing fixed 0 vars, tightened 10 bounds.
Probing changed sense of 2 constraints.
Probing time = 0.02 sec. (2.81 ticks)
Cover probing fixed 0 vars, tightened 11 bounds.
MIP Presolve eliminated 9 rows and 2 columns.
MIP Presolve modified 16 coefficients.
Reduced MIP has 167 rows, 143 columns, and 817 nonzeros.
Reduced MIP has 117 binaries, 11 generals, 0 SOSs, and 310 indicators.
Probing fixed 0 vars, tightened 1 bounds.
Probing time = 0.00 sec. (2.65 ticks)
Cover probing fixed 0 vars, tightened 4 bounds.
Clique table members: 3469.
MIP emphasis: balance optimality and feasibility.
MIP search method: dynamic search.
Parallel mode: deterministic, using up to 8 threads.
Root relaxation solution time = 0.00 sec. (0.81 ticks)
Nodes Cuts/
Node Left Objective IInf Best Integer Best Bound ItCnt Gap
* 0+ 0 205885.9988 203468.9982 1.17%
0 0 204017.4535 9 205885.9988 204017.4535 88 0.91%
* 0+ 0 204025.9988 204017.4535 0.00%
0 0 cutoff 204025.9988 204025.9988 94 0.00%
Elapsed time = 3.89 sec. (2462.41 ticks, tree = 0.01 MB)
Clique cuts applied: 7
Implied bound cuts applied: 8
Mixed integer rounding cuts applied: 2
Lift and project cuts applied: 1
Gomory fractional cuts applied: 1
Root node processing (before b&c):
Real time = 3.89 sec. (2462.58 ticks)
Parallel b&c, 8 threads:
Real time = 0.00 sec. (0.00 ticks)
Sync time (average) = 0.00 sec.
Wait time (average) = 0.00 sec.
------------
Total (root+branch&cut) = 3.89 sec. (2462.58 ticks)
CPLEX 12.6.3.0: optimal integer solution; objective 204025.9988
94 MIP simplex iterations
0 branch-and-bound nodes
No basis.
>Exit code: 3221225477
Could any one explain why?
Besides, I've tried the version of CPLEX from 12.5.1 to12.6.3, but such crashes always occur. It seems that something weird happened when using the drop command that made CPLEX failed to clean up the memory in its normal way. But how to overcome such a problem?
Thanks a lot for anyone who can help.
Regards,
Tianci
Robert Fourer
May 16, 2016, 11:34:50 AM5/16/16
to am...@googlegroups.com
This error seems to be due to a bug of some sort, perhaps in the AMPL-CPLEX interface, or perhaps in the AMPL processing of the solution. Can you post some files that would enable us to reproduce the error? Once we can get the error to occur on our computers, we can determine the cause and fix it.
Bob Fourer
am...@googlegroups.com
=======
Bob Fourer
am...@googlegroups.com
=======
Tiancivalen
May 21, 2016, 11:07:42 PM5/21/16
to AMPL Modeling Language, 4...@ampl.com
Hi Bob,
I have attatched the related files which produce the crash.
On my computer, the crash occurs after printing the following output message:
.............
.............
.............
------- GROUP 5: PHASE II: OPTIMIZATION ITERATION #1 --------
FINDING NEW CONFLICT TUPLES ... OK
nAdded = 12
set Conf :=
(28,29,43) (28,30,29) (29,31,33) (30,32,12) (31,32,11) (27,29,12)
(28,29,44) (29,30,32) (30,31,44) (30,32,15) (31,32,42) (27,29,15);
CPLEX 12.6.3.0: mipdisplay=2
integrality=1e-08
absmipgap=0
mipgap=0
Reduced MIP has 21553 rows, 26219 columns, and 127828 nonzeros.
Reduced MIP has 21372 binaries, 78 generals, 0 SOSs, and 33862 indicators.
Retaining values of one MIP start for possible repair.
MIP Presolve eliminated 3079 rows and 2874 columns.
MIP Presolve modified 17151 coefficients.
Reduced MIP has 17754 rows, 21259 columns, and 122597 nonzeros.
Reduced MIP has 18305 binaries, 78 generals, 0 SOSs, and 29059 indicators.
Probing fixed 15749 vars, tightened 2033 bounds.
Probing changed sense of 63 constraints.
Probing time = 4.02 sec. (1053.16 ticks)
Cover probing fixed 1 vars, tightened 4017 bounds.
MIP Presolve eliminated 15620 rows and 19288 columns.
MIP Presolve modified 2279 coefficients.
Reduced MIP has 1847 rows, 1553 columns, and 8419 nonzeros.
Reduced MIP has 1218 binaries, 73 generals, 0 SOSs, and 2294 indicators.
Probing fixed 27 vars, tightened 193 bounds.
Probing changed sense of 6 constraints.
Probing time = 0.13 sec. (70.85 ticks)
Cover probing fixed 0 vars, tightened 209 bounds.
MIP Presolve eliminated 84 rows and 55 columns.
MIP Presolve modified 1100 coefficients.
Reduced MIP has 1763 rows, 1496 columns, and 8130 nonzeros.
Reduced MIP has 1165 binaries, 69 generals, 0 SOSs, and 2236 indicators.
Probing fixed 0 vars, tightened 9 bounds.
Probing time = 0.03 sec. (23.68 ticks)
Clique table members: 38487.
I have attatched the related files which produce the crash.
On my computer, the crash occurs after printing the following output message:
.............
.............
.............
------- GROUP 5: PHASE II: OPTIMIZATION ITERATION #1 --------
FINDING NEW CONFLICT TUPLES ... OK
nAdded = 12
set Conf :=
(28,29,43) (28,30,29) (29,31,33) (30,32,12) (31,32,11) (27,29,12)
(28,29,44) (29,30,32) (30,31,44) (30,32,15) (31,32,42) (27,29,15);
CPLEX 12.6.3.0: mipdisplay=2
integrality=1e-08
absmipgap=0
mipgap=0
Reduced MIP has 21553 rows, 26219 columns, and 127828 nonzeros.
Reduced MIP has 21372 binaries, 78 generals, 0 SOSs, and 33862 indicators.
Retaining values of one MIP start for possible repair.
MIP Presolve eliminated 3079 rows and 2874 columns.
MIP Presolve modified 17151 coefficients.
Reduced MIP has 17754 rows, 21259 columns, and 122597 nonzeros.
Reduced MIP has 18305 binaries, 78 generals, 0 SOSs, and 29059 indicators.
Probing fixed 15749 vars, tightened 2033 bounds.
Probing changed sense of 63 constraints.
Probing time = 4.02 sec. (1053.16 ticks)
Cover probing fixed 1 vars, tightened 4017 bounds.
MIP Presolve eliminated 15620 rows and 19288 columns.
MIP Presolve modified 2279 coefficients.
Reduced MIP has 1847 rows, 1553 columns, and 8419 nonzeros.
Reduced MIP has 1218 binaries, 73 generals, 0 SOSs, and 2294 indicators.
Probing fixed 27 vars, tightened 193 bounds.
Probing changed sense of 6 constraints.
Probing time = 0.13 sec. (70.85 ticks)
Cover probing fixed 0 vars, tightened 209 bounds.
MIP Presolve eliminated 84 rows and 55 columns.
MIP Presolve modified 1100 coefficients.
Reduced MIP has 1763 rows, 1496 columns, and 8130 nonzeros.
Reduced MIP has 1165 binaries, 69 generals, 0 SOSs, and 2236 indicators.
Probing fixed 0 vars, tightened 9 bounds.
Probing time = 0.03 sec. (23.68 ticks)
Clique table members: 38487.
MIP emphasis: balance optimality and feasibility.
MIP search method: dynamic search.
Parallel mode: deterministic, using up to 8 threads.
Root relaxation solution time = 0.06 sec. (19.35 ticks)
Nodes Cuts/
Node Left Objective IInf Best Integer Best Bound ItCnt Gap
0 0 190413.5709 45 190413.5709 802
* 0+ 0 190540.9994 190413.5709 0.07%
0 0 190523.0000 17 190540.9994 Cuts: 117 913 0.01%
0 0 190523.0000 5 190540.9994 Cuts: 10 924 0.01%
* 0+ 0 190540.9988 190523.0000 0.01%
Repair heuristic found nothing.
Repeating presolve.
MIP Presolve eliminated 1496 rows and 1235 columns.
MIP Presolve modified 780 coefficients.
Reduced MIP has 220 rows, 173 columns, and 764 nonzeros.
Reduced MIP has 98 binaries, 20 generals, 0 SOSs, and 232 indicators.
Probing fixed 16 vars, tightened 116 bounds.
Probing changed sense of 10 constraints.
Probing time = 0.00 sec. (1.23 ticks)
Cover probing fixed 0 vars, tightened 97 bounds.
MIP Presolve eliminated 64 rows and 39 columns.
MIP Presolve modified 164 coefficients.
Reduced MIP has 191 rows, 133 columns, and 629 nonzeros.
Reduced MIP has 66 binaries, 13 generals, 0 SOSs, and 148 indicators.
Probing fixed 0 vars, tightened 28 bounds.
Probing changed sense of 1 constraints.
Probing time = 0.00 sec. (0.65 ticks)
Cover probing fixed 0 vars, tightened 24 bounds.
MIP Presolve eliminated 23 rows and 5 columns.
MIP Presolve modified 77 coefficients.
Reduced MIP has 168 rows, 128 columns, and 580 nonzeros.
Reduced MIP has 61 binaries, 13 generals, 0 SOSs, and 148 indicators.
Probing fixed 0 vars, tightened 14 bounds.
Probing time = 0.00 sec. (0.56 ticks)
Cover probing fixed 0 vars, tightened 6 bounds.
MIP Presolve modified 38 coefficients.
Reduced MIP has 168 rows, 128 columns, and 580 nonzeros.
Reduced MIP has 61 binaries, 13 generals, 0 SOSs, and 148 indicators.
Represolve time = 0.02 sec. (17.50 ticks)
Probing fixed 0 vars, tightened 13 bounds.
Probing time = 0.02 sec. (0.56 ticks)
Cover probing fixed 0 vars, tightened 67 bounds.
Clique table members: 420.
* 0+ 0 190540.9994 190413.5709 0.07%
0 0 190523.0000 17 190540.9994 Cuts: 117 913 0.01%
0 0 190523.0000 5 190540.9994 Cuts: 10 924 0.01%
* 0+ 0 190540.9988 190523.0000 0.01%
Repair heuristic found nothing.
Repeating presolve.
MIP Presolve eliminated 1496 rows and 1235 columns.
MIP Presolve modified 780 coefficients.
Reduced MIP has 220 rows, 173 columns, and 764 nonzeros.
Reduced MIP has 98 binaries, 20 generals, 0 SOSs, and 232 indicators.
Probing fixed 16 vars, tightened 116 bounds.
Probing changed sense of 10 constraints.
Probing time = 0.00 sec. (1.23 ticks)
Cover probing fixed 0 vars, tightened 97 bounds.
MIP Presolve eliminated 64 rows and 39 columns.
MIP Presolve modified 164 coefficients.
Reduced MIP has 191 rows, 133 columns, and 629 nonzeros.
Reduced MIP has 66 binaries, 13 generals, 0 SOSs, and 148 indicators.
Probing fixed 0 vars, tightened 28 bounds.
Probing changed sense of 1 constraints.
Probing time = 0.00 sec. (0.65 ticks)
Cover probing fixed 0 vars, tightened 24 bounds.
MIP Presolve eliminated 23 rows and 5 columns.
MIP Presolve modified 77 coefficients.
Reduced MIP has 168 rows, 128 columns, and 580 nonzeros.
Reduced MIP has 61 binaries, 13 generals, 0 SOSs, and 148 indicators.
Probing fixed 0 vars, tightened 14 bounds.
Probing time = 0.00 sec. (0.56 ticks)
Cover probing fixed 0 vars, tightened 6 bounds.
MIP Presolve modified 38 coefficients.
Reduced MIP has 168 rows, 128 columns, and 580 nonzeros.
Reduced MIP has 61 binaries, 13 generals, 0 SOSs, and 148 indicators.
Represolve time = 0.02 sec. (17.50 ticks)
Probing fixed 0 vars, tightened 13 bounds.
Probing time = 0.02 sec. (0.56 ticks)
Cover probing fixed 0 vars, tightened 67 bounds.
Clique table members: 420.
MIP emphasis: balance optimality and feasibility.
MIP search method: dynamic search.
Parallel mode: deterministic, using up to 8 threads.
Root relaxation solution time = 0.00 sec. (0.53 ticks)
Nodes Cuts/
Node Left Objective IInf Best Integer Best Bound ItCnt Gap
* 0+ 0 190540.9988 190523.0000 0.01%
0 0 190523.0000 6 190540.9988 190523.0000 973 0.01%
* 0 0 integral 0 190531.0000 Cuts: 20 1009 0.00%
0 0 cutoff 190531.0000 190531.0000 1009 0.00%
Elapsed time = 6.75 sec. (4410.13 ticks, tree = 0.01 MB)
Clique cuts applied: 16
Cover cuts applied: 1
Implied bound cuts applied: 20
Mixed integer rounding cuts applied: 6
0 0 190523.0000 6 190540.9988 190523.0000 973 0.01%
* 0 0 integral 0 190531.0000 Cuts: 20 1009 0.00%
0 0 cutoff 190531.0000 190531.0000 1009 0.00%
Elapsed time = 6.75 sec. (4410.13 ticks, tree = 0.01 MB)
Clique cuts applied: 16
Cover cuts applied: 1
Implied bound cuts applied: 20
Mixed integer rounding cuts applied: 6
Lift and project cuts applied: 1
Gomory fractional cuts applied: 4
Root node processing (before b&c):
Real time = 6.75 sec. (4410.48 ticks)
Parallel b&c, 8 threads:
Real time = 0.00 sec. (0.00 ticks)
Sync time (average) = 0.00 sec.
Wait time (average) = 0.00 sec.
------------
Total (root+branch&cut) = 6.75 sec. (4410.48 ticks)
CPLEX 12.6.3.0: optimal integer solution; objective 190531
1009 MIP simplex iterations
CPLEX 12.6.3.0: optimal integer solution; objective 190531
1009 MIP simplex iterations
0 branch-and-bound nodes
No basis.
>Exit code: 3221225477
By the way, I have used the latest AMPL download to run the code.
Regards,
Tianci
在 2016年5月16日星期一 UTC+8下午11:34:50，Robert Fourer写道：
Tiancivalen
May 22, 2016, 1:19:22 AM5/22/16
to AMPL Modeling Language, 4...@ampl.com
Hi Bob,
I found more data that cause crash. They are attached below.
Just change the following colored text in the .run file to the data folder name to use the new data:
data '30_4/zone_Disrupt.dat';
data '30_4/zone_Flight.dat';
data '30_4/zone_Step.dat';
data '30_4/zone_OldPlan.dat';
Best regards,
Tianci
在 2016年5月22日星期日 UTC+8上午11:07:42，Tiancivalen写道：
I found more data that cause crash. They are attached below.
Just change the following colored text in the .run file to the data folder name to use the new data:
data '30_4/zone_Disrupt.dat';
data '30_4/zone_Flight.dat';
data '30_4/zone_Step.dat';
data '30_4/zone_OldPlan.dat';
Best regards,
Tianci
在 2016年5月22日星期日 UTC+8上午11:07:42，Tiancivalen写道：
Robert Fourer
May 27, 2016, 2:28:09 PM5/27/16
to am...@googlegroups.com
We are following up this crash report, and I will post more information after the cause is determined.
Bob Fourer
am...@googlegroups.com
Bob Fourer
am...@googlegroups.com
Robert Fourer
May 31, 2016, 9:26:37 PM5/31/16
to am...@googlegroups.com
We identified a bug that was causing this crash, and we have provided a fix in a new build of AMPL that is now available for download. We tested it out successfully on two of your datasets, 30_4 and 30_6, with the successful results shown in the attached listings.
Bob Fourer
am...@googlegroups.com
=======
From: am...@googlegroups.com [mailto:am...@googlegroups.com] On Behalf Of Tiancivalen
Sent: Saturday, May 21, 2016 10:08 PM
To: AMPL Modeling Language
Cc: 4...@ampl.com
Subject: Re: [AMPL 11991] CPLEX crashed after solving a problem when using the drop command of AMPL
Hi Bob,
I have attatched the related files which produce the crash.
On my computer, the crash occurs after printing the following output message:
...
Bob Fourer
am...@googlegroups.com
=======
From: am...@googlegroups.com [mailto:am...@googlegroups.com] On Behalf Of Tiancivalen
Sent: Saturday, May 21, 2016 10:08 PM
To: AMPL Modeling Language
Cc: 4...@ampl.com
Subject: Re: [AMPL 11991] CPLEX crashed after solving a problem when using the drop command of AMPL
Hi Bob,
I have attatched the related files which produce the crash.
On my computer, the crash occurs after printing the following output message:
...
Reply all
Reply to author
Forward
0 new messages