Benchmark Results
The following results were obtained by the solver detailed in Standalone Solver. To refer each detail benchmark result, click the number in the No. column for each record.
v2.3.0
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | May 5, 2024 | v2.3.0 | 600sec(*) | Benchmark Set (89 instances) |
Ubuntu 22.04 | g++11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | May 5, 2024 | v2.3.0 | 600sec | Collection Set (58 "open" instances(**)) |
Ubuntu 22.04 | g++ 11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
(*) The number of open instances was reduced because open instances pb-market-split8-70-4 and sorrell4 were solved (the difficulty of the instance moves to "hard").
(**) From this version, computational time includes the time to read the MPS file.
v2.2.0 and v2.2.1
Please refer to Tabu Search-Based Heuristic Solver for General Integer Linear Programming Problems for numerical experimental results for v2.2.1; v2.2.0 and v2.2.1 have little algorithmic difference.
v2.1.2
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Jan. 15, 2023 | v2.1.2 | 600sec | Benchmark Set (89 instances) |
Ubuntu 22.04 | g++11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Jan. 15, 2023 | v2.1.2 | 600sec | Collection Set (60 "open" instances) |
Ubuntu 22.04 | g++ 11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Jan. 15, 2023 | v2.1.2 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 22.04 | g++11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Jan. 15, 2023 | v2.1.2 | 3600sec | Collection Set (60 "open" instances) |
Ubuntu 22.04 | g++ 11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v2.1.1
Few algorithmic changes from v2.1.0.
v2.1.0
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Oct. 6, 2022 | v2.1.0 | 600sec | Benchmark Set (89 instances) |
Ubuntu 22.04 | g++11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Oct. 6, 2022 | v2.1.0 | 600sec | Collection Set (60 "open" instances) |
Ubuntu 22.04 | g++ 11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Oct. 6, 2022 | v2.1.0 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 22.04 | g++11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Oct. 6, 2022 | v2.1.0 | 3600sec | Collection Set (60 "open" instances) |
Ubuntu 22.04 | g++ 11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v2.0.0
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Sep. 3, 2022 | v2.0.0 | 600sec | Benchmark Set (89 instances) |
Ubuntu 22.04 | g++11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Sep. 3, 2022 | v2.0.0 | 600sec | Collection Set (60 "open" instances) |
Ubuntu 22.04 | g++ 11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Sep. 21, 2022 | v2.0.0 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 22.04 | g++11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Sep. 21, 2022 | v2.0.0 | 3600sec | Collection Set (60 "open" instances) |
Ubuntu 22.04 | g++ 11.2.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v1.7.0
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Apr. 21, 2022 | v1.7.0 | 600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Apr. 21, 2022 | v1.7.0 | 600sec | Collection Set (60 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Apr. 21, 2022 | v1.7.0 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Apr. 21, 2022 | v1.7.0 | 3600sec | Collection Set (60 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v1.6.7
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Mar. 5, 2022 | v1.6.7 | 600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Mar. 5, 2022 | v1.6.7 | 600sec | Collection Set (61 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Mar. 5, 2022 | v1.6.7 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Mar. 5, 2022 | v1.6.7 | 3600sec | Collection Set (61 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v1.6.6
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Nov. 6, 2021 | v1.6.6 | 600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Nov. 6, 2021 | v1.6.6 | 600sec | Collection Set (61 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Nov. 6, 2021 | v1.6.6 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Nov. 6, 2021 | v1.6.6 | 3600sec | Collection Set (61 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v1.6.5
No algorithmic changes from v1.6.4.
v1.6.4
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Aug. 17, 2021 | v1.6.4 | 600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Aug. 17, 2021 | v1.6.4 | 600sec | Collection Set (61 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Aug. 28, 2021 | v1.6.4 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Aug. 28, 2021 | v1.6.4 | 3600sec | Collection Set (61 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v1.6.3
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Jun. 29, 2021 | v1.6.3 | 600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Jun. 29, 2021 | v1.6.3 | 600sec | Collection Set (61 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Jul. 4, 2021 | v1.6.3 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Jul. 4, 2021 | v1.6.3 | 3600sec | Collection Set (61 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v1.6.2
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | May 25, 2021 | v1.6.2 | 600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | May 25, 2021 | v1.6.2 | 600sec | Collection Set (63 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | May 25, 2021 | v1.6.2 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | May 25, 2021 | v1.6.2 | 3600sec | Collection Set (61 "open" instances(*)) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
(*) The number of open instances was reduced because open instances v150d30-2hopcds and neos-3237086-abava were solved (the difficulty of the instance moves to "hard").
v1.6.1
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | May 8, 2021 | v1.6.1 | 600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | May 8, 2021 | v1.6.1 | 600sec | Collection Set (63 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | May 15, 2021 | v1.6.1 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | May 15, 2021 | v1.6.1 | 3600sec | Collection Set (63 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v1.6.0
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Apr. 21, 2021 | v1.6.0 | 600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Apr. 21, 2021 | v1.6.0 | 600sec | Collection Set (63 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Apr. 29, 2021 | v1.6.0 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Apr. 29, 2021 | v1.6.0 | 3600sec | Collection Set (63 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v1.5.3
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Mar. 6, 2021 | v1.5.3 | 600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Mar. 6, 2021 | v1.5.3 | 600sec | Collection Set (63 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Mar. 11, 2021 | v1.5.3 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Mar. 11, 2021 | v1.5.3 | 3600sec | Collection Set (63 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v1.5.2
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Jan. 24, 2021 | v1.5.2 | 600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Jan. 24, 2021 | v1.5.2 | 600sec | Collection Set (63 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Feb. 1, 2021 | v1.5.2 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Feb. 1, 2021 | v1.5.2 | 3600sec | Collection Set (63 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
v1.5.1
| No. | Last Updated | Version | Computational Time | Instances | Operating System | Compiler | CPU | RAM |
|---|---|---|---|---|---|---|---|---|
| 1 | Nov. 30, 2020 | v1.5.1 | 600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 2 | Dec. 3, 2020 | v1.5.1 | 600sec | Collection Set (63 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 3 | Dec. 16, 2020 | v1.5.1 | 3600sec | Benchmark Set (89 instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |
| 4 | Dec. 16, 2020 | v1.5.1 | 3600sec | Collection Set (63 "open" instances) |
Ubuntu 18.04 | g++ 7.5.0 | Intel(R) Xeon(R) CPU E3-1270 v5 @ 3.60GHz | 16GB |