patrick/tplp-planning-benchmark
1
0
Fork 0
Code Issues Releases Activity
7c77c62ddf
tplp-planning-benchmark/configurations.yml

178 lines
7.1 KiB
YAML
Raw Normal View History

Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
options:
basics: &basics
- "--stats"
- "--verbose"
Print the planner call to the log files In order to inspect what the planner actually executed, this lets the planner print the actual call so that it can be easily reproduced.
2017-11-21 01:57:44 +01:00
- "--print-call"
Set soft memory limit of 8192 MB This sets a soft memory limit of 8192 MB on all configurations. This is a hint to the planners that they shouldn’t surpass this limit. Should planners still consume more memory, there is a 1024 MB tolerance margin (configured in the benchmark runner’s configuration) after which the measurement is counted as a memout. Note that this 8192 MB is the default for Madagascar, which is why this addition doesn’t have an influence on prior results obtained for Madagascar.
2017-11-29 18:06:47 +01:00
- "-m 8192"
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
fastDownwardPreprocessing: &fastDownwardPreprocessing
- "--translate"
plannerSequential: &plannerSequential
- "-A 1"
plannerA: &plannerA
- "-A 16"
plannerB: &plannerB
Make options of planner B explicit
2017-11-19 18:42:23 +01:00
- "-B 0.9"
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
plannerC: &plannerC
- "-C 1.41"
- "-F 5"
# parallel actions *without* checking for mutual disablement
encoding0: &encoding0
- "--parallel=0"
# “forall” parallel actions that can be arranged in any sequence
encoding1: &encoding1
- "--parallel=1"
# “exists” parallel actions that can be arranged in some sequence
encoding2: &encoding2
- "--parallel=2"
# “exists” parallel actions omitting achievement of preconditions
encoding3: &encoding3
- "--parallel=3"
# “exists” parallel actions like 3 implemented by acyclicity
encoding4: &encoding4
- "--parallel=4"
# sequential actions
encodingSequential: &encodingSequential
- "--parallel=5"
shallow: &shallow
- "--shallow"
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
t0: &t0
- "-T 0"
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
heuristics: &heuristics
Use --use-heuristic for proper heuristic encoding Instead of specifying the heuristic encoding manually, this lets the planner define its location. This is to make sure that an incorrect encoding isn’t applied accidentally.
2017-11-21 01:43:45 +01:00
- "--use-heuristic"
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
madagascarM: &madagascarM
- "--madagascar-M"
madagascarMp: &madagascarMp
- "--madagascar-Mp"
madagascarMpC: &madagascarMpC
- "--madagascar-MpC"
Add configurations for generate-and-check planner This adds multiple configuration variations for the generate-and-check planning strategy on the instances where the first found plan is not serializable, with the comparison to Madagascar.
2017-11-27 01:22:46 +01:00
generateAndCheck: &generateAndCheck
- "--test-until-not-sat"
- "--test=0"
testAdd1: &testAdd1
- "--test-add=1"
testAdd3: &testAdd3
- "--test-add=3"
testAdd4: &testAdd4
- "--test-add=4"
testAdd5: &testAdd5
- "--test-add=5"
testAdd7: &testAdd7
- "--test-add=7"
testTimes0: &testTimes0
- "--test-times=0"
testTimes1: &testTimes1
- "--test-times=1"
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
configurations:
- id: "m-m"
options: [*basics, *madagascarM]
Add configurations for generate-and-check planner This adds multiple configuration variations for the generate-and-check planning strategy on the instances where the first found plan is not serializable, with the comparison to Madagascar.
2017-11-27 01:22:46 +01:00
instanceSets: ["lpnmr-easy-instances", "lpnmr-hard-instances", "lpnmr-first-plan-not-serializable"]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
- id: "m-mp"
options: [*basics, *madagascarMp]
Exchange Madagascar configuration This exchanges Madagascar configuration MpC with Mp in the benchmark on Rintanen’s instance set. This is because MpC uses planner C, while our competing configuration uses planner B, which would make the results difficult to compare.
2017-11-28 15:58:57 +01:00
instanceSets: ["lpnmr-easy-instances", "lpnmr-hard-instances", "lpnmr-first-plan-not-serializable", "rintanen-aij-2012"]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
- id: "m-mpc"
options: [*basics, *madagascarMpC]
Exchange Madagascar configuration This exchanges Madagascar configuration MpC with Mp in the benchmark on Rintanen’s instance set. This is because MpC uses planner C, while our competing configuration uses planner B, which would make the results difficult to compare.
2017-11-28 15:58:57 +01:00
instanceSets: ["lpnmr-easy-instances", "lpnmr-hard-instances", "lpnmr-first-plan-not-serializable"]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "fd-ps-e1-sh"
options: [*basics, *fastDownwardPreprocessing, *plannerSequential, *encoding1, *shallow]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
instanceSets: ["lpnmr-hard-instances"]
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "fd-pa-e1-sh"
options: [*basics, *fastDownwardPreprocessing, *plannerA, *encoding1, *shallow]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
instanceSets: ["lpnmr-hard-instances"]
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "fd-pb-e0-sh"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
instanceSets: ["lpnmr-hard-instances"]
Add configuration This adds a variation of one of the best configurations so far with heuristics enabled.
2017-11-27 22:11:16 +01:00
- id: "fd-pb-e0-sh-h"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow, *heuristics]
instanceSets: ["lpnmr-easy-instances", "lpnmr-hard-instances"]
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "fd-pb-e1-sh"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding1, *shallow]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
instanceSets: ["lpnmr-hard-instances"]
- id: "fd-pb-e2"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding2]
instanceSets: ["lpnmr-hard-instances"]
- id: "fd-pb-e3"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding3]
instanceSets: ["lpnmr-hard-instances"]
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "fd-pb-e3-t0"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding3, *t0]
instanceSets: ["lpnmr-hard-instances"]
- id: "fd-pb-e1-sh-h"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding1, *shallow, *heuristics]
instanceSets: ["lpnmr-hard-instances", "lpnmr-easy-instances"]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
- id: "fd-pb-e4"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding4]
instanceSets: ["lpnmr-hard-instances"]
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "fd-pb-es"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encodingSequential]
instanceSets: ["lpnmr-hard-instances"]
- id: "fd-pc-e1-sh"
options: [*basics, *fastDownwardPreprocessing, *plannerC, *encoding1, *shallow]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
instanceSets: ["lpnmr-hard-instances"]
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "ps-e1-sh"
options: [*basics, *plannerSequential, *encoding1, *shallow]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
instanceSets: ["lpnmr-easy-instances"]
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "pa-e1-sh"
options: [*basics, *plannerA, *encoding1, *shallow]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
instanceSets: ["lpnmr-easy-instances"]
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "pb-e0-sh"
options: [*basics, *plannerB, *encoding0, *shallow]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
instanceSets: ["lpnmr-easy-instances"]
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "pb-e1-sh"
options: [*basics, *plannerB, *encoding1, *shallow]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
instanceSets: ["lpnmr-easy-instances"]
- id: "pb-e2"
options: [*basics, *plannerB, *encoding2]
instanceSets: ["lpnmr-easy-instances"]
- id: "pb-e3"
options: [*basics, *plannerB, *encoding3]
instanceSets: ["lpnmr-easy-instances"]
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "pb-e3-t0"
options: [*basics, *plannerB, *encoding3, *t0]
instanceSets: ["lpnmr-easy-instances"]
- id: "pb-e1-sh-h"
options: [*basics, *plannerB, *encoding1, *shallow, *heuristics]
instanceSets: ["lpnmr-easy-instances", "lpnmr-hard-instances"]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
- id: "pb-e4"
options: [*basics, *plannerB, *encoding4]
instanceSets: ["lpnmr-easy-instances"]
Add configurations with --shallow This adds new configurations with --shallow requested by Martin and Javier as well as the missing configurations with the sequential encoding.
2017-11-21 01:23:59 +01:00
- id: "pb-es"
options: [*basics, *plannerB, *encodingSequential]
instanceSets: ["lpnmr-easy-instances"]
- id: "pc-e1-sh"
options: [*basics, *plannerC, *encoding1, *shallow]
Add LPNMR benchmark configurations
2017-11-19 18:03:55 +01:00
instanceSets: ["lpnmr-easy-instances"]
Add configurations for generate-and-check planner This adds multiple configuration variations for the generate-and-check planning strategy on the instances where the first found plan is not serializable, with the comparison to Madagascar.
2017-11-27 01:22:46 +01:00
- id: "gc-ta1-tt0"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow, *heuristics, *generateAndCheck, *testAdd1, *testTimes0]
instanceSets: ["lpnmr-first-plan-not-serializable"]
- id: "gc-ta1-tt1"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow, *heuristics, *generateAndCheck, *testAdd1, *testTimes1]
Add configurations for Rintanen’s instance set This adds Madagascar MpC and the best configuration for the generate- and-test planning strategy to the comparison on Rintanen’s instance set from AIJ 2012.
2017-11-28 00:12:41 +01:00
instanceSets: ["lpnmr-first-plan-not-serializable", "rintanen-aij-2012"]
Add configurations for generate-and-check planner This adds multiple configuration variations for the generate-and-check planning strategy on the instances where the first found plan is not serializable, with the comparison to Madagascar.
2017-11-27 01:22:46 +01:00
- id: "gc-ta3-tt0"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow, *heuristics, *generateAndCheck, *testAdd3, *testTimes0]
instanceSets: ["lpnmr-first-plan-not-serializable"]
- id: "gc-ta3-tt1"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow, *heuristics, *generateAndCheck, *testAdd3, *testTimes1]
instanceSets: ["lpnmr-first-plan-not-serializable"]
- id: "gc-ta4-tt0"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow, *heuristics, *generateAndCheck, *testAdd4, *testTimes0]
instanceSets: ["lpnmr-first-plan-not-serializable"]
- id: "gc-ta4-tt1"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow, *heuristics, *generateAndCheck, *testAdd4, *testTimes1]
instanceSets: ["lpnmr-first-plan-not-serializable"]
- id: "gc-ta5-tt0"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow, *heuristics, *generateAndCheck, *testAdd5, *testTimes0]
instanceSets: ["lpnmr-first-plan-not-serializable"]
- id: "gc-ta5-tt1"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow, *heuristics, *generateAndCheck, *testAdd5, *testTimes1]
instanceSets: ["lpnmr-first-plan-not-serializable"]
- id: "gc-ta7-tt0"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow, *heuristics, *generateAndCheck, *testAdd7, *testTimes0]
instanceSets: ["lpnmr-first-plan-not-serializable"]
- id: "gc-ta7-tt1"
options: [*basics, *fastDownwardPreprocessing, *plannerB, *encoding0, *shallow, *heuristics, *generateAndCheck, *testAdd7, *testTimes1]
instanceSets: ["lpnmr-first-plan-not-serializable"]
Reference in New Issue Copy Permalink