How to read the tables?
Meaning of the model-checker's results| Model-checker on the instrumented program | Observed state in Litmus | Picture |
| VERIFICATION FAILED | YES | ![]() |
| VERIFICATION SUCCESSFUL | NO | ![]() |
Reading the results in the experiments tables
The table below is an excerpt of former results we obtained for x86/podwr experiments.
- In the first column, we can read the name of the original Litmus test (with a link to the file), and the expected violation cycle. The second column gathers the results of the model-checkers for SC. As we are interested in WMM bugs, the verification for SC should be
. - The three next columns concern TSO model. The last column tells which result we should get for this program under TSO, namely
. We see in the third column that Satabs indeed finds the correct result when checking the instrumented program. ESBMC in this example is missing the counterexample. Threader is either returning an error, or killed by timeout (here, it is an error).
- Note that there are two columns for TSO results: in the first one, we instrument all the delays; in the second one, we instrument only one delay per cycle.
- We also experiment under PSO, RMO and Power, and with additional model-checkers: additional columns of results (and expected results) appear after TSO's columns.
| Name | SC | TSO (all delay/cyc) | TSO (1 delay/cyc) | Expected (TSO) | ... |
|
x86/podwr000 Fre PodWR Fre PodWR |
SatAbs: ![]() 0.60sec ESBMC:
0.30secThreader:
7.92sec... |
Cycles SatAbs:
3.94sec (x6.56) ESBMC:
8.34secThreader: ERROR/TIMEOUT[1] 491.99sec ... |
Cycles SatAbs:
2.43sec (x4.05) ESBMC:
7.58sec
Threader: ERROR/TIMEOUT[1] 182.60sec ... |
|
... |
x86/thin (tooling date Sun Jan 22 02:23:23 GMT 2012)
This family corresponds to litmus tests involving thin-air (or causal loops) cycles. Therefore they should answer No in litmus terms, or Verification Successful in verification terms, regardless of the model.
| Name | SC | CAV'11 | TSO (all delay/cyc) | TSO (1 delay/cyc) | TSO (opt delay/cyc) | Expected (TSO) | PSO (all delay/cyc) | PSO (1 delay/cyc) | PSO (opt delay/cyc) | Expected (PSO) | RMO (all delay/cyc) | RMO (1 delay/cyc) | RMO (opt delay/cyc) | Expected (RMO) | Power (all delay/cyc) | Power (1 delay/cyc) | Power (opt delay/cyc) | Expected (Power) |
|
x86/thin000 |
SatAbs: ![]() 0.29sec Satabs-prefix-first:
0.26sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.04sec
CImpact:
0.11sec
Checkfence: 0.01sec ESBMC:
0.07sec
Threader-monolithic:
0.12sec
Threader-owicki-gries:
0.10sec
Threader-rely-guarantee:
0.11sec
Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: sc):
0.39sec
|
Cycles
SatAbs: ![]() 4.33sec (x14.93) Satabs-prefix-first:
11.36sec
CBMC-WMM:
0.04sec
CBMC-SC:
5.80sec
CImpact:
6.74sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[130] 652.61sec Threader-owicki-gries: ERROR/TIMEOUT[130] 596.05sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 594.97sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
0.41sec
|
Cycles
SatAbs: ![]() 0.68sec (x2.34) Satabs-prefix-first:
1.43sec
CBMC-WMM:
0.08sec
CBMC-SC:
0.05sec
CImpact:
3.13sec
Checkfence: 0.01sec ESBMC:
0.06sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.09sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
0.32sec
|
Cycles
SatAbs: ![]() 0.59sec (x2.03) Satabs-prefix-first:
1.15sec
CBMC-WMM:
0.06sec
CBMC-SC:
0.03sec
CImpact:
2.77sec
ESBMC:
0.05sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.10sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
0.37sec
|
Cycles
SatAbs: ![]() 0.64sec (x2.20) Satabs-prefix-first:
1.16sec
CBMC-WMM:
0.06sec
CBMC-SC:
0.03sec
CImpact:
2.59sec
ESBMC:
0.07sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.10sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.07sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
0.30sec
|
|
Cycles
SatAbs: ![]() 0.60sec (x2.06) Satabs-prefix-first:
1.16sec
CBMC-WMM:
0.05sec
CBMC-SC:
0.03sec
CImpact:
2.57sec
ESBMC:
0.05sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.07sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.09sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 0.63sec (x2.17) Satabs-prefix-first:
1.22sec
CBMC-WMM:
0.06sec
CBMC-SC:
0.04sec
CImpact:
2.64sec
ESBMC:
0.07sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.10sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 0.67sec (x2.31) Satabs-prefix-first:
1.37sec
CBMC-WMM:
0.06sec
CBMC-SC:
0.02sec
CImpact:
2.72sec
ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.10sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
|
Cycles
SatAbs: ![]() 10.05sec (x34.65) Satabs-prefix-first:
4.53sec
CBMC-WMM:
0.07sec
CBMC-SC:
1.87sec
CImpact:
0.01sec
ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[130] 618.49sec Threader-owicki-gries: ERROR/TIMEOUT[130] 666.93sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 627.90sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 8.74sec (x30.13) Satabs-prefix-first:
3.01sec
CBMC-WMM:
0.08sec
CBMC-SC:
0.56sec
CImpact:
0.01sec
ESBMC:
0.07sec
Threader-monolithic: ERROR/TIMEOUT[1] 363.79sec Threader-owicki-gries: ERROR/TIMEOUT[1] 362.42sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 347.00sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 6.92sec (x23.86) Satabs-prefix-first:
2.89sec
CBMC-WMM:
0.07sec
CBMC-SC:
0.47sec
CImpact:
0.01sec
ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 365.28sec Threader-owicki-gries: ERROR/TIMEOUT[1] 343.87sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 353.72sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
Cycles
SatAbs: ![]() 12.19sec (x42.03) Satabs-prefix-first:
20.73sec
CBMC-WMM:
0.07sec
CBMC-SC:
7.84sec
CImpact:
0.00sec
ESBMC:
0.13sec
Threader-monolithic: ERROR/TIMEOUT[130] 620.96sec Threader-owicki-gries: ERROR/TIMEOUT[130] 685.60sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 745.14sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 7.14sec (x24.62) Satabs-prefix-first:
3.30sec
CBMC-WMM:
0.08sec
CBMC-SC:
0.66sec
CImpact:
0.01sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[1] 347.15sec Threader-owicki-gries: ERROR/TIMEOUT[1] 363.32sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 353.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 10.89sec (x37.55) Satabs-prefix-first:
6.31sec
CBMC-WMM:
0.06sec
CBMC-SC:
1.13sec
CImpact:
2.20sec
ESBMC:
0.07sec
Threader-monolithic: ERROR/TIMEOUT[1] 357.26sec Threader-owicki-gries: ERROR/TIMEOUT[1] 359.79sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 350.56sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
|
x86/thin001 |
SatAbs: ![]() 0.33sec Satabs-prefix-first:
0.44sec
CBMC-WMM:
0.06sec
CBMC-SC:
0.06sec
CImpact:
237.54sec
Checkfence: 0.01sec ESBMC:
0.06sec
Threader-monolithic:
0.13sec
Threader-owicki-gries:
0.14sec
Threader-rely-guarantee:
0.10sec
Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: sc):
0.50sec
|
Cycles
SatAbs: ![]() 14.04sec (x42.54) Satabs-prefix-first:
47.69sec
CBMC-WMM:
0.09sec
CBMC-SC:
22.92sec
CImpact: ERROR/TIMEOUT[8] 430.28sec ESBMC:
0.13sec
Threader-monolithic: ERROR/TIMEOUT[130] 667.58sec Threader-owicki-gries: ERROR/TIMEOUT[130] 636.30sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 635.19sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
0.69sec
|
Cycles
SatAbs: ![]() 1.04sec (x3.15) Satabs-prefix-first:
4.18sec
CBMC-WMM:
0.11sec
CBMC-SC:
0.06sec
CImpact: ERROR/TIMEOUT[8] 290.91sec Checkfence: 0.01sec ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
0.63sec
|
Cycles
SatAbs: ![]() 1.05sec (x3.18) Satabs-prefix-first:
4.03sec
CBMC-WMM:
0.10sec
CBMC-SC:
0.04sec
CImpact: ERROR/TIMEOUT[8] 290.65sec ESBMC:
0.06sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
0.68sec
|
Cycles
SatAbs: ![]() 1.08sec (x3.27) Satabs-prefix-first:
4.08sec
CBMC-WMM:
0.09sec
CBMC-SC:
0.06sec
CImpact: ERROR/TIMEOUT[8] 281.81sec ESBMC:
0.06sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
0.63sec
|
|
Cycles
SatAbs: ![]() 1.09sec (x3.30) Satabs-prefix-first:
4.14sec
CBMC-WMM:
0.11sec
CBMC-SC:
0.06sec
CImpact: ERROR/TIMEOUT[8] 300.27sec ESBMC:
0.06sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.10sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 1.18sec (x3.57) Satabs-prefix-first:
3.67sec
CBMC-WMM:
0.11sec
CBMC-SC:
0.06sec
CImpact: ERROR/TIMEOUT[8] 297.80sec ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 1.04sec (x3.15) Satabs-prefix-first:
4.23sec
CBMC-WMM:
0.12sec
CBMC-SC:
0.06sec
CImpact: ERROR/TIMEOUT[8] 323.96sec ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
|
Cycles
SatAbs: ![]() 164.65sec (x498.93) Satabs-prefix-first:
78.37sec
CBMC-WMM:
0.12sec
CBMC-SC:
3.13sec
CImpact:
0.02sec
ESBMC:
0.11sec
Threader-monolithic: ERROR/TIMEOUT[130] 848.88sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.88sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.35sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 45.72sec (x138.54) Satabs-prefix-first:
6.16sec
CBMC-WMM:
0.11sec
CBMC-SC:
0.58sec
CImpact:
0.01sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[1] 358.81sec Threader-owicki-gries: ERROR/TIMEOUT[1] 440.93sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 425.06sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 47.14sec (x142.84) Satabs-prefix-first:
6.30sec
CBMC-WMM:
0.12sec
CBMC-SC:
0.60sec
CImpact:
0.01sec
ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 396.73sec Threader-owicki-gries: ERROR/TIMEOUT[1] 414.17sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 354.46sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
Cycles
SatAbs: ![]() 210.82sec (x638.84) Satabs-prefix-first:
99.45sec
CBMC-WMM:
0.11sec
CBMC-SC:
19.89sec
CImpact:
0.00sec
ESBMC:
0.16sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.72sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.78sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.77sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 34.39sec (x104.21) Satabs-prefix-first:
6.82sec
CBMC-WMM:
0.11sec
CBMC-SC:
0.70sec
CImpact:
0.00sec
ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 335.50sec Threader-owicki-gries: ERROR/TIMEOUT[1] 311.83sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 322.53sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 62.71sec (x190.03) Satabs-prefix-first:
21.82sec
CBMC-WMM:
0.11sec
CBMC-SC:
1.24sec
CImpact: ERROR/TIMEOUT[8] 336.26sec ESBMC:
0.11sec
Threader-monolithic: ERROR/TIMEOUT[1] 385.99sec Threader-owicki-gries: ERROR/TIMEOUT[1] 438.45sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 398.31sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
|
x86/thin002 |
SatAbs: ![]() 0.78sec Satabs-prefix-first:
0.60sec
CBMC-WMM:
0.09sec
CBMC-SC:
0.08sec
CImpact: ERROR/TIMEOUT[8] 263.42sec Checkfence: 0.01sec ESBMC:
0.05sec
Threader-monolithic:
0.16sec
Threader-owicki-gries:
0.17sec
Threader-rely-guarantee:
0.16sec
Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: sc):
0.50sec
|
Cycles
SatAbs: ![]() 50.85sec (x65.19) Satabs-prefix-first:
159.17sec
CBMC-WMM:
0.17sec
CBMC-SC:
42.17sec
CImpact: ERROR/TIMEOUT[8] 445.75sec ESBMC:
0.13sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.25sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.27sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.48sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
1.68sec
|
Cycles
SatAbs: ![]() 3.11sec (x3.98) Satabs-prefix-first:
23.56sec
CBMC-WMM:
0.16sec
CBMC-SC:
0.06sec
CImpact: ERROR/TIMEOUT[8] 386.89sec Checkfence: 0.01sec ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.10sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
1.91sec
|
Cycles
SatAbs: ![]() 3.13sec (x4.01) Satabs-prefix-first:
24.71sec
CBMC-WMM:
0.14sec
CBMC-SC:
0.08sec
CImpact: ERROR/TIMEOUT[8] 373.84sec ESBMC:
0.07sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.17sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
1.78sec
|
Cycles
SatAbs: ![]() 3.02sec (x3.87) Satabs-prefix-first:
30.10sec
CBMC-WMM:
0.15sec
CBMC-SC:
0.09sec
CImpact: ERROR/TIMEOUT[8] 395.47sec ESBMC:
0.07sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.10sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.13sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.13sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp):
3.48sec
|
|
Cycles
SatAbs: ![]() 3.51sec (x4.50) Satabs-prefix-first:
25.87sec
CBMC-WMM:
0.17sec
CBMC-SC:
0.09sec
CImpact: ERROR/TIMEOUT[8] 388.32sec ESBMC:
0.06sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.13sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 2.90sec (x3.71) Satabs-prefix-first:
24.49sec
CBMC-WMM:
0.15sec
CBMC-SC:
0.07sec
CImpact: ERROR/TIMEOUT[8] 343.78sec ESBMC:
0.06sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 2.70sec (x3.46) Satabs-prefix-first:
24.54sec
CBMC-WMM:
0.24sec
CBMC-SC:
0.07sec
CImpact: ERROR/TIMEOUT[8] 313.10sec ESBMC:
0.06sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
|
Cycles
SatAbs: ERROR/TIMEOUT[130] 1287.41sec (x1650.52) Satabs-prefix-first:
709.90sec
CBMC-WMM:
0.18sec
CBMC-SC:
11.20sec
CImpact:
0.02sec
ESBMC:
0.19sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.75sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.40sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 896.36sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 193.97sec (x248.67) Satabs-prefix-first:
36.02sec
CBMC-WMM:
0.18sec
CBMC-SC:
0.55sec
CImpact:
0.00sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[1] 531.06sec Threader-owicki-gries: ERROR/TIMEOUT[1] 530.53sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 535.76sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 177.71sec (x227.83) Satabs-prefix-first:
30.33sec
CBMC-WMM:
0.18sec
CBMC-SC:
0.50sec
CImpact:
0.01sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[1] 543.22sec Threader-owicki-gries: ERROR/TIMEOUT[1] 545.73sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 534.13sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
Cycles
SatAbs: ERROR/TIMEOUT[130] 1356.88sec (x1739.58) Satabs-prefix-first:
627.53sec
CBMC-WMM:
0.19sec
CBMC-SC:
25.05sec
CImpact:
0.03sec
ESBMC:
0.19sec
Threader-monolithic: ERROR/TIMEOUT[130] 895.95sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.58sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.40sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 174.91sec (x224.24) Satabs-prefix-first:
54.01sec
CBMC-WMM:
0.17sec
CBMC-SC:
0.79sec
CImpact:
0.01sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[1] 502.25sec Threader-owicki-gries: ERROR/TIMEOUT[1] 470.28sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 473.76sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 162.21sec (x207.96) Satabs-prefix-first:
70.05sec
CBMC-WMM:
0.17sec
CBMC-SC:
1.22sec
CImpact: ERROR/TIMEOUT[8] 314.93sec ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[1] 525.55sec Threader-owicki-gries: ERROR/TIMEOUT[1] 525.86sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 533.34sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|