How to read the tables?
Meaning of the model-checker's results| Model-checker on the instrumented program | Observed state in Litmus | Picture |
| VERIFICATION FAILED | YES | ![]() |
| VERIFICATION SUCCESSFUL | NO | ![]() |
Reading the results in the experiments tables
The table below is an excerpt of former results we obtained for x86/podwr experiments.
- In the first column, we can read the name of the original Litmus test (with a link to the file), and the expected violation cycle. The second column gathers the results of the model-checkers for SC. As we are interested in WMM bugs, the verification for SC should be
. - The three next columns concern TSO model. The last column tells which result we should get for this program under TSO, namely
. We see in the third column that Satabs indeed finds the correct result when checking the instrumented program. ESBMC in this example is missing the counterexample. Threader is either returning an error, or killed by timeout (here, it is an error).
- Note that there are two columns for TSO results: in the first one, we instrument all the delays; in the second one, we instrument only one delay per cycle.
- We also experiment under PSO, RMO and Power, and with additional model-checkers: additional columns of results (and expected results) appear after TSO's columns.
| Name | SC | TSO (all delay/cyc) | TSO (1 delay/cyc) | Expected (TSO) | ... |
|
x86/podwr000 Fre PodWR Fre PodWR |
SatAbs: ![]() 0.60sec ESBMC:
0.30secThreader:
7.92sec... |
Cycles SatAbs:
3.94sec (x6.56) ESBMC:
8.34secThreader: ERROR/TIMEOUT[1] 491.99sec ... |
Cycles SatAbs:
2.43sec (x4.05) ESBMC:
7.58sec
Threader: ERROR/TIMEOUT[1] 182.60sec ... |
|
... |
ppc/rfi (tooling date Sun Jan 22 02:23:23 GMT 2012)
This family corresponds to litmus tests showing that Power authorises store buffering. Therefore they should answer Yes in litmus terms, or Verification Failed in verification terms as soon as the model is Power.
| Name | SC | CAV'11 | TSO (all delay/cyc) | TSO (1 delay/cyc) | TSO (opt delay/cyc) | Expected (TSO) | PSO (all delay/cyc) | PSO (1 delay/cyc) | PSO (opt delay/cyc) | Expected (PSO) | RMO (all delay/cyc) | RMO (1 delay/cyc) | RMO (opt delay/cyc) | Expected (RMO) | Power (all delay/cyc) | Power (1 delay/cyc) | Power (opt delay/cyc) | Expected (Power) |
|
ppc/rfi000 |
SatAbs: ![]() 5.47sec Satabs-prefix-first:
8.32sec
CBMC-WMM:
0.08sec
CBMC-SC:
0.07sec
CImpact:
13.05sec
Checkfence: 0.01sec ESBMC:
0.07sec
Threader-monolithic:
0.16sec
Threader-owicki-gries:
0.15sec
Threader-rely-guarantee:
0.15sec
Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: sc): ERROR/TIMEOUT[1] 0.11sec |
Cycles
SatAbs: ![]() 9.46sec (x1.72) Satabs-prefix-first:
42.29sec
CBMC-WMM:
0.11sec
CBMC-SC:
15.18sec
CImpact:
2.29sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.04sec Threader-owicki-gries: ERROR/TIMEOUT[130] 896.78sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 896.35sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.10sec |
Cycles
SatAbs: ![]() 11.74sec (x2.14) Satabs-prefix-first:
44.28sec
CBMC-WMM:
0.12sec
CBMC-SC:
10.02sec
CImpact:
2.32sec
Checkfence: 0.01sec ESBMC:
0.12sec
Threader-monolithic: ERROR/TIMEOUT[130] 896.71sec Threader-owicki-gries: ERROR/TIMEOUT[130] 896.35sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 896.33sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.09sec |
Cycles
SatAbs: ![]() 5.33sec (x.97) Satabs-prefix-first:
37.22sec
CBMC-WMM:
0.13sec
CBMC-SC:
1.70sec
CImpact:
1.74sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[1] 197.61sec Threader-owicki-gries: ERROR/TIMEOUT[1] 263.67sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 245.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.09sec |
Cycles
SatAbs: ![]() 18.18sec (x3.32) Satabs-prefix-first:
24.21sec
CBMC-WMM:
0.13sec
CBMC-SC:
1.32sec
CImpact:
129.70sec
ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 262.71sec Threader-owicki-gries: ERROR/TIMEOUT[1] 262.79sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 246.05sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.10sec |
|
Cycles
SatAbs: ![]() 9.98sec (x1.82) Satabs-prefix-first:
44.15sec
CBMC-WMM:
0.12sec
CBMC-SC:
13.63sec
CImpact:
2.31sec
ESBMC:
0.12sec
Threader-monolithic: ERROR/TIMEOUT[130] 896.18sec Threader-owicki-gries: ERROR/TIMEOUT[130] 896.91sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 896.60sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 5.65sec (x1.03) Satabs-prefix-first:
35.83sec
CBMC-WMM:
0.11sec
CBMC-SC:
1.52sec
CImpact:
1.62sec
ESBMC:
0.07sec
Threader-monolithic: ERROR/TIMEOUT[1] 234.88sec Threader-owicki-gries: ERROR/TIMEOUT[1] 255.87sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 261.45sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 27.38sec (x5.00) Satabs-prefix-first:
32.43sec
CBMC-WMM:
0.11sec
CBMC-SC:
1.88sec
CImpact:
126.39sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[1] 183.09sec Threader-owicki-gries: ERROR/TIMEOUT[1] 205.12sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 196.19sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
|
Cycles
SatAbs: ![]() 10.12sec (x1.85) Satabs-prefix-first:
42.71sec
CBMC-WMM:
0.15sec
CBMC-SC:
14.92sec
CImpact:
2.26sec
ESBMC:
0.11sec
Threader-monolithic: ERROR/TIMEOUT[130] 896.92sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.14sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 896.08sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 5.56sec (x1.01) Satabs-prefix-first:
37.32sec
CBMC-WMM:
0.17sec
CBMC-SC:
1.60sec
CImpact:
1.63sec
ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 203.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 248.57sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 255.89sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 17.36sec (x3.17) Satabs-prefix-first:
22.38sec
CBMC-WMM:
0.15sec
CBMC-SC:
1.26sec
CImpact:
127.54sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[1] 262.72sec Threader-owicki-gries: ERROR/TIMEOUT[1] 260.67sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 188.37sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
Cycles
SatAbs: ![]() 9.09sec (x1.66) Satabs-prefix-first:
41.31sec
CBMC-WMM:
0.16sec
CBMC-SC:
15.01sec
CImpact:
2.31sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[130] 896.59sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.08sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.16sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 4.94sec (x.90) Satabs-prefix-first:
36.17sec
CBMC-WMM:
0.16sec
CBMC-SC:
1.54sec
CImpact:
1.66sec
ESBMC:
0.05sec
Threader-monolithic: ERROR/TIMEOUT[1] 249.56sec Threader-owicki-gries: ERROR/TIMEOUT[1] 254.50sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 244.50sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 17.37sec (x3.17) Satabs-prefix-first:
23.39sec
CBMC-WMM:
0.16sec
CBMC-SC:
1.34sec
CImpact:
130.58sec
ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 259.00sec Threader-owicki-gries: ERROR/TIMEOUT[1] 252.71sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 263.20sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
|
ppc/rfi001 |
SatAbs: ![]() 8.56sec Satabs-prefix-first:
10.61sec
CBMC-WMM:
0.06sec
CBMC-SC:
0.07sec
CImpact:
23.65sec
Checkfence: 0.01sec ESBMC:
0.07sec
Threader-monolithic:
0.16sec
Threader-owicki-gries:
0.12sec
Threader-rely-guarantee:
0.14sec
Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: sc): ERROR/TIMEOUT[1] 0.09sec |
Cycles
SatAbs: ![]() 2.37sec (x.27) Satabs-prefix-first:
4.12sec
CBMC-WMM:
0.13sec
CBMC-SC:
20.54sec
CImpact:
2.50sec
ESBMC:
0.12sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.43sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.29sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.22sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.10sec |
Cycles
SatAbs: ![]() 15.30sec (x1.78) Satabs-prefix-first:
17.65sec
CBMC-WMM:
0.12sec
CBMC-SC:
9.67sec
CImpact:
2.31sec
Checkfence: 0.01sec ESBMC:
0.11sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.53sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.55sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.58sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.09sec |
Cycles
SatAbs: ![]() 14.90sec (x1.74) Satabs-prefix-first:
18.12sec
CBMC-WMM:
0.10sec
CBMC-SC:
1.36sec
CImpact:
1.50sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.33sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.48sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.48sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.09sec |
Cycles
SatAbs: ![]() 14.93sec (x1.74) Satabs-prefix-first:
18.12sec
CBMC-WMM:
0.13sec
CBMC-SC:
1.35sec
CImpact:
1.49sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.31sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.31sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.26sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.10sec |
|
Cycles
SatAbs: ![]() 15.94sec (x1.86) Satabs-prefix-first:
17.26sec
CBMC-WMM:
0.14sec
CBMC-SC:
10.78sec
CImpact:
2.24sec
ESBMC:
0.11sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.51sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.48sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.36sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 14.83sec (x1.73) Satabs-prefix-first:
17.09sec
CBMC-WMM:
0.11sec
CBMC-SC:
10.16sec
CImpact:
2.23sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.10sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.08sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 32.64sec (x3.81) Satabs-prefix-first:
16.47sec
CBMC-WMM:
0.13sec
CBMC-SC:
1.16sec
CImpact:
201.13sec
ESBMC:
0.08sec
Threader-monolithic: ERROR/TIMEOUT[1] 263.03sec Threader-owicki-gries: ERROR/TIMEOUT[1] 224.32sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 255.14sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
|
Cycles
SatAbs: ![]() 14.22sec (x1.66) Satabs-prefix-first:
17.16sec
CBMC-WMM:
0.15sec
CBMC-SC:
10.24sec
CImpact:
2.23sec
ESBMC:
0.11sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.41sec Threader-owicki-gries: ERROR/TIMEOUT[130] 896.84sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.17sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 16.90sec (x1.97) Satabs-prefix-first:
18.89sec
CBMC-WMM:
0.17sec
CBMC-SC:
10.43sec
CImpact:
2.33sec
ESBMC:
0.11sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.34sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.27sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.35sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 35.25sec (x4.11) Satabs-prefix-first:
16.96sec
CBMC-WMM:
0.16sec
CBMC-SC:
1.13sec
CImpact:
179.80sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[1] 259.81sec Threader-owicki-gries: ERROR/TIMEOUT[1] 259.83sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 260.95sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
Cycles
SatAbs: ![]() 9.28sec (x1.08) Satabs-prefix-first:
17.15sec
CBMC-WMM:
0.15sec
CBMC-SC:
18.45sec
CImpact:
2.59sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.55sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.31sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 896.59sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 15.00sec (x1.75) Satabs-prefix-first:
16.96sec
CBMC-WMM:
0.14sec
CBMC-SC:
10.33sec
CImpact:
2.26sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.00sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.58sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.48sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 32.49sec (x3.79) Satabs-prefix-first:
15.68sec
CBMC-WMM:
0.15sec
CBMC-SC:
1.13sec
CImpact:
227.95sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[1] 218.85sec Threader-owicki-gries: ERROR/TIMEOUT[1] 234.35sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 211.84sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
|
ppc/rfi002 |
SatAbs: ![]() 10.60sec Satabs-prefix-first:
15.29sec
CBMC-WMM:
0.06sec
CBMC-SC:
0.05sec
CImpact:
53.15sec
Checkfence: 0.01sec ESBMC:
0.07sec
Threader-monolithic:
0.15sec
Threader-owicki-gries:
0.14sec
Threader-rely-guarantee:
0.14sec
Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: sc): ERROR/TIMEOUT[1] 0.11sec |
Cycles
SatAbs: ![]() 3.39sec (x.31) Satabs-prefix-first:
3.90sec
CBMC-WMM:
0.14sec
CBMC-SC:
26.96sec
CImpact:
2.78sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.57sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.43sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.10sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.10sec |
Cycles
SatAbs: ![]() 2.15sec (x.20) Satabs-prefix-first:
2.37sec
CBMC-WMM:
0.14sec
CBMC-SC:
0.08sec
CImpact: ERROR/TIMEOUT[8] 242.96sec Checkfence: 0.01sec ESBMC:
0.06sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.09sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.10sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.09sec |
Cycles
SatAbs: ![]() 2.30sec (x.21) Satabs-prefix-first:
2.25sec
CBMC-WMM:
0.13sec
CBMC-SC:
0.06sec
CImpact: ERROR/TIMEOUT[8] 241.25sec ESBMC:
0.07sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.11sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.11sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.09sec |
Cycles
SatAbs: ![]() 2.12sec (x.20) Satabs-prefix-first:
2.41sec
CBMC-WMM:
0.12sec
CBMC-SC:
0.08sec
CImpact: ERROR/TIMEOUT[8] 240.01sec ESBMC:
0.06sec
Threader-monolithic: ERROR/TIMEOUT[1] 0.12sec Threader-owicki-gries: ERROR/TIMEOUT[1] 0.09sec Threader-rely-guarantee: ERROR/TIMEOUT[1] 0.11sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT MMChecker (MM: csharp): ERROR/TIMEOUT[1] 0.10sec |
|
Cycles
SatAbs: ![]() 16.31sec (x1.53) Satabs-prefix-first:
51.00sec
CBMC-WMM:
0.13sec
CBMC-SC:
22.72sec
CImpact:
2.49sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.58sec Threader-owicki-gries: ERROR/TIMEOUT[130] 896.48sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 895.75sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 17.67sec (x1.66) Satabs-prefix-first:
76.65sec
CBMC-WMM:
0.11sec
CBMC-SC:
23.50sec
CImpact:
2.56sec
ESBMC:
0.11sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.37sec Threader-owicki-gries: ERROR/TIMEOUT[130] 896.08sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.41sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
Cycles
SatAbs: ![]() 16.96sec (x1.60) Satabs-prefix-first:
64.89sec
CBMC-WMM:
0.12sec
CBMC-SC:
23.32sec
CImpact:
2.46sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.68sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.42sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 896.94sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Blender:
|
|
Cycles
SatAbs: ![]() 16.48sec (x1.55) Satabs-prefix-first:
56.67sec
CBMC-WMM:
0.16sec
CBMC-SC:
23.28sec
CImpact:
2.75sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.32sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.27sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.58sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 16.47sec (x1.55) Satabs-prefix-first:
65.52sec
CBMC-WMM:
0.14sec
CBMC-SC:
23.01sec
CImpact:
2.49sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.29sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.38sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.20sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 16.60sec (x1.56) Satabs-prefix-first:
72.71sec
CBMC-WMM:
0.16sec
CBMC-SC:
23.34sec
CImpact:
2.50sec
ESBMC:
0.11sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.53sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.52sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 896.99sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|
Cycles
SatAbs: ![]() 19.73sec (x1.86) Satabs-prefix-first:
40.72sec
CBMC-WMM:
0.19sec
CBMC-SC:
69.97sec
CImpact:
3.22sec
ESBMC:
0.14sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.41sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.63sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.66sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 10.63sec (x1.00) Satabs-prefix-first:
18.47sec
CBMC-WMM:
0.18sec
CBMC-SC:
19.50sec
CImpact:
2.74sec
ESBMC:
0.10sec
Threader-monolithic: ERROR/TIMEOUT[130] 897.55sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.67sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.49sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
Cycles
SatAbs: ![]() 5.00sec (x.47) Satabs-prefix-first:
3.56sec
CBMC-WMM:
0.15sec
CBMC-SC:
15.67sec
CImpact:
1.25sec
ESBMC:
0.09sec
Threader-monolithic: ERROR/TIMEOUT[130] 896.73sec Threader-owicki-gries: ERROR/TIMEOUT[130] 897.24sec Threader-rely-guarantee: ERROR/TIMEOUT[130] 897.31sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT |
|