How to read the tables?
Meaning of the model-checker's results| Model-checker on the instrumented program | Observed state in Litmus | Picture |
| VERIFICATION FAILED | YES | ![]() |
| VERIFICATION SUCCESSFUL | NO | ![]() |
Reading the results in the experiments tables
The table below is an excerpt of former results we obtained for x86/podwr experiments.
- In the first column, we can read the name of the original Litmus test (with a link to the file), and the expected violation cycle. The second column gathers the results of the model-checkers for SC. As we are interested in WMM bugs, the verification for SC should be
. - The three next columns concern TSO model. The last column tells which result we should get for this program under TSO, namely
. We see in the third column that Satabs indeed finds the correct result when checking the instrumented program. ESBMC in this example is missing the counterexample. Threader is either returning an error, or killed by timeout (here, it is an error).
- Note that there are two columns for TSO results: in the first one, we instrument all the delays; in the second one, we instrument only one delay per cycle.
- We also experiment under PSO, RMO and Power, and with additional model-checkers: additional columns of results (and expected results) appear after TSO's columns.
| Name | SC | TSO (all delay/cyc) | TSO (1 delay/cyc) | Expected (TSO) | ... |
|
x86/podwr000 Fre PodWR Fre PodWR |
SatAbs: ![]() 0.60sec ESBMC:
0.30secThreader:
7.92sec... |
Cycles SatAbs:
3.94sec (x6.56) ESBMC:
8.34secThreader: ERROR/TIMEOUT[1] 491.99sec ... |
Cycles SatAbs:
2.43sec (x4.05) ESBMC:
7.58sec
Threader: ERROR/TIMEOUT[1] 182.60sec ... |
|
... |
Real-life C programs
On the one hand, this family contains the PostgreSQL bug, the fix proposed by PostgreSQL developers and our own fix for it. It should answer Yes in litmus terms, or Verification Failed in verification terms, starting from RMO. The fix proposed by the developers is not enough, hence should answer Yes in litmus terms, or Verification Failed in verification terms, starting from RMO. Our fix should answer No in litmus terms and Verification Successful in verification terms, regardless of the model.
On the other hand, this family contains our experiments with RCU and Apache. It shows all the cycles (i.e. potential bugs) exhibited by RCU, and verifies Apache.
Apache
| Name | SC | CAV'11 | TSO (all delay/cyc) | TSO (1 delay/cyc) | TSO (opt delay/cyc) | Expected (TSO) | PSO (all delay/cyc) | PSO (1 delay/cyc) | PSO (opt delay/cyc) | Expected (PSO) | RMO (all delay/cyc) | RMO (1 delay/cyc) | RMO (opt delay/cyc) | Expected (RMO) | Power (all delay/cyc) | Power (1 delay/cyc) | Power (opt delay/cyc) | Expected (Power) |
|
gb_fdqueue_builtins.c |
SatAbs: ERROR/TIMEOUT[1] 0.10sec Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.18sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.10sec (x1.00) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.12sec CBMC-WMM:
0.17sec
CBMC-SC:
0.16sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.09sec (x.90) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.12sec CBMC-WMM:
0.19sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.09sec CBMC-WMM:
0.17sec
CBMC-SC:
0.16sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.09sec (x.90) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.09sec CBMC-WMM:
0.18sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.09sec (x.90) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.18sec
CBMC-SC:
0.17sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.10sec (x1.00) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.12sec CBMC-WMM:
0.16sec
CBMC-SC:
0.17sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.12sec (x1.20) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.10sec CBMC-WMM:
0.16sec
CBMC-SC:
0.19sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.12sec CBMC-WMM:
0.20sec
CBMC-SC:
0.17sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.12sec CBMC-WMM:
0.13sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.17sec
CBMC-SC:
0.16sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.12sec CBMC-WMM:
0.18sec
CBMC-SC:
0.14sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.10sec CBMC-WMM:
0.18sec
CBMC-SC:
0.18sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.09sec (x.90) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.10sec CBMC-WMM:
0.16sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
UNKNOWN |
|
gb_fdqueue_builtins_ppc.c |
SatAbs: ERROR/TIMEOUT[1] 0.12sec Satabs-prefix-first: ERROR/TIMEOUT[1] 0.09sec CBMC-WMM:
0.18sec
CBMC-SC:
0.16sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.11sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.15sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.15sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.15sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.14sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.15sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.15sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.15sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.16sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.16sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.14sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.13sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.13sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
UNKNOWN |
|
gb_fdqueue_ia32.c |
SatAbs: ERROR/TIMEOUT[1] 0.10sec Satabs-prefix-first: ERROR/TIMEOUT[1] 0.08sec CBMC-WMM:
0.15sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.12sec (x1.20) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.09sec CBMC-WMM:
0.18sec
CBMC-SC:
0.18sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.10sec CBMC-WMM:
0.15sec
CBMC-SC:
0.17sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.10sec CBMC-WMM:
0.15sec
CBMC-SC:
0.17sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.17sec
CBMC-SC:
0.17sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.09sec (x.90) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.17sec
CBMC-SC:
0.18sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.10sec (x1.00) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.14sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.12sec CBMC-WMM:
0.14sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.18sec
CBMC-SC:
0.18sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.09sec (x.90) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.16sec
CBMC-SC:
0.16sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.09sec (x.90) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.16sec
CBMC-SC:
0.18sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.16sec
CBMC-SC:
0.16sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.12sec (x1.20) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.12sec CBMC-WMM:
0.17sec
CBMC-SC:
0.20sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.10) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.18sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
UNKNOWN |
|
gb_fdqueue_ppc.c |
SatAbs: ERROR/TIMEOUT[1] 0.11sec Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.15sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.09sec (x.81) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.16sec
CBMC-SC:
0.18sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.08sec (x.72) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.09sec CBMC-WMM:
0.18sec
CBMC-SC:
0.18sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.10sec (x.90) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.10sec CBMC-WMM:
0.18sec
CBMC-SC:
0.14sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.13sec (x1.18) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.12sec CBMC-WMM:
0.16sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.10sec (x.90) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.15sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.00) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.08sec CBMC-WMM:
0.16sec
CBMC-SC:
0.17sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.09sec (x.81) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.09sec CBMC-WMM:
0.19sec
CBMC-SC:
0.15sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.00) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.10sec CBMC-WMM:
0.14sec
CBMC-SC:
0.18sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.12sec (x1.09) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.10sec CBMC-WMM:
0.16sec
CBMC-SC:
0.18sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.00) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.10sec CBMC-WMM:
0.16sec
CBMC-SC:
0.16sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.00) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.12sec CBMC-WMM:
0.16sec
CBMC-SC:
0.16sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.11sec (x1.00) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.16sec
CBMC-SC:
0.17sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[1] 0.08sec (x.72) Satabs-prefix-first: ERROR/TIMEOUT[1] 0.11sec CBMC-WMM:
0.19sec
CBMC-SC:
0.17sec
dump-c failed with exit code 134 |
UNKNOWN |
Pgsql
| Name | SC | TSO (all delay/cyc) | TSO (1 delay/cyc) | Expected (TSO) | PSO (all delay/cyc) | PSO (1 delay/cyc) | Expected (PSO) | RMO (all delay/cyc) | RMO (1 delay/cyc) | Expected (RMO) | Power (all delay/cyc) | Power (1 delay/cyc) | Expected (Power) |
|
pgsql_two.c |
SatAbs: ![]() 0.06sec CImpact: ERROR/TIMEOUT[8] 34.48sec ESBMC:
475.63sec
Threader:
0.83sec
Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT C code |
Cycles
SatAbs: ![]() 0.44sec (x7.33) CImpact: ERROR/TIMEOUT[8] 19.86sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 0.08sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: ![]() 0.42sec (x7.00) CImpact: ERROR/TIMEOUT[8] 17.74sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 0.07sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
Cycles
SatAbs: (spurious)18.13sec (x302.16) CImpact: ERROR/TIMEOUT[8] 46.06sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 1.24sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: (spurious)16.60sec (x276.66) CImpact: ERROR/TIMEOUT[8] 46.55sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 1.07sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
Cycles
SatAbs: ![]() 23.70sec (x395.00) CImpact: ERROR/TIMEOUT[8] 52.59sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 1.12sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: ![]() 25.07sec (x417.83) CImpact: ERROR/TIMEOUT[8] 88.22sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 1.13sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
Cycles
SatAbs: ![]() 27.27sec (x454.50) CImpact: ERROR/TIMEOUT[8] 57.24sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 3.07sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: ![]() 27.15sec (x452.50) CImpact: ERROR/TIMEOUT[8] 55.60sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 5.00sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
|
pgsql_two-developer-fix.c |
SatAbs: ![]() 0.06sec CImpact: ERROR/TIMEOUT[8] 18.92sec ESBMC:
259.44sec
Threader:
0.60sec
Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT C code |
Cycles
SatAbs: ![]() 0.35sec (x5.83) CImpact: ERROR/TIMEOUT[8] 17.60sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 0.07sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: ![]() 0.54sec (x9.00) CImpact: ERROR/TIMEOUT[8] 17.17sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 0.09sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
Cycles
SatAbs: (spurious)8.84sec (x147.33) CImpact: ERROR/TIMEOUT[8] 32.93sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 1.50sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: (spurious)9.33sec (x155.50) CImpact: ERROR/TIMEOUT[8] 35.93sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 1.77sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
Cycles
SatAbs: ![]() 12.61sec (x210.16) CImpact: ERROR/TIMEOUT[8] 48.05sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 1.13sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: ![]() 8.87sec (x147.83) CImpact: ERROR/TIMEOUT[8] 27.62sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 1.60sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
Cycles
SatAbs: ![]() 13.86sec (x231.00) CImpact: ERROR/TIMEOUT[8] 38.36sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 2.98sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: ![]() 14.52sec (x242.00) CImpact: ERROR/TIMEOUT[8] 50.41sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 3.51sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
|
pgsql_two-fix.c |
SatAbs: ![]() 0.09sec CImpact: ERROR/TIMEOUT[8] 20.87sec ESBMC: ERROR/TIMEOUT[134] 0.08sec Threader: ERROR/TIMEOUT[1] 0.10sec Poirot-Integer:
131.890625 s
Poirot-BitVector: ERROR/TIMEOUT C code |
Cycles
SatAbs: ![]() 115.82sec (x1286.88) CImpact: ERROR/TIMEOUT[8] 31.67sec ESBMC: 0.39sec Threader: ERROR/TIMEOUT[1] 0.09sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: ![]() 116.43sec (x1293.66) CImpact: ERROR/TIMEOUT[8] 31.73sec ESBMC: 0.36sec Threader: ERROR/TIMEOUT[1] 0.08sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
Cycles
SatAbs: ![]() 151.42sec (x1682.44) CImpact: ERROR/TIMEOUT[8] 33.13sec ESBMC: 0.71sec Threader: ERROR/TIMEOUT[1] 0.35sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: ![]() 151.98sec (x1688.66) CImpact: ERROR/TIMEOUT[8] 33.02sec ESBMC: 0.75sec Threader: ERROR/TIMEOUT[1] 0.36sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
Cycles
SatAbs: ![]() 265.46sec (x2949.55) CImpact: ERROR/TIMEOUT[8] 34.45sec ESBMC: 0.80sec Threader: ERROR/TIMEOUT[1] 0.59sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: ERROR/TIMEOUT[130] CImpact: ERROR/TIMEOUT[8] 38.34sec ESBMC: ERROR/TIMEOUT[130] Threader: ERROR/TIMEOUT[1] 0.34sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
Cycles
SatAbs: ![]() 4.222sec CImpact: ERROR/TIMEOUT[8] 49.63sec ESBMC: 1.67sec Threader: ERROR/TIMEOUT[1] 4.52sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
Cycles
SatAbs: ERROR/TIMEOUT[100] 385.62sec (x4284.66) CImpact: ERROR/TIMEOUT[8] 33.18sec ESBMC: ERROR/TIMEOUT[134] 1.34sec Threader: ERROR/TIMEOUT[1] 2.90sec Poirot-Integer: ERROR/TIMEOUT Poirot-BitVector: ERROR/TIMEOUT Instrumented C code |
|
|
pgsql_two-fix-lwsync.c |
SatAbs: ![]() 0.20sec Satabs-prefix-first:
0.26sec
CImpact: ERROR/TIMEOUT[8] 19.90sec C code |
Cycles
SatAbs: ![]() 0.19sec (x.95) Satabs-prefix-first:
0.21sec
CImpact: ERROR/TIMEOUT[8] 18.44sec Instrumented C code |
Cycles
SatAbs: ![]() 0.17sec (x.85) Satabs-prefix-first:
0.19sec
CImpact: ERROR/TIMEOUT[8] 18.66sec Instrumented C code |
UNKNOWN |
Cycles
SatAbs: ![]() 1.60sec (x8.00) Satabs-prefix-first:
2.67sec
CImpact: ERROR/TIMEOUT[8] 27.93sec Instrumented C code |
Cycles
SatAbs: ![]() 0.86sec (x4.30) Satabs-prefix-first:
1.08sec
CImpact: ERROR/TIMEOUT[8] 29.15sec Instrumented C code |
UNKNOWN |
Cycles
SatAbs: ![]() 2.21sec (x11.05) Satabs-prefix-first:
2.90sec
CImpact: ERROR/TIMEOUT[8] 26.32sec Instrumented C code |
Cycles
SatAbs: ![]() 0.80sec (x4.00) Satabs-prefix-first:
0.97sec
CImpact: ERROR/TIMEOUT[8] 23.65sec Instrumented C code |
UNKNOWN |
Cycles
SatAbs: ![]() 1.49sec (x7.45) Satabs-prefix-first:
2.33sec
CImpact: ERROR/TIMEOUT[8] 24.71sec Instrumented C code |
Cycles
SatAbs: ![]() 0.85sec (x4.25) Satabs-prefix-first:
1.27sec
CImpact: ERROR/TIMEOUT[8] 24.41sec Instrumented C code |
UNKNOWN |
RCU
| Name | SC | CAV'11 | TSO (all delay/cyc) | TSO (1 delay/cyc) | TSO (opt delay/cyc) | Expected (TSO) | PSO (all delay/cyc) | PSO (1 delay/cyc) | PSO (opt delay/cyc) | Expected (PSO) | RMO (all delay/cyc) | RMO (1 delay/cyc) | RMO (opt delay/cyc) | Expected (RMO) | Power (all delay/cyc) | Power (1 delay/cyc) | Power (opt delay/cyc) | Expected (Power) |
|
gb_rcu_powerpc.c |
SatAbs: ERROR/TIMEOUT[1] 4.86sec Satabs-prefix-first: ERROR/TIMEOUT[1] 4.71sec CBMC-WMM:
0.04sec
CBMC-SC:
0.02sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.02sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ![]() 0.04sec (x0) Satabs-prefix-first:
0.02sec
CBMC-WMM:
0.03sec
CBMC-SC:
0.03sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.03sec (x0) Satabs-prefix-first:
0.02sec
CBMC-WMM:
0.03sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.05sec (x.01) Satabs-prefix-first:
0.03sec
CBMC-WMM:
0.02sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.04sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.02sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.04sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
UNKNOWN |
Cycles
SatAbs: ![]() 0.05sec (x.01) Satabs-prefix-first:
0.02sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.02sec (x0) Satabs-prefix-first:
0.02sec
CBMC-WMM:
0.02sec
CBMC-SC:
0.02sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.01sec (x0) Satabs-prefix-first:
0.02sec
CBMC-WMM:
0.02sec
CBMC-SC:
0.03sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.03sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ![]() 0.06sec (x.01) Satabs-prefix-first:
0.12sec
CBMC-WMM:
0.04sec
CBMC-SC:
1.08sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.07sec (x.01) Satabs-prefix-first:
0.07sec
CBMC-WMM:
0.04sec
CBMC-SC:
1.10sec
dump-c failed with exit code 134 |
UNKNOWN |
|
gb_rcu_powerpc_nosync.c |
SatAbs: ERROR/TIMEOUT[1] 4.35sec Satabs-prefix-first: ERROR/TIMEOUT[1] 4.19sec CBMC-WMM:
0.03sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.02sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ![]() 0.05sec (x.01) Satabs-prefix-first:
0.03sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.02sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.06sec (x.01) Satabs-prefix-first:
0.04sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.03sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.05sec (x.01) Satabs-prefix-first:
0.04sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.02sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ![]() 0.03sec (x0) Satabs-prefix-first:
0.02sec
CBMC-WMM:
0.03sec
CBMC-SC:
0.02sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.06sec (x.01) Satabs-prefix-first:
0.01sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.03sec (x0) Satabs-prefix-first:
0.01sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ![]() 0.02sec (x0) Satabs-prefix-first:
0.03sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.03sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.04sec (x0) Satabs-prefix-first:
0.04sec
CBMC-WMM:
0.03sec
CBMC-SC:
0.03sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.03sec (x0) Satabs-prefix-first:
0.04sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ![]() 0.12sec (x.02) Satabs-prefix-first:
0.08sec
CBMC-WMM:
0.04sec
CBMC-SC:
1.67sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.07sec (x.01) Satabs-prefix-first:
0.11sec
CBMC-WMM:
0.03sec
CBMC-SC:
0.91sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.07sec (x.01) Satabs-prefix-first:
0.10sec
CBMC-WMM:
0.02sec
CBMC-SC:
0.88sec
dump-c failed with exit code 134 |
UNKNOWN |
|
gb_rcu_x86.c |
SatAbs: ERROR/TIMEOUT[1] 4.22sec Satabs-prefix-first: ERROR/TIMEOUT[1] 4.08sec CBMC-WMM:
0.03sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ERROR/TIMEOUT[] Satabs-prefix-first: ERROR/TIMEOUT[] CBMC-WMM:
0.03sec
CBMC-SC: ERROR/TIMEOUT[] dump-c failed with exit code 11 |
Cycles
SatAbs: ![]() 0.04sec (x0) Satabs-prefix-first:
0.05sec
CBMC-WMM:
0.03sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.05sec (x.01) Satabs-prefix-first:
0.04sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.04sec (x0) Satabs-prefix-first:
0.04sec
CBMC-WMM:
0.03sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ![]() 0.05sec (x.01) Satabs-prefix-first:
0.04sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.03sec (x0) Satabs-prefix-first:
0.02sec
CBMC-WMM:
0.03sec
CBMC-SC:
0.03sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.03sec (x0) Satabs-prefix-first:
0.05sec
CBMC-WMM:
0.03sec
CBMC-SC:
0.03sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ![]() 0.04sec (x0) Satabs-prefix-first:
0.05sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.04sec (x0) Satabs-prefix-first:
0.05sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.03sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.01sec (x0) Satabs-prefix-first:
0.05sec
CBMC-WMM:
0.02sec
CBMC-SC:
0.04sec
dump-c failed with exit code 134 |
UNKNOWN |
Cycles
SatAbs: ![]() 0.08sec (x.01) Satabs-prefix-first:
0.10sec
CBMC-WMM:
0.03sec
CBMC-SC:
1.86sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.08sec (x.01) Satabs-prefix-first:
0.09sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.88sec
dump-c failed with exit code 134 |
Cycles
SatAbs: ![]() 0.07sec (x.01) Satabs-prefix-first:
0.12sec
CBMC-WMM:
0.04sec
CBMC-SC:
0.90sec
dump-c failed with exit code 134 |
UNKNOWN |