Runtime model results
Per-spec NNLS fits of test runtime against opcode count — one block per (target opcode, test, model combo, client). Use the filters to narrow to a single opcode or client.
SLOAD · test_sload_bloated · combo False · besu
nobs 99
R² 0.9883
coef (ms) 0.01622
p-value 1.00e-03
95% CI [0.01588, 0.0166]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.988
Model: NNLS Adj. R-squared: 0.988
No. Observations: 99 RMSE: 36.61
Df Residuals: 97 MAE: 27.45
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 259.5499 12.1168 0.001 237.1270 284.4209
opcount 0.0162 0.0002 0.001 0.0159 0.0166
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_bloated · combo False · erigon
nobs 55
R² 0.9949
coef (ms) 0.006437
p-value 1.00e-03
95% CI [0.006319, 0.00655]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 55 RMSE: 9.51
Df Residuals: 53 MAE: 7.50
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 7.2824 3.6555 0.038 0.0000 14.1698
opcount 0.0064 0.0001 0.001 0.0063 0.0065
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_bloated · combo False · ethrex
nobs 77
R² 0.9775
coef (ms) 0.008524
p-value 1.00e-03
95% CI [0.008249, 0.008612]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.977
No. Observations: 77 RMSE: 26.95
Df Residuals: 75 MAE: 23.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 4.4550 1.000 0.0000 15.8410
opcount 0.0085 0.0001 0.001 0.0082 0.0086
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_bloated · combo False · geth
nobs 88
R² 0.9723
coef (ms) 0.02172
p-value 1.00e-03
95% CI [0.02089, 0.02246]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.972
Model: NNLS Adj. R-squared: 0.972
No. Observations: 88 RMSE: 76.01
Df Residuals: 86 MAE: 64.56
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 554.3001 26.1329 0.001 506.5133 607.9640
opcount 0.0217 0.0004 0.001 0.0209 0.0225
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_bloated · combo False · nethermind
nobs 55
R² 0.9834
coef (ms) 0.008613
p-value 1.00e-03
95% CI [0.008305, 0.008906]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 55 RMSE: 23.21
Df Residuals: 53 MAE: 18.29
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 88.3019 9.6072 0.001 69.8932 106.7913
opcount 0.0086 0.0002 0.001 0.0083 0.0089
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_bloated · combo False · reth
nobs 77
R² 0.9781
coef (ms) 0.004069
p-value 1.00e-03
95% CI [0.003951, 0.00419]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.978
No. Observations: 77 RMSE: 12.62
Df Residuals: 75 MAE: 10.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 94.1618 3.8329 0.001 86.6446 101.3611
opcount 0.0041 0.0001 0.001 0.0040 0.0042
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_bloated · combo True · besu
nobs 99
R² 0.9894
coef (ms) 0.01608
p-value 1.00e-03
95% CI [0.01576, 0.0164]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.989
Model: NNLS Adj. R-squared: 0.989
No. Observations: 99 RMSE: 34.45
Df Residuals: 97 MAE: 25.62
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 253.0955 11.0848 0.001 232.2097 276.2529
opcount 0.0161 0.0002 0.001 0.0158 0.0164
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_bloated · combo True · erigon
nobs 55
R² 0.9947
coef (ms) 0.006288
p-value 1.00e-03
95% CI [0.006212, 0.006331]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 55 RMSE: 9.53
Df Residuals: 53 MAE: 7.06
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.9346 1.000 0.0000 3.2547
opcount 0.0063 0.0000 0.001 0.0062 0.0063
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_bloated · combo True · ethrex
nobs 77
R² 0.9864
coef (ms) 0.01319
p-value 1.00e-03
95% CI [0.01307, 0.0133]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.986
Model: NNLS Adj. R-squared: 0.986
No. Observations: 77 RMSE: 33.32
Df Residuals: 75 MAE: 27.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0000 1.000 0.0000 0.0000
opcount 0.0132 0.0001 0.001 0.0131 0.0133
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_bloated · combo True · geth
nobs 88
R² 0.9745
coef (ms) 0.02069
p-value 1.00e-03
95% CI [0.01994, 0.02141]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.975
Model: NNLS Adj. R-squared: 0.974
No. Observations: 88 RMSE: 69.31
Df Residuals: 86 MAE: 59.25
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 572.4047 23.1079 0.001 529.5397 619.6385
opcount 0.0207 0.0004 0.001 0.0199 0.0214
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_bloated · combo True · nethermind
nobs 55
R² 0.985
coef (ms) 0.0088
p-value 1.00e-03
95% CI [0.008481, 0.009118]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.985
Model: NNLS Adj. R-squared: 0.985
No. Observations: 55 RMSE: 22.46
Df Residuals: 53 MAE: 17.70
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 50.0055 10.1846 0.001 31.7464 69.9122
opcount 0.0088 0.0002 0.001 0.0085 0.0091
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_bloated · combo True · reth
nobs 77
R² 0.9814
coef (ms) 0.004047
p-value 1.00e-03
95% CI [0.003908, 0.004175]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 11.53
Df Residuals: 75 MAE: 8.95
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 99.5338 4.2985 0.001 91.0087 108.2963
opcount 0.0040 0.0001 0.001 0.0039 0.0042
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_same_key_benchmark · besu
nobs 198
R² 0.287
coef (ms) 6.27e-05
p-value 1.00e-03
95% CI [4.975e-05, 7.613e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.287
Model: NNLS Adj. R-squared: 0.283
No. Observations: 198 RMSE: 62.45
Df Residuals: 196 MAE: 48.00
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 139.8155 14.2022 0.001 110.0544 169.2750
opcount 0.0001 0.0000 0.001 0.0000 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_same_key_benchmark · erigon
nobs 110
R² 0.636
coef (ms) 4.8e-05
p-value 1.00e-03
95% CI [4.08e-05, 5.434e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.636
Model: NNLS Adj. R-squared: 0.633
No. Observations: 110 RMSE: 22.94
Df Residuals: 108 MAE: 17.07
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 10.8164 6.0231 0.050 0.0000 23.0634
opcount 0.0000 0.0000 0.001 0.0000 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_same_key_benchmark · ethrex
nobs 154
R² 0.7858
coef (ms) 2.375e-05
p-value 1.00e-03
95% CI [2.196e-05, 2.569e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.786
Model: NNLS Adj. R-squared: 0.784
No. Observations: 154 RMSE: 7.83
Df Residuals: 152 MAE: 6.71
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 17.5764 1.9322 0.001 13.6789 21.2600
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_same_key_benchmark · geth
nobs 176
R² 0.9324
coef (ms) 4.677e-05
p-value 1.00e-03
95% CI [4.512e-05, 4.833e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.932
Model: NNLS Adj. R-squared: 0.932
No. Observations: 176 RMSE: 7.96
Df Residuals: 174 MAE: 6.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 20.6650 1.6804 0.001 17.4430 23.9457
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_same_key_benchmark · nethermind
nobs 110
R² 0.5986
coef (ms) 0.0001303
p-value 1.00e-03
95% CI [0.0001087, 0.0001549]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.599
Model: NNLS Adj. R-squared: 0.595
No. Observations: 110 RMSE: 67.40
Df Residuals: 108 MAE: 47.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 125.6225 22.9674 0.001 78.8606 169.7401
opcount 0.0001 0.0000 0.001 0.0001 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SLOAD · test_sload_same_key_benchmark · reth
nobs 154
R² 0.5026
coef (ms) 7.853e-06
p-value 1.00e-03
95% CI [6.537e-06, 9.15e-06]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.503
Model: NNLS Adj. R-squared: 0.499
No. Observations: 154 RMSE: 4.94
Df Residuals: 152 MAE: 3.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 10.4809 1.3027 0.001 8.1106 13.0735
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_access] · besu
nobs 99
R² 0.8346
coef (ms) 0.0165
p-value 1.00e-03
95% CI [0.01531, 0.01774]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.835
Model: NNLS Adj. R-squared: 0.833
No. Observations: 99 RMSE: 152.91
Df Residuals: 97 MAE: 116.59
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 463.5356 44.6114 0.001 375.5202 553.5865
opcount 0.0165 0.0006 0.001 0.0153 0.0177
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_access] · erigon
nobs 55
R² 0.9929
coef (ms) 0.006577
p-value 1.00e-03
95% CI [0.00644, 0.006682]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.993
No. Observations: 55 RMSE: 11.61
Df Residuals: 53 MAE: 9.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 5.3297 3.9314 0.116 0.0000 13.7629
opcount 0.0066 0.0001 0.001 0.0064 0.0067
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_access] · ethrex
nobs 77
R² 0.9688
coef (ms) 0.008409
p-value 1.00e-03
95% CI [0.008292, 0.008523]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.969
Model: NNLS Adj. R-squared: 0.968
No. Observations: 77 RMSE: 32.58
Df Residuals: 75 MAE: 26.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.3548 1.000 0.0000 0.0000
opcount 0.0084 0.0001 0.001 0.0083 0.0085
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_access] · geth
nobs 88
R² 0.9747
coef (ms) 0.02178
p-value 1.00e-03
95% CI [0.02099, 0.02249]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.975
Model: NNLS Adj. R-squared: 0.974
No. Observations: 88 RMSE: 73.05
Df Residuals: 86 MAE: 63.24
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 560.3891 24.0935 0.001 516.8442 608.0816
opcount 0.0218 0.0004 0.001 0.0210 0.0225
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_access] · nethermind
nobs 55
R² 0.97
coef (ms) 0.008742
p-value 1.00e-03
95% CI [0.008344, 0.009141]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.970
Model: NNLS Adj. R-squared: 0.969
No. Observations: 55 RMSE: 32.01
Df Residuals: 53 MAE: 25.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 74.2215 12.8027 0.001 49.1929 99.7498
opcount 0.0087 0.0002 0.001 0.0083 0.0091
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_access] · reth
nobs 77
R² 0.9877
coef (ms) 0.004128
p-value 1.00e-03
95% CI [0.004012, 0.004246]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.988
Model: NNLS Adj. R-squared: 0.988
No. Observations: 77 RMSE: 9.58
Df Residuals: 75 MAE: 7.24
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 91.5400 3.6555 0.001 84.5149 98.3875
opcount 0.0041 0.0001 0.001 0.0040 0.0042
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_access] · besu
nobs 99
R² 0.8221
coef (ms) 0.01774
p-value 1.00e-03
95% CI [0.01649, 0.01909]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.822
Model: NNLS Adj. R-squared: 0.820
No. Observations: 99 RMSE: 171.78
Df Residuals: 97 MAE: 132.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 363.7812 42.9229 0.001 279.3211 453.5828
opcount 0.0177 0.0007 0.001 0.0165 0.0191
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_access] · erigon
nobs 55
R² 0.994
coef (ms) 0.006378
p-value 1.00e-03
95% CI [0.006241, 0.006418]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.994
Model: NNLS Adj. R-squared: 0.994
No. Observations: 55 RMSE: 10.32
Df Residuals: 53 MAE: 8.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 2.4176 1.000 0.0000 7.7174
opcount 0.0064 0.0000 0.001 0.0062 0.0064
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_access] · ethrex
nobs 77
R² 0.9858
coef (ms) 0.01306
p-value 1.00e-03
95% CI [0.01293, 0.01319]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.986
Model: NNLS Adj. R-squared: 0.986
No. Observations: 77 RMSE: 34.05
Df Residuals: 75 MAE: 25.44
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0000 1.000 0.0000 0.0000
opcount 0.0131 0.0001 0.001 0.0129 0.0132
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_access] · geth
nobs 88
R² 0.9776
coef (ms) 0.02076
p-value 1.00e-03
95% CI [0.01999, 0.02149]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.977
No. Observations: 88 RMSE: 65.37
Df Residuals: 86 MAE: 54.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 573.5088 23.3876 0.001 531.3504 623.9503
opcount 0.0208 0.0004 0.001 0.0200 0.0215
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_access] · nethermind
nobs 55
R² 0.9838
coef (ms) 0.008969
p-value 1.00e-03
95% CI [0.008713, 0.009246]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.984
Model: NNLS Adj. R-squared: 0.984
No. Observations: 55 RMSE: 23.94
Df Residuals: 53 MAE: 17.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 25.7224 8.0623 0.004 10.1123 41.7167
opcount 0.0090 0.0001 0.001 0.0087 0.0092
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_access] · reth
nobs 77
R² 0.9801
coef (ms) 0.004144
p-value 1.00e-03
95% CI [0.004013, 0.004265]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 12.28
Df Residuals: 75 MAE: 9.70
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 93.5883 4.2249 0.001 85.7091 102.1100
opcount 0.0041 0.0001 0.001 0.0040 0.0043
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_write] · besu
nobs 99
R² 0.9353
coef (ms) 0.1364
p-value 1.00e-03
95% CI [0.129, 0.1432]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.935
Model: NNLS Adj. R-squared: 0.935
No. Observations: 99 RMSE: 23.18
Df Residuals: 97 MAE: 19.43
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 82.1423 7.0488 0.001 68.8746 96.7301
opcount 0.1364 0.0037 0.001 0.1290 0.1432
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_write] · erigon
nobs 55
R² 0.996
coef (ms) 0.228
p-value 1.00e-03
95% CI [0.224, 0.2319]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 55 RMSE: 9.39
Df Residuals: 53 MAE: 7.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 153.1134 4.4806 0.001 144.9620 162.3317
opcount 0.2280 0.0020 0.001 0.2240 0.2319
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_write] · ethrex
nobs 77
R² 0
coef (ms) 0
p-value 1.00e+00
95% CI [0, 0]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.000
Model: NNLS Adj. R-squared: -0.013
No. Observations: 77 RMSE: 440.02
Df Residuals: 75 MAE: 427.46
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 833.5759 51.9377 0.001 731.5205 937.4842
opcount 0.0000 0.0000 1.000 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_write] · geth
nobs 88
R² 0.8759
coef (ms) 0.1381
p-value 1.00e-03
95% CI [0.1269, 0.148]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.876
Model: NNLS Adj. R-squared: 0.874
No. Observations: 88 RMSE: 33.56
Df Residuals: 86 MAE: 29.99
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 165.7656 11.2719 0.001 144.5103 190.1345
opcount 0.1381 0.0052 0.001 0.1269 0.1480
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_write] · nethermind
nobs 55
R² 0.9638
coef (ms) 0.07467
p-value 1.00e-03
95% CI [0.07105, 0.07793]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.964
Model: NNLS Adj. R-squared: 0.963
No. Observations: 55 RMSE: 9.35
Df Residuals: 53 MAE: 7.50
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 55.5138 3.6299 0.001 48.9970 63.2711
opcount 0.0747 0.0018 0.001 0.0710 0.0779
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_write] · reth
nobs 77
R² 0.9185
coef (ms) 0.04119
p-value 1.00e-03
95% CI [0.03876, 0.04373]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.918
Model: NNLS Adj. R-squared: 0.917
No. Observations: 77 RMSE: 7.93
Df Residuals: 75 MAE: 6.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 52.2566 2.7185 0.001 47.1711 57.6207
opcount 0.0412 0.0013 0.001 0.0388 0.0437
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_write] · besu
nobs 99
R² 0.9769
coef (ms) 0.0932
p-value 1.00e-03
95% CI [0.09058, 0.09597]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.977
No. Observations: 99 RMSE: 69.44
Df Residuals: 97 MAE: 55.09
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 328.7963 19.9599 0.001 291.0824 367.7153
opcount 0.0932 0.0014 0.001 0.0906 0.0960
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_write] · erigon
nobs 55
R² 0.9942
coef (ms) 0.1401
p-value 1.00e-03
95% CI [0.1369, 0.1432]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.994
Model: NNLS Adj. R-squared: 0.994
No. Observations: 55 RMSE: 51.65
Df Residuals: 53 MAE: 38.93
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 533.2786 23.1958 0.001 491.2326 582.1111
opcount 0.1401 0.0016 0.001 0.1369 0.1432
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_write] · ethrex
nobs 77
R² 0.2141
coef (ms) 0.00914
p-value 1.00e-03
95% CI [0.005768, 0.01174]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.214
Model: NNLS Adj. R-squared: 0.204
No. Observations: 77 RMSE: 84.82
Df Residuals: 75 MAE: 69.67
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 719.4575 28.2713 0.001 671.9958 781.4272
opcount 0.0091 0.0015 0.001 0.0058 0.0117
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_write] · geth
nobs 88
R² 0.9928
coef (ms) 0.09205
p-value 1.00e-03
95% CI [0.09034, 0.09378]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.993
No. Observations: 88 RMSE: 37.99
Df Residuals: 86 MAE: 31.62
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 490.4331 13.6976 0.001 462.3435 517.8061
opcount 0.0920 0.0009 0.001 0.0903 0.0938
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_write] · nethermind
nobs 55
R² 0.9835
coef (ms) 0.05931
p-value 1.00e-03
95% CI [0.05748, 0.06112]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.984
Model: NNLS Adj. R-squared: 0.983
No. Observations: 55 RMSE: 37.18
Df Residuals: 53 MAE: 29.74
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 148.4125 14.9896 0.001 120.0959 178.2336
opcount 0.0593 0.0010 0.001 0.0575 0.0611
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_write] · reth
nobs 77
R² 0.9854
coef (ms) 0.02749
p-value 1.00e-03
95% CI [0.02674, 0.02832]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.985
Model: NNLS Adj. R-squared: 0.985
No. Observations: 77 RMSE: 16.23
Df Residuals: 75 MAE: 12.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 125.7903 5.3565 0.001 115.1796 135.4132
opcount 0.0275 0.0004 0.001 0.0267 0.0283
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================BALANCE · test_ext_account_query_warm · combo BALANCE · besu
nobs 99
R² 0.4662
coef (ms) 9.094e-05
p-value 1.00e-03
95% CI [7.461e-05, 0.0001077]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.466
Model: NNLS Adj. R-squared: 0.461
No. Observations: 99 RMSE: 56.93
Df Residuals: 97 MAE: 42.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 171.8000 16.8103 0.001 139.4171 205.3011
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_ext_account_query_warm · combo BALANCE · erigon
nobs 55
R² 0.5453
coef (ms) 4.6e-05
p-value 1.00e-03
95% CI [3.403e-05, 5.512e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.545
Model: NNLS Adj. R-squared: 0.537
No. Observations: 55 RMSE: 24.57
Df Residuals: 53 MAE: 18.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 13.9062 8.7932 0.065 0.0000 32.0163
opcount 0.0000 0.0000 0.001 0.0000 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_ext_account_query_warm · combo BALANCE · ethrex
nobs 77
R² 0.7454
coef (ms) 1.696e-05
p-value 1.00e-03
95% CI [1.508e-05, 1.878e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.745
Model: NNLS Adj. R-squared: 0.742
No. Observations: 77 RMSE: 5.80
Df Residuals: 75 MAE: 4.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 6.0304 1.8861 0.001 2.5248 10.0241
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_ext_account_query_warm · combo BALANCE · geth
nobs 88
R² 0.6446
coef (ms) 1.996e-05
p-value 1.00e-03
95% CI [1.632e-05, 2.353e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.645
Model: NNLS Adj. R-squared: 0.640
No. Observations: 88 RMSE: 8.67
Df Residuals: 86 MAE: 7.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 38.1397 3.6912 0.001 30.8072 44.9947
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_ext_account_query_warm · combo BALANCE · nethermind
nobs 55
R² 0.7211
coef (ms) 0.0001529
p-value 1.00e-03
95% CI [0.0001277, 0.0001823]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.721
Model: NNLS Adj. R-squared: 0.716
No. Observations: 55 RMSE: 55.62
Df Residuals: 53 MAE: 33.70
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 74.8980 20.5956 0.001 31.0821 114.2098
opcount 0.0002 0.0000 0.001 0.0001 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_ext_account_query_warm · combo BALANCE · reth
nobs 77
R² 0.6038
coef (ms) 1.215e-05
p-value 1.00e-03
95% CI [1.014e-05, 1.451e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.604
Model: NNLS Adj. R-squared: 0.598
No. Observations: 77 RMSE: 5.76
Df Residuals: 75 MAE: 4.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 11.7064 2.1322 0.001 7.2540 15.4968
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_EOA · besu
nobs 99
R² 0.8918
coef (ms) 0.03164
p-value 1.00e-03
95% CI [0.02966, 0.03385]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.892
Model: NNLS Adj. R-squared: 0.891
No. Observations: 99 RMSE: 227.60
Df Residuals: 97 MAE: 218.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 210.0682 66.7182 0.001 68.0570 327.2194
opcount 0.0316 0.0011 0.001 0.0297 0.0339
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_EOA · erigon
nobs 55
R² 0.971
coef (ms) 0.009399
p-value 1.00e-03
95% CI [0.009191, 0.009538]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.971
Model: NNLS Adj. R-squared: 0.971
No. Observations: 55 RMSE: 34.36
Df Residuals: 53 MAE: 24.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 2.4839 1.000 0.0000 7.5231
opcount 0.0094 0.0001 0.001 0.0092 0.0095
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_EOA · ethrex
nobs 77
R² 0.9809
coef (ms) 0.0183
p-value 1.00e-03
95% CI [0.01764, 0.01902]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 52.79
Df Residuals: 75 MAE: 46.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 220.5990 25.2116 0.001 172.1903 267.7822
opcount 0.0183 0.0003 0.001 0.0176 0.0190
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_EOA · geth
nobs 88
R² 0.9964
coef (ms) 0.02081
p-value 1.00e-03
95% CI [0.02051, 0.02108]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 25.84
Df Residuals: 86 MAE: 20.59
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 392.3380 9.5818 0.001 375.2938 412.8225
opcount 0.0208 0.0001 0.001 0.0205 0.0211
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_EOA · nethermind
nobs 55
R² 0.983
coef (ms) 0.01039
p-value 1.00e-03
95% CI [0.01002, 0.01074]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 55 RMSE: 28.17
Df Residuals: 53 MAE: 23.19
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 104.6905 11.2563 0.001 82.8968 128.2575
opcount 0.0104 0.0002 0.001 0.0100 0.0107
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_EOA · reth
nobs 77
R² 0.9843
coef (ms) 0.004558
p-value 1.00e-03
95% CI [0.004429, 0.004696]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.984
Model: NNLS Adj. R-squared: 0.984
No. Observations: 77 RMSE: 11.88
Df Residuals: 75 MAE: 9.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.1965 4.2983 0.001 89.7220 106.5532
opcount 0.0046 0.0001 0.001 0.0044 0.0047
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu
nobs 99
R² 0.9074
coef (ms) 0.03101
p-value 1.00e-03
95% CI [0.02903, 0.03308]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.907
Model: NNLS Adj. R-squared: 0.906
No. Observations: 99 RMSE: 204.53
Df Residuals: 97 MAE: 194.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 222.4035 66.4146 0.001 87.5001 347.7682
opcount 0.0310 0.0010 0.001 0.0290 0.0331
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon
nobs 55
R² 0.9941
coef (ms) 0.008303
p-value 1.00e-03
95% CI [0.008242, 0.008356]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.994
Model: NNLS Adj. R-squared: 0.994
No. Observations: 55 RMSE: 13.53
Df Residuals: 53 MAE: 10.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.7218 1.000 0.0000 0.0016
opcount 0.0083 0.0000 0.001 0.0082 0.0084
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · ethrex
nobs 77
R² 0.9555
coef (ms) 0.002408
p-value 1.00e-03
95% CI [0.002294, 0.002524]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.955
Model: NNLS Adj. R-squared: 0.955
No. Observations: 77 RMSE: 10.74
Df Residuals: 75 MAE: 8.77
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 116.7511 3.5639 0.001 109.3374 123.3636
opcount 0.0024 0.0001 0.001 0.0023 0.0025
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth
nobs 88
R² 0.9966
coef (ms) 0.0201
p-value 1.00e-03
95% CI [0.01986, 0.02033]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 88 RMSE: 24.07
Df Residuals: 86 MAE: 19.41
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 388.4795 8.3932 0.001 373.1564 405.6367
opcount 0.0201 0.0001 0.001 0.0199 0.0203
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind
nobs 55
R² 0.9814
coef (ms) 0.01007
p-value 1.00e-03
95% CI [0.009684, 0.01044]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 55 RMSE: 28.64
Df Residuals: 53 MAE: 24.57
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 115.8439 13.6059 0.001 90.1327 142.8081
opcount 0.0101 0.0002 0.001 0.0097 0.0104
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth
nobs 77
R² 0.9739
coef (ms) 0.004476
p-value 1.00e-03
95% CI [0.004305, 0.004635]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 77 RMSE: 15.14
Df Residuals: 75 MAE: 12.17
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 108.0401 5.4278 0.001 97.6069 118.9548
opcount 0.0045 0.0001 0.001 0.0043 0.0046
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · besu
nobs 99
R² 0.8915
coef (ms) 0.0441
p-value 1.00e-03
95% CI [0.04083, 0.04732]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.891
Model: NNLS Adj. R-squared: 0.890
No. Observations: 99 RMSE: 312.78
Df Residuals: 97 MAE: 252.90
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 774.4080 104.0566 0.001 577.2645 985.6402
opcount 0.0441 0.0016 0.001 0.0408 0.0473
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · erigon
nobs 55
R² 0.9423
coef (ms) 0.02483
p-value 1.00e-03
95% CI [0.02315, 0.02623]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.942
Model: NNLS Adj. R-squared: 0.941
No. Observations: 55 RMSE: 124.87
Df Residuals: 53 MAE: 106.76
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 309.7276 57.4025 0.001 205.3841 436.5304
opcount 0.0248 0.0008 0.001 0.0231 0.0262
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · ethrex
nobs 77
R² 0.981
coef (ms) 0.01854
p-value 1.00e-03
95% CI [0.01785, 0.01918]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 52.46
Df Residuals: 75 MAE: 46.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 225.4107 24.1889 0.001 180.9728 275.4570
opcount 0.0185 0.0003 0.001 0.0178 0.0192
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · geth
nobs 88
R² 0.983
coef (ms) 0.02107
p-value 1.00e-03
95% CI [0.02029, 0.02182]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 88 RMSE: 56.35
Df Residuals: 86 MAE: 41.81
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 302.4383 29.2161 0.001 248.2298 360.3413
opcount 0.0211 0.0004 0.001 0.0203 0.0218
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · nethermind
nobs 55
R² 0.9742
coef (ms) 0.01142
p-value 1.00e-03
95% CI [0.01095, 0.01195]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 55 RMSE: 37.77
Df Residuals: 53 MAE: 28.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 115.5667 15.4062 0.001 82.7339 143.6459
opcount 0.0114 0.0003 0.001 0.0109 0.0119
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · reth
nobs 77
R² 0.9903
coef (ms) 0.02086
p-value 1.00e-03
95% CI [0.02031, 0.02135]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 77 RMSE: 42.02
Df Residuals: 75 MAE: 34.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 132.1980 16.4930 0.001 101.2503 169.2159
opcount 0.0209 0.0003 0.001 0.0203 0.0213
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_MINIMAL · besu
nobs 99
R² 0.8251
coef (ms) 0.0262
p-value 1.00e-03
95% CI [0.02403, 0.0286]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.825
Model: NNLS Adj. R-squared: 0.823
No. Observations: 99 RMSE: 245.26
Df Residuals: 97 MAE: 235.72
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 310.1928 71.1431 0.001 168.0867 441.6517
opcount 0.0262 0.0012 0.001 0.0240 0.0286
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_MINIMAL · erigon
nobs 55
R² 0.9409
coef (ms) 0.02386
p-value 1.00e-03
95% CI [0.02219, 0.02517]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.941
Model: NNLS Adj. R-squared: 0.940
No. Observations: 55 RMSE: 121.56
Df Residuals: 53 MAE: 105.00
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 321.2435 55.8425 0.001 227.8508 443.3832
opcount 0.0239 0.0008 0.001 0.0222 0.0252
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_MINIMAL · ethrex
nobs 77
R² 0.9816
coef (ms) 0.01861
p-value 1.00e-03
95% CI [0.01796, 0.01929]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 51.81
Df Residuals: 75 MAE: 45.72
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 220.2026 23.4013 0.001 174.6419 269.1115
opcount 0.0186 0.0003 0.001 0.0180 0.0193
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_MINIMAL · geth
nobs 88
R² 0.9961
coef (ms) 0.01976
p-value 1.00e-03
95% CI [0.0195, 0.02001]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 25.23
Df Residuals: 86 MAE: 20.67
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 404.5685 8.5939 0.001 389.0747 423.4707
opcount 0.0198 0.0001 0.001 0.0195 0.0200
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_MINIMAL · nethermind
nobs 55
R² 0.9794
coef (ms) 0.01175
p-value 1.00e-03
95% CI [0.01126, 0.0123]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.979
No. Observations: 55 RMSE: 34.61
Df Residuals: 53 MAE: 25.33
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 90.6164 16.4869 0.001 57.1074 121.0423
opcount 0.0118 0.0003 0.001 0.0113 0.0123
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_MINIMAL · reth
nobs 77
R² 0.9785
coef (ms) 0.004936
p-value 1.00e-03
95% CI [0.00476, 0.005099]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.978
No. Observations: 77 RMSE: 14.88
Df Residuals: 75 MAE: 11.77
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 85.4241 5.0921 0.001 76.0764 95.5298
opcount 0.0049 0.0001 0.001 0.0048 0.0051
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_SAME_MAX · besu
nobs 99
R² 0.8246
coef (ms) 0.02612
p-value 1.00e-03
95% CI [0.02372, 0.02849]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.825
Model: NNLS Adj. R-squared: 0.823
No. Observations: 99 RMSE: 244.94
Df Residuals: 97 MAE: 234.64
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 318.7226 72.3228 0.001 176.4784 458.7389
opcount 0.0261 0.0012 0.001 0.0237 0.0285
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_SAME_MAX · erigon
nobs 55
R² 0.9409
coef (ms) 0.02401
p-value 1.00e-03
95% CI [0.02242, 0.02533]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.941
Model: NNLS Adj. R-squared: 0.940
No. Observations: 55 RMSE: 122.39
Df Residuals: 53 MAE: 105.66
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 315.0566 57.0022 0.001 215.4352 435.6010
opcount 0.0240 0.0008 0.001 0.0224 0.0253
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_SAME_MAX · ethrex
nobs 77
R² 0.9815
coef (ms) 0.01864
p-value 1.00e-03
95% CI [0.01799, 0.01925]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 52.08
Df Residuals: 75 MAE: 46.56
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 217.1275 22.7796 0.001 173.7128 262.0233
opcount 0.0186 0.0003 0.001 0.0180 0.0193
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_SAME_MAX · geth
nobs 88
R² 0.9946
coef (ms) 0.01989
p-value 1.00e-03
95% CI [0.01959, 0.02022]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 29.78
Df Residuals: 86 MAE: 22.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 390.1749 9.7033 0.001 371.0523 408.9160
opcount 0.0199 0.0002 0.001 0.0196 0.0202
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_SAME_MAX · nethermind
nobs 55
R² 0.9815
coef (ms) 0.01111
p-value 1.00e-03
95% CI [0.01073, 0.01154]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 55 RMSE: 31.03
Df Residuals: 53 MAE: 24.74
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 132.2596 12.8452 0.001 108.0788 156.6012
opcount 0.0111 0.0002 0.001 0.0107 0.0115
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT_SAME_MAX · reth
nobs 77
R² 0.9842
coef (ms) 0.00499
p-value 1.00e-03
95% CI [0.004816, 0.005157]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.984
Model: NNLS Adj. R-squared: 0.984
No. Observations: 77 RMSE: 12.86
Df Residuals: 75 MAE: 10.17
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 84.0636 5.1555 0.001 74.3270 95.0145
opcount 0.0050 0.0001 0.001 0.0048 0.0052
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · besu
nobs 99
R² 0.9074
coef (ms) 0.03101
p-value 1.00e-03
95% CI [0.02903, 0.03308]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.907
Model: NNLS Adj. R-squared: 0.906
No. Observations: 99 RMSE: 204.53
Df Residuals: 97 MAE: 194.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 222.4035 66.4146 0.001 87.5001 347.7682
opcount 0.0310 0.0010 0.001 0.0290 0.0331
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · erigon
nobs 55
R² 0.9941
coef (ms) 0.008303
p-value 1.00e-03
95% CI [0.008242, 0.008356]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.994
Model: NNLS Adj. R-squared: 0.994
No. Observations: 55 RMSE: 13.53
Df Residuals: 53 MAE: 10.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.7218 1.000 0.0000 0.0016
opcount 0.0083 0.0000 0.001 0.0082 0.0084
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · ethrex
nobs 77
R² 0.9555
coef (ms) 0.002408
p-value 1.00e-03
95% CI [0.002294, 0.002524]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.955
Model: NNLS Adj. R-squared: 0.955
No. Observations: 77 RMSE: 10.74
Df Residuals: 75 MAE: 8.77
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 116.7511 3.5639 0.001 109.3374 123.3636
opcount 0.0024 0.0001 0.001 0.0023 0.0025
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · geth
nobs 88
R² 0.9966
coef (ms) 0.0201
p-value 1.00e-03
95% CI [0.01986, 0.02033]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 88 RMSE: 24.07
Df Residuals: 86 MAE: 19.41
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 388.4795 8.3932 0.001 373.1564 405.6367
opcount 0.0201 0.0001 0.001 0.0199 0.0203
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · nethermind
nobs 55
R² 0.9814
coef (ms) 0.01007
p-value 1.00e-03
95% CI [0.009684, 0.01044]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 55 RMSE: 28.64
Df Residuals: 53 MAE: 24.57
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 115.8439 13.6059 0.001 90.1327 142.8081
opcount 0.0101 0.0002 0.001 0.0097 0.0104
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · reth
nobs 77
R² 0.9739
coef (ms) 0.004476
p-value 1.00e-03
95% CI [0.004305, 0.004635]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 77 RMSE: 15.14
Df Residuals: 75 MAE: 12.17
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 108.0401 5.4278 0.001 97.6069 118.9548
opcount 0.0045 0.0001 0.001 0.0043 0.0046
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_ext_account_query_warm · combo CALL · besu
nobs 99
R² 0.6797
coef (ms) 0.0004113
p-value 1.00e-03
95% CI [0.0003529, 0.0004693]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.680
Model: NNLS Adj. R-squared: 0.676
No. Observations: 99 RMSE: 142.71
Df Residuals: 97 MAE: 113.16
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 678.0373 49.7610 0.001 586.6010 782.0995
opcount 0.0004 0.0000 0.001 0.0004 0.0005
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_ext_account_query_warm · combo CALL · erigon
nobs 55
R² 0.4751
coef (ms) 0.0003072
p-value 1.00e-03
95% CI [0.0002085, 0.00035]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.475
Model: NNLS Adj. R-squared: 0.465
No. Observations: 55 RMSE: 163.19
Df Residuals: 53 MAE: 122.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 30.7536 49.3443 0.327 0.0000 157.4671
opcount 0.0003 0.0000 0.001 0.0002 0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_ext_account_query_warm · combo CALL · ethrex
nobs 77
R² 0.9486
coef (ms) 0.0001001
p-value 1.00e-03
95% CI [9.544e-05, 0.0001055]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.949
Model: NNLS Adj. R-squared: 0.948
No. Observations: 77 RMSE: 11.77
Df Residuals: 75 MAE: 9.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 39.0439 4.6585 0.001 29.5706 47.2870
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_ext_account_query_warm · combo CALL · geth
nobs 88
R² 0.9537
coef (ms) 0.0001428
p-value 1.00e-03
95% CI [0.0001355, 0.0001501]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.954
Model: NNLS Adj. R-squared: 0.953
No. Observations: 88 RMSE: 15.90
Df Residuals: 86 MAE: 12.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 29.2392 5.7762 0.001 17.5260 39.9610
opcount 0.0001 0.0000 0.001 0.0001 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_ext_account_query_warm · combo CALL · nethermind
nobs 55
R² 0.862
coef (ms) 0.0003485
p-value 1.00e-03
95% CI [0.0003066, 0.0003873]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.862
Model: NNLS Adj. R-squared: 0.859
No. Observations: 55 RMSE: 70.48
Df Residuals: 53 MAE: 59.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 244.5760 35.4091 0.001 182.6294 318.9370
opcount 0.0003 0.0000 0.001 0.0003 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_ext_account_query_warm · combo CALL · reth
nobs 77
R² 0.9368
coef (ms) 5.849e-05
p-value 1.00e-03
95% CI [5.469e-05, 6.203e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.937
Model: NNLS Adj. R-squared: 0.936
No. Observations: 77 RMSE: 7.68
Df Residuals: 75 MAE: 6.05
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 28.0650 3.0878 0.001 22.2311 34.5095
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · besu
nobs 99
R² 0.8986
coef (ms) 0.03284
p-value 1.00e-03
95% CI [0.03058, 0.03511]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.899
Model: NNLS Adj. R-squared: 0.898
No. Observations: 99 RMSE: 226.59
Df Residuals: 97 MAE: 215.74
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 328.3880 74.0301 0.001 181.8718 467.9723
opcount 0.0328 0.0011 0.001 0.0306 0.0351
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · erigon
nobs 55
R² 0.9322
coef (ms) 0.01037
p-value 1.00e-03
95% CI [0.009634, 0.01062]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.932
Model: NNLS Adj. R-squared: 0.931
No. Observations: 55 RMSE: 57.86
Df Residuals: 53 MAE: 43.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 11.4747 1.000 0.0000 38.9934
opcount 0.0104 0.0003 0.001 0.0096 0.0106
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · ethrex
nobs 77
R² 0.9815
coef (ms) 0.01843
p-value 1.00e-03
95% CI [0.01776, 0.01908]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 51.99
Df Residuals: 75 MAE: 46.07
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 223.5068 24.8562 0.001 176.8589 273.7963
opcount 0.0184 0.0003 0.001 0.0178 0.0191
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · geth
nobs 88
R² 0.9947
coef (ms) 0.02101
p-value 1.00e-03
95% CI [0.02066, 0.02136]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 31.53
Df Residuals: 86 MAE: 25.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 392.9466 11.0894 0.001 371.7075 415.8159
opcount 0.0210 0.0002 0.001 0.0207 0.0214
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · nethermind
nobs 55
R² 0.9861
coef (ms) 0.01064
p-value 1.00e-03
95% CI [0.01033, 0.011]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.986
Model: NNLS Adj. R-squared: 0.986
No. Observations: 55 RMSE: 25.96
Df Residuals: 53 MAE: 20.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 105.0019 11.3951 0.001 82.4431 126.5562
opcount 0.0106 0.0002 0.001 0.0103 0.0110
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · reth
nobs 77
R² 0.9792
coef (ms) 0.004836
p-value 1.00e-03
95% CI [0.004686, 0.005001]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.979
No. Observations: 77 RMSE: 14.49
Df Residuals: 75 MAE: 11.95
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 101.9627 5.2057 0.001 91.7385 111.6262
opcount 0.0048 0.0001 0.001 0.0047 0.0050
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu
nobs 99
R² 0.8951
coef (ms) 0.03293
p-value 1.00e-03
95% CI [0.03082, 0.03529]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.895
Model: NNLS Adj. R-squared: 0.894
No. Observations: 99 RMSE: 231.54
Df Residuals: 97 MAE: 221.20
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 362.6627 71.7517 0.001 214.3013 498.7615
opcount 0.0329 0.0011 0.001 0.0308 0.0353
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon
nobs 55
R² 0.9767
coef (ms) 0.009159
p-value 1.00e-03
95% CI [0.008978, 0.009281]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.976
No. Observations: 55 RMSE: 29.74
Df Residuals: 53 MAE: 20.93
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 1.7935 1.000 0.0000 5.9246
opcount 0.0092 0.0001 0.001 0.0090 0.0093
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · ethrex
nobs 77
R² 0.9599
coef (ms) 0.00252
p-value 1.00e-03
95% CI [0.002404, 0.002647]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.959
No. Observations: 77 RMSE: 10.58
Df Residuals: 75 MAE: 8.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 116.4459 3.6758 0.001 108.8758 123.0501
opcount 0.0025 0.0001 0.001 0.0024 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth
nobs 88
R² 0.9962
coef (ms) 0.02093
p-value 1.00e-03
95% CI [0.02067, 0.02122]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 26.69
Df Residuals: 86 MAE: 21.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 365.2279 8.4953 0.001 348.7877 382.4005
opcount 0.0209 0.0001 0.001 0.0207 0.0212
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind
nobs 55
R² 0.9871
coef (ms) 0.01075
p-value 1.00e-03
95% CI [0.01043, 0.01104]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.987
Model: NNLS Adj. R-squared: 0.987
No. Observations: 55 RMSE: 25.19
Df Residuals: 53 MAE: 19.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 94.2809 10.0759 0.001 76.1279 115.5439
opcount 0.0108 0.0002 0.001 0.0104 0.0110
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth
nobs 77
R² 0.9759
coef (ms) 0.004618
p-value 1.00e-03
95% CI [0.004455, 0.004793]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.976
Model: NNLS Adj. R-squared: 0.976
No. Observations: 77 RMSE: 14.90
Df Residuals: 75 MAE: 11.34
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 101.7503 5.3839 0.001 91.3249 111.1999
opcount 0.0046 0.0001 0.001 0.0045 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · besu
nobs 99
R² 0.9623
coef (ms) 0.1151
p-value 1.00e-03
95% CI [0.1102, 0.1198]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.962
Model: NNLS Adj. R-squared: 0.962
No. Observations: 99 RMSE: 107.61
Df Residuals: 97 MAE: 94.53
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 330.2614 37.5518 0.001 258.9900 407.0338
opcount 0.1151 0.0024 0.001 0.1102 0.1198
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · erigon
nobs 55
R² 0.9846
coef (ms) 0.1464
p-value 1.00e-03
95% CI [0.1418, 0.1504]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.985
Model: NNLS Adj. R-squared: 0.984
No. Observations: 55 RMSE: 86.48
Df Residuals: 53 MAE: 47.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 521.6119 37.6559 0.001 461.9020 605.9307
opcount 0.1464 0.0022 0.001 0.1418 0.1504
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · ethrex
nobs 77
R² 0.9959
coef (ms) 0.03626
p-value 1.00e-03
95% CI [0.03575, 0.03677]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 77 RMSE: 11.05
Df Residuals: 75 MAE: 8.87
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 277.2548 3.4961 0.001 270.6281 284.2996
opcount 0.0363 0.0003 0.001 0.0358 0.0368
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · geth
nobs 88
R² 0.9966
coef (ms) 0.1028
p-value 1.00e-03
95% CI [0.1014, 0.1042]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 88 RMSE: 28.55
Df Residuals: 86 MAE: 23.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 382.4542 9.7409 0.001 364.2636 403.1197
opcount 0.1028 0.0007 0.001 0.1014 0.1042
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · nethermind
nobs 55
R² 0.9771
coef (ms) 0.06689
p-value 1.00e-03
95% CI [0.064, 0.06991]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.977
No. Observations: 55 RMSE: 48.35
Df Residuals: 53 MAE: 37.90
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 152.8902 20.5038 0.001 112.0298 191.9160
opcount 0.0669 0.0015 0.001 0.0640 0.0699
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · reth
nobs 77
R² 0.9884
coef (ms) 0.03574
p-value 1.00e-03
95% CI [0.03492, 0.03667]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.988
Model: NNLS Adj. R-squared: 0.988
No. Observations: 77 RMSE: 18.30
Df Residuals: 75 MAE: 14.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 88.6326 6.1041 0.001 76.2878 100.3819
opcount 0.0357 0.0004 0.001 0.0349 0.0367
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · besu
nobs 99
R² 0.852
coef (ms) 0.1758
p-value 1.00e-03
95% CI [0.158, 0.1933]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.852
Model: NNLS Adj. R-squared: 0.851
No. Observations: 99 RMSE: 25.24
Df Residuals: 97 MAE: 21.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 67.8435 8.7039 0.001 51.5632 85.7544
opcount 0.1758 0.0090 0.001 0.1580 0.1933
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · erigon
nobs 55
R² 0.9931
coef (ms) 0.2723
p-value 1.00e-03
95% CI [0.265, 0.279]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.993
No. Observations: 55 RMSE: 7.80
Df Residuals: 53 MAE: 6.15
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 92.1621 3.7157 0.001 85.1814 99.8527
opcount 0.2723 0.0036 0.001 0.2650 0.2790
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · ethrex
nobs 77
R² 0.8464
coef (ms) 0.05196
p-value 1.00e-03
95% CI [0.04627, 0.05735]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.846
Model: NNLS Adj. R-squared: 0.844
No. Observations: 77 RMSE: 7.63
Df Residuals: 75 MAE: 5.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 227.6842 3.2225 0.001 222.0053 234.4467
opcount 0.0520 0.0028 0.001 0.0463 0.0574
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · geth
nobs 88
R² 0.9811
coef (ms) 0.1572
p-value 1.00e-03
95% CI [0.1518, 0.1622]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 88 RMSE: 7.51
Df Residuals: 86 MAE: 5.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 42.7799 3.0100 0.001 37.4917 49.0752
opcount 0.1572 0.0027 0.001 0.1518 0.1622
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · nethermind
nobs 55
R² 0.9223
coef (ms) 0.1001
p-value 1.00e-03
95% CI [0.09222, 0.1093]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.922
Model: NNLS Adj. R-squared: 0.921
No. Observations: 55 RMSE: 10.01
Df Residuals: 53 MAE: 7.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 25.6635 3.9754 0.001 17.3201 33.2760
opcount 0.1001 0.0043 0.001 0.0922 0.1093
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · reth
nobs 77
R² 0.8
coef (ms) 0.05352
p-value 1.00e-03
95% CI [0.04774, 0.05894]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.800
Model: NNLS Adj. R-squared: 0.797
No. Observations: 77 RMSE: 9.22
Df Residuals: 75 MAE: 6.81
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 19.1636 3.1854 0.001 13.2112 25.5947
opcount 0.0535 0.0029 0.001 0.0477 0.0589
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · besu
nobs 99
R² 0.884
coef (ms) 0.04678
p-value 1.00e-03
95% CI [0.04354, 0.05006]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.884
Model: NNLS Adj. R-squared: 0.883
No. Observations: 99 RMSE: 342.71
Df Residuals: 97 MAE: 283.35
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 851.7345 104.3925 0.001 645.4577 1052.9397
opcount 0.0468 0.0017 0.001 0.0435 0.0501
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · erigon
nobs 55
R² 0.8984
coef (ms) 0.1471
p-value 1.00e-03
95% CI [0.1334, 0.1583]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.898
Model: NNLS Adj. R-squared: 0.897
No. Observations: 55 RMSE: 1000.06
Df Residuals: 53 MAE: 830.59
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 868.7634 446.4025 0.015 111.7696 1879.5464
opcount 0.1471 0.0063 0.001 0.1334 0.1583
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · ethrex
nobs 77
R² 0.9969
coef (ms) 0.1007
p-value 1.00e-03
95% CI [0.09941, 0.1018]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 77 RMSE: 113.28
Df Residuals: 75 MAE: 89.54
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 487.9641 39.0268 0.001 419.6564 571.3377
opcount 0.1007 0.0006 0.001 0.0994 0.1018
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · geth
nobs 88
R² 0.9359
coef (ms) 0.04167
p-value 1.00e-03
95% CI [0.03909, 0.04412]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.936
Model: NNLS Adj. R-squared: 0.935
No. Observations: 88 RMSE: 220.57
Df Residuals: 86 MAE: 184.18
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1299.9131 95.6090 0.001 1124.3915 1489.9229
opcount 0.0417 0.0013 0.001 0.0391 0.0441
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · nethermind
nobs 55
R² 0.9242
coef (ms) 0.03781
p-value 1.00e-03
95% CI [0.03441, 0.04088]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.924
Model: NNLS Adj. R-squared: 0.923
No. Observations: 55 RMSE: 219.00
Df Residuals: 53 MAE: 182.13
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 656.1439 117.9927 0.001 450.7461 907.9251
opcount 0.0378 0.0017 0.001 0.0344 0.0409
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · reth
nobs 77
R² 0.9932
coef (ms) 0.02399
p-value 1.00e-03
95% CI [0.02349, 0.0245]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.993
No. Observations: 77 RMSE: 40.21
Df Residuals: 75 MAE: 33.00
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 138.7516 14.4058 0.001 110.4761 166.5357
opcount 0.0240 0.0003 0.001 0.0235 0.0245
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · besu
nobs 99
R² 0.8443
coef (ms) 0.02717
p-value 1.00e-03
95% CI [0.02515, 0.0294]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.844
Model: NNLS Adj. R-squared: 0.843
No. Observations: 99 RMSE: 235.96
Df Residuals: 97 MAE: 226.30
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 385.6922 69.7479 0.001 251.1943 519.8613
opcount 0.0272 0.0011 0.001 0.0251 0.0294
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · erigon
nobs 55
R² 0.9418
coef (ms) 0.02495
p-value 1.00e-03
95% CI [0.02332, 0.02637]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.942
Model: NNLS Adj. R-squared: 0.941
No. Observations: 55 RMSE: 125.35
Df Residuals: 53 MAE: 108.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 323.4054 55.9884 0.001 221.8730 441.8588
opcount 0.0249 0.0008 0.001 0.0233 0.0264
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · ethrex
nobs 77
R² 0.9828
coef (ms) 0.01888
p-value 1.00e-03
95% CI [0.01826, 0.01953]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 77 RMSE: 50.50
Df Residuals: 75 MAE: 45.15
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 214.6876 23.4972 0.001 169.6305 260.8413
opcount 0.0189 0.0003 0.001 0.0183 0.0195
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · geth
nobs 88
R² 0.9953
coef (ms) 0.02038
p-value 1.00e-03
95% CI [0.02006, 0.02065]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 28.29
Df Residuals: 86 MAE: 23.03
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 399.3106 10.3007 0.001 381.6728 421.4335
opcount 0.0204 0.0002 0.001 0.0201 0.0207
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · nethermind
nobs 55
R² 0.9856
coef (ms) 0.01218
p-value 1.00e-03
95% CI [0.01184, 0.01253]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.986
Model: NNLS Adj. R-squared: 0.985
No. Observations: 55 RMSE: 29.79
Df Residuals: 53 MAE: 24.31
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 150.8724 12.6538 0.001 126.3611 175.2730
opcount 0.0122 0.0002 0.001 0.0118 0.0125
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · reth
nobs 77
R² 0.9838
coef (ms) 0.005463
p-value 1.00e-03
95% CI [0.00531, 0.005623]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.984
Model: NNLS Adj. R-squared: 0.984
No. Observations: 77 RMSE: 14.16
Df Residuals: 75 MAE: 11.34
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 85.8256 4.6387 0.001 77.1387 95.5038
opcount 0.0055 0.0001 0.001 0.0053 0.0056
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · besu
nobs 99
R² 0.8433
coef (ms) 0.02722
p-value 1.00e-03
95% CI [0.02502, 0.02939]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.843
Model: NNLS Adj. R-squared: 0.842
No. Observations: 99 RMSE: 237.24
Df Residuals: 97 MAE: 230.43
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 395.4916 73.3757 0.001 257.9003 540.3942
opcount 0.0272 0.0011 0.001 0.0250 0.0294
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · erigon
nobs 55
R² 0.7684
coef (ms) 0.02708
p-value 1.00e-03
95% CI [0.02313, 0.03127]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.768
Model: NNLS Adj. R-squared: 0.764
No. Observations: 55 RMSE: 300.57
Df Residuals: 53 MAE: 226.50
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 328.8053 119.5688 0.005 103.0088 576.3248
opcount 0.0271 0.0020 0.001 0.0231 0.0313
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · ethrex
nobs 77
R² 0.9806
coef (ms) 0.01874
p-value 1.00e-03
95% CI [0.01812, 0.01939]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 53.31
Df Residuals: 75 MAE: 47.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 225.1275 23.9367 0.001 180.6605 272.7015
opcount 0.0187 0.0003 0.001 0.0181 0.0194
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · geth
nobs 88
R² 0.9963
coef (ms) 0.02035
p-value 1.00e-03
95% CI [0.02009, 0.02057]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 25.16
Df Residuals: 86 MAE: 19.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 400.7474 8.0592 0.001 386.5100 417.6506
opcount 0.0203 0.0001 0.001 0.0201 0.0206
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · nethermind
nobs 55
R² 0.9823
coef (ms) 0.0124
p-value 1.00e-03
95% CI [0.01198, 0.01282]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.982
No. Observations: 55 RMSE: 33.65
Df Residuals: 53 MAE: 25.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 132.7729 14.9158 0.001 105.1365 162.1651
opcount 0.0124 0.0002 0.001 0.0120 0.0128
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · reth
nobs 77
R² 0.98
coef (ms) 0.005339
p-value 1.00e-03
95% CI [0.005148, 0.005522]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 15.42
Df Residuals: 75 MAE: 12.15
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 94.5252 5.7221 0.001 83.7408 106.1794
opcount 0.0053 0.0001 0.001 0.0051 0.0055
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · besu
nobs 99
R² 0.8951
coef (ms) 0.03293
p-value 1.00e-03
95% CI [0.03082, 0.03529]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.895
Model: NNLS Adj. R-squared: 0.894
No. Observations: 99 RMSE: 231.54
Df Residuals: 97 MAE: 221.20
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 362.6627 71.7517 0.001 214.3013 498.7615
opcount 0.0329 0.0011 0.001 0.0308 0.0353
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · erigon
nobs 55
R² 0.9767
coef (ms) 0.009159
p-value 1.00e-03
95% CI [0.008978, 0.009281]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.976
No. Observations: 55 RMSE: 29.74
Df Residuals: 53 MAE: 20.93
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 1.7935 1.000 0.0000 5.9246
opcount 0.0092 0.0001 0.001 0.0090 0.0093
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · ethrex
nobs 77
R² 0.9599
coef (ms) 0.00252
p-value 1.00e-03
95% CI [0.002404, 0.002647]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.959
No. Observations: 77 RMSE: 10.58
Df Residuals: 75 MAE: 8.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 116.4459 3.6758 0.001 108.8758 123.0501
opcount 0.0025 0.0001 0.001 0.0024 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · geth
nobs 88
R² 0.9962
coef (ms) 0.02093
p-value 1.00e-03
95% CI [0.02067, 0.02122]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 26.69
Df Residuals: 86 MAE: 21.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 365.2279 8.4953 0.001 348.7877 382.4005
opcount 0.0209 0.0001 0.001 0.0207 0.0212
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · nethermind
nobs 55
R² 0.9871
coef (ms) 0.01075
p-value 1.00e-03
95% CI [0.01043, 0.01104]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.987
Model: NNLS Adj. R-squared: 0.987
No. Observations: 55 RMSE: 25.19
Df Residuals: 53 MAE: 19.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 94.2809 10.0759 0.001 76.1279 115.5439
opcount 0.0108 0.0002 0.001 0.0104 0.0110
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · reth
nobs 77
R² 0.9759
coef (ms) 0.004618
p-value 1.00e-03
95% CI [0.004455, 0.004793]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.976
Model: NNLS Adj. R-squared: 0.976
No. Observations: 77 RMSE: 14.90
Df Residuals: 75 MAE: 11.34
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 101.7503 5.3839 0.001 91.3249 111.1999
opcount 0.0046 0.0001 0.001 0.0045 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · besu
nobs 99
R² 0.959
coef (ms) 0.1442
p-value 1.00e-03
95% CI [0.1381, 0.1508]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.959
Model: NNLS Adj. R-squared: 0.959
No. Observations: 99 RMSE: 140.31
Df Residuals: 97 MAE: 120.07
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 215.9218 42.0530 0.001 130.4026 294.6425
opcount 0.1442 0.0033 0.001 0.1381 0.1508
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · erigon
nobs 55
R² 0.973
coef (ms) 0.2752
p-value 1.00e-03
95% CI [0.2624, 0.2867]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.973
Model: NNLS Adj. R-squared: 0.972
No. Observations: 55 RMSE: 215.92
Df Residuals: 53 MAE: 180.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1113.2143 93.6392 0.001 950.3839 1308.8648
opcount 0.2752 0.0061 0.001 0.2624 0.2867
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · ethrex
nobs 77
R² 0.9926
coef (ms) 0.1342
p-value 1.00e-03
95% CI [0.1314, 0.137]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.992
No. Observations: 77 RMSE: 54.68
Df Residuals: 75 MAE: 43.09
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 235.4854 17.7136 0.001 200.1946 271.5631
opcount 0.1342 0.0014 0.001 0.1314 0.1370
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · geth
nobs 88
R² 0.9897
coef (ms) 0.1303
p-value 1.00e-03
95% CI [0.1272, 0.1334]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 88 RMSE: 62.56
Df Residuals: 86 MAE: 51.41
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 541.4631 25.6609 0.001 494.5394 594.3846
opcount 0.1303 0.0016 0.001 0.1272 0.1334
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · nethermind
nobs 55
R² 0.9656
coef (ms) 0.09117
p-value 1.00e-03
95% CI [0.08644, 0.09565]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.966
Model: NNLS Adj. R-squared: 0.965
No. Observations: 55 RMSE: 81.05
Df Residuals: 53 MAE: 61.46
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 116.3143 30.4748 0.001 56.9590 177.5114
opcount 0.0912 0.0024 0.001 0.0864 0.0957
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · reth
nobs 77
R² 0.9925
coef (ms) 0.05739
p-value 1.00e-03
95% CI [0.05622, 0.05857]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.992
No. Observations: 77 RMSE: 23.41
Df Residuals: 75 MAE: 18.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 137.0464 8.9269 0.001 120.1953 154.0146
opcount 0.0574 0.0006 0.001 0.0562 0.0586
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · besu
nobs 99
R² 0.9536
coef (ms) 0.1131
p-value 1.00e-03
95% CI [0.108, 0.1189]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.954
Model: NNLS Adj. R-squared: 0.953
No. Observations: 99 RMSE: 117.43
Df Residuals: 97 MAE: 101.58
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 275.0144 38.2660 0.001 199.3495 346.2580
opcount 0.1131 0.0028 0.001 0.1080 0.1189
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · erigon
nobs 55
R² 0.9966
coef (ms) 0.1615
p-value 1.00e-03
95% CI [0.1583, 0.1645]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 55 RMSE: 44.61
Df Residuals: 53 MAE: 36.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 759.9618 23.1939 0.001 719.9050 809.3914
opcount 0.1615 0.0016 0.001 0.1583 0.1645
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · ethrex
nobs 77
R² 0.9869
coef (ms) 0.03608
p-value 1.00e-03
95% CI [0.03546, 0.03681]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.987
Model: NNLS Adj. R-squared: 0.987
No. Observations: 77 RMSE: 19.55
Df Residuals: 75 MAE: 13.86
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 281.1518 5.0514 0.001 270.7064 290.6555
opcount 0.0361 0.0003 0.001 0.0355 0.0368
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · geth
nobs 88
R² 0.997
coef (ms) 0.103
p-value 1.00e-03
95% CI [0.1017, 0.1042]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 88 RMSE: 26.45
Df Residuals: 86 MAE: 22.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 383.3015 9.4545 0.001 367.1791 403.2880
opcount 0.1030 0.0006 0.001 0.1017 0.1042
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · nethermind
nobs 55
R² 0.9821
coef (ms) 0.07208
p-value 1.00e-03
95% CI [0.06912, 0.07509]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.982
No. Observations: 55 RMSE: 45.84
Df Residuals: 53 MAE: 36.48
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 107.6899 19.0895 0.001 67.7253 143.0748
opcount 0.0721 0.0015 0.001 0.0691 0.0751
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · reth
nobs 77
R² 0.9898
coef (ms) 0.03529
p-value 1.00e-03
95% CI [0.03443, 0.03627]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 77 RMSE: 16.87
Df Residuals: 75 MAE: 13.02
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 95.6921 6.7435 0.001 82.2397 107.9524
opcount 0.0353 0.0005 0.001 0.0344 0.0363
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · besu
nobs 99
R² 0.9612
coef (ms) 0.1133
p-value 1.00e-03
95% CI [0.1085, 0.118]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.961
Model: NNLS Adj. R-squared: 0.961
No. Observations: 99 RMSE: 107.17
Df Residuals: 97 MAE: 94.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 272.6428 34.4986 0.001 205.3446 338.8854
opcount 0.1133 0.0024 0.001 0.1085 0.1180
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · erigon
nobs 55
R² 0.9842
coef (ms) 0.1626
p-value 1.00e-03
95% CI [0.1566, 0.1693]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.984
Model: NNLS Adj. R-squared: 0.984
No. Observations: 55 RMSE: 97.03
Df Residuals: 53 MAE: 66.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 788.8304 43.1823 0.001 704.9796 874.1204
opcount 0.1626 0.0033 0.001 0.1566 0.1693
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · ethrex
nobs 77
R² 0.9912
coef (ms) 0.03604
p-value 1.00e-03
95% CI [0.03545, 0.03669]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.991
Model: NNLS Adj. R-squared: 0.991
No. Observations: 77 RMSE: 15.96
Df Residuals: 75 MAE: 12.81
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 284.0817 4.5923 0.001 274.8609 293.3115
opcount 0.0360 0.0003 0.001 0.0355 0.0367
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · geth
nobs 88
R² 0.9973
coef (ms) 0.1027
p-value 1.00e-03
95% CI [0.1014, 0.104]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 88 RMSE: 24.99
Df Residuals: 86 MAE: 19.32
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 383.4056 9.3322 0.001 366.1888 402.7397
opcount 0.1027 0.0006 0.001 0.1014 0.1040
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · nethermind
nobs 55
R² 0.9747
coef (ms) 0.07064
p-value 1.00e-03
95% CI [0.06765, 0.07397]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.975
Model: NNLS Adj. R-squared: 0.974
No. Observations: 55 RMSE: 53.61
Df Residuals: 53 MAE: 40.64
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 108.9970 21.8948 0.001 63.7328 148.8849
opcount 0.0706 0.0017 0.001 0.0677 0.0740
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · reth
nobs 77
R² 0.9876
coef (ms) 0.03712
p-value 1.00e-03
95% CI [0.03602, 0.03823]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.988
Model: NNLS Adj. R-squared: 0.987
No. Observations: 77 RMSE: 19.62
Df Residuals: 75 MAE: 14.62
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 72.1091 7.7282 0.001 57.3815 86.8231
opcount 0.0371 0.0006 0.001 0.0360 0.0382
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · besu
nobs 99
R² 0.852
coef (ms) 0.1758
p-value 1.00e-03
95% CI [0.158, 0.1933]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.852
Model: NNLS Adj. R-squared: 0.851
No. Observations: 99 RMSE: 25.24
Df Residuals: 97 MAE: 21.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 67.8435 8.7039 0.001 51.5632 85.7544
opcount 0.1758 0.0090 0.001 0.1580 0.1933
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · erigon
nobs 55
R² 0.9931
coef (ms) 0.2723
p-value 1.00e-03
95% CI [0.265, 0.279]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.993
No. Observations: 55 RMSE: 7.80
Df Residuals: 53 MAE: 6.15
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 92.1621 3.7157 0.001 85.1814 99.8527
opcount 0.2723 0.0036 0.001 0.2650 0.2790
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · ethrex
nobs 77
R² 0.8464
coef (ms) 0.05196
p-value 1.00e-03
95% CI [0.04627, 0.05735]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.846
Model: NNLS Adj. R-squared: 0.844
No. Observations: 77 RMSE: 7.63
Df Residuals: 75 MAE: 5.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 227.6842 3.2225 0.001 222.0053 234.4467
opcount 0.0520 0.0028 0.001 0.0463 0.0574
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · geth
nobs 88
R² 0.9811
coef (ms) 0.1572
p-value 1.00e-03
95% CI [0.1518, 0.1622]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 88 RMSE: 7.51
Df Residuals: 86 MAE: 5.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 42.7799 3.0100 0.001 37.4917 49.0752
opcount 0.1572 0.0027 0.001 0.1518 0.1622
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · nethermind
nobs 55
R² 0.9223
coef (ms) 0.1001
p-value 1.00e-03
95% CI [0.09222, 0.1093]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.922
Model: NNLS Adj. R-squared: 0.921
No. Observations: 55 RMSE: 10.01
Df Residuals: 53 MAE: 7.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 25.6635 3.9754 0.001 17.3201 33.2760
opcount 0.1001 0.0043 0.001 0.0922 0.1093
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · reth
nobs 77
R² 0.8
coef (ms) 0.05352
p-value 1.00e-03
95% CI [0.04774, 0.05894]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.800
Model: NNLS Adj. R-squared: 0.797
No. Observations: 77 RMSE: 9.22
Df Residuals: 75 MAE: 6.81
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 19.1636 3.1854 0.001 13.2112 25.5947
opcount 0.0535 0.0029 0.001 0.0477 0.0589
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_ext_account_query_warm · combo CALLCODE · besu
nobs 99
R² 0.7592
coef (ms) 0.0004493
p-value 1.00e-03
95% CI [0.0003975, 0.0005054]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.759
Model: NNLS Adj. R-squared: 0.757
No. Observations: 99 RMSE: 127.92
Df Residuals: 97 MAE: 102.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 592.3317 41.8390 0.001 509.6398 670.5967
opcount 0.0004 0.0000 0.001 0.0004 0.0005
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_ext_account_query_warm · combo CALLCODE · erigon
nobs 55
R² 0.6391
coef (ms) 0.0001025
p-value 1.00e-03
95% CI [7.941e-05, 0.0001216]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.639
Model: NNLS Adj. R-squared: 0.632
No. Observations: 55 RMSE: 38.92
Df Residuals: 53 MAE: 28.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 28.5143 15.1400 0.034 0.0000 59.4697
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_ext_account_query_warm · combo CALLCODE · ethrex
nobs 77
R² 0.9508
coef (ms) 0.0001008
p-value 1.00e-03
95% CI [9.547e-05, 0.0001064]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.951
Model: NNLS Adj. R-squared: 0.950
No. Observations: 77 RMSE: 11.59
Df Residuals: 75 MAE: 9.35
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 35.0707 4.5549 0.001 25.8188 43.8756
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_ext_account_query_warm · combo CALLCODE · geth
nobs 88
R² 0.9401
coef (ms) 0.0001799
p-value 1.00e-03
95% CI [0.0001696, 0.0001906]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.940
Model: NNLS Adj. R-squared: 0.939
No. Observations: 88 RMSE: 22.95
Df Residuals: 86 MAE: 18.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 40.6222 8.2187 0.001 24.0478 56.5076
opcount 0.0002 0.0000 0.001 0.0002 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_ext_account_query_warm · combo CALLCODE · nethermind
nobs 55
R² 0.7979
coef (ms) 0.0001917
p-value 1.00e-03
95% CI [0.0001688, 0.0002158]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.798
Model: NNLS Adj. R-squared: 0.794
No. Observations: 55 RMSE: 48.76
Df Residuals: 53 MAE: 37.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 157.2705 17.4229 0.001 123.2374 191.4358
opcount 0.0002 0.0000 0.001 0.0002 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_ext_account_query_warm · combo CALLCODE · reth
nobs 77
R² 0.9167
coef (ms) 5.662e-05
p-value 1.00e-03
95% CI [5.289e-05, 6.038e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.917
Model: NNLS Adj. R-squared: 0.916
No. Observations: 77 RMSE: 8.63
Df Residuals: 75 MAE: 6.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 26.3462 3.2378 0.001 20.2796 32.8542
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · besu
nobs 99
R² 0.8923
coef (ms) 0.03279
p-value 1.00e-03
95% CI [0.03051, 0.03503]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.892
Model: NNLS Adj. R-squared: 0.891
No. Observations: 99 RMSE: 233.95
Df Residuals: 97 MAE: 224.45
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 274.6951 73.9991 0.001 122.9271 424.2489
opcount 0.0328 0.0012 0.001 0.0305 0.0350
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · erigon
nobs 55
R² 0.9504
coef (ms) 0.009483
p-value 1.00e-03
95% CI [0.008943, 0.00967]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.950
Model: NNLS Adj. R-squared: 0.949
No. Observations: 55 RMSE: 45.02
Df Residuals: 53 MAE: 33.53
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 7.8498 1.000 0.0000 27.6242
opcount 0.0095 0.0002 0.001 0.0089 0.0097
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · ethrex
nobs 77
R² 0.9804
coef (ms) 0.01833
p-value 1.00e-03
95% CI [0.01764, 0.019]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 53.17
Df Residuals: 75 MAE: 46.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 229.4092 24.7481 0.001 181.3194 279.7136
opcount 0.0183 0.0003 0.001 0.0176 0.0190
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · geth
nobs 88
R² 0.9951
coef (ms) 0.02105
p-value 1.00e-03
95% CI [0.02075, 0.02141]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 30.27
Df Residuals: 86 MAE: 24.09
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 394.0259 10.0691 0.001 373.6552 412.5062
opcount 0.0211 0.0002 0.001 0.0207 0.0214
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · nethermind
nobs 55
R² 0.9858
coef (ms) 0.01067
p-value 1.00e-03
95% CI [0.01034, 0.01099]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.986
Model: NNLS Adj. R-squared: 0.985
No. Observations: 55 RMSE: 26.34
Df Residuals: 53 MAE: 21.28
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 87.0125 9.9669 0.001 68.0976 106.4749
opcount 0.0107 0.0002 0.001 0.0103 0.0110
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · reth
nobs 77
R² 0.9725
coef (ms) 0.004657
p-value 1.00e-03
95% CI [0.004479, 0.004852]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.972
Model: NNLS Adj. R-squared: 0.972
No. Observations: 77 RMSE: 16.09
Df Residuals: 75 MAE: 11.25
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 94.9170 5.7210 0.001 83.6411 106.7643
opcount 0.0047 0.0001 0.001 0.0045 0.0049
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu
nobs 99
R² 0.9101
coef (ms) 0.03223
p-value 1.00e-03
95% CI [0.03023, 0.03406]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.910
Model: NNLS Adj. R-squared: 0.909
No. Observations: 99 RMSE: 207.95
Df Residuals: 97 MAE: 200.10
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 275.3318 66.2408 0.001 153.9379 408.6019
opcount 0.0322 0.0010 0.001 0.0302 0.0341
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon
nobs 55
R² 0.9918
coef (ms) 0.008415
p-value 1.00e-03
95% CI [0.008346, 0.008479]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.992
Model: NNLS Adj. R-squared: 0.992
No. Observations: 55 RMSE: 16.17
Df Residuals: 53 MAE: 11.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0064 1.000 0.0000 0.0000
opcount 0.0084 0.0000 0.001 0.0083 0.0085
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · ethrex
nobs 77
R² 0.9596
coef (ms) 0.002557
p-value 1.00e-03
95% CI [0.002419, 0.002689]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.959
No. Observations: 77 RMSE: 10.78
Df Residuals: 75 MAE: 8.66
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 115.4471 4.2481 0.001 106.9765 123.6747
opcount 0.0026 0.0001 0.001 0.0024 0.0027
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth
nobs 88
R² 0.9962
coef (ms) 0.02126
p-value 1.00e-03
95% CI [0.02098, 0.02154]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 27.04
Df Residuals: 86 MAE: 22.08
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 393.1118 9.5320 0.001 375.6098 411.6503
opcount 0.0213 0.0001 0.001 0.0210 0.0215
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind
nobs 55
R² 0.9854
coef (ms) 0.01053
p-value 1.00e-03
95% CI [0.01022, 0.01086]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.985
Model: NNLS Adj. R-squared: 0.985
No. Observations: 55 RMSE: 26.31
Df Residuals: 53 MAE: 21.61
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 87.5144 10.5157 0.001 66.5412 108.4995
opcount 0.0105 0.0002 0.001 0.0102 0.0109
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth
nobs 77
R² 0.974
coef (ms) 0.004269
p-value 1.00e-03
95% CI [0.004096, 0.004437]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 77 RMSE: 14.33
Df Residuals: 75 MAE: 11.87
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 118.7567 5.7458 0.001 107.6608 130.2576
opcount 0.0043 0.0001 0.001 0.0041 0.0044
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · besu
nobs 99
R² 0.7932
coef (ms) 0.03743
p-value 1.00e-03
95% CI [0.03345, 0.04103]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.793
Model: NNLS Adj. R-squared: 0.791
No. Observations: 99 RMSE: 90.26
Df Residuals: 97 MAE: 82.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 41.9799 26.1464 0.076 0.0000 92.3829
opcount 0.0374 0.0020 0.001 0.0334 0.0410
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · erigon
nobs 55
R² 0.9436
coef (ms) 0.008701
p-value 1.00e-03
95% CI [0.008066, 0.009187]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.944
Model: NNLS Adj. R-squared: 0.943
No. Observations: 55 RMSE: 10.05
Df Residuals: 53 MAE: 7.43
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 5.8027 3.9121 0.076 0.0000 13.9680
opcount 0.0087 0.0003 0.001 0.0081 0.0092
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · ethrex
nobs 77
R² 0.9778
coef (ms) 0.01869
p-value 1.00e-03
95% CI [0.01793, 0.01943]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.977
No. Observations: 77 RMSE: 13.31
Df Residuals: 75 MAE: 11.25
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 142.3354 6.3894 0.001 129.8584 154.9929
opcount 0.0187 0.0004 0.001 0.0179 0.0194
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · geth
nobs 88
R² 0.9875
coef (ms) 0.03149
p-value 1.00e-03
95% CI [0.03075, 0.03222]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.987
Model: NNLS Adj. R-squared: 0.987
No. Observations: 88 RMSE: 16.76
Df Residuals: 86 MAE: 13.63
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 84.8997 6.4651 0.001 73.1137 97.9820
opcount 0.0315 0.0004 0.001 0.0308 0.0322
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · nethermind
nobs 55
R² 0.969
coef (ms) 0.01423
p-value 1.00e-03
95% CI [0.01347, 0.01498]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.969
Model: NNLS Adj. R-squared: 0.968
No. Observations: 55 RMSE: 12.02
Df Residuals: 53 MAE: 9.25
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 32.0655 4.7910 0.001 22.5825 41.1422
opcount 0.0142 0.0004 0.001 0.0135 0.0150
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · reth
nobs 77
R² 0.945
coef (ms) 0.006516
p-value 1.00e-03
95% CI [0.006143, 0.006873]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.945
Model: NNLS Adj. R-squared: 0.944
No. Observations: 77 RMSE: 7.42
Df Residuals: 75 MAE: 5.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 35.1280 2.7990 0.001 29.9049 40.8434
opcount 0.0065 0.0002 0.001 0.0061 0.0069
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · besu
nobs 99
R² 0.8047
coef (ms) 0.0371
p-value 1.00e-03
95% CI [0.03313, 0.04028]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.805
Model: NNLS Adj. R-squared: 0.803
No. Observations: 99 RMSE: 86.35
Df Residuals: 97 MAE: 77.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 35.2262 24.6251 0.071 0.0000 87.4405
opcount 0.0371 0.0019 0.001 0.0331 0.0403
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · erigon
nobs 55
R² 0.9681
coef (ms) 0.007828
p-value 1.00e-03
95% CI [0.007417, 0.008293]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.968
Model: NNLS Adj. R-squared: 0.968
No. Observations: 55 RMSE: 6.71
Df Residuals: 53 MAE: 4.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 6.8582 2.8298 0.016 1.0355 12.3264
opcount 0.0078 0.0002 0.001 0.0074 0.0083
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · ethrex
nobs 77
R² 0.7516
coef (ms) 0.002655
p-value 1.00e-03
95% CI [0.002355, 0.002984]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.752
Model: NNLS Adj. R-squared: 0.748
No. Observations: 77 RMSE: 7.21
Df Residuals: 75 MAE: 5.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 121.9783 2.4085 0.001 117.0098 126.6083
opcount 0.0027 0.0002 0.001 0.0024 0.0030
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · geth
nobs 88
R² 0.9936
coef (ms) 0.0315
p-value 1.00e-03
95% CI [0.03096, 0.03209]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.994
Model: NNLS Adj. R-squared: 0.994
No. Observations: 88 RMSE: 11.93
Df Residuals: 86 MAE: 9.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 86.0869 4.2312 0.001 77.5712 94.3465
opcount 0.0315 0.0003 0.001 0.0310 0.0321
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · nethermind
nobs 55
R² 0.9669
coef (ms) 0.01342
p-value 1.00e-03
95% CI [0.01273, 0.01412]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.967
Model: NNLS Adj. R-squared: 0.966
No. Observations: 55 RMSE: 11.74
Df Residuals: 53 MAE: 9.46
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 37.7612 4.6452 0.001 29.3360 47.4060
opcount 0.0134 0.0003 0.001 0.0127 0.0141
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · reth
nobs 77
R² 0.9507
coef (ms) 0.00649
p-value 1.00e-03
95% CI [0.006127, 0.006875]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.951
Model: NNLS Adj. R-squared: 0.950
No. Observations: 77 RMSE: 6.98
Df Residuals: 75 MAE: 5.45
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 38.5085 2.5992 0.001 33.6301 43.9400
opcount 0.0065 0.0002 0.001 0.0061 0.0069
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · besu
nobs 99
R² 0.8817
coef (ms) 0.04614
p-value 1.00e-03
95% CI [0.0426, 0.04951]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.882
Model: NNLS Adj. R-squared: 0.880
No. Observations: 99 RMSE: 341.72
Df Residuals: 97 MAE: 283.32
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 840.2163 110.0164 0.001 633.4839 1062.5925
opcount 0.0461 0.0018 0.001 0.0426 0.0495
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · erigon
nobs 55
R² 0.8989
coef (ms) 0.1465
p-value 1.00e-03
95% CI [0.1349, 0.158]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.899
Model: NNLS Adj. R-squared: 0.897
No. Observations: 55 RMSE: 993.80
Df Residuals: 53 MAE: 832.15
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 865.6884 430.9474 0.015 53.3449 1742.2111
opcount 0.1465 0.0061 0.001 0.1349 0.1580
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · ethrex
nobs 77
R² 0.9977
coef (ms) 0.1008
p-value 1.00e-03
95% CI [0.09962, 0.1019]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.998
Model: NNLS Adj. R-squared: 0.998
No. Observations: 77 RMSE: 98.39
Df Residuals: 75 MAE: 78.84
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 453.1065 35.4117 0.001 387.1118 526.8215
opcount 0.1008 0.0006 0.001 0.0996 0.1019
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · geth
nobs 88
R² 0.9344
coef (ms) 0.0415
p-value 1.00e-03
95% CI [0.03896, 0.04421]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.934
Model: NNLS Adj. R-squared: 0.934
No. Observations: 88 RMSE: 222.33
Df Residuals: 86 MAE: 184.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1305.2599 97.7638 0.001 1115.8817 1489.6431
opcount 0.0415 0.0014 0.001 0.0390 0.0442
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · nethermind
nobs 55
R² 0.9178
coef (ms) 0.0378
p-value 1.00e-03
95% CI [0.03429, 0.04135]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.918
Model: NNLS Adj. R-squared: 0.916
No. Observations: 55 RMSE: 228.79
Df Residuals: 53 MAE: 195.57
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 644.9835 127.3481 0.001 397.5688 901.2716
opcount 0.0378 0.0018 0.001 0.0343 0.0414
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[0] · reth
nobs 77
R² 0.9924
coef (ms) 0.02308
p-value 1.00e-03
95% CI [0.02266, 0.02352]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.992
Model: NNLS Adj. R-squared: 0.992
No. Observations: 77 RMSE: 40.81
Df Residuals: 75 MAE: 31.94
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 143.6644 12.6602 0.001 118.4676 166.2983
opcount 0.0231 0.0002 0.001 0.0227 0.0235
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · besu
nobs 99
R² 0.8273
coef (ms) 0.02749
p-value 1.00e-03
95% CI [0.0251, 0.0299]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.827
Model: NNLS Adj. R-squared: 0.825
No. Observations: 99 RMSE: 253.99
Df Residuals: 97 MAE: 245.32
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 355.9228 74.8816 0.001 209.9594 498.3611
opcount 0.0275 0.0013 0.001 0.0251 0.0299
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · erigon
nobs 55
R² 0.9416
coef (ms) 0.02446
p-value 1.00e-03
95% CI [0.02272, 0.02578]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.942
Model: NNLS Adj. R-squared: 0.940
No. Observations: 55 RMSE: 123.23
Df Residuals: 53 MAE: 105.63
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 322.0429 58.6534 0.001 226.9415 448.6442
opcount 0.0245 0.0008 0.001 0.0227 0.0258
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · ethrex
nobs 77
R² 0.9819
coef (ms) 0.01885
p-value 1.00e-03
95% CI [0.01821, 0.01954]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.982
No. Observations: 77 RMSE: 51.67
Df Residuals: 75 MAE: 45.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 217.0764 22.7793 0.001 171.0877 259.7007
opcount 0.0188 0.0003 0.001 0.0182 0.0195
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · geth
nobs 88
R² 0.9972
coef (ms) 0.02032
p-value 1.00e-03
95% CI [0.02006, 0.02059]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 88 RMSE: 21.93
Df Residuals: 86 MAE: 17.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 394.8358 8.2516 0.001 378.3650 410.9928
opcount 0.0203 0.0001 0.001 0.0201 0.0206
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · nethermind
nobs 55
R² 0.9786
coef (ms) 0.01253
p-value 1.00e-03
95% CI [0.01204, 0.01305]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.978
No. Observations: 55 RMSE: 37.50
Df Residuals: 53 MAE: 28.79
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 120.4708 18.0548 0.001 84.3041 153.9115
opcount 0.0125 0.0003 0.001 0.0120 0.0131
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[0] · reth
nobs 77
R² 0.982
coef (ms) 0.004798
p-value 1.00e-03
95% CI [0.004657, 0.004934]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.982
No. Observations: 77 RMSE: 13.13
Df Residuals: 75 MAE: 10.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.0457 4.3976 0.001 89.9490 106.8633
opcount 0.0048 0.0001 0.001 0.0047 0.0049
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · besu
nobs 99
R² 0.8234
coef (ms) 0.02759
p-value 1.00e-03
95% CI [0.02516, 0.02993]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.823
Model: NNLS Adj. R-squared: 0.822
No. Observations: 99 RMSE: 258.37
Df Residuals: 97 MAE: 248.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 357.3458 72.3594 0.001 213.5353 501.5167
opcount 0.0276 0.0012 0.001 0.0252 0.0299
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · erigon
nobs 55
R² 0.7456
coef (ms) 0.02638
p-value 1.00e-03
95% CI [0.02211, 0.03043]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.746
Model: NNLS Adj. R-squared: 0.741
No. Observations: 55 RMSE: 311.59
Df Residuals: 53 MAE: 234.79
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 336.3322 124.0523 0.001 105.2941 585.4494
opcount 0.0264 0.0021 0.001 0.0221 0.0304
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · ethrex
nobs 77
R² 0.9802
coef (ms) 0.01881
p-value 1.00e-03
95% CI [0.01805, 0.01949]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 54.02
Df Residuals: 75 MAE: 47.81
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 222.6299 25.3413 0.001 174.2582 275.0364
opcount 0.0188 0.0004 0.001 0.0180 0.0195
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · geth
nobs 88
R² 0.9937
coef (ms) 0.02001
p-value 1.00e-03
95% CI [0.0196, 0.02036]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.994
Model: NNLS Adj. R-squared: 0.994
No. Observations: 88 RMSE: 32.19
Df Residuals: 86 MAE: 23.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 415.6233 13.1754 0.001 392.9955 443.9527
opcount 0.0200 0.0002 0.001 0.0196 0.0204
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · nethermind
nobs 55
R² 0.9861
coef (ms) 0.0124
p-value 1.00e-03
95% CI [0.01196, 0.01284]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.986
Model: NNLS Adj. R-squared: 0.986
No. Observations: 55 RMSE: 29.75
Df Residuals: 53 MAE: 20.07
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 130.8373 15.1869 0.001 101.7170 162.5295
opcount 0.0124 0.0002 0.001 0.0120 0.0128
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[0] · reth
nobs 77
R² 0.9814
coef (ms) 0.005082
p-value 1.00e-03
95% CI [0.00493, 0.005238]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 14.14
Df Residuals: 75 MAE: 11.57
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 82.7807 4.7956 0.001 73.4641 92.1974
opcount 0.0051 0.0001 0.001 0.0049 0.0052
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · besu
nobs 99
R² 0.9101
coef (ms) 0.03223
p-value 1.00e-03
95% CI [0.03023, 0.03406]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.910
Model: NNLS Adj. R-squared: 0.909
No. Observations: 99 RMSE: 207.95
Df Residuals: 97 MAE: 200.10
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 275.3318 66.2408 0.001 153.9379 408.6019
opcount 0.0322 0.0010 0.001 0.0302 0.0341
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · erigon
nobs 55
R² 0.9918
coef (ms) 0.008415
p-value 1.00e-03
95% CI [0.008346, 0.008479]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.992
Model: NNLS Adj. R-squared: 0.992
No. Observations: 55 RMSE: 16.17
Df Residuals: 53 MAE: 11.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0064 1.000 0.0000 0.0000
opcount 0.0084 0.0000 0.001 0.0083 0.0085
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · ethrex
nobs 77
R² 0.9596
coef (ms) 0.002557
p-value 1.00e-03
95% CI [0.002419, 0.002689]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.960
Model: NNLS Adj. R-squared: 0.959
No. Observations: 77 RMSE: 10.78
Df Residuals: 75 MAE: 8.66
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 115.4471 4.2481 0.001 106.9765 123.6747
opcount 0.0026 0.0001 0.001 0.0024 0.0027
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · geth
nobs 88
R² 0.9962
coef (ms) 0.02126
p-value 1.00e-03
95% CI [0.02098, 0.02154]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 27.04
Df Residuals: 86 MAE: 22.08
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 393.1118 9.5320 0.001 375.6098 411.6503
opcount 0.0213 0.0001 0.001 0.0210 0.0215
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · nethermind
nobs 55
R² 0.9854
coef (ms) 0.01053
p-value 1.00e-03
95% CI [0.01022, 0.01086]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.985
Model: NNLS Adj. R-squared: 0.985
No. Observations: 55 RMSE: 26.31
Df Residuals: 53 MAE: 21.61
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 87.5144 10.5157 0.001 66.5412 108.4995
opcount 0.0105 0.0002 0.001 0.0102 0.0109
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · reth
nobs 77
R² 0.974
coef (ms) 0.004269
p-value 1.00e-03
95% CI [0.004096, 0.004437]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 77 RMSE: 14.33
Df Residuals: 75 MAE: 11.87
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 118.7567 5.7458 0.001 107.6608 130.2576
opcount 0.0043 0.0001 0.001 0.0041 0.0044
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · besu
nobs 99
R² 0.8676
coef (ms) 0.05657
p-value 1.00e-03
95% CI [0.05204, 0.06109]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.868
Model: NNLS Adj. R-squared: 0.866
No. Observations: 99 RMSE: 104.02
Df Residuals: 97 MAE: 88.03
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 172.0331 32.2504 0.001 109.0359 236.0559
opcount 0.0566 0.0024 0.001 0.0520 0.0611
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · erigon
nobs 55
R² 0.9069
coef (ms) 0.1456
p-value 1.00e-03
95% CI [0.1316, 0.1559]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.907
Model: NNLS Adj. R-squared: 0.905
No. Observations: 55 RMSE: 219.66
Df Residuals: 53 MAE: 187.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 490.5537 104.2881 0.001 319.6887 720.5567
opcount 0.1456 0.0062 0.001 0.1316 0.1559
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · ethrex
nobs 77
R² 0.99
coef (ms) 0.1113
p-value 1.00e-03
95% CI [0.1086, 0.1138]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 77 RMSE: 52.55
Df Residuals: 75 MAE: 39.51
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 164.9760 17.4065 0.001 133.6767 201.5244
opcount 0.1113 0.0013 0.001 0.1086 0.1138
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · geth
nobs 88
R² 0.9488
coef (ms) 0.06125
p-value 1.00e-03
95% CI [0.058, 0.06474]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.949
Model: NNLS Adj. R-squared: 0.948
No. Observations: 88 RMSE: 66.99
Df Residuals: 86 MAE: 55.25
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 391.2607 28.9403 0.001 335.8995 446.7485
opcount 0.0612 0.0018 0.001 0.0580 0.0647
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · nethermind
nobs 55
R² 0.9261
coef (ms) 0.04436
p-value 1.00e-03
95% CI [0.04119, 0.04752]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.926
Model: NNLS Adj. R-squared: 0.925
No. Observations: 55 RMSE: 58.95
Df Residuals: 53 MAE: 48.53
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 130.2642 26.7908 0.001 82.0442 184.3084
opcount 0.0444 0.0016 0.001 0.0412 0.0475
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_DIFF_MAX` — `models.custom[1] · reth
nobs 77
R² 0.9858
coef (ms) 0.02475
p-value 1.00e-03
95% CI [0.02399, 0.02551]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.986
Model: NNLS Adj. R-squared: 0.986
No. Observations: 77 RMSE: 14.00
Df Residuals: 75 MAE: 10.61
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 74.4923 5.3884 0.001 64.1269 85.5262
opcount 0.0248 0.0004 0.001 0.0240 0.0255
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · besu
nobs 99
R² 0.7622
coef (ms) 0.03492
p-value 1.00e-03
95% CI [0.03076, 0.03826]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.762
Model: NNLS Adj. R-squared: 0.760
No. Observations: 99 RMSE: 91.80
Df Residuals: 97 MAE: 83.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 37.5633 24.4682 0.075 0.0000 87.6323
opcount 0.0349 0.0019 0.001 0.0308 0.0383
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · erigon
nobs 55
R² 0.9081
coef (ms) 0.02446
p-value 1.00e-03
95% CI [0.02232, 0.02635]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.908
Model: NNLS Adj. R-squared: 0.906
No. Observations: 55 RMSE: 36.62
Df Residuals: 53 MAE: 28.81
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 275.5899 17.4446 0.001 244.0662 312.3226
opcount 0.0245 0.0010 0.001 0.0223 0.0263
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · ethrex
nobs 77
R² 0.9771
coef (ms) 0.01874
p-value 1.00e-03
95% CI [0.01797, 0.01947]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.977
No. Observations: 77 RMSE: 13.51
Df Residuals: 75 MAE: 11.29
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 142.1704 6.8167 0.001 129.4077 155.7726
opcount 0.0187 0.0004 0.001 0.0180 0.0195
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · geth
nobs 88
R² 0.9904
coef (ms) 0.0303
p-value 1.00e-03
95% CI [0.02967, 0.031]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 88 RMSE: 14.01
Df Residuals: 86 MAE: 11.70
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 89.3772 5.1596 0.001 79.2209 99.2699
opcount 0.0303 0.0003 0.001 0.0297 0.0310
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · nethermind
nobs 55
R² 0.9645
coef (ms) 0.01563
p-value 1.00e-03
95% CI [0.01481, 0.01653]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.964
Model: NNLS Adj. R-squared: 0.964
No. Observations: 55 RMSE: 14.12
Df Residuals: 53 MAE: 11.00
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 48.1951 5.7312 0.001 37.4342 59.4175
opcount 0.0156 0.0004 0.001 0.0148 0.0165
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_MINIMAL` — `models.custom[1] · reth
nobs 77
R² 0.9513
coef (ms) 0.006709
p-value 1.00e-03
95% CI [0.006323, 0.007071]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.951
Model: NNLS Adj. R-squared: 0.951
No. Observations: 77 RMSE: 7.14
Df Residuals: 75 MAE: 5.63
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 34.6509 2.7548 0.001 29.4331 40.4196
opcount 0.0067 0.0002 0.001 0.0063 0.0071
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · besu
nobs 99
R² 0.7418
coef (ms) 0.0357
p-value 1.00e-03
95% CI [0.03105, 0.03896]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.742
Model: NNLS Adj. R-squared: 0.739
No. Observations: 99 RMSE: 99.14
Df Residuals: 97 MAE: 89.94
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 31.5587 26.2835 0.123 0.0000 91.5438
opcount 0.0357 0.0021 0.001 0.0311 0.0390
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · erigon
nobs 55
R² 0.8409
coef (ms) 0.02646
p-value 1.00e-03
95% CI [0.02304, 0.02972]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.841
Model: NNLS Adj. R-squared: 0.838
No. Observations: 55 RMSE: 54.17
Df Residuals: 53 MAE: 42.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 274.2964 23.9604 0.001 228.3297 325.7207
opcount 0.0265 0.0017 0.001 0.0230 0.0297
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · ethrex
nobs 77
R² 0.9765
coef (ms) 0.01907
p-value 1.00e-03
95% CI [0.01832, 0.01985]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.976
Model: NNLS Adj. R-squared: 0.976
No. Observations: 77 RMSE: 13.92
Df Residuals: 75 MAE: 11.95
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 142.1606 6.3761 0.001 129.6863 154.5953
opcount 0.0191 0.0004 0.001 0.0183 0.0198
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · geth
nobs 88
R² 0.9898
coef (ms) 0.03081
p-value 1.00e-03
95% CI [0.0301, 0.03162]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 88 RMSE: 14.70
Df Residuals: 86 MAE: 10.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 80.7786 5.6864 0.001 69.6076 91.6731
opcount 0.0308 0.0004 0.001 0.0301 0.0316
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · nethermind
nobs 55
R² 0.9513
coef (ms) 0.01522
p-value 1.00e-03
95% CI [0.01435, 0.01616]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.951
Model: NNLS Adj. R-squared: 0.950
No. Observations: 55 RMSE: 16.21
Df Residuals: 53 MAE: 12.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 55.2381 6.2698 0.001 42.8947 67.0684
opcount 0.0152 0.0005 0.001 0.0143 0.0162
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT_SAME_MAX` — `models.custom[1] · reth
nobs 77
R² 0.9307
coef (ms) 0.006603
p-value 1.00e-03
95% CI [0.006149, 0.00706]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.931
Model: NNLS Adj. R-squared: 0.930
No. Observations: 77 RMSE: 8.48
Df Residuals: 75 MAE: 6.94
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 37.4879 3.3948 0.001 31.2688 44.3653
opcount 0.0066 0.0002 0.001 0.0061 0.0071
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · besu
nobs 99
R² 0.8047
coef (ms) 0.0371
p-value 1.00e-03
95% CI [0.03313, 0.04028]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.805
Model: NNLS Adj. R-squared: 0.803
No. Observations: 99 RMSE: 86.35
Df Residuals: 97 MAE: 77.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 35.2262 24.6251 0.071 0.0000 87.4405
opcount 0.0371 0.0019 0.001 0.0331 0.0403
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · erigon
nobs 55
R² 0.9681
coef (ms) 0.007828
p-value 1.00e-03
95% CI [0.007417, 0.008293]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.968
Model: NNLS Adj. R-squared: 0.968
No. Observations: 55 RMSE: 6.71
Df Residuals: 53 MAE: 4.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 6.8582 2.8298 0.016 1.0355 12.3264
opcount 0.0078 0.0002 0.001 0.0074 0.0083
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · ethrex
nobs 77
R² 0.7516
coef (ms) 0.002655
p-value 1.00e-03
95% CI [0.002355, 0.002984]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.752
Model: NNLS Adj. R-squared: 0.748
No. Observations: 77 RMSE: 7.21
Df Residuals: 75 MAE: 5.89
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 121.9783 2.4085 0.001 117.0098 126.6083
opcount 0.0027 0.0002 0.001 0.0024 0.0030
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · geth
nobs 88
R² 0.9936
coef (ms) 0.0315
p-value 1.00e-03
95% CI [0.03096, 0.03209]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.994
Model: NNLS Adj. R-squared: 0.994
No. Observations: 88 RMSE: 11.93
Df Residuals: 86 MAE: 9.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 86.0869 4.2312 0.001 77.5712 94.3465
opcount 0.0315 0.0003 0.001 0.0310 0.0321
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · nethermind
nobs 55
R² 0.9669
coef (ms) 0.01342
p-value 1.00e-03
95% CI [0.01273, 0.01412]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.967
Model: NNLS Adj. R-squared: 0.966
No. Observations: 55 RMSE: 11.74
Df Residuals: 53 MAE: 9.46
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 37.7612 4.6452 0.001 29.3360 47.4060
opcount 0.0134 0.0003 0.001 0.0127 0.0141
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[1] · reth
nobs 77
R² 0.9507
coef (ms) 0.00649
p-value 1.00e-03
95% CI [0.006127, 0.006875]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.951
Model: NNLS Adj. R-squared: 0.950
No. Observations: 77 RMSE: 6.98
Df Residuals: 75 MAE: 5.45
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 38.5085 2.5992 0.001 33.6301 43.9400
opcount 0.0065 0.0002 0.001 0.0061 0.0069
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================DELEGATECALL · test_ext_account_query_warm · combo DELEGATECALL · besu
nobs 99
R² 0.7976
coef (ms) 0.0004023
p-value 1.00e-03
95% CI [0.0003615, 0.0004428]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.798
Model: NNLS Adj. R-squared: 0.795
No. Observations: 99 RMSE: 104.97
Df Residuals: 97 MAE: 82.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 564.2071 32.0822 0.001 501.2938 626.3946
opcount 0.0004 0.0000 0.001 0.0004 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_ext_account_query_warm · combo DELEGATECALL · erigon
nobs 55
R² 0.6673
coef (ms) 0.0001047
p-value 1.00e-03
95% CI [8.54e-05, 0.0001207]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.667
Model: NNLS Adj. R-squared: 0.661
No. Observations: 55 RMSE: 38.27
Df Residuals: 53 MAE: 28.93
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 23.6682 14.1080 0.057 0.0000 51.9939
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_ext_account_query_warm · combo DELEGATECALL · ethrex
nobs 77
R² 0.9365
coef (ms) 9.885e-05
p-value 1.00e-03
95% CI [9.232e-05, 0.0001055]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.937
Model: NNLS Adj. R-squared: 0.936
No. Observations: 77 RMSE: 13.32
Df Residuals: 75 MAE: 10.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 35.5131 5.0235 0.001 25.8606 45.8435
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_ext_account_query_warm · combo DELEGATECALL · geth
nobs 88
R² 0.9443
coef (ms) 0.0001542
p-value 1.00e-03
95% CI [0.0001468, 0.0001617]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.944
Model: NNLS Adj. R-squared: 0.944
No. Observations: 88 RMSE: 19.40
Df Residuals: 86 MAE: 14.27
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 42.1594 6.1200 0.001 30.1883 54.5513
opcount 0.0002 0.0000 0.001 0.0001 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_ext_account_query_warm · combo DELEGATECALL · nethermind
nobs 55
R² 0.9048
coef (ms) 0.0004683
p-value 1.00e-03
95% CI [0.0004251, 0.0005111]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.905
Model: NNLS Adj. R-squared: 0.903
No. Observations: 55 RMSE: 78.67
Df Residuals: 53 MAE: 57.32
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 216.1733 38.8728 0.001 143.7373 293.9980
opcount 0.0005 0.0000 0.001 0.0004 0.0005
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_ext_account_query_warm · combo DELEGATECALL · reth
nobs 77
R² 0.9164
coef (ms) 5.177e-05
p-value 1.00e-03
95% CI [4.8e-05, 5.512e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.916
Model: NNLS Adj. R-squared: 0.915
No. Observations: 77 RMSE: 8.10
Df Residuals: 75 MAE: 6.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 31.2036 3.2357 0.001 25.1467 37.8283
opcount 0.0001 0.0000 0.001 0.0000 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_EOA · besu
nobs 99
R² 0.9022
coef (ms) 0.03309
p-value 1.00e-03
95% CI [0.03093, 0.03519]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.902
Model: NNLS Adj. R-squared: 0.901
No. Observations: 99 RMSE: 224.00
Df Residuals: 97 MAE: 214.27
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 248.3228 71.6717 0.001 111.1447 390.8085
opcount 0.0331 0.0011 0.001 0.0309 0.0352
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_EOA · erigon
nobs 55
R² 0.9619
coef (ms) 0.009524
p-value 1.00e-03
95% CI [0.009276, 0.009677]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.962
Model: NNLS Adj. R-squared: 0.961
No. Observations: 55 RMSE: 40.06
Df Residuals: 53 MAE: 28.34
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 2.9014 1.000 0.0000 11.3937
opcount 0.0095 0.0001 0.001 0.0093 0.0097
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_EOA · ethrex
nobs 77
R² 0.9805
coef (ms) 0.01835
p-value 1.00e-03
95% CI [0.0177, 0.01903]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 53.12
Df Residuals: 75 MAE: 47.26
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 226.6568 25.2403 0.001 178.2619 275.9967
opcount 0.0183 0.0004 0.001 0.0177 0.0190
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_EOA · geth
nobs 88
R² 0.9959
coef (ms) 0.02112
p-value 1.00e-03
95% CI [0.02081, 0.0214]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 27.85
Df Residuals: 86 MAE: 22.45
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 386.7699 9.2898 0.001 369.5922 405.1035
opcount 0.0211 0.0002 0.001 0.0208 0.0214
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_EOA · nethermind
nobs 55
R² 0.9796
coef (ms) 0.01044
p-value 1.00e-03
95% CI [0.01007, 0.01087]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.979
No. Observations: 55 RMSE: 30.97
Df Residuals: 53 MAE: 23.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 122.8472 12.6648 0.001 97.7888 148.0723
opcount 0.0104 0.0002 0.001 0.0101 0.0109
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_EOA · reth
nobs 77
R² 0.983
coef (ms) 0.004682
p-value 1.00e-03
95% CI [0.004536, 0.004827]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 77 RMSE: 12.67
Df Residuals: 75 MAE: 9.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 91.2911 4.5442 0.001 82.5315 100.1107
opcount 0.0047 0.0001 0.001 0.0045 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu
nobs 99
R² 0.9023
coef (ms) 0.03231
p-value 1.00e-03
95% CI [0.03023, 0.0345]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.902
Model: NNLS Adj. R-squared: 0.901
No. Observations: 99 RMSE: 218.54
Df Residuals: 97 MAE: 208.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 262.9381 70.2662 0.001 122.2494 391.8547
opcount 0.0323 0.0011 0.001 0.0302 0.0345
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon
nobs 55
R² 0.99
coef (ms) 0.008434
p-value 1.00e-03
95% CI [0.008345, 0.008511]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 55 RMSE: 17.96
Df Residuals: 53 MAE: 13.05
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0436 1.000 0.0000 0.0000
opcount 0.0084 0.0000 0.001 0.0083 0.0085
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · ethrex
nobs 77
R² 0.9649
coef (ms) 0.002529
p-value 1.00e-03
95% CI [0.002421, 0.002643]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.965
Model: NNLS Adj. R-squared: 0.964
No. Observations: 77 RMSE: 9.92
Df Residuals: 75 MAE: 8.17
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 115.7003 3.8191 0.001 108.1621 123.1163
opcount 0.0025 0.0001 0.001 0.0024 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth
nobs 88
R² 0.9957
coef (ms) 0.0213
p-value 1.00e-03
95% CI [0.02101, 0.0216]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 28.94
Df Residuals: 86 MAE: 23.71
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 387.6659 9.8004 0.001 368.8967 407.3177
opcount 0.0213 0.0002 0.001 0.0210 0.0216
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind
nobs 55
R² 0.9794
coef (ms) 0.01055
p-value 1.00e-03
95% CI [0.01014, 0.01096]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.979
No. Observations: 55 RMSE: 31.48
Df Residuals: 53 MAE: 26.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 103.4930 13.3409 0.001 78.5811 129.6006
opcount 0.0105 0.0002 0.001 0.0101 0.0110
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth
nobs 77
R² 0.9784
coef (ms) 0.004583
p-value 1.00e-03
95% CI [0.004423, 0.004754]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.978
No. Observations: 77 RMSE: 13.99
Df Residuals: 75 MAE: 11.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.7855 5.1998 0.001 88.6394 108.7259
opcount 0.0046 0.0001 0.001 0.0044 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · besu
nobs 99
R² 0.866
coef (ms) 0.04586
p-value 1.00e-03
95% CI [0.04233, 0.04937]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.866
Model: NNLS Adj. R-squared: 0.865
No. Observations: 99 RMSE: 365.13
Df Residuals: 97 MAE: 306.08
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 857.2869 112.7542 0.001 641.4053 1076.1850
opcount 0.0459 0.0018 0.001 0.0423 0.0494
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · erigon
nobs 55
R² 0.8999
coef (ms) 0.1468
p-value 1.00e-03
95% CI [0.1324, 0.1579]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.900
Model: NNLS Adj. R-squared: 0.898
No. Observations: 55 RMSE: 991.08
Df Residuals: 53 MAE: 824.63
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 853.0698 458.5662 0.016 66.4202 1907.7971
opcount 0.1468 0.0066 0.001 0.1324 0.1579
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · ethrex
nobs 77
R² 0.9971
coef (ms) 0.101
p-value 1.00e-03
95% CI [0.09976, 0.1021]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 77 RMSE: 109.69
Df Residuals: 75 MAE: 88.17
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 436.6425 38.3979 0.001 364.7068 518.4333
opcount 0.1010 0.0006 0.001 0.0998 0.1021
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · geth
nobs 88
R² 0.9354
coef (ms) 0.04132
p-value 1.00e-03
95% CI [0.03863, 0.04381]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.935
Model: NNLS Adj. R-squared: 0.935
No. Observations: 88 RMSE: 219.86
Df Residuals: 86 MAE: 182.43
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1311.5050 96.6647 0.001 1133.1091 1518.1038
opcount 0.0413 0.0013 0.001 0.0386 0.0438
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · nethermind
nobs 55
R² 0.9247
coef (ms) 0.0373
p-value 1.00e-03
95% CI [0.03434, 0.04057]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.925
Model: NNLS Adj. R-squared: 0.923
No. Observations: 55 RMSE: 215.50
Df Residuals: 53 MAE: 173.46
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 673.8864 113.5572 0.001 436.7450 894.4934
opcount 0.0373 0.0015 0.001 0.0343 0.0406
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · reth
nobs 77
R² 0.9932
coef (ms) 0.02283
p-value 1.00e-03
95% CI [0.02238, 0.02324]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.993
No. Observations: 77 RMSE: 38.15
Df Residuals: 75 MAE: 31.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 163.1423 13.8828 0.001 136.6260 192.2361
opcount 0.0228 0.0002 0.001 0.0224 0.0232
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_MINIMAL · besu
nobs 99
R² 0.8235
coef (ms) 0.0276
p-value 1.00e-03
95% CI [0.02508, 0.03037]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.824
Model: NNLS Adj. R-squared: 0.822
No. Observations: 99 RMSE: 258.56
Df Residuals: 97 MAE: 246.40
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 350.9713 77.9954 0.001 194.5754 502.5652
opcount 0.0276 0.0013 0.001 0.0251 0.0304
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_MINIMAL · erigon
nobs 55
R² 0.9405
coef (ms) 0.02432
p-value 1.00e-03
95% CI [0.02268, 0.02562]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.940
Model: NNLS Adj. R-squared: 0.939
No. Observations: 55 RMSE: 123.83
Df Residuals: 53 MAE: 106.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 327.6339 56.1178 0.001 230.8680 446.6572
opcount 0.0243 0.0008 0.001 0.0227 0.0256
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_MINIMAL · ethrex
nobs 77
R² 0.9823
coef (ms) 0.01875
p-value 1.00e-03
95% CI [0.01815, 0.01941]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.982
No. Observations: 77 RMSE: 50.90
Df Residuals: 75 MAE: 45.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 220.4853 23.0462 0.001 174.4831 265.2843
opcount 0.0188 0.0003 0.001 0.0181 0.0194
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_MINIMAL · geth
nobs 88
R² 0.9967
coef (ms) 0.02025
p-value 1.00e-03
95% CI [0.02, 0.02051]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 88 RMSE: 23.75
Df Residuals: 86 MAE: 19.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 396.6662 8.2608 0.001 381.7279 414.0030
opcount 0.0202 0.0001 0.001 0.0200 0.0205
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_MINIMAL · nethermind
nobs 55
R² 0.9849
coef (ms) 0.01257
p-value 1.00e-03
95% CI [0.01214, 0.01313]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.985
Model: NNLS Adj. R-squared: 0.985
No. Observations: 55 RMSE: 31.52
Df Residuals: 53 MAE: 22.56
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 119.7194 14.2261 0.001 87.7872 144.4791
opcount 0.0126 0.0003 0.001 0.0121 0.0131
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_MINIMAL · reth
nobs 77
R² 0.9793
coef (ms) 0.004965
p-value 1.00e-03
95% CI [0.004811, 0.005137]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.979
No. Observations: 77 RMSE: 14.61
Df Residuals: 75 MAE: 11.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 87.9607 4.8349 0.001 78.3970 97.0526
opcount 0.0050 0.0001 0.001 0.0048 0.0051
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · besu
nobs 99
R² 0.8089
coef (ms) 0.02766
p-value 1.00e-03
95% CI [0.02522, 0.03055]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.809
Model: NNLS Adj. R-squared: 0.807
No. Observations: 99 RMSE: 272.09
Df Residuals: 97 MAE: 259.70
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 354.5324 81.3032 0.001 180.4152 502.8979
opcount 0.0277 0.0014 0.001 0.0252 0.0306
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · erigon
nobs 55
R² 0.7461
coef (ms) 0.02652
p-value 1.00e-03
95% CI [0.02239, 0.03106]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.746
Model: NNLS Adj. R-squared: 0.741
No. Observations: 55 RMSE: 313.16
Df Residuals: 53 MAE: 234.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 327.3225 128.7273 0.007 82.4866 588.3611
opcount 0.0265 0.0022 0.001 0.0224 0.0311
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · ethrex
nobs 77
R² 0.9806
coef (ms) 0.01883
p-value 1.00e-03
95% CI [0.01815, 0.0195]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 53.53
Df Residuals: 75 MAE: 46.70
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 218.9653 24.6572 0.001 172.0177 266.3870
opcount 0.0188 0.0003 0.001 0.0181 0.0195
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · geth
nobs 88
R² 0.9952
coef (ms) 0.02
p-value 1.00e-03
95% CI [0.01969, 0.02031]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 28.16
Df Residuals: 86 MAE: 22.25
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 410.1828 10.0162 0.001 391.1691 430.3812
opcount 0.0200 0.0002 0.001 0.0197 0.0203
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · nethermind
nobs 55
R² 0.9851
coef (ms) 0.01226
p-value 1.00e-03
95% CI [0.01184, 0.01267]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.985
Model: NNLS Adj. R-squared: 0.985
No. Observations: 55 RMSE: 30.48
Df Residuals: 53 MAE: 24.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 140.4319 14.4328 0.001 112.5265 168.8508
opcount 0.0123 0.0002 0.001 0.0118 0.0127
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · reth
nobs 77
R² 0.9735
coef (ms) 0.005041
p-value 1.00e-03
95% CI [0.004857, 0.005215]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.973
Model: NNLS Adj. R-squared: 0.973
No. Observations: 77 RMSE: 16.85
Df Residuals: 75 MAE: 12.88
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 85.1036 5.4519 0.001 75.1004 95.9383
opcount 0.0050 0.0001 0.001 0.0049 0.0052
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · besu
nobs 99
R² 0.9023
coef (ms) 0.03231
p-value 1.00e-03
95% CI [0.03023, 0.0345]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.902
Model: NNLS Adj. R-squared: 0.901
No. Observations: 99 RMSE: 218.54
Df Residuals: 97 MAE: 208.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 262.9381 70.2662 0.001 122.2494 391.8547
opcount 0.0323 0.0011 0.001 0.0302 0.0345
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · erigon
nobs 55
R² 0.99
coef (ms) 0.008434
p-value 1.00e-03
95% CI [0.008345, 0.008511]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.990
Model: NNLS Adj. R-squared: 0.990
No. Observations: 55 RMSE: 17.96
Df Residuals: 53 MAE: 13.05
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0436 1.000 0.0000 0.0000
opcount 0.0084 0.0000 0.001 0.0083 0.0085
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · ethrex
nobs 77
R² 0.9649
coef (ms) 0.002529
p-value 1.00e-03
95% CI [0.002421, 0.002643]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.965
Model: NNLS Adj. R-squared: 0.964
No. Observations: 77 RMSE: 9.92
Df Residuals: 75 MAE: 8.17
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 115.7003 3.8191 0.001 108.1621 123.1163
opcount 0.0025 0.0001 0.001 0.0024 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · geth
nobs 88
R² 0.9957
coef (ms) 0.0213
p-value 1.00e-03
95% CI [0.02101, 0.0216]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 28.94
Df Residuals: 86 MAE: 23.71
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 387.6659 9.8004 0.001 368.8967 407.3177
opcount 0.0213 0.0002 0.001 0.0210 0.0216
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · nethermind
nobs 55
R² 0.9794
coef (ms) 0.01055
p-value 1.00e-03
95% CI [0.01014, 0.01096]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.979
No. Observations: 55 RMSE: 31.48
Df Residuals: 53 MAE: 26.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 103.4930 13.3409 0.001 78.5811 129.6006
opcount 0.0105 0.0002 0.001 0.0101 0.0110
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · reth
nobs 77
R² 0.9784
coef (ms) 0.004583
p-value 1.00e-03
95% CI [0.004423, 0.004754]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.978
No. Observations: 77 RMSE: 13.99
Df Residuals: 75 MAE: 11.42
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 98.7855 5.1998 0.001 88.6394 108.7259
opcount 0.0046 0.0001 0.001 0.0044 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODEHASH · test_ext_account_query_warm · combo EXTCODEHASH · besu
nobs 99
R² 0.3836
coef (ms) 7.293e-05
p-value 1.00e-03
95% CI [5.524e-05, 8.873e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.384
Model: NNLS Adj. R-squared: 0.377
No. Observations: 99 RMSE: 54.09
Df Residuals: 97 MAE: 41.24
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 209.2487 18.6059 0.001 176.1186 248.1456
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_ext_account_query_warm · combo EXTCODEHASH · erigon
nobs 55
R² 0.3088
coef (ms) 0.00029
p-value 1.00e-03
95% CI [0.0001669, 0.0003372]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.309
Model: NNLS Adj. R-squared: 0.296
No. Observations: 55 RMSE: 253.79
Df Residuals: 53 MAE: 193.16
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 20.6812 63.0326 0.422 0.0000 210.6931
opcount 0.0003 0.0000 0.001 0.0002 0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_ext_account_query_warm · combo EXTCODEHASH · ethrex
nobs 77
R² 0.7452
coef (ms) 1.434e-05
p-value 1.00e-03
95% CI [1.235e-05, 1.641e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.745
Model: NNLS Adj. R-squared: 0.742
No. Observations: 77 RMSE: 4.91
Df Residuals: 75 MAE: 3.48
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 9.0960 1.8282 0.001 5.6768 12.8809
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_ext_account_query_warm · combo EXTCODEHASH · geth
nobs 88
R² 0.8773
coef (ms) 3.789e-05
p-value 1.00e-03
95% CI [3.496e-05, 4.101e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.877
Model: NNLS Adj. R-squared: 0.876
No. Observations: 88 RMSE: 8.29
Df Residuals: 86 MAE: 6.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 24.3259 2.7174 0.001 18.8270 29.4409
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_ext_account_query_warm · combo EXTCODEHASH · nethermind
nobs 55
R² 0.8816
coef (ms) 0.0002363
p-value 1.00e-03
95% CI [0.0002134, 0.0002635]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.882
Model: NNLS Adj. R-squared: 0.879
No. Observations: 55 RMSE: 50.66
Df Residuals: 53 MAE: 39.94
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 166.9969 20.9098 0.001 123.1633 203.8272
opcount 0.0002 0.0000 0.001 0.0002 0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_ext_account_query_warm · combo EXTCODEHASH · reth
nobs 77
R² 0.4998
coef (ms) 1.496e-05
p-value 1.00e-03
95% CI [1.239e-05, 1.782e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.500
Model: NNLS Adj. R-squared: 0.493
No. Observations: 77 RMSE: 8.76
Df Residuals: 75 MAE: 5.94
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 9.9364 2.4749 0.001 4.9567 14.7032
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_EOA · besu
nobs 99
R² 0.8912
coef (ms) 0.0313
p-value 1.00e-03
95% CI [0.02929, 0.03318]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.891
Model: NNLS Adj. R-squared: 0.890
No. Observations: 99 RMSE: 225.83
Df Residuals: 97 MAE: 216.56
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 238.3810 65.7984 0.001 115.6447 378.3763
opcount 0.0313 0.0010 0.001 0.0293 0.0332
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_EOA · erigon
nobs 55
R² 0.9931
coef (ms) 0.009052
p-value 1.00e-03
95% CI [0.008973, 0.009123]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.993
No. Observations: 55 RMSE: 15.99
Df Residuals: 53 MAE: 11.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.1567 1.000 0.0000 0.0000
opcount 0.0091 0.0000 0.001 0.0090 0.0091
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_EOA · ethrex
nobs 77
R² 0.9807
coef (ms) 0.01821
p-value 1.00e-03
95% CI [0.0176, 0.01889]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 52.77
Df Residuals: 75 MAE: 46.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 227.0142 24.5720 0.001 178.1961 273.8972
opcount 0.0182 0.0003 0.001 0.0176 0.0189
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_EOA · geth
nobs 88
R² 0.9958
coef (ms) 0.02062
p-value 1.00e-03
95% CI [0.02032, 0.02091]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 27.61
Df Residuals: 86 MAE: 22.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 405.4722 9.4877 0.001 387.8178 424.4576
opcount 0.0206 0.0002 0.001 0.0203 0.0209
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_EOA · nethermind
nobs 55
R² 0.9814
coef (ms) 0.01023
p-value 1.00e-03
95% CI [0.00981, 0.0107]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 55 RMSE: 29.12
Df Residuals: 53 MAE: 22.53
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 126.1404 14.1691 0.001 97.3364 153.3715
opcount 0.0102 0.0002 0.001 0.0098 0.0107
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_EOA · reth
nobs 77
R² 0.9775
coef (ms) 0.004582
p-value 1.00e-03
95% CI [0.004463, 0.004714]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.977
No. Observations: 77 RMSE: 14.34
Df Residuals: 75 MAE: 10.76
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 96.3552 4.1490 0.001 88.1593 104.2904
opcount 0.0046 0.0001 0.001 0.0045 0.0047
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu
nobs 99
R² 0.9082
coef (ms) 0.03104
p-value 1.00e-03
95% CI [0.02924, 0.03305]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.908
Model: NNLS Adj. R-squared: 0.907
No. Observations: 99 RMSE: 203.72
Df Residuals: 97 MAE: 195.08
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 218.7135 64.3428 0.001 92.6995 343.3392
opcount 0.0310 0.0010 0.001 0.0292 0.0331
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon
nobs 55
R² 0.9953
coef (ms) 0.008043
p-value 1.00e-03
95% CI [0.007989, 0.00809]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 55 RMSE: 11.81
Df Residuals: 53 MAE: 9.74
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0000 1.000 0.0000 0.0000
opcount 0.0080 0.0000 0.001 0.0080 0.0081
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · ethrex
nobs 77
R² 0.9632
coef (ms) 0.002416
p-value 1.00e-03
95% CI [0.002315, 0.002524]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.963
Model: NNLS Adj. R-squared: 0.963
No. Observations: 77 RMSE: 9.76
Df Residuals: 75 MAE: 8.23
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 118.5350 3.4275 0.001 111.8061 125.1573
opcount 0.0024 0.0001 0.001 0.0023 0.0025
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth
nobs 88
R² 0.9961
coef (ms) 0.02005
p-value 1.00e-03
95% CI [0.01976, 0.02033]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 25.97
Df Residuals: 86 MAE: 21.25
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 386.6254 9.9440 0.001 367.8586 407.1937
opcount 0.0200 0.0001 0.001 0.0198 0.0203
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind
nobs 55
R² 0.9832
coef (ms) 0.01042
p-value 1.00e-03
95% CI [0.01007, 0.01084]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 55 RMSE: 28.18
Df Residuals: 53 MAE: 22.64
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 93.6138 11.2846 0.001 70.1513 114.3580
opcount 0.0104 0.0002 0.001 0.0101 0.0108
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth
nobs 77
R² 0.9858
coef (ms) 0.004461
p-value 1.00e-03
95% CI [0.004332, 0.00458]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.986
Model: NNLS Adj. R-squared: 0.986
No. Observations: 77 RMSE: 11.06
Df Residuals: 75 MAE: 8.64
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 102.5624 4.3274 0.001 94.4034 111.2976
opcount 0.0045 0.0001 0.001 0.0043 0.0046
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_DIFF_MAX · besu
nobs 99
R² 0.8851
coef (ms) 0.04405
p-value 1.00e-03
95% CI [0.04061, 0.04698]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.885
Model: NNLS Adj. R-squared: 0.884
No. Observations: 99 RMSE: 322.65
Df Residuals: 97 MAE: 266.26
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 792.5775 104.8161 0.001 598.0511 1001.7986
opcount 0.0440 0.0016 0.001 0.0406 0.0470
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_DIFF_MAX · erigon
nobs 55
R² 0.9425
coef (ms) 0.02438
p-value 1.00e-03
95% CI [0.02274, 0.02573]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.943
Model: NNLS Adj. R-squared: 0.941
No. Observations: 55 RMSE: 122.36
Df Residuals: 53 MAE: 106.69
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 314.5053 56.1465 0.001 213.5665 435.4651
opcount 0.0244 0.0008 0.001 0.0227 0.0257
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_DIFF_MAX · ethrex
nobs 77
R² 0.9807
coef (ms) 0.01854
p-value 1.00e-03
95% CI [0.01781, 0.01919]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 52.90
Df Residuals: 75 MAE: 46.95
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 227.4577 25.1173 0.001 182.5793 280.0195
opcount 0.0185 0.0004 0.001 0.0178 0.0192
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_DIFF_MAX · geth
nobs 88
R² 0.9958
coef (ms) 0.01963
p-value 1.00e-03
95% CI [0.01936, 0.01991]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 25.90
Df Residuals: 86 MAE: 21.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 411.8427 9.2016 0.001 393.4439 430.5357
opcount 0.0196 0.0001 0.001 0.0194 0.0199
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_DIFF_MAX · nethermind
nobs 55
R² 0.9707
coef (ms) 0.01165
p-value 1.00e-03
95% CI [0.01109, 0.0123]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.971
Model: NNLS Adj. R-squared: 0.970
No. Observations: 55 RMSE: 41.19
Df Residuals: 53 MAE: 30.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 131.1535 18.3794 0.001 91.7775 165.9123
opcount 0.0117 0.0003 0.001 0.0111 0.0123
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_DIFF_MAX · reth
nobs 77
R² 0.9909
coef (ms) 0.02031
p-value 1.00e-03
95% CI [0.01983, 0.02077]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.991
Model: NNLS Adj. R-squared: 0.991
No. Observations: 77 RMSE: 39.48
Df Residuals: 75 MAE: 32.78
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 170.5095 15.0856 0.001 142.2027 201.5537
opcount 0.0203 0.0002 0.001 0.0198 0.0208
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_MINIMAL · besu
nobs 99
R² 0.8157
coef (ms) 0.02613
p-value 1.00e-03
95% CI [0.02362, 0.02851]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.816
Model: NNLS Adj. R-squared: 0.814
No. Observations: 99 RMSE: 252.57
Df Residuals: 97 MAE: 242.51
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 318.1105 73.1462 0.001 180.8947 464.8734
opcount 0.0261 0.0012 0.001 0.0236 0.0285
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_MINIMAL · erigon
nobs 55
R² 0.9429
coef (ms) 0.02379
p-value 1.00e-03
95% CI [0.02219, 0.02505]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.943
Model: NNLS Adj. R-squared: 0.942
No. Observations: 55 RMSE: 119.06
Df Residuals: 53 MAE: 103.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 310.5866 55.0487 0.001 219.1513 424.4262
opcount 0.0238 0.0008 0.001 0.0222 0.0251
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_MINIMAL · ethrex
nobs 77
R² 0.9807
coef (ms) 0.01865
p-value 1.00e-03
95% CI [0.01792, 0.01928]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 53.17
Df Residuals: 75 MAE: 46.55
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 218.5036 24.4605 0.001 172.4648 271.9492
opcount 0.0186 0.0003 0.001 0.0179 0.0193
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_MINIMAL · geth
nobs 88
R² 0.9948
coef (ms) 0.01977
p-value 1.00e-03
95% CI [0.01946, 0.02005]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 29.10
Df Residuals: 86 MAE: 23.77
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 401.3227 9.3074 0.001 384.0747 420.9278
opcount 0.0198 0.0002 0.001 0.0195 0.0201
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_MINIMAL · nethermind
nobs 55
R² 0.9834
coef (ms) 0.01176
p-value 1.00e-03
95% CI [0.01137, 0.01214]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 55 RMSE: 31.03
Df Residuals: 53 MAE: 24.76
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 103.9982 12.6941 0.001 80.4735 129.5737
opcount 0.0118 0.0002 0.001 0.0114 0.0121
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_MINIMAL · reth
nobs 77
R² 0.9804
coef (ms) 0.004904
p-value 1.00e-03
95% CI [0.004771, 0.005046]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 14.11
Df Residuals: 75 MAE: 10.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 87.2739 4.0613 0.001 79.8376 95.1230
opcount 0.0049 0.0001 0.001 0.0048 0.0050
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_SAME_MAX · besu
nobs 99
R² 0.8162
coef (ms) 0.02558
p-value 1.00e-03
95% CI [0.02331, 0.02804]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.816
Model: NNLS Adj. R-squared: 0.814
No. Observations: 99 RMSE: 246.77
Df Residuals: 97 MAE: 235.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 351.3241 73.5871 0.001 204.9769 500.3688
opcount 0.0256 0.0012 0.001 0.0233 0.0280
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_SAME_MAX · erigon
nobs 55
R² 0.9401
coef (ms) 0.02363
p-value 1.00e-03
95% CI [0.02207, 0.02498]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.940
Model: NNLS Adj. R-squared: 0.939
No. Observations: 55 RMSE: 121.26
Df Residuals: 53 MAE: 105.51
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 322.5070 55.1589 0.001 221.0948 436.3990
opcount 0.0236 0.0008 0.001 0.0221 0.0250
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_SAME_MAX · ethrex
nobs 77
R² 0.9808
coef (ms) 0.01862
p-value 1.00e-03
95% CI [0.01798, 0.01928]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 52.93
Df Residuals: 75 MAE: 46.46
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 219.9853 24.8011 0.001 174.1750 266.6998
opcount 0.0186 0.0003 0.001 0.0180 0.0193
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_SAME_MAX · geth
nobs 88
R² 0.9951
coef (ms) 0.01966
p-value 1.00e-03
95% CI [0.01933, 0.01999]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 27.98
Df Residuals: 86 MAE: 22.22
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 407.3864 9.8609 0.001 388.6146 427.1229
opcount 0.0197 0.0002 0.001 0.0193 0.0200
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_SAME_MAX · nethermind
nobs 55
R² 0.9781
coef (ms) 0.01191
p-value 1.00e-03
95% CI [0.01146, 0.0124]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.978
No. Observations: 55 RMSE: 36.26
Df Residuals: 53 MAE: 27.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 121.6066 16.1126 0.001 90.0378 152.6152
opcount 0.0119 0.0002 0.001 0.0115 0.0124
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT_SAME_MAX · reth
nobs 77
R² 0.9787
coef (ms) 0.004861
p-value 1.00e-03
95% CI [0.004693, 0.005025]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.978
No. Observations: 77 RMSE: 14.58
Df Residuals: 75 MAE: 10.99
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 92.5258 4.9053 0.001 83.5283 102.8241
opcount 0.0049 0.0001 0.001 0.0047 0.0050
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · besu
nobs 99
R² 0.9082
coef (ms) 0.03104
p-value 1.00e-03
95% CI [0.02924, 0.03305]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.908
Model: NNLS Adj. R-squared: 0.907
No. Observations: 99 RMSE: 203.72
Df Residuals: 97 MAE: 195.08
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 218.7135 64.3428 0.001 92.6995 343.3392
opcount 0.0310 0.0010 0.001 0.0292 0.0331
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · erigon
nobs 55
R² 0.9953
coef (ms) 0.008043
p-value 1.00e-03
95% CI [0.007989, 0.00809]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 55 RMSE: 11.81
Df Residuals: 53 MAE: 9.74
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0000 1.000 0.0000 0.0000
opcount 0.0080 0.0000 0.001 0.0080 0.0081
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · ethrex
nobs 77
R² 0.9632
coef (ms) 0.002416
p-value 1.00e-03
95% CI [0.002315, 0.002524]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.963
Model: NNLS Adj. R-squared: 0.963
No. Observations: 77 RMSE: 9.76
Df Residuals: 75 MAE: 8.23
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 118.5350 3.4275 0.001 111.8061 125.1573
opcount 0.0024 0.0001 0.001 0.0023 0.0025
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · geth
nobs 88
R² 0.9961
coef (ms) 0.02005
p-value 1.00e-03
95% CI [0.01976, 0.02033]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 25.97
Df Residuals: 86 MAE: 21.25
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 386.6254 9.9440 0.001 367.8586 407.1937
opcount 0.0200 0.0001 0.001 0.0198 0.0203
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · nethermind
nobs 55
R² 0.9832
coef (ms) 0.01042
p-value 1.00e-03
95% CI [0.01007, 0.01084]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 55 RMSE: 28.18
Df Residuals: 53 MAE: 22.64
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 93.6138 11.2846 0.001 70.1513 114.3580
opcount 0.0104 0.0002 0.001 0.0101 0.0108
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · reth
nobs 77
R² 0.9858
coef (ms) 0.004461
p-value 1.00e-03
95% CI [0.004332, 0.00458]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.986
Model: NNLS Adj. R-squared: 0.986
No. Observations: 77 RMSE: 11.06
Df Residuals: 75 MAE: 8.64
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 102.5624 4.3274 0.001 94.4034 111.2976
opcount 0.0045 0.0001 0.001 0.0043 0.0046
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODESIZE · test_ext_account_query_warm · combo EXTCODESIZE · besu
nobs 99
R² 0.1817
coef (ms) 0.0001005
p-value 1.00e-03
95% CI [5.471e-05, 0.0001406]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.182
Model: NNLS Adj. R-squared: 0.173
No. Observations: 99 RMSE: 64.77
Df Residuals: 97 MAE: 50.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 166.1799 24.3661 0.001 123.1181 216.7679
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_ext_account_query_warm · combo EXTCODESIZE · erigon
nobs 55
R² 0.5454
coef (ms) 4.028e-05
p-value 1.00e-03
95% CI [3.012e-05, 4.94e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.545
Model: NNLS Adj. R-squared: 0.537
No. Observations: 55 RMSE: 11.17
Df Residuals: 53 MAE: 8.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 10.5249 4.5480 0.008 1.9446 19.9348
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_ext_account_query_warm · combo EXTCODESIZE · ethrex
nobs 77
R² 0.7042
coef (ms) 1.657e-05
p-value 1.00e-03
95% CI [1.448e-05, 1.877e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.704
Model: NNLS Adj. R-squared: 0.700
No. Observations: 77 RMSE: 3.26
Df Residuals: 75 MAE: 2.43
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 5.2879 0.9845 0.001 3.4390 7.3431
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_ext_account_query_warm · combo EXTCODESIZE · geth
nobs 88
R² 0.001862
coef (ms) 1.51e-06
p-value 3.11e-01
95% CI [0, 8.249e-06]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.002
Model: NNLS Adj. R-squared: -0.010
No. Observations: 88 RMSE: 10.62
Df Residuals: 86 MAE: 8.00
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 58.0903 2.9778 0.001 50.1236 61.3030
opcount 0.0000 0.0000 0.311 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_ext_account_query_warm · combo EXTCODESIZE · nethermind
nobs 55
R² 0.7676
coef (ms) 0.0002449
p-value 1.00e-03
95% CI [0.0002153, 0.0002815]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.768
Model: NNLS Adj. R-squared: 0.763
No. Observations: 55 RMSE: 40.93
Df Residuals: 53 MAE: 26.78
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 48.0540 13.0154 0.001 20.1502 71.1840
opcount 0.0002 0.0000 0.001 0.0002 0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_ext_account_query_warm · combo EXTCODESIZE · reth
nobs 77
R² 0.2177
coef (ms) 7.763e-06
p-value 1.00e-03
95% CI [4.646e-06, 1.074e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.218
Model: NNLS Adj. R-squared: 0.207
No. Observations: 77 RMSE: 4.47
Df Residuals: 75 MAE: 3.62
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 9.3241 1.5640 0.001 6.4200 12.5280
opcount 0.0000 0.0000 0.001 0.0000 0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_EOA · besu
nobs 99
R² 0.8904
coef (ms) 0.0317
p-value 1.00e-03
95% CI [0.02953, 0.03382]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.890
Model: NNLS Adj. R-squared: 0.889
No. Observations: 99 RMSE: 222.41
Df Residuals: 97 MAE: 213.77
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 207.1098 66.7138 0.002 79.3195 338.6629
opcount 0.0317 0.0011 0.001 0.0295 0.0338
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_EOA · erigon
nobs 55
R² 0.9546
coef (ms) 0.009219
p-value 1.00e-03
95% CI [0.008699, 0.009396]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.955
Model: NNLS Adj. R-squared: 0.954
No. Observations: 55 RMSE: 40.65
Df Residuals: 53 MAE: 29.96
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 7.0632 1.000 0.0000 25.7591
opcount 0.0092 0.0002 0.001 0.0087 0.0094
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_EOA · ethrex
nobs 77
R² 0.9808
coef (ms) 0.01826
p-value 1.00e-03
95% CI [0.01761, 0.01898]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 51.08
Df Residuals: 75 MAE: 45.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 219.4658 24.4110 0.001 172.5322 266.0524
opcount 0.0183 0.0003 0.001 0.0176 0.0190
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_EOA · geth
nobs 88
R² 0.9969
coef (ms) 0.02082
p-value 1.00e-03
95% CI [0.0206, 0.02104]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 88 RMSE: 23.31
Df Residuals: 86 MAE: 19.14
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 388.8972 7.2569 0.001 374.6496 403.6065
opcount 0.0208 0.0001 0.001 0.0206 0.0210
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_EOA · nethermind
nobs 55
R² 0.9835
coef (ms) 0.0103
p-value 1.00e-03
95% CI [0.01001, 0.01063]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 55 RMSE: 26.68
Df Residuals: 53 MAE: 19.93
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 108.3314 9.2709 0.001 90.0965 125.5478
opcount 0.0103 0.0002 0.001 0.0100 0.0106
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_EOA · reth
nobs 77
R² 0.977
coef (ms) 0.004632
p-value 1.00e-03
95% CI [0.004491, 0.00477]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.977
Model: NNLS Adj. R-squared: 0.977
No. Observations: 77 RMSE: 14.22
Df Residuals: 75 MAE: 10.55
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 93.5320 4.5214 0.001 84.9745 102.9766
opcount 0.0046 0.0001 0.001 0.0045 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu
nobs 99
R² 0.8962
coef (ms) 0.03092
p-value 1.00e-03
95% CI [0.02893, 0.0328]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.896
Model: NNLS Adj. R-squared: 0.895
No. Observations: 99 RMSE: 210.39
Df Residuals: 97 MAE: 196.23
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 237.0196 62.7194 0.001 120.7702 359.2960
opcount 0.0309 0.0010 0.001 0.0289 0.0328
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon
nobs 55
R² 0.9934
coef (ms) 0.008149
p-value 1.00e-03
95% CI [0.00809, 0.00821]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.993
No. Observations: 55 RMSE: 13.74
Df Residuals: 53 MAE: 10.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0000 1.000 0.0000 0.0000
opcount 0.0081 0.0000 0.001 0.0081 0.0082
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · ethrex
nobs 77
R² 0.9462
coef (ms) 0.002398
p-value 1.00e-03
95% CI [0.002265, 0.002558]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.946
Model: NNLS Adj. R-squared: 0.945
No. Observations: 77 RMSE: 11.43
Df Residuals: 75 MAE: 9.18
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 116.1489 4.2985 0.001 106.6910 123.8671
opcount 0.0024 0.0001 0.001 0.0023 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth
nobs 88
R² 0.9967
coef (ms) 0.02015
p-value 1.00e-03
95% CI [0.01991, 0.0204]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 88 RMSE: 23.27
Df Residuals: 86 MAE: 18.87
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 385.0860 8.1960 0.001 369.4215 400.9695
opcount 0.0202 0.0001 0.001 0.0199 0.0204
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind
nobs 55
R² 0.9881
coef (ms) 0.01036
p-value 1.00e-03
95% CI [0.01006, 0.01071]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.988
Model: NNLS Adj. R-squared: 0.988
No. Observations: 55 RMSE: 22.76
Df Residuals: 53 MAE: 17.25
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 85.1464 10.2638 0.001 64.3464 105.0470
opcount 0.0104 0.0002 0.001 0.0101 0.0107
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth
nobs 77
R² 0.9794
coef (ms) 0.004386
p-value 1.00e-03
95% CI [0.004224, 0.004535]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.979
No. Observations: 77 RMSE: 12.72
Df Residuals: 75 MAE: 10.02
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 105.7334 4.9640 0.001 96.5346 115.4257
opcount 0.0044 0.0001 0.001 0.0042 0.0045
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · besu
nobs 99
R² 0.8893
coef (ms) 0.04421
p-value 1.00e-03
95% CI [0.04106, 0.04745]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.889
Model: NNLS Adj. R-squared: 0.888
No. Observations: 99 RMSE: 307.26
Df Residuals: 97 MAE: 251.71
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 756.2924 97.0307 0.001 559.4781 940.9105
opcount 0.0442 0.0016 0.001 0.0411 0.0474
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · erigon
nobs 55
R² 0.9107
coef (ms) 0.1435
p-value 1.00e-03
95% CI [0.1313, 0.1547]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.911
Model: NNLS Adj. R-squared: 0.909
No. Observations: 55 RMSE: 885.31
Df Residuals: 53 MAE: 773.71
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 866.5823 415.7621 0.017 76.9188 1696.8645
opcount 0.1435 0.0059 0.001 0.1313 0.1547
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · ethrex
nobs 77
R² 0.9973
coef (ms) 0.1013
p-value 1.00e-03
95% CI [0.1001, 0.1024]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 77 RMSE: 102.93
Df Residuals: 75 MAE: 87.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 410.5749 35.0040 0.001 348.6169 482.3695
opcount 0.1013 0.0006 0.001 0.1001 0.1024
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · geth
nobs 88
R² 0.9338
coef (ms) 0.04158
p-value 1.00e-03
95% CI [0.03882, 0.04432]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.934
Model: NNLS Adj. R-squared: 0.933
No. Observations: 88 RMSE: 217.98
Df Residuals: 86 MAE: 182.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1253.2866 97.9291 0.001 1073.0440 1454.4557
opcount 0.0416 0.0014 0.001 0.0388 0.0443
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · nethermind
nobs 55
R² 0.9194
coef (ms) 0.03718
p-value 1.00e-03
95% CI [0.03411, 0.04077]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.919
Model: NNLS Adj. R-squared: 0.918
No. Observations: 55 RMSE: 216.78
Df Residuals: 53 MAE: 176.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 532.7425 111.9096 0.001 305.8810 759.6897
opcount 0.0372 0.0016 0.001 0.0341 0.0408
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_DIFF_MAX · reth
nobs 77
R² 0.9925
coef (ms) 0.02314
p-value 1.00e-03
95% CI [0.0227, 0.02359]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.992
No. Observations: 77 RMSE: 39.56
Df Residuals: 75 MAE: 30.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 134.9133 12.5315 0.001 110.2120 159.9940
opcount 0.0231 0.0002 0.001 0.0227 0.0236
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_MINIMAL · besu
nobs 99
R² 0.8236
coef (ms) 0.02595
p-value 1.00e-03
95% CI [0.02355, 0.02833]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.824
Model: NNLS Adj. R-squared: 0.822
No. Observations: 99 RMSE: 236.52
Df Residuals: 97 MAE: 226.50
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 317.7827 68.4287 0.001 181.3964 456.5909
opcount 0.0259 0.0012 0.001 0.0235 0.0283
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_MINIMAL · erigon
nobs 55
R² 0.9369
coef (ms) 0.02421
p-value 1.00e-03
95% CI [0.02242, 0.02566]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.937
Model: NNLS Adj. R-squared: 0.936
No. Observations: 55 RMSE: 123.77
Df Residuals: 53 MAE: 105.43
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 311.2902 56.8111 0.001 212.1607 428.2251
opcount 0.0242 0.0008 0.001 0.0224 0.0257
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_MINIMAL · ethrex
nobs 77
R² 0.9819
coef (ms) 0.01872
p-value 1.00e-03
95% CI [0.01809, 0.01938]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.982
No. Observations: 77 RMSE: 50.11
Df Residuals: 75 MAE: 44.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 213.0793 22.4426 0.001 170.0473 256.5276
opcount 0.0187 0.0003 0.001 0.0181 0.0194
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_MINIMAL · geth
nobs 88
R² 0.9947
coef (ms) 0.01988
p-value 1.00e-03
95% CI [0.01954, 0.0202]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 28.70
Df Residuals: 86 MAE: 22.90
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 396.7119 10.2899 0.001 377.8951 417.3980
opcount 0.0199 0.0002 0.001 0.0195 0.0202
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_MINIMAL · nethermind
nobs 55
R² 0.9827
coef (ms) 0.01114
p-value 1.00e-03
95% CI [0.01076, 0.01154]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.982
No. Observations: 55 RMSE: 29.12
Df Residuals: 53 MAE: 22.92
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 145.4680 12.7506 0.001 121.1107 171.2104
opcount 0.0111 0.0002 0.001 0.0108 0.0115
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_MINIMAL · reth
nobs 77
R² 0.974
coef (ms) 0.004891
p-value 1.00e-03
95% CI [0.004708, 0.005081]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.974
No. Observations: 77 RMSE: 15.73
Df Residuals: 75 MAE: 12.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 88.2660 5.8948 0.001 77.3597 99.8596
opcount 0.0049 0.0001 0.001 0.0047 0.0051
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_SAME_MAX · besu
nobs 99
R² 0.8166
coef (ms) 0.02608
p-value 1.00e-03
95% CI [0.02368, 0.02842]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.817
Model: NNLS Adj. R-squared: 0.815
No. Observations: 99 RMSE: 243.51
Df Residuals: 97 MAE: 231.44
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 312.5346 69.2638 0.001 182.4285 450.1273
opcount 0.0261 0.0012 0.001 0.0237 0.0284
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_SAME_MAX · erigon
nobs 55
R² 0.9375
coef (ms) 0.02408
p-value 1.00e-03
95% CI [0.02252, 0.0255]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.938
Model: NNLS Adj. R-squared: 0.936
No. Observations: 55 RMSE: 122.46
Df Residuals: 53 MAE: 105.12
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 322.8695 54.1870 0.001 223.1520 432.8990
opcount 0.0241 0.0008 0.001 0.0225 0.0255
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_SAME_MAX · ethrex
nobs 77
R² 0.9805
coef (ms) 0.01863
p-value 1.00e-03
95% CI [0.01802, 0.01935]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 51.73
Df Residuals: 75 MAE: 45.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 217.7914 22.9144 0.001 171.2149 263.4624
opcount 0.0186 0.0003 0.001 0.0180 0.0194
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_SAME_MAX · geth
nobs 88
R² 0.9964
coef (ms) 0.0198
p-value 1.00e-03
95% CI [0.01953, 0.02006]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 23.60
Df Residuals: 86 MAE: 18.64
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 406.5873 8.2998 0.001 391.3406 423.2486
opcount 0.0198 0.0001 0.001 0.0195 0.0201
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_SAME_MAX · nethermind
nobs 55
R² 0.9752
coef (ms) 0.01156
p-value 1.00e-03
95% CI [0.01113, 0.01201]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.975
Model: NNLS Adj. R-squared: 0.975
No. Observations: 55 RMSE: 36.31
Df Residuals: 53 MAE: 27.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 119.3643 13.9314 0.001 90.9137 146.0042
opcount 0.0116 0.0002 0.001 0.0111 0.0120
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT_SAME_MAX · reth
nobs 77
R² 0.9799
coef (ms) 0.004952
p-value 1.00e-03
95% CI [0.00479, 0.005117]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 13.97
Df Residuals: 75 MAE: 10.95
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 86.3628 4.9411 0.001 77.2619 96.1587
opcount 0.0050 0.0001 0.001 0.0048 0.0051
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · besu
nobs 99
R² 0.8962
coef (ms) 0.03092
p-value 1.00e-03
95% CI [0.02893, 0.0328]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.896
Model: NNLS Adj. R-squared: 0.895
No. Observations: 99 RMSE: 210.39
Df Residuals: 97 MAE: 196.23
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 237.0196 62.7194 0.001 120.7702 359.2960
opcount 0.0309 0.0010 0.001 0.0289 0.0328
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · erigon
nobs 55
R² 0.9934
coef (ms) 0.008149
p-value 1.00e-03
95% CI [0.00809, 0.00821]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.993
Model: NNLS Adj. R-squared: 0.993
No. Observations: 55 RMSE: 13.74
Df Residuals: 53 MAE: 10.52
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0000 1.000 0.0000 0.0000
opcount 0.0081 0.0000 0.001 0.0081 0.0082
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · ethrex
nobs 77
R² 0.9462
coef (ms) 0.002398
p-value 1.00e-03
95% CI [0.002265, 0.002558]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.946
Model: NNLS Adj. R-squared: 0.945
No. Observations: 77 RMSE: 11.43
Df Residuals: 75 MAE: 9.18
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 116.1489 4.2985 0.001 106.6910 123.8671
opcount 0.0024 0.0001 0.001 0.0023 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · geth
nobs 88
R² 0.9967
coef (ms) 0.02015
p-value 1.00e-03
95% CI [0.01991, 0.0204]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 88 RMSE: 23.27
Df Residuals: 86 MAE: 18.87
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 385.0860 8.1960 0.001 369.4215 400.9695
opcount 0.0202 0.0001 0.001 0.0199 0.0204
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · nethermind
nobs 55
R² 0.9881
coef (ms) 0.01036
p-value 1.00e-03
95% CI [0.01006, 0.01071]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.988
Model: NNLS Adj. R-squared: 0.988
No. Observations: 55 RMSE: 22.76
Df Residuals: 53 MAE: 17.25
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 85.1464 10.2638 0.001 64.3464 105.0470
opcount 0.0104 0.0002 0.001 0.0101 0.0107
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · reth
nobs 77
R² 0.9794
coef (ms) 0.004386
p-value 1.00e-03
95% CI [0.004224, 0.004535]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.979
Model: NNLS Adj. R-squared: 0.979
No. Observations: 77 RMSE: 12.72
Df Residuals: 75 MAE: 10.02
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 105.7334 4.9640 0.001 96.5346 115.4257
opcount 0.0044 0.0001 0.001 0.0042 0.0045
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================STATICCALL · test_ext_account_query_warm · combo STATICCALL · besu
nobs 99
R² 0.7089
coef (ms) 0.0003954
p-value 1.00e-03
95% CI [0.0003409, 0.0004441]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.709
Model: NNLS Adj. R-squared: 0.706
No. Observations: 99 RMSE: 131.19
Df Residuals: 97 MAE: 109.54
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 577.6191 44.1033 0.001 494.8281 670.7977
opcount 0.0004 0.0000 0.001 0.0003 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_ext_account_query_warm · combo STATICCALL · erigon
nobs 55
R² 0.3876
coef (ms) 0.0002985
p-value 1.00e-03
95% CI [0.0001914, 0.0003478]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.388
Model: NNLS Adj. R-squared: 0.376
No. Observations: 55 RMSE: 194.29
Df Residuals: 53 MAE: 145.78
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 32.0015 56.6747 0.323 0.0000 182.5860
opcount 0.0003 0.0000 0.001 0.0002 0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_ext_account_query_warm · combo STATICCALL · ethrex
nobs 77
R² 0.9336
coef (ms) 9.587e-05
p-value 1.00e-03
95% CI [8.993e-05, 0.0001015]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.934
Model: NNLS Adj. R-squared: 0.933
No. Observations: 77 RMSE: 13.24
Df Residuals: 75 MAE: 11.04
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 42.4947 5.1820 0.001 33.3985 52.8695
opcount 0.0001 0.0000 0.001 0.0001 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_ext_account_query_warm · combo STATICCALL · geth
nobs 88
R² 0.9496
coef (ms) 0.0001862
p-value 1.00e-03
95% CI [0.0001767, 0.000197]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.950
Model: NNLS Adj. R-squared: 0.949
No. Observations: 88 RMSE: 22.21
Df Residuals: 86 MAE: 17.38
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 39.8585 7.5180 0.001 24.6449 54.8623
opcount 0.0002 0.0000 0.001 0.0002 0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_ext_account_query_warm · combo STATICCALL · nethermind
nobs 55
R² 0.9215
coef (ms) 0.0003697
p-value 1.00e-03
95% CI [0.0003445, 0.0003971]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.922
Model: NNLS Adj. R-squared: 0.920
No. Observations: 55 RMSE: 55.87
Df Residuals: 53 MAE: 46.30
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 183.5996 21.6774 0.001 142.0409 226.9139
opcount 0.0004 0.0000 0.001 0.0003 0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_ext_account_query_warm · combo STATICCALL · reth
nobs 77
R² 0.8975
coef (ms) 5.294e-05
p-value 1.00e-03
95% CI [4.891e-05, 5.692e-05]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.898
Model: NNLS Adj. R-squared: 0.896
No. Observations: 77 RMSE: 9.26
Df Residuals: 75 MAE: 7.44
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 31.7819 3.4028 0.001 25.2053 38.8601
opcount 0.0001 0.0000 0.001 0.0000 0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_EOA · besu
nobs 99
R² 0.8985
coef (ms) 0.03283
p-value 1.00e-03
95% CI [0.03076, 0.03507]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.898
Model: NNLS Adj. R-squared: 0.897
No. Observations: 99 RMSE: 226.89
Df Residuals: 97 MAE: 213.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 317.5815 74.2094 0.001 168.4773 458.6252
opcount 0.0328 0.0011 0.001 0.0308 0.0351
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_EOA · erigon
nobs 55
R² 0.9642
coef (ms) 0.00972
p-value 1.00e-03
95% CI [0.009234, 0.009889]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.964
Model: NNLS Adj. R-squared: 0.964
No. Observations: 55 RMSE: 38.78
Df Residuals: 53 MAE: 28.53
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 7.5190 1.000 0.0000 25.8571
opcount 0.0097 0.0002 0.001 0.0092 0.0099
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_EOA · ethrex
nobs 77
R² 0.9811
coef (ms) 0.01847
p-value 1.00e-03
95% CI [0.01775, 0.01913]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 52.66
Df Residuals: 75 MAE: 46.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 221.6427 25.9123 0.001 175.7443 274.6780
opcount 0.0185 0.0004 0.001 0.0177 0.0191
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_EOA · geth
nobs 88
R² 0.9966
coef (ms) 0.02096
p-value 1.00e-03
95% CI [0.0207, 0.02124]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.997
Model: NNLS Adj. R-squared: 0.997
No. Observations: 88 RMSE: 25.02
Df Residuals: 86 MAE: 20.21
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 399.4146 8.1161 0.001 383.2867 416.0017
opcount 0.0210 0.0001 0.001 0.0207 0.0212
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_EOA · nethermind
nobs 55
R² 0.9803
coef (ms) 0.01106
p-value 1.00e-03
95% CI [0.01075, 0.01143]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 55 RMSE: 32.28
Df Residuals: 53 MAE: 24.61
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 80.7540 11.1426 0.001 59.3467 103.3013
opcount 0.0111 0.0002 0.001 0.0108 0.0114
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_EOA · reth
nobs 77
R² 0.9838
coef (ms) 0.004748
p-value 1.00e-03
95% CI [0.00463, 0.004872]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.984
Model: NNLS Adj. R-squared: 0.984
No. Observations: 77 RMSE: 12.51
Df Residuals: 75 MAE: 10.23
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 106.0920 4.2486 0.001 97.7278 114.1341
opcount 0.0047 0.0001 0.001 0.0046 0.0049
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu
nobs 99
R² 0.8935
coef (ms) 0.03368
p-value 1.00e-03
95% CI [0.03147, 0.03605]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.893
Model: NNLS Adj. R-squared: 0.892
No. Observations: 99 RMSE: 239.05
Df Residuals: 97 MAE: 224.26
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 306.5129 76.0899 0.001 155.7634 451.0043
opcount 0.0337 0.0012 0.001 0.0315 0.0361
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon
nobs 55
R² 0.9944
coef (ms) 0.1056
p-value 1.00e-03
95% CI [0.1036, 0.1078]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.994
Model: NNLS Adj. R-squared: 0.994
No. Observations: 55 RMSE: 163.06
Df Residuals: 53 MAE: 122.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1870.4802 66.8236 0.001 1743.1530 2003.8204
opcount 0.1056 0.0011 0.001 0.1036 0.1078
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · ethrex
nobs 77
R² 0.9645
coef (ms) 0.002553
p-value 1.00e-03
95% CI [0.002421, 0.00268]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.965
Model: NNLS Adj. R-squared: 0.964
No. Observations: 77 RMSE: 10.06
Df Residuals: 75 MAE: 8.09
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 113.8424 4.0770 0.001 105.6246 122.2428
opcount 0.0026 0.0001 0.001 0.0024 0.0027
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth
nobs 88
R² 0.9951
coef (ms) 0.02133
p-value 1.00e-03
95% CI [0.02099, 0.02166]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 30.83
Df Residuals: 86 MAE: 24.38
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 400.4763 11.1075 0.001 380.2785 421.8560
opcount 0.0213 0.0002 0.001 0.0210 0.0217
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind
nobs 55
R² 0.9824
coef (ms) 0.01097
p-value 1.00e-03
95% CI [0.01065, 0.01128]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.982
No. Observations: 55 RMSE: 30.16
Df Residuals: 53 MAE: 24.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 81.0842 11.4221 0.001 59.6175 105.2781
opcount 0.0110 0.0002 0.001 0.0106 0.0113
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth
nobs 77
R² 0.9807
coef (ms) 0.004608
p-value 1.00e-03
95% CI [0.00448, 0.004739]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 13.30
Df Residuals: 75 MAE: 10.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 101.8717 4.4706 0.001 93.5681 110.3344
opcount 0.0046 0.0001 0.001 0.0045 0.0047
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · besu
nobs 99
R² 0.8853
coef (ms) 0.04653
p-value 1.00e-03
95% CI [0.04323, 0.04991]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.885
Model: NNLS Adj. R-squared: 0.884
No. Observations: 99 RMSE: 338.93
Df Residuals: 97 MAE: 282.16
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 847.0191 104.2554 0.001 638.4865 1046.1114
opcount 0.0465 0.0017 0.001 0.0432 0.0499
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · erigon
nobs 55
R² 0.8993
coef (ms) 0.1467
p-value 1.00e-03
95% CI [0.1329, 0.1576]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.899
Model: NNLS Adj. R-squared: 0.897
No. Observations: 55 RMSE: 993.45
Df Residuals: 53 MAE: 826.87
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 875.1316 442.1037 0.012 98.1024 1826.6889
opcount 0.1467 0.0063 0.001 0.1329 0.1576
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · ethrex
nobs 77
R² 0.9979
coef (ms) 0.1014
p-value 1.00e-03
95% CI [0.1003, 0.1025]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.998
Model: NNLS Adj. R-squared: 0.998
No. Observations: 77 RMSE: 93.13
Df Residuals: 75 MAE: 76.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 424.6560 34.6936 0.001 356.1222 495.4123
opcount 0.1014 0.0005 0.001 0.1003 0.1025
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · geth
nobs 88
R² 0.9342
coef (ms) 0.04144
p-value 1.00e-03
95% CI [0.03886, 0.04424]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.934
Model: NNLS Adj. R-squared: 0.933
No. Observations: 88 RMSE: 222.50
Df Residuals: 86 MAE: 184.19
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1310.6988 93.6881 0.001 1128.7665 1490.6004
opcount 0.0414 0.0013 0.001 0.0389 0.0442
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · nethermind
nobs 55
R² 0.9135
coef (ms) 0.0371
p-value 1.00e-03
95% CI [0.03366, 0.04062]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.914
Model: NNLS Adj. R-squared: 0.912
No. Observations: 55 RMSE: 231.06
Df Residuals: 53 MAE: 193.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 682.8969 121.2381 0.001 454.9520 939.8770
opcount 0.0371 0.0017 0.001 0.0337 0.0406
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_DIFF_MAX · reth
nobs 77
R² 0.9941
coef (ms) 0.02404
p-value 1.00e-03
95% CI [0.02358, 0.02446]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.994
Model: NNLS Adj. R-squared: 0.994
No. Observations: 77 RMSE: 37.36
Df Residuals: 75 MAE: 29.80
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 140.9764 14.4060 0.001 113.7526 170.0339
opcount 0.0240 0.0002 0.001 0.0236 0.0245
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_MINIMAL · besu
nobs 99
R² 0.8357
coef (ms) 0.02646
p-value 1.00e-03
95% CI [0.02413, 0.02875]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.836
Model: NNLS Adj. R-squared: 0.834
No. Observations: 99 RMSE: 237.44
Df Residuals: 97 MAE: 229.54
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 431.7412 77.3598 0.001 284.7045 579.8816
opcount 0.0265 0.0012 0.001 0.0241 0.0288
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_MINIMAL · erigon
nobs 55
R² 0.9412
coef (ms) 0.02454
p-value 1.00e-03
95% CI [0.02287, 0.02588]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.941
Model: NNLS Adj. R-squared: 0.940
No. Observations: 55 RMSE: 124.19
Df Residuals: 53 MAE: 107.33
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 325.5536 56.8346 0.001 225.6517 444.7742
opcount 0.0245 0.0008 0.001 0.0229 0.0259
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_MINIMAL · ethrex
nobs 77
R² 0.9817
coef (ms) 0.01885
p-value 1.00e-03
95% CI [0.01816, 0.01953]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 52.05
Df Residuals: 75 MAE: 45.79
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 216.4057 24.3804 0.001 170.2273 264.2953
opcount 0.0188 0.0003 0.001 0.0182 0.0195
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_MINIMAL · geth
nobs 88
R² 0.9958
coef (ms) 0.01999
p-value 1.00e-03
95% CI [0.0197, 0.02026]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 26.40
Df Residuals: 86 MAE: 20.65
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 412.0929 8.5749 0.001 397.1212 429.4011
opcount 0.0200 0.0001 0.001 0.0197 0.0203
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_MINIMAL · nethermind
nobs 55
R² 0.9802
coef (ms) 0.01231
p-value 1.00e-03
95% CI [0.01189, 0.01284]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 55 RMSE: 35.38
Df Residuals: 53 MAE: 27.74
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 136.4208 14.5971 0.001 105.5086 162.8740
opcount 0.0123 0.0002 0.001 0.0119 0.0128
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_MINIMAL · reth
nobs 77
R² 0.9833
coef (ms) 0.005333
p-value 1.00e-03
95% CI [0.005169, 0.0055]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 77 RMSE: 14.06
Df Residuals: 75 MAE: 10.90
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 94.0279 5.1693 0.001 84.0960 104.0262
opcount 0.0053 0.0001 0.001 0.0052 0.0055
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · besu
nobs 99
R² 0.8307
coef (ms) 0.02708
p-value 1.00e-03
95% CI [0.02495, 0.02941]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.831
Model: NNLS Adj. R-squared: 0.829
No. Observations: 99 RMSE: 247.47
Df Residuals: 97 MAE: 235.51
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 397.1765 72.0428 0.001 247.8929 540.8921
opcount 0.0271 0.0011 0.001 0.0249 0.0294
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · erigon
nobs 55
R² 0.7444
coef (ms) 0.02654
p-value 1.00e-03
95% CI [0.02208, 0.03052]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.744
Model: NNLS Adj. R-squared: 0.740
No. Observations: 55 RMSE: 314.78
Df Residuals: 53 MAE: 235.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 336.6097 129.0195 0.001 110.6802 614.2429
opcount 0.0265 0.0022 0.001 0.0221 0.0305
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · ethrex
nobs 77
R² 0.9802
coef (ms) 0.01878
p-value 1.00e-03
95% CI [0.01806, 0.01948]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 54.08
Df Residuals: 75 MAE: 47.35
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 224.2771 26.5388 0.001 173.5584 278.0182
opcount 0.0188 0.0004 0.001 0.0181 0.0195
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · geth
nobs 88
R² 0.9945
coef (ms) 0.02042
p-value 1.00e-03
95% CI [0.02008, 0.02074]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.994
No. Observations: 88 RMSE: 30.67
Df Residuals: 86 MAE: 25.30
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 387.1572 10.3758 0.001 368.3547 407.9260
opcount 0.0204 0.0002 0.001 0.0201 0.0207
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · nethermind
nobs 55
R² 0.9778
coef (ms) 0.01232
p-value 1.00e-03
95% CI [0.01182, 0.01284]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.977
No. Observations: 55 RMSE: 37.53
Df Residuals: 53 MAE: 29.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 143.0855 17.0113 0.001 109.8923 176.1506
opcount 0.0123 0.0003 0.001 0.0118 0.0128
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT_SAME_MAX · reth
nobs 77
R² 0.9738
coef (ms) 0.005395
p-value 1.00e-03
95% CI [0.005183, 0.005633]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.974
Model: NNLS Adj. R-squared: 0.973
No. Observations: 77 RMSE: 17.90
Df Residuals: 75 MAE: 13.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 91.5955 6.5083 0.001 79.0965 103.6774
opcount 0.0054 0.0001 0.001 0.0052 0.0056
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · besu
nobs 99
R² 0.8935
coef (ms) 0.03368
p-value 1.00e-03
95% CI [0.03147, 0.03605]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.893
Model: NNLS Adj. R-squared: 0.892
No. Observations: 99 RMSE: 239.05
Df Residuals: 97 MAE: 224.26
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 306.5129 76.0899 0.001 155.7634 451.0043
opcount 0.0337 0.0012 0.001 0.0315 0.0361
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · erigon
nobs 55
R² 0.9944
coef (ms) 0.1056
p-value 1.00e-03
95% CI [0.1036, 0.1078]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.994
Model: NNLS Adj. R-squared: 0.994
No. Observations: 55 RMSE: 163.06
Df Residuals: 53 MAE: 122.85
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1870.4802 66.8236 0.001 1743.1530 2003.8204
opcount 0.1056 0.0011 0.001 0.1036 0.1078
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · ethrex
nobs 77
R² 0.9645
coef (ms) 0.002553
p-value 1.00e-03
95% CI [0.002421, 0.00268]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.965
Model: NNLS Adj. R-squared: 0.964
No. Observations: 77 RMSE: 10.06
Df Residuals: 75 MAE: 8.09
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 113.8424 4.0770 0.001 105.6246 122.2428
opcount 0.0026 0.0001 0.001 0.0024 0.0027
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · geth
nobs 88
R² 0.9951
coef (ms) 0.02133
p-value 1.00e-03
95% CI [0.02099, 0.02166]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 30.83
Df Residuals: 86 MAE: 24.38
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 400.4763 11.1075 0.001 380.2785 421.8560
opcount 0.0213 0.0002 0.001 0.0210 0.0217
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · nethermind
nobs 55
R² 0.9824
coef (ms) 0.01097
p-value 1.00e-03
95% CI [0.01065, 0.01128]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.982
No. Observations: 55 RMSE: 30.16
Df Residuals: 53 MAE: 24.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 81.0842 11.4221 0.001 59.6175 105.2781
opcount 0.0110 0.0002 0.001 0.0106 0.0113
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · reth
nobs 77
R² 0.9807
coef (ms) 0.004608
p-value 1.00e-03
95% CI [0.00448, 0.004739]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 13.30
Df Residuals: 75 MAE: 10.39
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 101.8717 4.4706 0.001 93.5681 110.3344
opcount 0.0046 0.0001 0.001 0.0045 0.0047
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_EOA · besu
nobs 99
R² 0.8868
coef (ms) 0.03141
p-value 1.00e-03
95% CI [0.02935, 0.03345]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.887
Model: NNLS Adj. R-squared: 0.886
No. Observations: 99 RMSE: 217.37
Df Residuals: 97 MAE: 204.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 229.4076 64.0876 0.001 105.4093 356.0824
opcount 0.0314 0.0011 0.001 0.0293 0.0334
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_EOA · erigon
nobs 55
R² 0.9535
coef (ms) 0.009257
p-value 1.00e-03
95% CI [0.008773, 0.009445]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.954
Model: NNLS Adj. R-squared: 0.953
No. Observations: 55 RMSE: 40.22
Df Residuals: 53 MAE: 29.26
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 6.3573 1.000 0.0000 22.0083
opcount 0.0093 0.0002 0.001 0.0088 0.0094
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_EOA · ethrex
nobs 77
R² 0.982
coef (ms) 0.01828
p-value 1.00e-03
95% CI [0.01765, 0.01888]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.982
Model: NNLS Adj. R-squared: 0.982
No. Observations: 77 RMSE: 47.97
Df Residuals: 75 MAE: 42.11
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 219.2694 22.1391 0.001 179.1260 264.8216
opcount 0.0183 0.0003 0.001 0.0176 0.0189
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_EOA · geth
nobs 88
R² 0.995
coef (ms) 0.02139
p-value 1.00e-03
95% CI [0.02108, 0.02172]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 29.25
Df Residuals: 86 MAE: 23.47
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 381.3815 10.0993 0.001 362.1513 400.0523
opcount 0.0214 0.0002 0.001 0.0211 0.0217
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_EOA · nethermind
nobs 55
R² 0.987
coef (ms) 0.01051
p-value 1.00e-03
95% CI [0.01017, 0.01084]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.987
Model: NNLS Adj. R-squared: 0.987
No. Observations: 55 RMSE: 23.36
Df Residuals: 53 MAE: 19.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 96.3674 11.1193 0.001 76.1424 119.0858
opcount 0.0105 0.0002 0.001 0.0102 0.0108
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_EOA · reth
nobs 77
R² 0.9759
coef (ms) 0.004669
p-value 1.00e-03
95% CI [0.004517, 0.004829]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.976
Model: NNLS Adj. R-squared: 0.976
No. Observations: 77 RMSE: 14.21
Df Residuals: 75 MAE: 11.02
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 91.5522 5.0174 0.001 81.8618 101.6747
opcount 0.0047 0.0001 0.001 0.0045 0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu
nobs 99
R² 0.9059
coef (ms) 0.03153
p-value 1.00e-03
95% CI [0.02952, 0.03355]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.906
Model: NNLS Adj. R-squared: 0.905
No. Observations: 99 RMSE: 196.77
Df Residuals: 97 MAE: 189.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 201.9312 63.9482 0.001 72.8729 333.3197
opcount 0.0315 0.0010 0.001 0.0295 0.0336
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon
nobs 55
R² 0.9916
coef (ms) 0.008183
p-value 1.00e-03
95% CI [0.008106, 0.008248]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.992
Model: NNLS Adj. R-squared: 0.991
No. Observations: 55 RMSE: 15.18
Df Residuals: 53 MAE: 11.08
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0470 1.000 0.0000 0.0000
opcount 0.0082 0.0000 0.001 0.0081 0.0082
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · ethrex
nobs 77
R² 0.9486
coef (ms) 0.002461
p-value 1.00e-03
95% CI [0.00232, 0.002605]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.949
Model: NNLS Adj. R-squared: 0.948
No. Observations: 77 RMSE: 11.09
Df Residuals: 75 MAE: 8.86
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 114.7175 4.3316 0.001 106.0354 122.9206
opcount 0.0025 0.0001 0.001 0.0023 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth
nobs 88
R² 0.9964
coef (ms) 0.02054
p-value 1.00e-03
95% CI [0.02027, 0.0208]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 23.97
Df Residuals: 86 MAE: 19.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 384.4299 8.6365 0.001 369.0941 402.5026
opcount 0.0205 0.0001 0.001 0.0203 0.0208
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind
nobs 55
R² 0.9804
coef (ms) 0.01025
p-value 1.00e-03
95% CI [0.009917, 0.01057]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 55 RMSE: 28.04
Df Residuals: 53 MAE: 23.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 99.7082 10.7518 0.001 78.2884 120.4455
opcount 0.0102 0.0002 0.001 0.0099 0.0106
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth
nobs 77
R² 0.9801
coef (ms) 0.004576
p-value 1.00e-03
95% CI [0.004427, 0.004724]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 12.64
Df Residuals: 75 MAE: 8.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 97.2827 4.5441 0.001 88.4045 106.1714
opcount 0.0046 0.0001 0.001 0.0044 0.0047
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_DIFF_MAX · besu
nobs 99
R² 0.8801
coef (ms) 0.04537
p-value 1.00e-03
95% CI [0.04211, 0.04857]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.880
Model: NNLS Adj. R-squared: 0.879
No. Observations: 99 RMSE: 319.53
Df Residuals: 97 MAE: 259.96
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 697.3101 98.4247 0.001 509.0707 893.4431
opcount 0.0454 0.0017 0.001 0.0421 0.0486
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_DIFF_MAX · erigon
nobs 55
R² 0.913
coef (ms) 0.144
p-value 1.00e-03
95% CI [0.132, 0.1546]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.913
Model: NNLS Adj. R-squared: 0.911
No. Observations: 55 RMSE: 848.61
Df Residuals: 53 MAE: 741.60
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 838.3448 387.5728 0.010 131.4115 1643.2975
opcount 0.1440 0.0057 0.001 0.1320 0.1546
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_DIFF_MAX · ethrex
nobs 77
R² 0.998
coef (ms) 0.101
p-value 1.00e-03
95% CI [0.1, 0.102]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.998
Model: NNLS Adj. R-squared: 0.998
No. Observations: 77 RMSE: 86.29
Df Residuals: 75 MAE: 67.27
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 405.3569 30.2236 0.001 347.2593 465.9105
opcount 0.1010 0.0005 0.001 0.1000 0.1020
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_DIFF_MAX · geth
nobs 88
R² 0.9334
coef (ms) 0.04207
p-value 1.00e-03
95% CI [0.0393, 0.04475]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.933
Model: NNLS Adj. R-squared: 0.933
No. Observations: 88 RMSE: 214.48
Df Residuals: 86 MAE: 179.36
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 1229.8040 92.4692 0.001 1055.2091 1420.6882
opcount 0.0421 0.0014 0.001 0.0393 0.0447
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_DIFF_MAX · nethermind
nobs 55
R² 0.932
coef (ms) 0.03707
p-value 1.00e-03
95% CI [0.03412, 0.03983]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.932
Model: NNLS Adj. R-squared: 0.931
No. Observations: 55 RMSE: 191.11
Df Residuals: 53 MAE: 165.82
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 524.2035 97.8309 0.001 338.2860 714.6658
opcount 0.0371 0.0015 0.001 0.0341 0.0398
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_DIFF_MAX · reth
nobs 77
R² 0.9916
coef (ms) 0.02306
p-value 1.00e-03
95% CI [0.02249, 0.02355]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.992
Model: NNLS Adj. R-squared: 0.991
No. Observations: 77 RMSE: 40.49
Df Residuals: 75 MAE: 31.81
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 140.1590 15.3440 0.001 111.4118 172.6238
opcount 0.0231 0.0003 0.001 0.0225 0.0235
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_MINIMAL · besu
nobs 99
R² 0.8212
coef (ms) 0.02626
p-value 1.00e-03
95% CI [0.02384, 0.02853]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.821
Model: NNLS Adj. R-squared: 0.819
No. Observations: 99 RMSE: 233.83
Df Residuals: 97 MAE: 225.01
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 305.5489 69.2711 0.001 173.3177 444.5637
opcount 0.0263 0.0012 0.001 0.0238 0.0285
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_MINIMAL · erigon
nobs 55
R² 0.9364
coef (ms) 0.0242
p-value 1.00e-03
95% CI [0.02258, 0.02558]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.936
Model: NNLS Adj. R-squared: 0.935
No. Observations: 55 RMSE: 120.37
Df Residuals: 53 MAE: 100.83
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 314.1557 53.7235 0.001 216.7083 430.4911
opcount 0.0242 0.0008 0.001 0.0226 0.0256
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_MINIMAL · ethrex
nobs 77
R² 0.9809
coef (ms) 0.01873
p-value 1.00e-03
95% CI [0.01807, 0.0194]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 49.84
Df Residuals: 75 MAE: 44.41
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 210.4280 22.0645 0.001 168.0312 253.7638
opcount 0.0187 0.0003 0.001 0.0181 0.0194
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_MINIMAL · geth
nobs 88
R² 0.9952
coef (ms) 0.02033
p-value 1.00e-03
95% CI [0.02001, 0.02064]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 26.95
Df Residuals: 86 MAE: 20.81
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 390.8365 9.7822 0.001 372.4626 410.6861
opcount 0.0203 0.0002 0.001 0.0200 0.0206
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_MINIMAL · nethermind
nobs 55
R² 0.9782
coef (ms) 0.01163
p-value 1.00e-03
95% CI [0.01116, 0.01216]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.978
No. Observations: 55 RMSE: 33.12
Df Residuals: 53 MAE: 24.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 114.2168 15.0224 0.001 84.2653 141.5265
opcount 0.0116 0.0003 0.001 0.0112 0.0122
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_MINIMAL · reth
nobs 77
R² 0.9796
coef (ms) 0.004993
p-value 1.00e-03
95% CI [0.004804, 0.005168]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.979
No. Observations: 77 RMSE: 13.76
Df Residuals: 75 MAE: 10.68
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 85.0057 5.2348 0.001 75.3317 96.5307
opcount 0.0050 0.0001 0.001 0.0048 0.0052
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_SAME_MAX · besu
nobs 99
R² 0.8069
coef (ms) 0.02662
p-value 1.00e-03
95% CI [0.02405, 0.02925]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.807
Model: NNLS Adj. R-squared: 0.805
No. Observations: 99 RMSE: 248.47
Df Residuals: 97 MAE: 237.73
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 294.8193 75.3030 0.001 145.9801 442.6891
opcount 0.0266 0.0013 0.001 0.0240 0.0292
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_SAME_MAX · erigon
nobs 55
R² 0.9396
coef (ms) 0.02417
p-value 1.00e-03
95% CI [0.0227, 0.02567]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.940
Model: NNLS Adj. R-squared: 0.938
No. Observations: 55 RMSE: 116.93
Df Residuals: 53 MAE: 100.03
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 320.5097 53.0681 0.001 221.0401 428.0292
opcount 0.0242 0.0008 0.001 0.0227 0.0257
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_SAME_MAX · ethrex
nobs 77
R² 0.9815
coef (ms) 0.01862
p-value 1.00e-03
95% CI [0.01796, 0.01932]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.981
Model: NNLS Adj. R-squared: 0.981
No. Observations: 77 RMSE: 48.85
Df Residuals: 75 MAE: 42.78
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 215.6361 23.0677 0.001 169.0980 261.4959
opcount 0.0186 0.0003 0.001 0.0180 0.0193
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_SAME_MAX · geth
nobs 88
R² 0.9948
coef (ms) 0.02006
p-value 1.00e-03
95% CI [0.01973, 0.02046]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.995
Model: NNLS Adj. R-squared: 0.995
No. Observations: 88 RMSE: 27.78
Df Residuals: 86 MAE: 22.86
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 392.7815 10.8162 0.001 370.6211 412.6266
opcount 0.0201 0.0002 0.001 0.0197 0.0205
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_SAME_MAX · nethermind
nobs 55
R² 0.9828
coef (ms) 0.01141
p-value 1.00e-03
95% CI [0.011, 0.01181]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.983
Model: NNLS Adj. R-squared: 0.983
No. Observations: 55 RMSE: 28.79
Df Residuals: 53 MAE: 23.43
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 129.8145 11.9086 0.001 106.9976 154.6854
opcount 0.0114 0.0002 0.001 0.0110 0.0118
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT_SAME_MAX · reth
nobs 77
R² 0.9779
coef (ms) 0.005011
p-value 1.00e-03
95% CI [0.004863, 0.005181]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.978
Model: NNLS Adj. R-squared: 0.978
No. Observations: 77 RMSE: 14.39
Df Residuals: 75 MAE: 11.49
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 85.5965 4.7502 0.001 76.4411 95.0765
opcount 0.0050 0.0001 0.001 0.0049 0.0052
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================
EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · besu
nobs 99
R² 0.9059
coef (ms) 0.03153
p-value 1.00e-03
95% CI [0.02952, 0.03355]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.906
Model: NNLS Adj. R-squared: 0.905
No. Observations: 99 RMSE: 196.77
Df Residuals: 97 MAE: 189.97
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 201.9312 63.9482 0.001 72.8729 333.3197
opcount 0.0315 0.0010 0.001 0.0295 0.0336
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · erigon
nobs 55
R² 0.9916
coef (ms) 0.008183
p-value 1.00e-03
95% CI [0.008106, 0.008248]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.992
Model: NNLS Adj. R-squared: 0.991
No. Observations: 55 RMSE: 15.18
Df Residuals: 53 MAE: 11.08
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 0.0000 0.0470 1.000 0.0000 0.0000
opcount 0.0082 0.0000 0.001 0.0081 0.0082
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · ethrex
nobs 77
R² 0.9486
coef (ms) 0.002461
p-value 1.00e-03
95% CI [0.00232, 0.002605]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.949
Model: NNLS Adj. R-squared: 0.948
No. Observations: 77 RMSE: 11.09
Df Residuals: 75 MAE: 8.86
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 114.7175 4.3316 0.001 106.0354 122.9206
opcount 0.0025 0.0001 0.001 0.0023 0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · geth
nobs 88
R² 0.9964
coef (ms) 0.02054
p-value 1.00e-03
95% CI [0.02027, 0.0208]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.996
Model: NNLS Adj. R-squared: 0.996
No. Observations: 88 RMSE: 23.97
Df Residuals: 86 MAE: 19.75
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 384.4299 8.6365 0.001 369.0941 402.5026
opcount 0.0205 0.0001 0.001 0.0203 0.0208
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · nethermind
nobs 55
R² 0.9804
coef (ms) 0.01025
p-value 1.00e-03
95% CI [0.009917, 0.01057]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 55 RMSE: 28.04
Df Residuals: 53 MAE: 23.37
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 99.7082 10.7518 0.001 78.2884 120.4455
opcount 0.0102 0.0002 0.001 0.0099 0.0106
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `models.custom[0] · reth
nobs 77
R² 0.9801
coef (ms) 0.004576
p-value 1.00e-03
95% CI [0.004427, 0.004724]
NNLS regression summary
==============================================================================
NNLS Regression Results
==============================================================================
Dep. Variable: test_runtime_ms R-squared: 0.980
Model: NNLS Adj. R-squared: 0.980
No. Observations: 77 RMSE: 12.64
Df Residuals: 75 MAE: 8.91
Df Model: 1
==============================================================================
coef std err P-value [0.025 0.975]
------------------------------------------------------------------------------
const 97.2827 4.5441 0.001 88.4045 106.1714
opcount 0.0046 0.0001 0.001 0.0044 0.0047
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================