Viewing run older run · latest of 12

Runtime model results

Per-spec NNLS fits of test runtime against opcode count — one block per (target opcode, test, model combo, client). Use the filters to narrow to a single opcode or client.

Plots omitted. This is an older archived run; only the 5 most recent runs retain the runtime plots. The per-fit stats and NNLS summaries below are unchanged.

SLOAD · test_sload_bloated · combo False · besu

nobs 286 0.9237 coef (ms) 0.008679 p-value 1.00e-03 95% CI [0.008388, 0.00897]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.924
Model:                  NNLS                    Adj. R-squared:          0.923
No. Observations:       286                               RMSE:          73.44
Df Residuals:           284                                MAE:          56.52
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    161.2454     12.6120       0.001    136.7350    186.2127
       opcount      0.0087      0.0001       0.001      0.0084      0.0090
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_sload_bloated · combo False · erigon

nobs 418 0.9956 coef (ms) 0.006218 p-value 1.00e-03 95% CI [0.006178, 0.006256]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.996
Model:                  NNLS                    Adj. R-squared:          0.996
No. Observations:       418                               RMSE:          12.17
Df Residuals:           416                                MAE:           9.77
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     17.8972      1.7007       0.001     14.7454     21.4000
       opcount      0.0062      0.0000       0.001      0.0062      0.0063
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_sload_bloated · combo False · geth

nobs 561 0.732 coef (ms) 0.1558 p-value 1.00e-03 95% CI [0.148, 0.1634]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.732
Model:                  NNLS                    Adj. R-squared:          0.732
No. Observations:       561                               RMSE:        2773.65
Df Residuals:           559                                MAE:        2553.77
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   2712.9320    327.4943       0.001   2073.9982   3350.0504
       opcount      0.1558      0.0040       0.001      0.1480      0.1634
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_sload_bloated · combo False · nethermind

nobs 682 0.8193 coef (ms) 0.003777 p-value 1.00e-03 95% CI [0.003645, 0.003917]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.819
Model:                  NNLS                    Adj. R-squared:          0.819
No. Observations:       682                               RMSE:          52.21
Df Residuals:           680                                MAE:          42.01
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    129.9899      5.8651       0.001    118.2574    141.3187
       opcount      0.0038      0.0001       0.001      0.0036      0.0039
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_sload_bloated · combo False · reth

nobs 1056 0.947 coef (ms) 0.001299 p-value 1.00e-03 95% CI [0.001279, 0.001318]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.947
Model:                  NNLS                    Adj. R-squared:          0.947
No. Observations:       1056                              RMSE:           9.05
Df Residuals:           1054                               MAE:           6.92
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     39.5671      1.0828       0.001     37.5597     41.6825
       opcount      0.0013      0.0000       0.001      0.0013      0.0013
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_sload_bloated · combo True · besu

nobs 286 0.8741 coef (ms) 0.01965 p-value 1.00e-03 95% CI [0.01868, 0.02055]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.874
Model:                  NNLS                    Adj. R-squared:          0.874
No. Observations:       286                               RMSE:         219.42
Df Residuals:           284                                MAE:         169.64
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    462.0781     40.5182       0.001    385.1484    546.8667
       opcount      0.0196      0.0005       0.001      0.0187      0.0206
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_sload_bloated · combo True · erigon

nobs 418 0.9882 coef (ms) 0.005783 p-value 1.00e-03 95% CI [0.005728, 0.00584]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.988
Model:                  NNLS                    Adj. R-squared:          0.988
No. Observations:       418                               RMSE:          18.63
Df Residuals:           416                                MAE:          15.78
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     26.9169      2.7597       0.001     21.3989     32.2661
       opcount      0.0058      0.0000       0.001      0.0057      0.0058
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_sload_bloated · combo True · geth

nobs 561 0.7063 coef (ms) 0.1491 p-value 1.00e-03 95% CI [0.1412, 0.157]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.706
Model:                  NNLS                    Adj. R-squared:          0.706
No. Observations:       561                               RMSE:        2829.03
Df Residuals:           559                                MAE:        2536.01
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   2783.6178    325.5915       0.001   2163.1304   3425.7170
       opcount      0.1491      0.0040       0.001      0.1412      0.1570
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_sload_bloated · combo True · nethermind

nobs 682 0.469 coef (ms) 0.02223 p-value 1.00e-03 95% CI [0.02048, 0.02403]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.469
Model:                  NNLS                    Adj. R-squared:          0.468
No. Observations:       682                               RMSE:         696.08
Df Residuals:           680                                MAE:         615.75
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1386.7932     82.8999       0.001   1221.8237   1544.9483
       opcount      0.0222      0.0009       0.001      0.0205      0.0240
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_sload_bloated · combo True · reth

nobs 1056 0.9682 coef (ms) 0.001454 p-value 1.00e-03 95% CI [0.001438, 0.001471]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.968
Model:                  NNLS                    Adj. R-squared:          0.968
No. Observations:       1056                              RMSE:           7.76
Df Residuals:           1054                               MAE:           5.99
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     29.5400      0.7122       0.001     28.0631     30.8418
       opcount      0.0015      0.0000       0.001      0.0014      0.0015
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_storage_sload_same_key_benchmark · besu

nobs 572 0.6146 coef (ms) 0.0001202 p-value 1.00e-03 95% CI [0.0001124, 0.0001279]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.615
Model:                  NNLS                    Adj. R-squared:          0.614
No. Observations:       572                               RMSE:          60.13
Df Residuals:           570                                MAE:          46.19
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    117.1462      7.9426       0.001    101.5263    132.6318
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_storage_sload_same_key_benchmark · erigon

nobs 836 0.8589 coef (ms) 5.021e-05 p-value 1.00e-03 95% CI [4.876e-05, 5.165e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.859
Model:                  NNLS                    Adj. R-squared:          0.859
No. Observations:       836                               RMSE:          12.85
Df Residuals:           834                                MAE:           9.74
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     36.6993      1.3347       0.001     34.1760     39.2963
       opcount      0.0001      0.0000       0.001      0.0000      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_storage_sload_same_key_benchmark · geth

nobs 1122 0.9812 coef (ms) 0.0002154 p-value 1.00e-03 95% CI [0.0002135, 0.0002172]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.981
Model:                  NNLS                    Adj. R-squared:          0.981
No. Observations:       1122                              RMSE:          18.81
Df Residuals:           1120                               MAE:          14.35
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     13.1431      1.7426       0.001      9.7495     16.6272
       opcount      0.0002      0.0000       0.001      0.0002      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_storage_sload_same_key_benchmark · nethermind

nobs 1364 0.6883 coef (ms) 0.0001661 p-value 1.00e-03 95% CI [0.0001594, 0.000172]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.688
Model:                  NNLS                    Adj. R-squared:          0.688
No. Observations:       1364                              RMSE:          70.58
Df Residuals:           1362                               MAE:          56.15
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     97.0840      5.7093       0.001     86.1547    109.0415
       opcount      0.0002      0.0000       0.001      0.0002      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SLOAD · test_storage_sload_same_key_benchmark · reth

nobs 2112 0.6868 coef (ms) 5.23e-06 p-value 1.00e-03 95% CI [5.086e-06, 5.379e-06]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.687
Model:                  NNLS                    Adj. R-squared:          0.687
No. Observations:       2112                              RMSE:           2.23
Df Residuals:           2110                               MAE:           1.59
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      5.4808      0.1498       0.001      5.1982      5.7654
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_access] · besu

nobs 286 0.8213 coef (ms) 0.009797 p-value 1.00e-03 95% CI [0.009256, 0.01033]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.821
Model:                  NNLS                    Adj. R-squared:          0.821
No. Observations:       286                               RMSE:         129.15
Df Residuals:           284                                MAE:          99.21
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    458.8944     21.4152       0.001    417.8417    500.2840
       opcount      0.0098      0.0003       0.001      0.0093      0.0103
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_access] · erigon

nobs 418 0.9951 coef (ms) 0.006176 p-value 1.00e-03 95% CI [0.006132, 0.006221]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.995
Model:                  NNLS                    Adj. R-squared:          0.995
No. Observations:       418                               RMSE:          12.31
Df Residuals:           416                                MAE:           9.77
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     20.6528      1.8173       0.001     17.1461     24.1990
       opcount      0.0062      0.0000       0.001      0.0061      0.0062
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_access] · geth

nobs 561 0.6975 coef (ms) 0.03761 p-value 1.00e-03 95% CI [0.03563, 0.03978]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.698
Model:                  NNLS                    Adj. R-squared:          0.697
No. Observations:       561                               RMSE:         699.90
Df Residuals:           559                                MAE:         596.80
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1130.8928     86.3186       0.001    952.0515   1294.8603
       opcount      0.0376      0.0011       0.001      0.0356      0.0398
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_access] · nethermind

nobs 682 0.8526 coef (ms) 0.003844 p-value 1.00e-03 95% CI [0.003726, 0.003967]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.853
Model:                  NNLS                    Adj. R-squared:          0.852
No. Observations:       682                               RMSE:          45.18
Df Residuals:           680                                MAE:          36.01
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    116.2859      5.0264       0.001    106.5099    126.3000
       opcount      0.0038      0.0001       0.001      0.0037      0.0040
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_access] · reth

nobs 1056 0.945 coef (ms) 0.001309 p-value 1.00e-03 95% CI [0.001289, 0.001328]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.945
Model:                  NNLS                    Adj. R-squared:          0.945
No. Observations:       1056                              RMSE:           8.93
Df Residuals:           1054                               MAE:           7.05
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     42.1828      0.9409       0.001     40.3713     44.0988
       opcount      0.0013      0.0000       0.001      0.0013      0.0013
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_access] · besu

nobs 286 0.8481 coef (ms) 0.02029 p-value 1.00e-03 95% CI [0.0192, 0.02137]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.848
Model:                  NNLS                    Adj. R-squared:          0.848
No. Observations:       286                               RMSE:         242.70
Df Residuals:           284                                MAE:         194.70
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    689.3695     45.2958       0.001    597.9227    780.8373
       opcount      0.0203      0.0005       0.001      0.0192      0.0214
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_access] · erigon

nobs 418 0.9806 coef (ms) 0.005716 p-value 1.00e-03 95% CI [0.005645, 0.005787]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.981
Model:                  NNLS                    Adj. R-squared:          0.981
No. Observations:       418                               RMSE:          22.72
Df Residuals:           416                                MAE:          19.35
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     28.5961      3.2392       0.001     22.2999     35.1155
       opcount      0.0057      0.0000       0.001      0.0056      0.0058
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_access] · geth

nobs 561 0.5996 coef (ms) 0.03228 p-value 1.00e-03 95% CI [0.02999, 0.03452]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.600
Model:                  NNLS                    Adj. R-squared:          0.599
No. Observations:       561                               RMSE:         745.44
Df Residuals:           559                                MAE:         615.62
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1462.0408     94.8397       0.001   1278.8845   1644.6507
       opcount      0.0323      0.0012       0.001      0.0300      0.0345
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_access] · nethermind

nobs 682 0.509 coef (ms) 0.02385 p-value 1.00e-03 95% CI [0.02223, 0.02567]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.509
Model:                  NNLS                    Adj. R-squared:          0.508
No. Observations:       682                               RMSE:         661.85
Df Residuals:           680                                MAE:         575.32
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1235.5336     78.1593       0.001   1084.6210   1384.2028
       opcount      0.0238      0.0009       0.001      0.0222      0.0257
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_access] · reth

nobs 1056 0.9691 coef (ms) 0.001491 p-value 1.00e-03 95% CI [0.001473, 0.001508]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.969
Model:                  NNLS                    Adj. R-squared:          0.969
No. Observations:       1056                              RMSE:           7.52
Df Residuals:           1054                               MAE:           5.93
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     29.1922      0.7529       0.001     27.7199     30.6344
       opcount      0.0015      0.0000       0.001      0.0015      0.0015
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_write] · besu

nobs 286 0.1801 coef (ms) 0.132 p-value 1.00e-03 95% CI [0.1015, 0.1626]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.180
Model:                  NNLS                    Adj. R-squared:          0.177
No. Observations:       286                               RMSE:         172.96
Df Residuals:           284                                MAE:         147.16
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    526.6398     27.9900       0.001    469.2246    580.1065
       opcount      0.1320      0.0154       0.001      0.1015      0.1626
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_write] · erigon

nobs 418 0.734 coef (ms) 1.115 p-value 1.00e-03 95% CI [1.048, 1.178]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.734
Model:                  NNLS                    Adj. R-squared:          0.733
No. Observations:       418                               RMSE:         412.14
Df Residuals:           416                                MAE:         358.80
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   2750.8638     73.3621       0.001   2614.1881   2901.2119
       opcount      1.1147      0.0315       0.001      1.0480      1.1776
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_write] · geth

nobs 561 0.7759 coef (ms) 0.4634 p-value 1.00e-03 95% CI [0.4411, 0.4851]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.776
Model:                  NNLS                    Adj. R-squared:          0.775
No. Observations:       561                               RMSE:         152.96
Df Residuals:           559                                MAE:         123.44
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    128.4397     19.2097       0.001     92.0270    166.6872
       opcount      0.4634      0.0110       0.001      0.4411      0.4851
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_write] · nethermind

nobs 682 0.2978 coef (ms) 0.05534 p-value 1.00e-03 95% CI [0.04976, 0.06107]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.298
Model:                  NNLS                    Adj. R-squared:          0.297
No. Observations:       682                               RMSE:          52.19
Df Residuals:           680                                MAE:          42.32
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    145.5018      6.2297       0.001    134.0227    157.4257
       opcount      0.0553      0.0030       0.001      0.0498      0.0611
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo False` — `presets[cold_storage_sstore_write] · reth

nobs 1056 0.006533 coef (ms) 0.008868 p-value 1.50e-02 95% CI [0.0004736, 0.01751]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.007
Model:                  NNLS                    Adj. R-squared:          0.006
No. Observations:       1056                              RMSE:          67.16
Df Residuals:           1054                               MAE:          50.51
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    303.0290      9.9245       0.001    282.9531    321.9767
       opcount      0.0089      0.0043       0.015      0.0005      0.0175
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_write] · besu

nobs 286 0.9505 coef (ms) 0.1099 p-value 1.00e-03 95% CI [0.107, 0.113]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.950
Model:                  NNLS                    Adj. R-squared:          0.950
No. Observations:       286                               RMSE:         314.28
Df Residuals:           284                                MAE:         249.28
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    938.9117     63.6371       0.001    817.2899   1058.0365
       opcount      0.1099      0.0016       0.001      0.1070      0.1130
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_write] · erigon

nobs 418 0.9949 coef (ms) 0.5711 p-value 1.00e-03 95% CI [0.5668, 0.5755]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.995
Model:                  NNLS                    Adj. R-squared:          0.995
No. Observations:       418                               RMSE:         513.10
Df Residuals:           416                                MAE:         392.90
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   5727.9907     74.4477       0.001   5578.5104   5879.0917
       opcount      0.5711      0.0021       0.001      0.5668      0.5755
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_write] · geth

nobs 561 0.9381 coef (ms) 0.1072 p-value 1.00e-03 95% CI [0.105, 0.1094]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.938
Model:                  NNLS                    Adj. R-squared:          0.938
No. Observations:       561                               RMSE:         344.73
Df Residuals:           559                                MAE:         276.97
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    840.3130     42.5078       0.001    756.5058    920.8568
       opcount      0.1072      0.0012       0.001      0.1050      0.1094
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_write] · nethermind

nobs 682 0.651 coef (ms) 0.06179 p-value 1.00e-03 95% CI [0.05831, 0.065]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.651
Model:                  NNLS                    Adj. R-squared:          0.650
No. Observations:       682                               RMSE:         566.54
Df Residuals:           680                                MAE:         467.02
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    828.7944     64.0221       0.001    710.2904    957.8192
       opcount      0.0618      0.0018       0.001      0.0583      0.0650
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

SSTORE · test_sstore_bloated · combo True` — `presets[cold_storage_sstore_write] · reth

nobs 1056 0.9933 coef (ms) 0.1472 p-value 1.00e-03 95% CI [0.1464, 0.148]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.993
Model:                  NNLS                    Adj. R-squared:          0.993
No. Observations:       1056                              RMSE:         151.17
Df Residuals:           1054                               MAE:         120.35
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1304.4393     14.9334       0.001   1273.8391   1332.7068
       opcount      0.1472      0.0004       0.001      0.1464      0.1480
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_EOA · besu

nobs 286 0.6401 coef (ms) 0.01768 p-value 1.00e-03 95% CI [0.01603, 0.01933]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.640
Model:                  NNLS                    Adj. R-squared:          0.639
No. Observations:       286                               RMSE:         316.75
Df Residuals:           284                                MAE:         236.17
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    383.7500     57.8061       0.001    269.8517    494.4449
       opcount      0.0177      0.0008       0.001      0.0160      0.0193
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_EOA · erigon

nobs 418 0.9955 coef (ms) 0.009916 p-value 1.00e-03 95% CI [0.009855, 0.009982]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.996
Model:                  NNLS                    Adj. R-squared:          0.996
No. Observations:       418                               RMSE:          15.91
Df Residuals:           416                                MAE:          12.56
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.8878      2.2641       0.001     27.2408     36.0670
       opcount      0.0099      0.0000       0.001      0.0099      0.0100
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_EOA · geth

nobs 561 0.6608 coef (ms) 0.0113 p-value 1.00e-03 95% CI [0.01063, 0.01197]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.661
Model:                  NNLS                    Adj. R-squared:          0.660
No. Observations:       561                               RMSE:         193.46
Df Residuals:           559                                MAE:         162.93
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    524.7151     26.3305       0.001    469.6947    575.4908
       opcount      0.0113      0.0003       0.001      0.0106      0.0120
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_EOA · nethermind

nobs 682 0.749 coef (ms) 0.004967 p-value 1.00e-03 95% CI [0.004731, 0.005183]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.749
Model:                  NNLS                    Adj. R-squared:          0.749
No. Observations:       682                               RMSE:          68.73
Df Residuals:           680                                MAE:          52.72
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     49.5620      7.6070       0.001     36.1407     64.8940
       opcount      0.0050      0.0001       0.001      0.0047      0.0052
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_EOA · reth

nobs 1056 0.9755 coef (ms) 0.001092 p-value 1.00e-03 95% CI [0.001082, 0.001104]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.976
Model:                  NNLS                    Adj. R-squared:          0.976
No. Observations:       1056                              RMSE:           4.13
Df Residuals:           1054                               MAE:           3.28
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.7664      0.4441       0.001     30.8985     32.5988
       opcount      0.0011      0.0000       0.001      0.0011      0.0011
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu

nobs 286 0.8583 coef (ms) 0.01085 p-value 1.00e-03 95% CI [0.01032, 0.01141]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.858
Model:                  NNLS                    Adj. R-squared:          0.858
No. Observations:       286                               RMSE:         105.40
Df Residuals:           284                                MAE:          86.82
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    374.8198     21.5301       0.001    330.7917    416.0005
       opcount      0.0109      0.0003       0.001      0.0103      0.0114
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon

nobs 418 0.9956 coef (ms) 0.009141 p-value 1.00e-03 95% CI [0.009083, 0.009197]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.996
Model:                  NNLS                    Adj. R-squared:          0.996
No. Observations:       418                               RMSE:          14.45
Df Residuals:           416                                MAE:          11.24
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      5.7861      2.1275       0.002      1.6130     10.0649
       opcount      0.0091      0.0000       0.001      0.0091      0.0092
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth

nobs 561 0.5552 coef (ms) 0.02944 p-value 1.00e-03 95% CI [0.02726, 0.03173]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.555
Model:                  NNLS                    Adj. R-squared:          0.554
No. Observations:       561                               RMSE:         629.67
Df Residuals:           559                                MAE:         511.06
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1520.2162     82.8407       0.001   1356.3773   1678.4405
       opcount      0.0294      0.0011       0.001      0.0273      0.0317
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind

nobs 682 0.757 coef (ms) 0.004563 p-value 1.00e-03 95% CI [0.004375, 0.004769]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.757
Model:                  NNLS                    Adj. R-squared:          0.757
No. Observations:       682                               RMSE:          61.79
Df Residuals:           680                                MAE:          47.91
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     58.1813      6.7663       0.001     44.9972     70.5402
       opcount      0.0046      0.0001       0.001      0.0044      0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth

nobs 1056 0.9715 coef (ms) 0.0009166 p-value 1.00e-03 95% CI [0.0009067, 0.0009257]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.972
Model:                  NNLS                    Adj. R-squared:          0.972
No. Observations:       1056                              RMSE:           3.75
Df Residuals:           1054                               MAE:           2.98
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.8838      0.3819       0.001     31.1985     32.6860
       opcount      0.0009      0.0000       0.001      0.0009      0.0009
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT · besu

nobs 286 0.8861 coef (ms) 0.0308 p-value 1.00e-03 95% CI [0.02937, 0.03211]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.886
Model:                  NNLS                    Adj. R-squared:          0.886
No. Observations:       286                               RMSE:         229.69
Df Residuals:           284                                MAE:         182.14
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    472.2463     44.5780       0.001    386.6881    558.3061
       opcount      0.0308      0.0007       0.001      0.0294      0.0321
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT · erigon

nobs 418 0.8955 coef (ms) 0.03619 p-value 1.00e-03 95% CI [0.03497, 0.03725]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.895
Model:                  NNLS                    Adj. R-squared:          0.895
No. Observations:       418                               RMSE:         257.24
Df Residuals:           416                                MAE:         216.38
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    441.3811     43.3037       0.001    363.5905    533.7210
       opcount      0.0362      0.0006       0.001      0.0350      0.0372
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT · geth

nobs 561 0.6498 coef (ms) 0.03565 p-value 1.00e-03 95% CI [0.03313, 0.03786]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.650
Model:                  NNLS                    Adj. R-squared:          0.649
No. Observations:       561                               RMSE:         544.54
Df Residuals:           559                                MAE:         452.89
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1245.6960     73.7741       0.001   1104.9690   1402.1920
       opcount      0.0357      0.0012       0.001      0.0331      0.0379
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT · nethermind

nobs 682 0.7871 coef (ms) 0.01997 p-value 1.00e-03 95% CI [0.01921, 0.02073]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.787
Model:                  NNLS                    Adj. R-squared:          0.787
No. Observations:       682                               RMSE:         216.08
Df Residuals:           680                                MAE:         151.08
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    219.2324     23.8131       0.001    170.9256    267.5567
       opcount      0.0200      0.0004       0.001      0.0192      0.0207
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.EXISTING_CONTRACT · reth

nobs 1056 0.779 coef (ms) 0.03047 p-value 1.00e-03 95% CI [0.02942, 0.03146]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.779
Model:                  NNLS                    Adj. R-squared:          0.779
No. Observations:       1056                              RMSE:         337.65
Df Residuals:           1054                               MAE:         233.01
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    660.7516     36.3522       0.001    592.0961    734.3853
       opcount      0.0305      0.0005       0.001      0.0294      0.0315
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · besu

nobs 286 0.8583 coef (ms) 0.01085 p-value 1.00e-03 95% CI [0.01032, 0.01141]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.858
Model:                  NNLS                    Adj. R-squared:          0.858
No. Observations:       286                               RMSE:         105.40
Df Residuals:           284                                MAE:          86.82
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    374.8198     21.5301       0.001    330.7917    416.0005
       opcount      0.0109      0.0003       0.001      0.0103      0.0114
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · erigon

nobs 418 0.9956 coef (ms) 0.009141 p-value 1.00e-03 95% CI [0.009083, 0.009197]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.996
Model:                  NNLS                    Adj. R-squared:          0.996
No. Observations:       418                               RMSE:          14.45
Df Residuals:           416                                MAE:          11.24
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      5.7861      2.1275       0.002      1.6130     10.0649
       opcount      0.0091      0.0000       0.001      0.0091      0.0092
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · geth

nobs 561 0.5552 coef (ms) 0.02944 p-value 1.00e-03 95% CI [0.02726, 0.03173]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.555
Model:                  NNLS                    Adj. R-squared:          0.554
No. Observations:       561                               RMSE:         629.67
Df Residuals:           559                                MAE:         511.06
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1520.2162     82.8407       0.001   1356.3773   1678.4405
       opcount      0.0294      0.0011       0.001      0.0273      0.0317
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · nethermind

nobs 682 0.757 coef (ms) 0.004563 p-value 1.00e-03 95% CI [0.004375, 0.004769]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.757
Model:                  NNLS                    Adj. R-squared:          0.757
No. Observations:       682                               RMSE:          61.79
Df Residuals:           680                                MAE:          47.91
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     58.1813      6.7663       0.001     44.9972     70.5402
       opcount      0.0046      0.0001       0.001      0.0044      0.0048
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_account_access · combo BALANCE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · reth

nobs 1056 0.9715 coef (ms) 0.0009166 p-value 1.00e-03 95% CI [0.0009067, 0.0009257]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.972
Model:                  NNLS                    Adj. R-squared:          0.972
No. Observations:       1056                              RMSE:           3.75
Df Residuals:           1054                               MAE:           2.98
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.8838      0.3819       0.001     31.1985     32.6860
       opcount      0.0009      0.0000       0.001      0.0009      0.0009
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_ext_account_query_warm · combo BALANCE · besu

nobs 286 0.6604 coef (ms) 0.0001535 p-value 1.00e-03 95% CI [0.0001408, 0.0001668]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.660
Model:                  NNLS                    Adj. R-squared:          0.659
No. Observations:       286                               RMSE:          64.38
Df Residuals:           284                                MAE:          51.28
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    156.7474     12.8296       0.001    132.0136    181.4434
       opcount      0.0002      0.0000       0.001      0.0001      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_ext_account_query_warm · combo BALANCE · erigon

nobs 418 0.8416 coef (ms) 5.083e-05 p-value 1.00e-03 95% CI [4.847e-05, 5.299e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.842
Model:                  NNLS                    Adj. R-squared:          0.841
No. Observations:       418                               RMSE:          12.90
Df Residuals:           416                                MAE:          10.58
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     36.1995      2.1415       0.001     32.1893     40.6515
       opcount      0.0001      0.0000       0.001      0.0000      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_ext_account_query_warm · combo BALANCE · geth

nobs 561 0.9688 coef (ms) 0.0001389 p-value 1.00e-03 95% CI [0.0001368, 0.0001411]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.969
Model:                  NNLS                    Adj. R-squared:          0.969
No. Observations:       561                               RMSE:          14.57
Df Residuals:           559                                MAE:          11.14
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     14.9237      1.9662       0.001     11.2046     18.6436
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_ext_account_query_warm · combo BALANCE · nethermind

nobs 682 0.6898 coef (ms) 0.0001501 p-value 1.00e-03 95% CI [0.0001426, 0.0001577]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.690
Model:                  NNLS                    Adj. R-squared:          0.689
No. Observations:       682                               RMSE:          58.88
Df Residuals:           680                                MAE:          46.12
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     63.5429      6.7411       0.001     50.4586     76.9632
       opcount      0.0002      0.0000       0.001      0.0001      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

BALANCE · test_ext_account_query_warm · combo BALANCE · reth

nobs 1056 0.6683 coef (ms) 6.971e-06 p-value 1.00e-03 95% CI [6.679e-06, 7.288e-06]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.668
Model:                  NNLS                    Adj. R-squared:          0.668
No. Observations:       1056                              RMSE:           2.87
Df Residuals:           1054                               MAE:           2.00
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      5.9893      0.2782       0.001      5.4233      6.4899
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · besu

nobs 286 0.6802 coef (ms) 0.01916 p-value 1.00e-03 95% CI [0.01741, 0.02074]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.680
Model:                  NNLS                    Adj. R-squared:          0.679
No. Observations:       286                               RMSE:         311.95
Df Residuals:           284                                MAE:         229.48
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    592.4399     55.9411       0.001    486.5170    707.1070
       opcount      0.0192      0.0008       0.001      0.0174      0.0207
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · erigon

nobs 418 0.9946 coef (ms) 0.01111 p-value 1.00e-03 95% CI [0.01103, 0.01118]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.995
Model:                  NNLS                    Adj. R-squared:          0.995
No. Observations:       418                               RMSE:          19.42
Df Residuals:           416                                MAE:          15.22
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     48.2171      2.6551       0.001     43.0739     53.5371
       opcount      0.0111      0.0000       0.001      0.0110      0.0112
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · geth

nobs 561 0.709 coef (ms) 0.01227 p-value 1.00e-03 95% CI [0.01173, 0.01287]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.709
Model:                  NNLS                    Adj. R-squared:          0.708
No. Observations:       561                               RMSE:         186.69
Df Residuals:           559                                MAE:         157.93
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    484.9146     22.6195       0.001    439.9186    527.5940
       opcount      0.0123      0.0003       0.001      0.0117      0.0129
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · nethermind

nobs 682 0.792 coef (ms) 0.006083 p-value 1.00e-03 95% CI [0.005842, 0.006323]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.792
Model:                  NNLS                    Adj. R-squared:          0.792
No. Observations:       682                               RMSE:          74.01
Df Residuals:           680                                MAE:          55.97
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     61.7436      8.2508       0.001     45.9254     77.9148
       opcount      0.0061      0.0001       0.001      0.0058      0.0063
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · reth

nobs 1056 0.9764 coef (ms) 0.001129 p-value 1.00e-03 95% CI [0.001118, 0.00114]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.976
Model:                  NNLS                    Adj. R-squared:          0.976
No. Observations:       1056                              RMSE:           4.17
Df Residuals:           1054                               MAE:           3.30
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     32.9170      0.4593       0.001     32.0507     33.8378
       opcount      0.0011      0.0000       0.001      0.0011      0.0011
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu

nobs 286 0.8097 coef (ms) 0.01287 p-value 1.00e-03 95% CI [0.01221, 0.01364]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.810
Model:                  NNLS                    Adj. R-squared:          0.809
No. Observations:       286                               RMSE:         148.18
Df Residuals:           284                                MAE:         114.38
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    548.6595     27.3938       0.001    494.0643    597.6323
       opcount      0.0129      0.0004       0.001      0.0122      0.0136
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon

nobs 418 0.9955 coef (ms) 0.0101 p-value 1.00e-03 95% CI [0.01003, 0.01017]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.995
Model:                  NNLS                    Adj. R-squared:          0.995
No. Observations:       418                               RMSE:          16.21
Df Residuals:           416                                MAE:          13.01
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     17.3716      2.6429       0.001     12.0888     22.3634
       opcount      0.0101      0.0000       0.001      0.0100      0.0102
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth

nobs 561 0.6008 coef (ms) 0.03145 p-value 1.00e-03 95% CI [0.02926, 0.03372]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.601
Model:                  NNLS                    Adj. R-squared:          0.600
No. Observations:       561                               RMSE:         608.74
Df Residuals:           559                                MAE:         511.98
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1431.2723     80.0009       0.001   1270.7042   1581.0087
       opcount      0.0314      0.0011       0.001      0.0293      0.0337
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind

nobs 682 0.7865 coef (ms) 0.005689 p-value 1.00e-03 95% CI [0.005453, 0.005928]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.786
Model:                  NNLS                    Adj. R-squared:          0.786
No. Observations:       682                               RMSE:          70.39
Df Residuals:           680                                MAE:          53.31
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     64.1494      7.9079       0.001     48.1737     80.6596
       opcount      0.0057      0.0001       0.001      0.0055      0.0059
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth

nobs 1056 0.9734 coef (ms) 0.0009718 p-value 1.00e-03 95% CI [0.000962, 0.0009815]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.973
Model:                  NNLS                    Adj. R-squared:          0.973
No. Observations:       1056                              RMSE:           3.82
Df Residuals:           1054                               MAE:           2.97
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     32.1696      0.3803       0.001     31.4257     32.8714
       opcount      0.0010      0.0000       0.001      0.0010      0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_access] · besu

nobs 286 0.8994 coef (ms) 0.03406 p-value 1.00e-03 95% CI [0.03275, 0.03538]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.899
Model:                  NNLS                    Adj. R-squared:          0.899
No. Observations:       286                               RMSE:         231.79
Df Residuals:           284                                MAE:         184.96
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    430.2638     42.4477       0.001    340.5535    512.6989
       opcount      0.0341      0.0007       0.001      0.0328      0.0354
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_access] · erigon

nobs 418 0.8698 coef (ms) 0.08783 p-value 1.00e-03 95% CI [0.0849, 0.09107]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.870
Model:                  NNLS                    Adj. R-squared:          0.870
No. Observations:       418                               RMSE:         691.41
Df Residuals:           416                                MAE:         581.95
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1496.8070    122.1047       0.001   1250.7375   1714.0941
       opcount      0.0878      0.0016       0.001      0.0849      0.0911
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_access] · geth

nobs 561 0.7264 coef (ms) 0.04421 p-value 1.00e-03 95% CI [0.04193, 0.04666]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.726
Model:                  NNLS                    Adj. R-squared:          0.726
No. Observations:       561                               RMSE:         552.07
Df Residuals:           559                                MAE:         474.25
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    957.3048     67.4948       0.001    822.3422   1086.9756
       opcount      0.0442      0.0012       0.001      0.0419      0.0467
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_access] · nethermind

nobs 682 0.7826 coef (ms) 0.02103 p-value 1.00e-03 95% CI [0.02018, 0.02183]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.783
Model:                  NNLS                    Adj. R-squared:          0.782
No. Observations:       682                               RMSE:         225.52
Df Residuals:           680                                MAE:         157.13
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    239.6138     25.9368       0.001    190.1320    290.7668
       opcount      0.0210      0.0004       0.001      0.0202      0.0218
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_access] · reth

nobs 1056 0.8893 coef (ms) 0.03498 p-value 1.00e-03 95% CI [0.03411, 0.03586]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.889
Model:                  NNLS                    Adj. R-squared:          0.889
No. Observations:       1056                              RMSE:         251.16
Df Residuals:           1054                               MAE:         158.52
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    233.9473     28.5602       0.001    178.5410    290.9334
       opcount      0.0350      0.0004       0.001      0.0341      0.0359
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · besu

nobs 286 0.8097 coef (ms) 0.01287 p-value 1.00e-03 95% CI [0.01221, 0.01364]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.810
Model:                  NNLS                    Adj. R-squared:          0.809
No. Observations:       286                               RMSE:         148.18
Df Residuals:           284                                MAE:         114.38
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    548.6595     27.3938       0.001    494.0643    597.6323
       opcount      0.0129      0.0004       0.001      0.0122      0.0136
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · erigon

nobs 418 0.9955 coef (ms) 0.0101 p-value 1.00e-03 95% CI [0.01003, 0.01017]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.995
Model:                  NNLS                    Adj. R-squared:          0.995
No. Observations:       418                               RMSE:          16.21
Df Residuals:           416                                MAE:          13.01
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     17.3716      2.6429       0.001     12.0888     22.3634
       opcount      0.0101      0.0000       0.001      0.0100      0.0102
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · geth

nobs 561 0.6008 coef (ms) 0.03145 p-value 1.00e-03 95% CI [0.02926, 0.03372]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.601
Model:                  NNLS                    Adj. R-squared:          0.600
No. Observations:       561                               RMSE:         608.74
Df Residuals:           559                                MAE:         511.98
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1431.2723     80.0009       0.001   1270.7042   1581.0087
       opcount      0.0314      0.0011       0.001      0.0293      0.0337
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · nethermind

nobs 682 0.7865 coef (ms) 0.005689 p-value 1.00e-03 95% CI [0.005453, 0.005928]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.786
Model:                  NNLS                    Adj. R-squared:          0.786
No. Observations:       682                               RMSE:          70.39
Df Residuals:           680                                MAE:          53.31
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     64.1494      7.9079       0.001     48.1737     80.6596
       opcount      0.0057      0.0001       0.001      0.0055      0.0059
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · reth

nobs 1056 0.9734 coef (ms) 0.0009718 p-value 1.00e-03 95% CI [0.000962, 0.0009815]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.973
Model:                  NNLS                    Adj. R-squared:          0.973
No. Observations:       1056                              RMSE:           3.82
Df Residuals:           1054                               MAE:           2.97
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     32.1696      0.3803       0.001     31.4257     32.8714
       opcount      0.0010      0.0000       0.001      0.0010      0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · besu

nobs 286 0.9392 coef (ms) 0.07655 p-value 1.00e-03 95% CI [0.07399, 0.07896]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.939
Model:                  NNLS                    Adj. R-squared:          0.939
No. Observations:       286                               RMSE:         131.04
Df Residuals:           284                                MAE:         107.33
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    378.2036     26.1516       0.001    326.2478    432.1351
       opcount      0.0766      0.0013       0.001      0.0740      0.0790
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · erigon

nobs 418 0.9586 coef (ms) 0.2295 p-value 1.00e-03 95% CI [0.2247, 0.234]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.959
Model:                  NNLS                    Adj. R-squared:          0.959
No. Observations:       418                               RMSE:         320.78
Df Residuals:           416                                MAE:         264.28
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   2385.0326     56.0863       0.001   2276.1746   2494.3695
       opcount      0.2295      0.0024       0.001      0.2247      0.2340
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · geth

nobs 561 0.8828 coef (ms) 0.05414 p-value 1.00e-03 95% CI [0.05256, 0.05589]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.883
Model:                  NNLS                    Adj. R-squared:          0.883
No. Observations:       561                               RMSE:         132.75
Df Residuals:           559                                MAE:         105.74
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    357.4102     16.7863       0.001    324.7606    389.8495
       opcount      0.0541      0.0008       0.001      0.0526      0.0559
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · nethermind

nobs 682 0.6993 coef (ms) 0.03372 p-value 1.00e-03 95% CI [0.03195, 0.03555]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.699
Model:                  NNLS                    Adj. R-squared:          0.699
No. Observations:       682                               RMSE:         148.80
Df Residuals:           680                                MAE:         120.07
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    220.6585     17.4050       0.001    187.0171    255.3537
       opcount      0.0337      0.0009       0.001      0.0319      0.0356
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · reth

nobs 1056 0.9498 coef (ms) 0.147 p-value 1.00e-03 95% CI [0.1444, 0.1496]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.950
Model:                  NNLS                    Adj. R-squared:          0.950
No. Observations:       1056                              RMSE:         227.50
Df Residuals:           1054                               MAE:         177.49
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    568.6733     31.4799       0.001    507.3220    629.2646
       opcount      0.1470      0.0013       0.001      0.1444      0.1496
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · besu

nobs 286 0.1723 coef (ms) 0.09663 p-value 1.00e-03 95% CI [0.06647, 0.1311]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.172
Model:                  NNLS                    Adj. R-squared:          0.169
No. Observations:       286                               RMSE:          69.72
Df Residuals:           284                                MAE:          46.86
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    357.7734     16.0427       0.001    324.5397    387.6560
       opcount      0.0966      0.0164       0.001      0.0665      0.1311
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · erigon

nobs 418 0.6928 coef (ms) 1.572 p-value 1.00e-03 95% CI [1.473, 1.672]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.693
Model:                  NNLS                    Adj. R-squared:          0.692
No. Observations:       418                               RMSE:         344.64
Df Residuals:           416                                MAE:         316.65
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    692.6879     50.5811       0.001    588.6307    788.8476
       opcount      1.5719      0.0510       0.001      1.4727      1.6723
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · geth

nobs 561 0.3177 coef (ms) 0.1223 p-value 1.00e-03 95% CI [0.108, 0.1357]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.318
Model:                  NNLS                    Adj. R-squared:          0.316
No. Observations:       561                               RMSE:          58.99
Df Residuals:           559                                MAE:          48.61
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     78.0666      6.8698       0.001     64.5748     92.0770
       opcount      0.1223      0.0070       0.001      0.1080      0.1357
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · nethermind

nobs 682 0.6421 coef (ms) 0.04204 p-value 1.00e-03 95% CI [0.03959, 0.04458]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.642
Model:                  NNLS                    Adj. R-squared:          0.642
No. Observations:       682                               RMSE:          10.33
Df Residuals:           680                                MAE:           8.31
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     17.6712      1.2160       0.001     15.2669     19.9954
       opcount      0.0420      0.0012       0.001      0.0396      0.0446
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · reth

nobs 1056 0.006104 coef (ms) 0.006498 p-value 1.80e-02 95% CI [0.0005219, 0.01256]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.006
Model:                  NNLS                    Adj. R-squared:          0.005
No. Observations:       1056                              RMSE:          27.30
Df Residuals:           1054                               MAE:          21.72
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     96.3752      3.7656       0.001     88.8040    103.9135
       opcount      0.0065      0.0031       0.018      0.0005      0.0126
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_write] · besu

nobs 286 0.9185 coef (ms) 0.1003 p-value 1.00e-03 95% CI [0.09713, 0.1041]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.919
Model:                  NNLS                    Adj. R-squared:          0.918
No. Observations:       286                               RMSE:         191.96
Df Residuals:           284                                MAE:         155.66
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    972.9233     37.2159       0.001    894.6796   1042.8311
       opcount      0.1003      0.0018       0.001      0.0971      0.1041
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_write] · erigon

nobs 418 0.9318 coef (ms) 1.132 p-value 1.00e-03 95% CI [1.099, 1.164]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.932
Model:                  NNLS                    Adj. R-squared:          0.932
No. Observations:       418                               RMSE:        1966.83
Df Residuals:           416                                MAE:        1660.69
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const  13304.4260    301.9879       0.001  12707.2743  13917.7894
       opcount      1.1321      0.0161       0.001      1.0995      1.1637
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_write] · geth

nobs 561 0.9308 coef (ms) 0.09718 p-value 1.00e-03 95% CI [0.0953, 0.09916]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.931
Model:                  NNLS                    Adj. R-squared:          0.931
No. Observations:       561                               RMSE:         170.21
Df Residuals:           559                                MAE:         130.53
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    694.8484     20.3444       0.001    654.5472    734.0159
       opcount      0.0972      0.0010       0.001      0.0953      0.0992
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_write] · nethermind

nobs 682 0.7593 coef (ms) 0.0602 p-value 1.00e-03 95% CI [0.05759, 0.06285]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.759
Model:                  NNLS                    Adj. R-squared:          0.759
No. Observations:       682                               RMSE:         217.67
Df Residuals:           680                                MAE:         173.60
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    229.8624     24.8776       0.001    181.6751    277.4561
       opcount      0.0602      0.0014       0.001      0.0576      0.0629
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_write] · reth

nobs 1056 0.9709 coef (ms) 0.1513 p-value 1.00e-03 95% CI [0.1496, 0.1533]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.971
Model:                  NNLS                    Adj. R-squared:          0.971
No. Observations:       1056                              RMSE:         168.22
Df Residuals:           1054                               MAE:         132.25
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1010.0316     21.9682       0.001    965.2064   1051.1776
       opcount      0.1513      0.0009       0.001      0.1496      0.1533
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_write] · besu

nobs 286 0.1723 coef (ms) 0.09663 p-value 1.00e-03 95% CI [0.06647, 0.1311]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.172
Model:                  NNLS                    Adj. R-squared:          0.169
No. Observations:       286                               RMSE:          69.72
Df Residuals:           284                                MAE:          46.86
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    357.7734     16.0427       0.001    324.5397    387.6560
       opcount      0.0966      0.0164       0.001      0.0665      0.1311
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_write] · erigon

nobs 418 0.6928 coef (ms) 1.572 p-value 1.00e-03 95% CI [1.473, 1.672]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.693
Model:                  NNLS                    Adj. R-squared:          0.692
No. Observations:       418                               RMSE:         344.64
Df Residuals:           416                                MAE:         316.65
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    692.6879     50.5811       0.001    588.6307    788.8476
       opcount      1.5719      0.0510       0.001      1.4727      1.6723
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_write] · geth

nobs 561 0.3177 coef (ms) 0.1223 p-value 1.00e-03 95% CI [0.108, 0.1357]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.318
Model:                  NNLS                    Adj. R-squared:          0.316
No. Observations:       561                               RMSE:          58.99
Df Residuals:           559                                MAE:          48.61
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     78.0666      6.8698       0.001     64.5748     92.0770
       opcount      0.1223      0.0070       0.001      0.1080      0.1357
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_write] · nethermind

nobs 682 0.6421 coef (ms) 0.04204 p-value 1.00e-03 95% CI [0.03959, 0.04458]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.642
Model:                  NNLS                    Adj. R-squared:          0.642
No. Observations:       682                               RMSE:          10.33
Df Residuals:           680                                MAE:           8.31
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     17.6712      1.2160       0.001     15.2669     19.9954
       opcount      0.0420      0.0012       0.001      0.0396      0.0446
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_account_access · combo CALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_write] · reth

nobs 1056 0.006104 coef (ms) 0.006498 p-value 1.80e-02 95% CI [0.0005219, 0.01256]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.006
Model:                  NNLS                    Adj. R-squared:          0.005
No. Observations:       1056                              RMSE:          27.30
Df Residuals:           1054                               MAE:          21.72
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     96.3752      3.7656       0.001     88.8040    103.9135
       opcount      0.0065      0.0031       0.018      0.0005      0.0126
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_ext_account_query_warm · combo CALL · besu

nobs 286 0.9562 coef (ms) 0.001346 p-value 1.00e-03 95% CI [0.001312, 0.001379]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.956
Model:                  NNLS                    Adj. R-squared:          0.956
No. Observations:       286                               RMSE:         145.49
Df Residuals:           284                                MAE:         118.72
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    772.0548     30.8896       0.001    714.8577    832.1726
       opcount      0.0013      0.0000       0.001      0.0013      0.0014
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_ext_account_query_warm · combo CALL · erigon

nobs 418 0.8299 coef (ms) 0.000519 p-value 1.00e-03 95% CI [0.0004964, 0.0005472]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.830
Model:                  NNLS                    Adj. R-squared:          0.830
No. Observations:       418                               RMSE:         118.71
Df Residuals:           416                                MAE:          72.46
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     56.4571     17.4449       0.001     18.9382     88.2260
       opcount      0.0005      0.0000       0.001      0.0005      0.0005
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_ext_account_query_warm · combo CALL · geth

nobs 561 0.9855 coef (ms) 0.0005862 p-value 1.00e-03 95% CI [0.0005808, 0.000592]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.986
Model:                  NNLS                    Adj. R-squared:          0.986
No. Observations:       561                               RMSE:          35.88
Df Residuals:           559                                MAE:          28.04
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     23.0194      4.0549       0.001     14.7253     30.8098
       opcount      0.0006      0.0000       0.001      0.0006      0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_ext_account_query_warm · combo CALL · nethermind

nobs 682 0.5208 coef (ms) 0.0005168 p-value 1.00e-03 95% CI [0.0004764, 0.000558]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.521
Model:                  NNLS                    Adj. R-squared:          0.520
No. Observations:       682                               RMSE:         250.46
Df Residuals:           680                                MAE:         194.20
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    384.7920     28.7705       0.001    329.9117    440.1884
       opcount      0.0005      0.0000       0.001      0.0005      0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALL · test_ext_account_query_warm · combo CALL · reth

nobs 1056 0.8934 coef (ms) 4.964e-05 p-value 1.00e-03 95% CI [4.856e-05, 5.067e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.893
Model:                  NNLS                    Adj. R-squared:          0.893
No. Observations:       1056                              RMSE:           8.67
Df Residuals:           1054                               MAE:           7.13
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     18.4522      0.8806       0.001     16.7231     20.1665
       opcount      0.0000      0.0000       0.001      0.0000      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · besu

nobs 286 0.666 coef (ms) 0.01855 p-value 1.00e-03 95% CI [0.01698, 0.02013]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.666
Model:                  NNLS                    Adj. R-squared:          0.665
No. Observations:       286                               RMSE:         311.97
Df Residuals:           284                                MAE:         230.95
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    588.6560     55.6195       0.001    477.4344    695.7759
       opcount      0.0186      0.0008       0.001      0.0170      0.0201
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · erigon

nobs 418 0.9957 coef (ms) 0.01027 p-value 1.00e-03 95% CI [0.0102, 0.01034]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.996
Model:                  NNLS                    Adj. R-squared:          0.996
No. Observations:       418                               RMSE:          15.99
Df Residuals:           416                                MAE:          12.36
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.0286      2.4943       0.001     26.1793     35.8379
       opcount      0.0103      0.0000       0.001      0.0102      0.0103
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · geth

nobs 561 0.7109 coef (ms) 0.01231 p-value 1.00e-03 95% CI [0.0117, 0.01297]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.711
Model:                  NNLS                    Adj. R-squared:          0.710
No. Observations:       561                               RMSE:         186.38
Df Residuals:           559                                MAE:         158.92
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    503.5820     25.0355       0.001    455.8899    549.8554
       opcount      0.0123      0.0003       0.001      0.0117      0.0130
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · nethermind

nobs 682 0.7745 coef (ms) 0.006004 p-value 1.00e-03 95% CI [0.005787, 0.006235]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.775
Model:                  NNLS                    Adj. R-squared:          0.774
No. Observations:       682                               RMSE:          76.92
Df Residuals:           680                                MAE:          59.29
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     65.6185      7.6193       0.001     50.8728     80.1750
       opcount      0.0060      0.0001       0.001      0.0058      0.0062
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_access] · reth

nobs 1056 0.9771 coef (ms) 0.001136 p-value 1.00e-03 95% CI [0.001126, 0.001147]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.977
Model:                  NNLS                    Adj. R-squared:          0.977
No. Observations:       1056                              RMSE:           4.13
Df Residuals:           1054                               MAE:           3.32
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.3971      0.4424       0.001     30.5429     32.2990
       opcount      0.0011      0.0000       0.001      0.0011      0.0011
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu

nobs 286 0.8056 coef (ms) 0.01156 p-value 1.00e-03 95% CI [0.01088, 0.01228]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.806
Model:                  NNLS                    Adj. R-squared:          0.805
No. Observations:       286                               RMSE:         134.78
Df Residuals:           284                                MAE:         108.93
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    557.6139     25.4759       0.001    504.1844    605.4980
       opcount      0.0116      0.0003       0.001      0.0109      0.0123
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon

nobs 418 0.9949 coef (ms) 0.009547 p-value 1.00e-03 95% CI [0.009484, 0.009615]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.995
Model:                  NNLS                    Adj. R-squared:          0.995
No. Observations:       418                               RMSE:          16.31
Df Residuals:           416                                MAE:          13.17
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     20.5969      2.5373       0.001     15.5777     25.2167
       opcount      0.0095      0.0000       0.001      0.0095      0.0096
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth

nobs 561 0.6337 coef (ms) 0.03185 p-value 1.00e-03 95% CI [0.02988, 0.03384]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.634
Model:                  NNLS                    Adj. R-squared:          0.633
No. Observations:       561                               RMSE:         575.05
Df Residuals:           559                                MAE:         477.91
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1457.1070     77.2397       0.001   1312.1952   1594.6631
       opcount      0.0319      0.0011       0.001      0.0299      0.0338
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind

nobs 682 0.7908 coef (ms) 0.005574 p-value 1.00e-03 95% CI [0.005331, 0.00581]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.791
Model:                  NNLS                    Adj. R-squared:          0.790
No. Observations:       682                               RMSE:          68.08
Df Residuals:           680                                MAE:          52.39
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     65.6611      8.0999       0.001     50.2360     80.8814
       opcount      0.0056      0.0001       0.001      0.0053      0.0058
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth

nobs 1056 0.9724 coef (ms) 0.00096 p-value 1.00e-03 95% CI [0.0009497, 0.0009701]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.972
Model:                  NNLS                    Adj. R-squared:          0.972
No. Observations:       1056                              RMSE:           3.84
Df Residuals:           1054                               MAE:           3.04
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.6698      0.3886       0.001     30.9118     32.4232
       opcount      0.0010      0.0000       0.001      0.0009      0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_access] · besu

nobs 286 0.8775 coef (ms) 0.03233 p-value 1.00e-03 95% CI [0.031, 0.0336]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.878
Model:                  NNLS                    Adj. R-squared:          0.877
No. Observations:       286                               RMSE:         245.80
Df Residuals:           284                                MAE:         188.15
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    523.6484     40.9097       0.001    447.2727    603.6409
       opcount      0.0323      0.0007       0.001      0.0310      0.0336
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_access] · erigon

nobs 418 0.8695 coef (ms) 0.08768 p-value 1.00e-03 95% CI [0.0844, 0.09082]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.869
Model:                  NNLS                    Adj. R-squared:          0.869
No. Observations:       418                               RMSE:         691.33
Df Residuals:           416                                MAE:         586.79
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1464.7441    120.2114       0.001   1237.4844   1699.9906
       opcount      0.0877      0.0016       0.001      0.0844      0.0908
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_access] · geth

nobs 561 0.6062 coef (ms) 0.03454 p-value 1.00e-03 95% CI [0.03228, 0.03665]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.606
Model:                  NNLS                    Adj. R-squared:          0.605
No. Observations:       561                               RMSE:         566.55
Df Residuals:           559                                MAE:         474.47
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1379.1644     73.8592       0.001   1238.5615   1523.2899
       opcount      0.0345      0.0012       0.001      0.0323      0.0366
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_access] · nethermind

nobs 682 0.7751 coef (ms) 0.02057 p-value 1.00e-03 95% CI [0.01975, 0.02143]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.775
Model:                  NNLS                    Adj. R-squared:          0.775
No. Observations:       682                               RMSE:         225.51
Df Residuals:           680                                MAE:         159.91
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    270.6765     26.0895       0.001    221.9262    321.3027
       opcount      0.0206      0.0004       0.001      0.0198      0.0214
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_access] · reth

nobs 1056 0.7733 coef (ms) 0.03016 p-value 1.00e-03 95% CI [0.02911, 0.03125]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.773
Model:                  NNLS                    Adj. R-squared:          0.773
No. Observations:       1056                              RMSE:         332.30
Df Residuals:           1054                               MAE:         202.10
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    629.4951     38.1602       0.001    555.5500    696.4957
       opcount      0.0302      0.0006       0.001      0.0291      0.0313
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · besu

nobs 286 0.8056 coef (ms) 0.01156 p-value 1.00e-03 95% CI [0.01088, 0.01228]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.806
Model:                  NNLS                    Adj. R-squared:          0.805
No. Observations:       286                               RMSE:         134.78
Df Residuals:           284                                MAE:         108.93
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    557.6139     25.4759       0.001    504.1844    605.4980
       opcount      0.0116      0.0003       0.001      0.0109      0.0123
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · erigon

nobs 418 0.9949 coef (ms) 0.009547 p-value 1.00e-03 95% CI [0.009484, 0.009615]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.995
Model:                  NNLS                    Adj. R-squared:          0.995
No. Observations:       418                               RMSE:          16.31
Df Residuals:           416                                MAE:          13.17
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     20.5969      2.5373       0.001     15.5777     25.2167
       opcount      0.0095      0.0000       0.001      0.0095      0.0096
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · geth

nobs 561 0.6337 coef (ms) 0.03185 p-value 1.00e-03 95% CI [0.02988, 0.03384]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.634
Model:                  NNLS                    Adj. R-squared:          0.633
No. Observations:       561                               RMSE:         575.05
Df Residuals:           559                                MAE:         477.91
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1457.1070     77.2397       0.001   1312.1952   1594.6631
       opcount      0.0319      0.0011       0.001      0.0299      0.0338
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · nethermind

nobs 682 0.7908 coef (ms) 0.005574 p-value 1.00e-03 95% CI [0.005331, 0.00581]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.791
Model:                  NNLS                    Adj. R-squared:          0.790
No. Observations:       682                               RMSE:          68.08
Df Residuals:           680                                MAE:          52.39
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     65.6611      8.0999       0.001     50.2360     80.8814
       opcount      0.0056      0.0001       0.001      0.0053      0.0058
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · reth

nobs 1056 0.9724 coef (ms) 0.00096 p-value 1.00e-03 95% CI [0.0009497, 0.0009701]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.972
Model:                  NNLS                    Adj. R-squared:          0.972
No. Observations:       1056                              RMSE:           3.84
Df Residuals:           1054                               MAE:           3.04
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.6698      0.3886       0.001     30.9118     32.4232
       opcount      0.0010      0.0000       0.001      0.0009      0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · besu

nobs 286 0.7424 coef (ms) 0.02008 p-value 1.00e-03 95% CI [0.01857, 0.02153]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.742
Model:                  NNLS                    Adj. R-squared:          0.741
No. Observations:       286                               RMSE:          79.60
Df Residuals:           284                                MAE:          59.42
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    257.2833     14.8693       0.001    229.0348    286.2618
       opcount      0.0201      0.0008       0.001      0.0186      0.0215
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · erigon

nobs 418 0.9736 coef (ms) 0.008062 p-value 1.00e-03 95% CI [0.007922, 0.008195]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.974
Model:                  NNLS                    Adj. R-squared:          0.974
No. Observations:       418                               RMSE:           8.93
Df Residuals:           416                                MAE:           7.25
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     40.8352      1.4529       0.001     38.1157     43.8229
       opcount      0.0081      0.0001       0.001      0.0079      0.0082
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · geth

nobs 561 0.2407 coef (ms) 0.0125 p-value 1.00e-03 95% CI [0.01073, 0.0142]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.241
Model:                  NNLS                    Adj. R-squared:          0.239
No. Observations:       561                               RMSE:         149.42
Df Residuals:           559                                MAE:         127.09
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    246.7054     18.2617       0.001    209.6629    283.5705
       opcount      0.0125      0.0009       0.001      0.0107      0.0142
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · nethermind

nobs 682 0.7726 coef (ms) 0.005862 p-value 1.00e-03 95% CI [0.00562, 0.006109]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.773
Model:                  NNLS                    Adj. R-squared:          0.772
No. Observations:       682                               RMSE:          21.40
Df Residuals:           680                                MAE:          16.84
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     49.4546      2.3313       0.001     44.8299     54.0231
       opcount      0.0059      0.0001       0.001      0.0056      0.0061
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_EOA` — `presets[cold_account_nocode_write] · reth

nobs 1056 0.9381 coef (ms) 0.001209 p-value 1.00e-03 95% CI [0.001191, 0.001228]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.938
Model:                  NNLS                    Adj. R-squared:          0.938
No. Observations:       1056                              RMSE:           2.09
Df Residuals:           1054                               MAE:           1.64
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      9.7911      0.1987       0.001      9.3952     10.1611
       opcount      0.0012      0.0000       0.001      0.0012      0.0012
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · besu

nobs 286 0.3371 coef (ms) 0.003834 p-value 1.00e-03 95% CI [0.003185, 0.004536]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.337
Model:                  NNLS                    Adj. R-squared:          0.335
No. Observations:       286                               RMSE:          36.19
Df Residuals:           284                                MAE:          28.31
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    293.7402      7.6090       0.001    278.4041    308.2687
       opcount      0.0038      0.0003       0.001      0.0032      0.0045
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · erigon

nobs 418 0.7672 coef (ms) 0.001801 p-value 1.00e-03 95% CI [0.001705, 0.001898]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.767
Model:                  NNLS                    Adj. R-squared:          0.767
No. Observations:       418                               RMSE:           6.68
Df Residuals:           416                                MAE:           5.83
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     54.6915      1.0664       0.001     52.6219     56.7328
       opcount      0.0018      0.0000       0.001      0.0017      0.0019
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · geth

nobs 561 0.03448 coef (ms) 0.01055 p-value 1.00e-03 95% CI [0.00605, 0.01521]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.034
Model:                  NNLS                    Adj. R-squared:          0.033
No. Observations:       561                               RMSE:         375.77
Df Residuals:           559                                MAE:         343.77
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    446.4394     49.1509       0.001    349.7171    538.5711
       opcount      0.0105      0.0024       0.001      0.0060      0.0152
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · nethermind

nobs 682 0.5913 coef (ms) 0.002494 p-value 1.00e-03 95% CI [0.002351, 0.002646]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.591
Model:                  NNLS                    Adj. R-squared:          0.591
No. Observations:       682                               RMSE:          13.96
Df Residuals:           680                                MAE:          11.22
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     41.4553      1.5548       0.001     38.3291     44.3312
       opcount      0.0025      0.0001       0.001      0.0024      0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_write] · reth

nobs 1056 0.775 coef (ms) 0.0002405 p-value 1.00e-03 95% CI [0.0002322, 0.0002488]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.775
Model:                  NNLS                    Adj. R-squared:          0.775
No. Observations:       1056                              RMSE:           0.87
Df Residuals:           1054                               MAE:           0.63
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      6.2429      0.0850       0.001      6.0773      6.4186
       opcount      0.0002      0.0000       0.001      0.0002      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_write] · besu

nobs 286 0.6815 coef (ms) 0.02874 p-value 1.00e-03 95% CI [0.02628, 0.03117]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.682
Model:                  NNLS                    Adj. R-squared:          0.680
No. Observations:       286                               RMSE:         126.17
Df Residuals:           284                                MAE:          93.86
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    236.6282     22.3366       0.001    194.0869    279.8499
       opcount      0.0287      0.0013       0.001      0.0263      0.0312
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_write] · erigon

nobs 418 0.9054 coef (ms) 0.08299 p-value 1.00e-03 95% CI [0.08077, 0.0852]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.905
Model:                  NNLS                    Adj. R-squared:          0.905
No. Observations:       418                               RMSE:         172.32
Df Residuals:           416                                MAE:         142.52
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    563.1981     27.2197       0.001    511.3528    615.1659
       opcount      0.0830      0.0012       0.001      0.0808      0.0852
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_write] · geth

nobs 561 0.676 coef (ms) 0.04983 p-value 1.00e-03 95% CI [0.04711, 0.05256]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.676
Model:                  NNLS                    Adj. R-squared:          0.675
No. Observations:       561                               RMSE:         221.57
Df Residuals:           559                                MAE:         190.61
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    323.9260     24.9493       0.001    275.7548    374.6745
       opcount      0.0498      0.0014       0.001      0.0471      0.0526
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_write] · nethermind

nobs 682 0.7359 coef (ms) 0.02093 p-value 1.00e-03 95% CI [0.01998, 0.02184]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.736
Model:                  NNLS                    Adj. R-squared:          0.736
No. Observations:       682                               RMSE:          80.53
Df Residuals:           680                                MAE:          56.92
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     98.2195      8.9936       0.001     81.7781    117.2547
       opcount      0.0209      0.0005       0.001      0.0200      0.0218
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.EXISTING_CONTRACT` — `presets[cold_account_code_write] · reth

nobs 1056 0.4034 coef (ms) 0.01322 p-value 1.00e-03 95% CI [0.01183, 0.01466]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.403
Model:                  NNLS                    Adj. R-squared:          0.403
No. Observations:       1056                              RMSE:         103.24
Df Residuals:           1054                               MAE:          79.14
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    174.1509     15.9522       0.001    140.8948    204.7044
       opcount      0.0132      0.0007       0.001      0.0118      0.0147
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_write] · besu

nobs 286 0.3371 coef (ms) 0.003834 p-value 1.00e-03 95% CI [0.003185, 0.004536]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.337
Model:                  NNLS                    Adj. R-squared:          0.335
No. Observations:       286                               RMSE:          36.19
Df Residuals:           284                                MAE:          28.31
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    293.7402      7.6090       0.001    278.4041    308.2687
       opcount      0.0038      0.0003       0.001      0.0032      0.0045
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_write] · erigon

nobs 418 0.7672 coef (ms) 0.001801 p-value 1.00e-03 95% CI [0.001705, 0.001898]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.767
Model:                  NNLS                    Adj. R-squared:          0.767
No. Observations:       418                               RMSE:           6.68
Df Residuals:           416                                MAE:           5.83
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     54.6915      1.0664       0.001     52.6219     56.7328
       opcount      0.0018      0.0000       0.001      0.0017      0.0019
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_write] · geth

nobs 561 0.03448 coef (ms) 0.01055 p-value 1.00e-03 95% CI [0.00605, 0.01521]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.034
Model:                  NNLS                    Adj. R-squared:          0.033
No. Observations:       561                               RMSE:         375.77
Df Residuals:           559                                MAE:         343.77
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    446.4394     49.1509       0.001    349.7171    538.5711
       opcount      0.0105      0.0024       0.001      0.0060      0.0152
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_write] · nethermind

nobs 682 0.5913 coef (ms) 0.002494 p-value 1.00e-03 95% CI [0.002351, 0.002646]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.591
Model:                  NNLS                    Adj. R-squared:          0.591
No. Observations:       682                               RMSE:          13.96
Df Residuals:           680                                MAE:          11.22
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     41.4553      1.5548       0.001     38.3291     44.3312
       opcount      0.0025      0.0001       0.001      0.0024      0.0026
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_account_access · combo CALLCODE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_write] · reth

nobs 1056 0.775 coef (ms) 0.0002405 p-value 1.00e-03 95% CI [0.0002322, 0.0002488]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.775
Model:                  NNLS                    Adj. R-squared:          0.775
No. Observations:       1056                              RMSE:           0.87
Df Residuals:           1054                               MAE:           0.63
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      6.2429      0.0850       0.001      6.0773      6.4186
       opcount      0.0002      0.0000       0.001      0.0002      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_ext_account_query_warm · combo CALLCODE · besu

nobs 286 0.9546 coef (ms) 0.001356 p-value 1.00e-03 95% CI [0.001323, 0.001391]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.955
Model:                  NNLS                    Adj. R-squared:          0.954
No. Observations:       286                               RMSE:         149.41
Df Residuals:           284                                MAE:         121.34
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    774.6343     30.7929       0.001    715.0401    831.5418
       opcount      0.0014      0.0000       0.001      0.0013      0.0014
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_ext_account_query_warm · combo CALLCODE · erigon

nobs 418 0.9009 coef (ms) 0.0002846 p-value 1.00e-03 95% CI [0.0002758, 0.0002932]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.901
Model:                  NNLS                    Adj. R-squared:          0.901
No. Observations:       418                               RMSE:          47.69
Df Residuals:           416                                MAE:          38.73
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     52.2219      6.7862       0.001     39.6988     65.1955
       opcount      0.0003      0.0000       0.001      0.0003      0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_ext_account_query_warm · combo CALLCODE · geth

nobs 561 0.9787 coef (ms) 0.0006909 p-value 1.00e-03 95% CI [0.0006824, 0.0006998]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.979
Model:                  NNLS                    Adj. R-squared:          0.979
No. Observations:       561                               RMSE:          51.56
Df Residuals:           559                                MAE:          39.93
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     16.5620      6.4072       0.004      4.1566     29.5839
       opcount      0.0007      0.0000       0.001      0.0007      0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_ext_account_query_warm · combo CALLCODE · nethermind

nobs 682 0.5777 coef (ms) 0.000533 p-value 1.00e-03 95% CI [0.0004978, 0.0005688]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.578
Model:                  NNLS                    Adj. R-squared:          0.577
No. Observations:       682                               RMSE:         230.26
Df Residuals:           680                                MAE:         181.53
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    365.4173     25.1595       0.001    315.8339    416.7247
       opcount      0.0005      0.0000       0.001      0.0005      0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

CALLCODE · test_ext_account_query_warm · combo CALLCODE · reth

nobs 1056 0.9069 coef (ms) 4.812e-05 p-value 1.00e-03 95% CI [4.707e-05, 4.912e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.907
Model:                  NNLS                    Adj. R-squared:          0.907
No. Observations:       1056                              RMSE:           7.79
Df Residuals:           1054                               MAE:           6.31
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     16.5775      0.8410       0.001     14.9413     18.3254
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_EOA · besu

nobs 286 0.6547 coef (ms) 0.01836 p-value 1.00e-03 95% CI [0.01664, 0.01976]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.655
Model:                  NNLS                    Adj. R-squared:          0.653
No. Observations:       286                               RMSE:         316.95
Df Residuals:           284                                MAE:         235.93
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    584.2775     54.2965       0.001    485.4124    698.2947
       opcount      0.0184      0.0008       0.001      0.0166      0.0198
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_EOA · erigon

nobs 418 0.9957 coef (ms) 0.01012 p-value 1.00e-03 95% CI [0.01006, 0.01019]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.996
Model:                  NNLS                    Adj. R-squared:          0.996
No. Observations:       418                               RMSE:          15.80
Df Residuals:           416                                MAE:          12.72
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     42.8318      2.2814       0.001     38.2999     47.4411
       opcount      0.0101      0.0000       0.001      0.0101      0.0102
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_EOA · geth

nobs 561 0.7086 coef (ms) 0.0123 p-value 1.00e-03 95% CI [0.01169, 0.01294]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.709
Model:                  NNLS                    Adj. R-squared:          0.708
No. Observations:       561                               RMSE:         187.45
Df Residuals:           559                                MAE:         158.55
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    497.1733     25.0926       0.001    448.8567    543.9733
       opcount      0.0123      0.0003       0.001      0.0117      0.0129
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_EOA · nethermind

nobs 682 0.7724 coef (ms) 0.005941 p-value 1.00e-03 95% CI [0.00571, 0.006202]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.772
Model:                  NNLS                    Adj. R-squared:          0.772
No. Observations:       682                               RMSE:          76.67
Df Residuals:           680                                MAE:          58.89
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     74.3194      8.5270       0.001     56.7816     90.7112
       opcount      0.0059      0.0001       0.001      0.0057      0.0062
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_EOA · reth

nobs 1056 0.9712 coef (ms) 0.001123 p-value 1.00e-03 95% CI [0.001111, 0.001135]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.971
Model:                  NNLS                    Adj. R-squared:          0.971
No. Observations:       1056                              RMSE:           4.60
Df Residuals:           1054                               MAE:           3.55
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     32.1884      0.5258       0.001     31.1326     33.1896
       opcount      0.0011      0.0000       0.001      0.0011      0.0011
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu

nobs 286 0.8551 coef (ms) 0.01191 p-value 1.00e-03 95% CI [0.01136, 0.01253]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.855
Model:                  NNLS                    Adj. R-squared:          0.855
No. Observations:       286                               RMSE:         116.56
Df Residuals:           284                                MAE:          94.87
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    523.7447     22.5830       0.001    476.4728    563.8939
       opcount      0.0119      0.0003       0.001      0.0114      0.0125
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon

nobs 418 0.9959 coef (ms) 0.009545 p-value 1.00e-03 95% CI [0.009486, 0.009606]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.996
Model:                  NNLS                    Adj. R-squared:          0.996
No. Observations:       418                               RMSE:          14.49
Df Residuals:           416                                MAE:          11.15
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     19.0801      2.2654       0.001     14.4258     23.4695
       opcount      0.0095      0.0000       0.001      0.0095      0.0096
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth

nobs 561 0.6202 coef (ms) 0.03177 p-value 1.00e-03 95% CI [0.02958, 0.03408]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.620
Model:                  NNLS                    Adj. R-squared:          0.620
No. Observations:       561                               RMSE:         591.06
Df Residuals:           559                                MAE:         484.86
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1470.2510     81.2951       0.001   1302.5444   1632.8158
       opcount      0.0318      0.0011       0.001      0.0296      0.0341
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind

nobs 682 0.7811 coef (ms) 0.005527 p-value 1.00e-03 95% CI [0.005301, 0.00577]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.781
Model:                  NNLS                    Adj. R-squared:          0.781
No. Observations:       682                               RMSE:          69.56
Df Residuals:           680                                MAE:          53.27
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     70.6502      7.9873       0.001     53.7858     84.9926
       opcount      0.0055      0.0001       0.001      0.0053      0.0058
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth

nobs 1056 0.9727 coef (ms) 0.0009602 p-value 1.00e-03 95% CI [0.0009511, 0.0009701]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.973
Model:                  NNLS                    Adj. R-squared:          0.973
No. Observations:       1056                              RMSE:           3.82
Df Residuals:           1054                               MAE:           3.01
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.6537      0.3879       0.001     30.8902     32.4446
       opcount      0.0010      0.0000       0.001      0.0010      0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT · besu

nobs 286 0.8983 coef (ms) 0.03332 p-value 1.00e-03 95% CI [0.03208, 0.03461]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.898
Model:                  NNLS                    Adj. R-squared:          0.898
No. Observations:       286                               RMSE:         228.37
Df Residuals:           284                                MAE:         174.09
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    418.8015     40.3114       0.001    338.3071    486.9388
       opcount      0.0333      0.0007       0.001      0.0321      0.0346
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT · erigon

nobs 418 0.8728 coef (ms) 0.08742 p-value 1.00e-03 95% CI [0.08429, 0.09054]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.873
Model:                  NNLS                    Adj. R-squared:          0.872
No. Observations:       418                               RMSE:         679.93
Df Residuals:           416                                MAE:         576.39
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1485.7298    116.7480       0.001   1255.4277   1716.1175
       opcount      0.0874      0.0016       0.001      0.0843      0.0905
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT · geth

nobs 561 0.6331 coef (ms) 0.035 p-value 1.00e-03 95% CI [0.03284, 0.03732]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.633
Model:                  NNLS                    Adj. R-squared:          0.632
No. Observations:       561                               RMSE:         542.80
Df Residuals:           559                                MAE:         445.90
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1355.5510     71.1718       0.001   1208.9002   1500.2108
       opcount      0.0350      0.0012       0.001      0.0328      0.0373
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT · nethermind

nobs 682 0.7664 coef (ms) 0.02053 p-value 1.00e-03 95% CI [0.01965, 0.02136]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.766
Model:                  NNLS                    Adj. R-squared:          0.766
No. Observations:       682                               RMSE:         230.93
Df Residuals:           680                                MAE:         164.54
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    270.5539     26.6970       0.001    219.3276    324.3129
       opcount      0.0205      0.0004       0.001      0.0196      0.0214
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.EXISTING_CONTRACT · reth

nobs 1056 0.9222 coef (ms) 0.03754 p-value 1.00e-03 95% CI [0.03731, 0.03776]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.922
Model:                  NNLS                    Adj. R-squared:          0.922
No. Observations:       1056                              RMSE:         231.04
Df Residuals:           1054                               MAE:         128.41
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      0.0000      0.0000       1.000      0.0000      0.0000
       opcount      0.0375      0.0001       0.001      0.0373      0.0378
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · besu

nobs 286 0.8551 coef (ms) 0.01191 p-value 1.00e-03 95% CI [0.01136, 0.01253]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.855
Model:                  NNLS                    Adj. R-squared:          0.855
No. Observations:       286                               RMSE:         116.56
Df Residuals:           284                                MAE:          94.87
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    523.7447     22.5830       0.001    476.4728    563.8939
       opcount      0.0119      0.0003       0.001      0.0114      0.0125
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · erigon

nobs 418 0.9959 coef (ms) 0.009545 p-value 1.00e-03 95% CI [0.009486, 0.009606]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.996
Model:                  NNLS                    Adj. R-squared:          0.996
No. Observations:       418                               RMSE:          14.49
Df Residuals:           416                                MAE:          11.15
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     19.0801      2.2654       0.001     14.4258     23.4695
       opcount      0.0095      0.0000       0.001      0.0095      0.0096
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · geth

nobs 561 0.6202 coef (ms) 0.03177 p-value 1.00e-03 95% CI [0.02958, 0.03408]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.620
Model:                  NNLS                    Adj. R-squared:          0.620
No. Observations:       561                               RMSE:         591.06
Df Residuals:           559                                MAE:         484.86
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1470.2510     81.2951       0.001   1302.5444   1632.8158
       opcount      0.0318      0.0011       0.001      0.0296      0.0341
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · nethermind

nobs 682 0.7811 coef (ms) 0.005527 p-value 1.00e-03 95% CI [0.005301, 0.00577]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.781
Model:                  NNLS                    Adj. R-squared:          0.781
No. Observations:       682                               RMSE:          69.56
Df Residuals:           680                                MAE:          53.27
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     70.6502      7.9873       0.001     53.7858     84.9926
       opcount      0.0055      0.0001       0.001      0.0053      0.0058
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_account_access · combo DELEGATECALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · reth

nobs 1056 0.9727 coef (ms) 0.0009602 p-value 1.00e-03 95% CI [0.0009511, 0.0009701]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.973
Model:                  NNLS                    Adj. R-squared:          0.973
No. Observations:       1056                              RMSE:           3.82
Df Residuals:           1054                               MAE:           3.01
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.6537      0.3879       0.001     30.8902     32.4446
       opcount      0.0010      0.0000       0.001      0.0010      0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_ext_account_query_warm · combo DELEGATECALL · besu

nobs 286 0.9585 coef (ms) 0.001313 p-value 1.00e-03 95% CI [0.001283, 0.001341]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.958
Model:                  NNLS                    Adj. R-squared:          0.958
No. Observations:       286                               RMSE:         141.49
Df Residuals:           284                                MAE:         105.52
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    718.0529     26.9588       0.001    665.2606    770.9186
       opcount      0.0013      0.0000       0.001      0.0013      0.0013
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_ext_account_query_warm · combo DELEGATECALL · erigon

nobs 418 0.9051 coef (ms) 0.0002761 p-value 1.00e-03 95% CI [0.0002679, 0.0002852]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.905
Model:                  NNLS                    Adj. R-squared:          0.905
No. Observations:       418                               RMSE:          46.28
Df Residuals:           416                                MAE:          37.84
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     62.1101      6.9609       0.001     47.4198     75.5321
       opcount      0.0003      0.0000       0.001      0.0003      0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_ext_account_query_warm · combo DELEGATECALL · geth

nobs 561 0.9761 coef (ms) 0.0005538 p-value 1.00e-03 95% CI [0.0005467, 0.0005616]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.976
Model:                  NNLS                    Adj. R-squared:          0.976
No. Observations:       561                               RMSE:          44.89
Df Residuals:           559                                MAE:          34.23
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     23.6296      5.5939       0.001     12.2465     34.0852
       opcount      0.0006      0.0000       0.001      0.0005      0.0006
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_ext_account_query_warm · combo DELEGATECALL · nethermind

nobs 682 0.5583 coef (ms) 0.0005109 p-value 1.00e-03 95% CI [0.0004746, 0.0005468]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.558
Model:                  NNLS                    Adj. R-squared:          0.558
No. Observations:       682                               RMSE:         235.25
Df Residuals:           680                                MAE:         187.68
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    402.5629     25.9792       0.001    352.3878    454.5131
       opcount      0.0005      0.0000       0.001      0.0005      0.0005
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

DELEGATECALL · test_ext_account_query_warm · combo DELEGATECALL · reth

nobs 1056 0.9196 coef (ms) 4.738e-05 p-value 1.00e-03 95% CI [4.643e-05, 4.83e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.920
Model:                  NNLS                    Adj. R-squared:          0.919
No. Observations:       1056                              RMSE:           7.25
Df Residuals:           1054                               MAE:           5.98
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     16.4318      0.8044       0.001     14.8430     18.0389
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu

nobs 286 0.583 coef (ms) 0.0003921 p-value 1.00e-03 95% CI [0.0003552, 0.0004321]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.583
Model:                  NNLS                    Adj. R-squared:          0.581
No. Observations:       286                               RMSE:          85.15
Df Residuals:           284                                MAE:          67.73
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    212.4181     17.2821       0.001    177.8930    244.9350
       opcount      0.0004      0.0000       0.001      0.0004      0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon

nobs 418 0.7352 coef (ms) 6.391e-05 p-value 1.00e-03 95% CI [6.022e-05, 6.759e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.735
Model:                  NNLS                    Adj. R-squared:          0.735
No. Observations:       418                               RMSE:           9.85
Df Residuals:           416                                MAE:           8.03
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     44.3031      1.5615       0.001     41.1097     47.2400
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth

nobs 561 0.9378 coef (ms) 0.0008106 p-value 1.00e-03 95% CI [0.0007944, 0.0008279]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.938
Model:                  NNLS                    Adj. R-squared:          0.938
No. Observations:       561                               RMSE:          53.58
Df Residuals:           559                                MAE:          40.04
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     22.9030      6.2938       0.001     10.2273     35.0054
       opcount      0.0008      0.0000       0.001      0.0008      0.0008
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind

nobs 682 0.7251 coef (ms) 0.0003169 p-value 1.00e-03 95% CI [0.0003016, 0.0003317]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.725
Model:                  NNLS                    Adj. R-squared:          0.725
No. Observations:       682                               RMSE:          50.09
Df Residuals:           680                                MAE:          37.15
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    120.3152      5.6427       0.001    109.9056    131.6889
       opcount      0.0003      0.0000       0.001      0.0003      0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth

nobs 1056 0.7327 coef (ms) 1.634e-05 p-value 1.00e-03 95% CI [1.573e-05, 1.693e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.733
Model:                  NNLS                    Adj. R-squared:          0.732
No. Observations:       1056                              RMSE:           2.53
Df Residuals:           1054                               MAE:           1.86
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      6.2516      0.2418       0.001      5.8075      6.7497
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT · besu

nobs 286 0.7232 coef (ms) 0.001869 p-value 1.00e-03 95% CI [0.001733, 0.001998]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.723
Model:                  NNLS                    Adj. R-squared:          0.722
No. Observations:       286                               RMSE:         114.25
Df Residuals:           284                                MAE:          90.63
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    420.6476     21.5166       0.001    379.8994    465.5150
       opcount      0.0019      0.0001       0.001      0.0017      0.0020
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT · erigon

nobs 418 0.858 coef (ms) 0.0003228 p-value 1.00e-03 95% CI [0.0003104, 0.0003345]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.858
Model:                  NNLS                    Adj. R-squared:          0.858
No. Observations:       418                               RMSE:          12.98
Df Residuals:           416                                MAE:          10.88
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     44.0441      2.0473       0.001     40.3566     48.0134
       opcount      0.0003      0.0000       0.001      0.0003      0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT · geth

nobs 561 0.9787 coef (ms) 0.002852 p-value 1.00e-03 95% CI [0.002818, 0.002888]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.979
Model:                  NNLS                    Adj. R-squared:          0.979
No. Observations:       561                               RMSE:          41.54
Df Residuals:           559                                MAE:          32.24
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     34.9740      5.2015       0.001     24.5637     44.9688
       opcount      0.0029      0.0000       0.001      0.0028      0.0029
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT · nethermind

nobs 682 0.7322 coef (ms) 0.001152 p-value 1.00e-03 95% CI [0.001096, 0.001211]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.732
Model:                  NNLS                    Adj. R-squared:          0.732
No. Observations:       682                               RMSE:          68.82
Df Residuals:           680                                MAE:          55.45
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    196.6337      8.3367       0.001    180.1018    212.1298
       opcount      0.0012      0.0000       0.001      0.0011      0.0012
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.EXISTING_CONTRACT · reth

nobs 1056 0.7751 coef (ms) 7.837e-05 p-value 1.00e-03 95% CI [7.563e-05, 8.13e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.775
Model:                  NNLS                    Adj. R-squared:          0.775
No. Observations:       1056                              RMSE:           4.17
Df Residuals:           1054                               MAE:           3.22
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     11.1438      0.4642       0.001     10.1795     12.0346
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · besu

nobs 286 0.583 coef (ms) 0.0003921 p-value 1.00e-03 95% CI [0.0003552, 0.0004321]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.583
Model:                  NNLS                    Adj. R-squared:          0.581
No. Observations:       286                               RMSE:          85.15
Df Residuals:           284                                MAE:          67.73
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    212.4181     17.2821       0.001    177.8930    244.9350
       opcount      0.0004      0.0000       0.001      0.0004      0.0004
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · erigon

nobs 418 0.7352 coef (ms) 6.391e-05 p-value 1.00e-03 95% CI [6.022e-05, 6.759e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.735
Model:                  NNLS                    Adj. R-squared:          0.735
No. Observations:       418                               RMSE:           9.85
Df Residuals:           416                                MAE:           8.03
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     44.3031      1.5615       0.001     41.1097     47.2400
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · geth

nobs 561 0.9378 coef (ms) 0.0008106 p-value 1.00e-03 95% CI [0.0007944, 0.0008279]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.938
Model:                  NNLS                    Adj. R-squared:          0.938
No. Observations:       561                               RMSE:          53.58
Df Residuals:           559                                MAE:          40.04
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     22.9030      6.2938       0.001     10.2273     35.0054
       opcount      0.0008      0.0000       0.001      0.0008      0.0008
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · nethermind

nobs 682 0.7251 coef (ms) 0.0003169 p-value 1.00e-03 95% CI [0.0003016, 0.0003317]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.725
Model:                  NNLS                    Adj. R-squared:          0.725
No. Observations:       682                               RMSE:          50.09
Df Residuals:           680                                MAE:          37.15
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    120.3152      5.6427       0.001    109.9056    131.6889
       opcount      0.0003      0.0000       0.001      0.0003      0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODECOPY · test_account_access · combo EXTCODECOPY_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · reth

nobs 1056 0.7327 coef (ms) 1.634e-05 p-value 1.00e-03 95% CI [1.573e-05, 1.693e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.733
Model:                  NNLS                    Adj. R-squared:          0.732
No. Observations:       1056                              RMSE:           2.53
Df Residuals:           1054                               MAE:           1.86
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      6.2516      0.2418       0.001      5.8075      6.7497
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu

nobs 286 0.8317 coef (ms) 0.01061 p-value 1.00e-03 95% CI [0.01004, 0.01118]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.832
Model:                  NNLS                    Adj. R-squared:          0.831
No. Observations:       286                               RMSE:         114.05
Df Residuals:           284                                MAE:          95.71
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    420.6799     23.2092       0.001    376.1825    467.0201
       opcount      0.0106      0.0003       0.001      0.0100      0.0112
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon

nobs 418 0.9955 coef (ms) 0.008628 p-value 1.00e-03 95% CI [0.008572, 0.008682]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.995
Model:                  NNLS                    Adj. R-squared:          0.995
No. Observations:       418                               RMSE:          13.91
Df Residuals:           416                                MAE:          10.53
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     12.4905      2.1597       0.001      8.5185     17.0440
       opcount      0.0086      0.0000       0.001      0.0086      0.0087
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth

nobs 561 0.6666 coef (ms) 0.03858 p-value 1.00e-03 95% CI [0.03632, 0.04108]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.667
Model:                  NNLS                    Adj. R-squared:          0.666
No. Observations:       561                               RMSE:         652.16
Df Residuals:           559                                MAE:         551.55
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1157.7273     82.4163       0.001    986.6898   1312.6548
       opcount      0.0386      0.0012       0.001      0.0363      0.0411
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind

nobs 682 0.7695 coef (ms) 0.005077 p-value 1.00e-03 95% CI [0.004868, 0.005295]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.770
Model:                  NNLS                    Adj. R-squared:          0.769
No. Observations:       682                               RMSE:          66.40
Df Residuals:           680                                MAE:          51.50
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     30.5002      7.3075       0.001     15.4564     43.8379
       opcount      0.0051      0.0001       0.001      0.0049      0.0053
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth

nobs 1056 0.9698 coef (ms) 0.0009145 p-value 1.00e-03 95% CI [0.000905, 0.0009241]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.970
Model:                  NNLS                    Adj. R-squared:          0.970
No. Observations:       1056                              RMSE:           3.86
Df Residuals:           1054                               MAE:           3.03
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     32.0990      0.3970       0.001     31.3387     32.9117
       opcount      0.0009      0.0000       0.001      0.0009      0.0009
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT · besu

nobs 286 0.8932 coef (ms) 0.0317 p-value 1.00e-03 95% CI [0.03036, 0.03295]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.893
Model:                  NNLS                    Adj. R-squared:          0.893
No. Observations:       286                               RMSE:         228.03
Df Residuals:           284                                MAE:         176.55
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    388.7523     42.5263       0.001    303.6207    472.4043
       opcount      0.0317      0.0007       0.001      0.0304      0.0330
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT · erigon

nobs 418 0.8946 coef (ms) 0.03586 p-value 1.00e-03 95% CI [0.03468, 0.03698]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.895
Model:                  NNLS                    Adj. R-squared:          0.894
No. Observations:       418                               RMSE:         256.10
Df Residuals:           416                                MAE:         215.89
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    427.3062     43.4548       0.001    345.2601    512.9334
       opcount      0.0359      0.0006       0.001      0.0347      0.0370
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT · geth

nobs 561 0.6274 coef (ms) 0.0344 p-value 1.00e-03 95% CI [0.03212, 0.03652]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.627
Model:                  NNLS                    Adj. R-squared:          0.627
No. Observations:       561                               RMSE:         551.49
Df Residuals:           559                                MAE:         454.35
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1333.2670     70.7989       0.001   1199.3609   1474.2298
       opcount      0.0344      0.0011       0.001      0.0321      0.0365
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT · nethermind

nobs 682 0.7833 coef (ms) 0.02032 p-value 1.00e-03 95% CI [0.01954, 0.02103]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.783
Model:                  NNLS                    Adj. R-squared:          0.783
No. Observations:       682                               RMSE:         222.32
Df Residuals:           680                                MAE:         154.28
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    219.6562     23.6627       0.001    172.9214    265.8773
       opcount      0.0203      0.0004       0.001      0.0195      0.0210
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.EXISTING_CONTRACT · reth

nobs 1056 0.8746 coef (ms) 0.03554 p-value 1.00e-03 95% CI [0.03474, 0.03646]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.875
Model:                  NNLS                    Adj. R-squared:          0.874
No. Observations:       1056                              RMSE:         279.99
Df Residuals:           1054                               MAE:         157.84
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    192.8474     28.5144       0.001    132.3808    247.2720
       opcount      0.0355      0.0004       0.001      0.0347      0.0365
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · besu

nobs 286 0.8317 coef (ms) 0.01061 p-value 1.00e-03 95% CI [0.01004, 0.01118]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.832
Model:                  NNLS                    Adj. R-squared:          0.831
No. Observations:       286                               RMSE:         114.05
Df Residuals:           284                                MAE:          95.71
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    420.6799     23.2092       0.001    376.1825    467.0201
       opcount      0.0106      0.0003       0.001      0.0100      0.0112
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · erigon

nobs 418 0.9955 coef (ms) 0.008628 p-value 1.00e-03 95% CI [0.008572, 0.008682]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.995
Model:                  NNLS                    Adj. R-squared:          0.995
No. Observations:       418                               RMSE:          13.91
Df Residuals:           416                                MAE:          10.53
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     12.4905      2.1597       0.001      8.5185     17.0440
       opcount      0.0086      0.0000       0.001      0.0086      0.0087
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · geth

nobs 561 0.6666 coef (ms) 0.03858 p-value 1.00e-03 95% CI [0.03632, 0.04108]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.667
Model:                  NNLS                    Adj. R-squared:          0.666
No. Observations:       561                               RMSE:         652.16
Df Residuals:           559                                MAE:         551.55
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1157.7273     82.4163       0.001    986.6898   1312.6548
       opcount      0.0386      0.0012       0.001      0.0363      0.0411
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · nethermind

nobs 682 0.7695 coef (ms) 0.005077 p-value 1.00e-03 95% CI [0.004868, 0.005295]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.770
Model:                  NNLS                    Adj. R-squared:          0.769
No. Observations:       682                               RMSE:          66.40
Df Residuals:           680                                MAE:          51.50
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     30.5002      7.3075       0.001     15.4564     43.8379
       opcount      0.0051      0.0001       0.001      0.0049      0.0053
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_account_access · combo EXTCODEHASH_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · reth

nobs 1056 0.9698 coef (ms) 0.0009145 p-value 1.00e-03 95% CI [0.000905, 0.0009241]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.970
Model:                  NNLS                    Adj. R-squared:          0.970
No. Observations:       1056                              RMSE:           3.86
Df Residuals:           1054                               MAE:           3.03
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     32.0990      0.3970       0.001     31.3387     32.9117
       opcount      0.0009      0.0000       0.001      0.0009      0.0009
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_ext_account_query_warm · combo EXTCODEHASH · besu

nobs 286 0.6441 coef (ms) 0.0001429 p-value 1.00e-03 95% CI [0.0001294, 0.0001558]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.644
Model:                  NNLS                    Adj. R-squared:          0.643
No. Observations:       286                               RMSE:          62.14
Df Residuals:           284                                MAE:          48.72
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    182.4175     12.8891       0.001    158.8791    208.8183
       opcount      0.0001      0.0000       0.001      0.0001      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_ext_account_query_warm · combo EXTCODEHASH · erigon

nobs 418 0.9105 coef (ms) 0.0002649 p-value 1.00e-03 95% CI [0.0002572, 0.0002731]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.910
Model:                  NNLS                    Adj. R-squared:          0.910
No. Observations:       418                               RMSE:          48.57
Df Residuals:           416                                MAE:          39.71
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     46.8745      6.8314       0.001     33.4932     59.9743
       opcount      0.0003      0.0000       0.001      0.0003      0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_ext_account_query_warm · combo EXTCODEHASH · geth

nobs 561 0.9648 coef (ms) 0.0001977 p-value 1.00e-03 95% CI [0.0001943, 0.0002011]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.965
Model:                  NNLS                    Adj. R-squared:          0.965
No. Observations:       561                               RMSE:          22.07
Df Residuals:           559                                MAE:          16.40
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      6.9347      2.7529       0.005      1.3806     12.4345
       opcount      0.0002      0.0000       0.001      0.0002      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_ext_account_query_warm · combo EXTCODEHASH · nethermind

nobs 682 0.6134 coef (ms) 0.0002368 p-value 1.00e-03 95% CI [0.0002222, 0.0002508]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.613
Model:                  NNLS                    Adj. R-squared:          0.613
No. Observations:       682                               RMSE:         109.93
Df Residuals:           680                                MAE:          87.15
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    119.8529     12.1896       0.001     96.3837    144.1412
       opcount      0.0002      0.0000       0.001      0.0002      0.0003
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODEHASH · test_ext_account_query_warm · combo EXTCODEHASH · reth

nobs 1056 0.6781 coef (ms) 7.656e-06 p-value 1.00e-03 95% CI [7.317e-06, 7.985e-06]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.678
Model:                  NNLS                    Adj. R-squared:          0.678
No. Observations:       1056                              RMSE:           3.08
Df Residuals:           1054                               MAE:           2.20
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      6.5662      0.3115       0.001      5.9507      7.1734
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu

nobs 286 0.8329 coef (ms) 0.01065 p-value 1.00e-03 95% CI [0.01014, 0.01122]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.833
Model:                  NNLS                    Adj. R-squared:          0.832
No. Observations:       286                               RMSE:         114.01
Df Residuals:           284                                MAE:          96.24
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    417.0410     22.3278       0.001    372.5417    459.4166
       opcount      0.0106      0.0003       0.001      0.0101      0.0112
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon

nobs 418 0.996 coef (ms) 0.008841 p-value 1.00e-03 95% CI [0.008787, 0.008894]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.996
Model:                  NNLS                    Adj. R-squared:          0.996
No. Observations:       418                               RMSE:          13.32
Df Residuals:           416                                MAE:          10.74
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     11.5064      2.2397       0.001      7.0031     15.4977
       opcount      0.0088      0.0000       0.001      0.0088      0.0089
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth

nobs 561 0.6535 coef (ms) 0.0372 p-value 1.00e-03 95% CI [0.03471, 0.03955]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.653
Model:                  NNLS                    Adj. R-squared:          0.653
No. Observations:       561                               RMSE:         647.37
Df Residuals:           559                                MAE:         544.36
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1227.0102     83.3792       0.001   1069.0609   1395.5582
       opcount      0.0372      0.0012       0.001      0.0347      0.0396
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind

nobs 682 0.7823 coef (ms) 0.004918 p-value 1.00e-03 95% CI [0.004716, 0.005103]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.782
Model:                  NNLS                    Adj. R-squared:          0.782
No. Observations:       682                               RMSE:          61.99
Df Residuals:           680                                MAE:          49.12
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     38.0217      6.9952       0.001     25.6318     52.3769
       opcount      0.0049      0.0001       0.001      0.0047      0.0051
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth

nobs 1056 0.9668 coef (ms) 0.0009176 p-value 1.00e-03 95% CI [0.0009078, 0.0009277]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.967
Model:                  NNLS                    Adj. R-squared:          0.967
No. Observations:       1056                              RMSE:           4.06
Df Residuals:           1054                               MAE:           3.20
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.9214      0.3967       0.001     31.1003     32.6675
       opcount      0.0009      0.0000       0.001      0.0009      0.0009
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT · besu

nobs 286 0.8804 coef (ms) 0.03184 p-value 1.00e-03 95% CI [0.03057, 0.03316]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.880
Model:                  NNLS                    Adj. R-squared:          0.880
No. Observations:       286                               RMSE:         244.16
Df Residuals:           284                                MAE:         189.50
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    379.5633     42.7431       0.001    291.2857    458.9452
       opcount      0.0318      0.0007       0.001      0.0306      0.0332
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT · erigon

nobs 418 0.8709 coef (ms) 0.08608 p-value 1.00e-03 95% CI [0.08292, 0.08927]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.871
Model:                  NNLS                    Adj. R-squared:          0.871
No. Observations:       418                               RMSE:         689.64
Df Residuals:           416                                MAE:         583.61
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1524.1649    123.1609       0.001   1279.1004   1756.1797
       opcount      0.0861      0.0016       0.001      0.0829      0.0893
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT · geth

nobs 561 0.7292 coef (ms) 0.04026 p-value 1.00e-03 95% CI [0.0381, 0.04232]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.729
Model:                  NNLS                    Adj. R-squared:          0.729
No. Observations:       561                               RMSE:         510.37
Df Residuals:           559                                MAE:         418.32
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1066.0585     62.2065       0.001    947.7730   1193.9413
       opcount      0.0403      0.0011       0.001      0.0381      0.0423
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT · nethermind

nobs 682 0.7758 coef (ms) 0.01996 p-value 1.00e-03 95% CI [0.01916, 0.02078]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.776
Model:                  NNLS                    Adj. R-squared:          0.775
No. Observations:       682                               RMSE:         223.29
Df Residuals:           680                                MAE:         155.28
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    226.9765     24.9282       0.001    178.5611    274.5454
       opcount      0.0200      0.0004       0.001      0.0192      0.0208
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.EXISTING_CONTRACT · reth

nobs 1056 0.8992 coef (ms) 0.03504 p-value 1.00e-03 95% CI [0.03423, 0.03582]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.899
Model:                  NNLS                    Adj. R-squared:          0.899
No. Observations:       1056                              RMSE:         244.12
Df Residuals:           1054                               MAE:         145.15
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    228.1705     27.8350       0.001    176.4368    281.9659
       opcount      0.0350      0.0004       0.001      0.0342      0.0358
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · besu

nobs 286 0.8329 coef (ms) 0.01065 p-value 1.00e-03 95% CI [0.01014, 0.01122]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.833
Model:                  NNLS                    Adj. R-squared:          0.832
No. Observations:       286                               RMSE:         114.01
Df Residuals:           284                                MAE:          96.24
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    417.0410     22.3278       0.001    372.5417    459.4166
       opcount      0.0106      0.0003       0.001      0.0101      0.0112
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · erigon

nobs 418 0.996 coef (ms) 0.008841 p-value 1.00e-03 95% CI [0.008787, 0.008894]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.996
Model:                  NNLS                    Adj. R-squared:          0.996
No. Observations:       418                               RMSE:          13.32
Df Residuals:           416                                MAE:          10.74
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     11.5064      2.2397       0.001      7.0031     15.4977
       opcount      0.0088      0.0000       0.001      0.0088      0.0089
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · geth

nobs 561 0.6535 coef (ms) 0.0372 p-value 1.00e-03 95% CI [0.03471, 0.03955]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.653
Model:                  NNLS                    Adj. R-squared:          0.653
No. Observations:       561                               RMSE:         647.37
Df Residuals:           559                                MAE:         544.36
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1227.0102     83.3792       0.001   1069.0609   1395.5582
       opcount      0.0372      0.0012       0.001      0.0347      0.0396
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · nethermind

nobs 682 0.7823 coef (ms) 0.004918 p-value 1.00e-03 95% CI [0.004716, 0.005103]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.782
Model:                  NNLS                    Adj. R-squared:          0.782
No. Observations:       682                               RMSE:          61.99
Df Residuals:           680                                MAE:          49.12
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     38.0217      6.9952       0.001     25.6318     52.3769
       opcount      0.0049      0.0001       0.001      0.0047      0.0051
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_account_access · combo EXTCODESIZE_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · reth

nobs 1056 0.9668 coef (ms) 0.0009176 p-value 1.00e-03 95% CI [0.0009078, 0.0009277]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.967
Model:                  NNLS                    Adj. R-squared:          0.967
No. Observations:       1056                              RMSE:           4.06
Df Residuals:           1054                               MAE:           3.20
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.9214      0.3967       0.001     31.1003     32.6675
       opcount      0.0009      0.0000       0.001      0.0009      0.0009
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_ext_account_query_warm · combo EXTCODESIZE · besu

nobs 286 0.6399 coef (ms) 0.0001309 p-value 1.00e-03 95% CI [0.0001195, 0.0001432]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.640
Model:                  NNLS                    Adj. R-squared:          0.639
No. Observations:       286                               RMSE:          57.43
Df Residuals:           284                                MAE:          45.61
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    204.6688     11.5596       0.001    181.7621    226.9720
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_ext_account_query_warm · combo EXTCODESIZE · erigon

nobs 418 0.7697 coef (ms) 4.084e-05 p-value 1.00e-03 95% CI [3.857e-05, 4.312e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.770
Model:                  NNLS                    Adj. R-squared:          0.769
No. Observations:       418                               RMSE:          13.06
Df Residuals:           416                                MAE:          10.48
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     45.2346      1.9112       0.001     41.4991     49.0183
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_ext_account_query_warm · combo EXTCODESIZE · geth

nobs 561 0.9736 coef (ms) 0.0001459 p-value 1.00e-03 95% CI [0.0001439, 0.0001477]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.974
Model:                  NNLS                    Adj. R-squared:          0.974
No. Observations:       561                               RMSE:          14.04
Df Residuals:           559                                MAE:           9.97
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     12.5073      1.6679       0.001      9.4157     15.7935
       opcount      0.0001      0.0000       0.001      0.0001      0.0001
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_ext_account_query_warm · combo EXTCODESIZE · nethermind

nobs 682 0.6787 coef (ms) 0.0001862 p-value 1.00e-03 95% CI [0.0001764, 0.0001962]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.679
Model:                  NNLS                    Adj. R-squared:          0.678
No. Observations:       682                               RMSE:          74.91
Df Residuals:           680                                MAE:          61.24
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     76.7320      9.1033       0.001     58.7889     94.9055
       opcount      0.0002      0.0000       0.001      0.0002      0.0002
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

EXTCODESIZE · test_ext_account_query_warm · combo EXTCODESIZE · reth

nobs 1056 0.6644 coef (ms) 5.683e-06 p-value 1.00e-03 95% CI [5.404e-06, 5.952e-06]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.664
Model:                  NNLS                    Adj. R-squared:          0.664
No. Observations:       1056                              RMSE:           2.36
Df Residuals:           1054                               MAE:           1.62
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      5.0382      0.2384       0.001      4.5873      5.5235
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_EOA · besu

nobs 286 0.6838 coef (ms) 0.01933 p-value 1.00e-03 95% CI [0.01776, 0.02079]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.684
Model:                  NNLS                    Adj. R-squared:          0.683
No. Observations:       286                               RMSE:         312.41
Df Residuals:           284                                MAE:         229.44
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    561.4273     52.7785       0.001    457.6148    665.8726
       opcount      0.0193      0.0008       0.001      0.0178      0.0208
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_EOA · erigon

nobs 418 0.9956 coef (ms) 0.0103 p-value 1.00e-03 95% CI [0.01023, 0.01036]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.996
Model:                  NNLS                    Adj. R-squared:          0.996
No. Observations:       418                               RMSE:          16.32
Df Residuals:           416                                MAE:          12.84
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     41.7728      2.3860       0.001     37.2317     46.7279
       opcount      0.0103      0.0000       0.001      0.0102      0.0104
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_EOA · geth

nobs 561 0.7122 coef (ms) 0.01234 p-value 1.00e-03 95% CI [0.01172, 0.01302]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.712
Model:                  NNLS                    Adj. R-squared:          0.712
No. Observations:       561                               RMSE:         186.52
Df Residuals:           559                                MAE:         158.40
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    509.2433     25.0730       0.001    459.0982    555.5250
       opcount      0.0123      0.0003       0.001      0.0117      0.0130
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_EOA · nethermind

nobs 682 0.7927 coef (ms) 0.006083 p-value 1.00e-03 95% CI [0.005862, 0.006314]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.793
Model:                  NNLS                    Adj. R-squared:          0.792
No. Observations:       682                               RMSE:          73.97
Df Residuals:           680                                MAE:          56.17
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     57.9798      8.0937       0.001     41.5079     73.5463
       opcount      0.0061      0.0001       0.001      0.0059      0.0063
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_EOA · reth

nobs 1056 0.9731 coef (ms) 0.001133 p-value 1.00e-03 95% CI [0.001122, 0.001145]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.973
Model:                  NNLS                    Adj. R-squared:          0.973
No. Observations:       1056                              RMSE:           4.48
Df Residuals:           1054                               MAE:           3.51
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     32.3579      0.4842       0.001     31.3800     33.2954
       opcount      0.0011      0.0000       0.001      0.0011      0.0011
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · besu

nobs 286 0.8348 coef (ms) 0.01285 p-value 1.00e-03 95% CI [0.0122, 0.01358]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.835
Model:                  NNLS                    Adj. R-squared:          0.834
No. Observations:       286                               RMSE:         135.91
Df Residuals:           284                                MAE:         108.90
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    525.7708     26.3281       0.001    469.5713    574.7974
       opcount      0.0128      0.0003       0.001      0.0122      0.0136
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · erigon

nobs 418 0.9954 coef (ms) 0.01181 p-value 1.00e-03 95% CI [0.01176, 0.01184]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.995
Model:                  NNLS                    Adj. R-squared:          0.995
No. Observations:       418                               RMSE:          19.14
Df Residuals:           416                                MAE:          15.08
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      0.0000      0.7201       1.000      0.0000      2.7102
       opcount      0.0118      0.0000       0.001      0.0118      0.0118
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · geth

nobs 561 0.6322 coef (ms) 0.03315 p-value 1.00e-03 95% CI [0.03086, 0.03542]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.632
Model:                  NNLS                    Adj. R-squared:          0.632
No. Observations:       561                               RMSE:         601.03
Df Residuals:           559                                MAE:         486.64
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1416.6405     82.2612       0.001   1254.1636   1578.7844
       opcount      0.0331      0.0012       0.001      0.0309      0.0354
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · nethermind

nobs 682 0.7834 coef (ms) 0.005564 p-value 1.00e-03 95% CI [0.005321, 0.005802]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.783
Model:                  NNLS                    Adj. R-squared:          0.783
No. Observations:       682                               RMSE:          69.56
Df Residuals:           680                                MAE:          52.42
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     72.4394      7.7437       0.001     57.7234     87.2232
       opcount      0.0056      0.0001       0.001      0.0053      0.0058
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_nocode_access] · reth

nobs 1056 0.9726 coef (ms) 0.0009768 p-value 1.00e-03 95% CI [0.0009667, 0.0009865]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.973
Model:                  NNLS                    Adj. R-squared:          0.973
No. Observations:       1056                              RMSE:           3.90
Df Residuals:           1054                               MAE:           3.09
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.5165      0.3875       0.001     30.7543     32.3016
       opcount      0.0010      0.0000       0.001      0.0010      0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT · besu

nobs 286 0.8961 coef (ms) 0.03394 p-value 1.00e-03 95% CI [0.03276, 0.03523]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.896
Model:                  NNLS                    Adj. R-squared:          0.896
No. Observations:       286                               RMSE:         235.34
Df Residuals:           284                                MAE:         189.96
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    423.3945     39.3096       0.001    342.0565    495.6362
       opcount      0.0339      0.0006       0.001      0.0328      0.0352
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT · erigon

nobs 418 0.872 coef (ms) 0.08761 p-value 1.00e-03 95% CI [0.08445, 0.0905]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.872
Model:                  NNLS                    Adj. R-squared:          0.872
No. Observations:       418                               RMSE:         683.80
Df Residuals:           416                                MAE:         579.95
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1481.3545    120.4529       0.001   1260.5021   1723.9184
       opcount      0.0876      0.0016       0.001      0.0844      0.0905
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT · geth

nobs 561 0.6969 coef (ms) 0.04166 p-value 1.00e-03 95% CI [0.03933, 0.04419]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.697
Model:                  NNLS                    Adj. R-squared:          0.696
No. Observations:       561                               RMSE:         559.65
Df Residuals:           559                                MAE:         462.01
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1069.1002     70.6682       0.001    928.5773   1200.6791
       opcount      0.0417      0.0012       0.001      0.0393      0.0442
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT · nethermind

nobs 682 0.7728 coef (ms) 0.02086 p-value 1.00e-03 95% CI [0.02002, 0.02164]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.773
Model:                  NNLS                    Adj. R-squared:          0.772
No. Observations:       682                               RMSE:         230.41
Df Residuals:           680                                MAE:         165.02
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    255.0589     25.8841       0.001    207.9916    307.3310
       opcount      0.0209      0.0004       0.001      0.0200      0.0216
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.EXISTING_CONTRACT · reth

nobs 1056 0.8908 coef (ms) 0.03572 p-value 1.00e-03 95% CI [0.03488, 0.03655]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.891
Model:                  NNLS                    Adj. R-squared:          0.891
No. Observations:       1056                              RMSE:         254.79
Df Residuals:           1054                               MAE:         147.72
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    196.6867     27.2779       0.001    143.5697    250.6574
       opcount      0.0357      0.0004       0.001      0.0349      0.0366
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · besu

nobs 286 0.8348 coef (ms) 0.01285 p-value 1.00e-03 95% CI [0.0122, 0.01358]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.835
Model:                  NNLS                    Adj. R-squared:          0.834
No. Observations:       286                               RMSE:         135.91
Df Residuals:           284                                MAE:         108.90
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    525.7708     26.3281       0.001    469.5713    574.7974
       opcount      0.0128      0.0003       0.001      0.0122      0.0136
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · erigon

nobs 418 0.9954 coef (ms) 0.01181 p-value 1.00e-03 95% CI [0.01176, 0.01184]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.995
Model:                  NNLS                    Adj. R-squared:          0.995
No. Observations:       418                               RMSE:          19.14
Df Residuals:           416                                MAE:          15.08
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const      0.0000      0.7201       1.000      0.0000      2.7102
       opcount      0.0118      0.0000       0.001      0.0118      0.0118
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · geth

nobs 561 0.6322 coef (ms) 0.03315 p-value 1.00e-03 95% CI [0.03086, 0.03542]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.632
Model:                  NNLS                    Adj. R-squared:          0.632
No. Observations:       561                               RMSE:         601.03
Df Residuals:           559                                MAE:         486.64
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const   1416.6405     82.2612       0.001   1254.1636   1578.7844
       opcount      0.0331      0.0012       0.001      0.0309      0.0354
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · nethermind

nobs 682 0.7834 coef (ms) 0.005564 p-value 1.00e-03 95% CI [0.005321, 0.005802]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.783
Model:                  NNLS                    Adj. R-squared:          0.783
No. Observations:       682                               RMSE:          69.56
Df Residuals:           680                                MAE:          52.42
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     72.4394      7.7437       0.001     57.7234     87.2232
       opcount      0.0056      0.0001       0.001      0.0053      0.0058
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_account_access · combo STATICCALL_AccountMode.NON_EXISTING_ACCOUNT` — `presets[cold_account_code_access] · reth

nobs 1056 0.9726 coef (ms) 0.0009768 p-value 1.00e-03 95% CI [0.0009667, 0.0009865]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.973
Model:                  NNLS                    Adj. R-squared:          0.973
No. Observations:       1056                              RMSE:           3.90
Df Residuals:           1054                               MAE:           3.09
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     31.5165      0.3875       0.001     30.7543     32.3016
       opcount      0.0010      0.0000       0.001      0.0010      0.0010
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_ext_account_query_warm · combo STATICCALL · besu

nobs 286 0.9635 coef (ms) 0.001308 p-value 1.00e-03 95% CI [0.001275, 0.001338]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.964
Model:                  NNLS                    Adj. R-squared:          0.963
No. Observations:       286                               RMSE:         131.72
Df Residuals:           284                                MAE:         106.77
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    709.1301     27.5639       0.001    656.6987    766.1418
       opcount      0.0013      0.0000       0.001      0.0013      0.0013
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_ext_account_query_warm · combo STATICCALL · erigon

nobs 418 0.8826 coef (ms) 0.0005056 p-value 1.00e-03 95% CI [0.0004854, 0.0005254]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.883
Model:                  NNLS                    Adj. R-squared:          0.882
No. Observations:       418                               RMSE:          95.45
Df Residuals:           416                                MAE:          70.63
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     54.0917     14.5075       0.001     25.8247     82.2230
       opcount      0.0005      0.0000       0.001      0.0005      0.0005
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_ext_account_query_warm · combo STATICCALL · geth

nobs 561 0.9742 coef (ms) 0.0006563 p-value 1.00e-03 95% CI [0.0006472, 0.0006651]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.974
Model:                  NNLS                    Adj. R-squared:          0.974
No. Observations:       561                               RMSE:          55.25
Df Residuals:           559                                MAE:          41.62
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     14.0786      6.6702       0.018      0.7412     27.9110
       opcount      0.0007      0.0000       0.001      0.0006      0.0007
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_ext_account_query_warm · combo STATICCALL · nethermind

nobs 682 0.5691 coef (ms) 0.0005083 p-value 1.00e-03 95% CI [0.0004751, 0.0005404]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.569
Model:                  NNLS                    Adj. R-squared:          0.568
No. Observations:       682                               RMSE:         228.95
Df Residuals:           680                                MAE:         184.16
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const    385.1312     24.7178       0.001    338.0910    434.5309
       opcount      0.0005      0.0000       0.001      0.0005      0.0005
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================

STATICCALL · test_ext_account_query_warm · combo STATICCALL · reth

nobs 1056 0.9109 coef (ms) 4.59e-05 p-value 1.00e-03 95% CI [4.496e-05, 4.678e-05]
NNLS regression summary
==============================================================================
                           NNLS Regression Results                            
==============================================================================
Dep. Variable:          test_runtime_ms              R-squared:          0.911
Model:                  NNLS                    Adj. R-squared:          0.911
No. Observations:       1056                              RMSE:           7.43
Df Residuals:           1054                               MAE:           6.02
Df Model:               1      
==============================================================================
                      coef     std err     P-value      [0.025      0.975]
------------------------------------------------------------------------------
         const     19.1654      0.8060       0.001     17.7148     20.8395
       opcount      0.0000      0.0000       0.001      0.0000      0.0000
==============================================================================
Notes: Non-negative least squares with bootstrap inference (1000 iterations)
==============================================================================