Skip to content

Instantly share code, notes, and snippets.

@Fraser999

Fraser999/Default (without system contracts).txt

Created March 27, 2020 18:43
Show Gist options
  • Save Fraser999/56f0e6218b260ae8d1f48c9dfa3f063c to your computer and use it in GitHub Desktop.
Save Fraser999/56f0e6218b260ae8d1f48c9dfa3f063c to your computer and use it in GitHub Desktop.
Download ZIP
Benchmarks without gas metering injected
Raw
Default (without system contracts).txt
tps/transfer_to_existing_account_multiple_execs/3/false
time: [4.1253 ms 4.1331 ms 4.1398 ms]
thrpt: [724.67 elem/s 725.85 elem/s 727.22 elem/s]
change:
time: [-18.142% -17.929% -17.739%] (p = 0.00 < 0.05)
thrpt: [+21.564% +21.846% +22.162%]
Performance has improved.
tps/transfer_to_existing_account_multiple_deploys_per_exec/3/false
time: [4.4451 ms 4.5028 ms 4.5329 ms]
thrpt: [661.83 elem/s 666.25 elem/s 674.91 elem/s]
change:
time: [-19.639% -18.341% -17.135%] (p = 0.00 < 0.05)
thrpt: [+20.678% +22.460% +24.439%]
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) low mild
tps/transfer_to_purse_multiple_execs/3/false
time: [4.6393 ms 4.6596 ms 4.6859 ms]
thrpt: [640.22 elem/s 643.83 elem/s 646.65 elem/s]
change:
time: [-19.010% -18.683% -18.398%] (p = 0.00 < 0.05)
thrpt: [+22.546% +22.976% +23.472%]
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) low mild
tps/transfer_to_purse_multiple_deploys_per_exec/3/false
time: [4.6312 ms 4.6386 ms 4.6507 ms]
thrpt: [645.06 elem/s 646.75 elem/s 647.78 elem/s]
change:
time: [-20.745% -20.382% -19.995%] (p = 0.00 < 0.05)
thrpt: [+24.993% +25.599% +26.175%]
Performance has improved.
tps/transfer_to_existing_account_multiple_execs/3/true
time: [16.075 ms 16.356 ms 16.543 ms]
thrpt: [181.35 elem/s 183.42 elem/s 186.63 elem/s]
change:
time: [-15.380% -13.644% -11.698%] (p = 0.00 < 0.05)
thrpt: [+13.248% +15.799% +18.176%]
Performance has improved.
tps/transfer_to_existing_account_multiple_deploys_per_exec/3/true
time: [8.8210 ms 8.8643 ms 8.9298 ms]
thrpt: [335.95 elem/s 338.44 elem/s 340.10 elem/s]
change:
time: [-17.193% -15.301% -13.064%] (p = 0.00 < 0.05)
thrpt: [+15.028% +18.065% +20.763%]
Performance has improved.
tps/transfer_to_purse_multiple_execs/3/true
time: [16.845 ms 16.976 ms 17.064 ms]
thrpt: [175.81 elem/s 176.73 elem/s 178.09 elem/s]
change:
time: [-17.593% -16.105% -14.589%] (p = 0.00 < 0.05)
thrpt: [+17.081% +19.197% +21.349%]
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) low mild
tps/transfer_to_purse_multiple_deploys_per_exec/3/true
time: [9.4736 ms 9.7433 ms 9.9464 ms]
thrpt: [301.62 elem/s 307.90 elem/s 316.67 elem/s]
change:
time: [-16.500% -12.285% -7.1508%] (p = 0.00 < 0.05)
thrpt: [+7.7015% +14.005% +19.761%]
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) low mild
Raw
Diff against e322fd227.diff
Diff against e322fd227
======================
diff --git a/execution-engine/engine-core/src/runtime/mod.rs b/execution-engine/engine-core/src/runtime/mod.rs
index 59ef595ac..a1fa5941a 100644
--- a/execution-engine/engine-core/src/runtime/mod.rs
+++ b/execution-engine/engine-core/src/runtime/mod.rs
@@ -1383,6 +1383,7 @@ where
/// Intuition about the return value sense is to answer the question 'are we
/// allowed to continue?'
fn charge_gas(&mut self, amount: Gas) -> bool {
+ panic!();
let prev = self.context.gas_counter();
match prev.checked_add(amount) {
// gas charge overflow protection
diff --git a/execution-engine/engine-wasm-prep/src/lib.rs b/execution-engine/engine-wasm-prep/src/lib.rs
index 2f2414fd1..1777b62d2 100644
--- a/execution-engine/engine-wasm-prep/src/lib.rs
+++ b/execution-engine/engine-wasm-prep/src/lib.rs
@@ -50,8 +50,8 @@ impl Preprocessor {
pub fn preprocess(&self, module_bytes: &[u8]) -> Result<Module, PreprocessingError> {
let module = deserialize(module_bytes)?;
let module = pwasm_utils::externalize_mem(module, None, self.mem_pages);
- let module = pwasm_utils::inject_gas_counter(module, &self.wasm_costs.to_set())
- .map_err(|_| PreprocessingError::OperationForbiddenByGasRules)?;
+ // let module = pwasm_utils::inject_gas_counter(module, &self.wasm_costs.to_set())
+ // .map_err(|_| PreprocessingError::OperationForbiddenByGasRules)?;
let module = stack_height::inject_limiter(module, self.wasm_costs.max_stack_height)
.map_err(|_| PreprocessingError::StackLimiter)?;
Ok(module)
Raw
Using system contracts.txt
tps/transfer_to_existing_account_multiple_execs/3/false
time: [71.306 ms 73.340 ms 74.547 ms]
thrpt: [40.243 elem/s 40.906 elem/s 42.072 elem/s]
change:
time: [-15.216% -13.684% -11.938%] (p = 0.00 < 0.05)
thrpt: [+13.557% +15.853% +17.947%]
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) high mild
tps/transfer_to_existing_account_multiple_deploys_per_exec/3/false
time: [76.256 ms 76.554 ms 77.213 ms]
thrpt: [38.854 elem/s 39.188 elem/s 39.341 elem/s]
change:
time: [-13.713% -13.073% -12.485%] (p = 0.00 < 0.05)
thrpt: [+14.266% +15.039% +15.893%]
Performance has improved.
tps/transfer_to_purse_multiple_execs/3/false
time: [76.196 ms 76.217 ms 76.232 ms]
thrpt: [39.354 elem/s 39.361 elem/s 39.372 elem/s]
change:
time: [-14.659% -14.488% -14.316%] (p = 0.00 < 0.05)
thrpt: [+16.708% +16.943% +17.177%]
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) low severe
tps/transfer_to_purse_multiple_deploys_per_exec/3/false
time: [76.060 ms 76.598 ms 76.871 ms]
thrpt: [39.026 elem/s 39.165 elem/s 39.442 elem/s]
change:
time: [-14.191% -13.675% -13.190%] (p = 0.00 < 0.05)
thrpt: [+15.195% +15.841% +16.538%]
Performance has improved.
tps/transfer_to_existing_account_multiple_execs/3/true
time: [91.270 ms 91.966 ms 92.610 ms]
thrpt: [32.394 elem/s 32.621 elem/s 32.869 elem/s]
change:
time: [-13.840% -12.527% -11.126%] (p = 0.00 < 0.05)
thrpt: [+12.519% +14.321% +16.064%]
Performance has improved.
Found 2 outliers among 10 measurements (20.00%)
1 (10.00%) low severe
1 (10.00%) high severe
tps/transfer_to_existing_account_multiple_deploys_per_exec/3/true
time: [80.867 ms 81.285 ms 81.598 ms]
thrpt: [36.766 elem/s 36.907 elem/s 37.098 elem/s]
change:
time: [-13.432% -12.793% -12.084%] (p = 0.00 < 0.05)
thrpt: [+13.745% +14.670% +15.516%]
Performance has improved.
tps/transfer_to_purse_multiple_execs/3/true
time: [86.956 ms 87.637 ms 88.431 ms]
thrpt: [33.925 elem/s 34.232 elem/s 34.500 elem/s]
change:
time: [-19.105% -17.731% -16.401%] (p = 0.00 < 0.05)
thrpt: [+19.619% +21.553% +23.617%]
Performance has improved.
Found 3 outliers among 10 measurements (30.00%)
1 (10.00%) low mild
2 (20.00%) high mild
tps/transfer_to_purse_multiple_deploys_per_exec/3/true
time: [83.624 ms 85.389 ms 86.888 ms]
thrpt: [34.527 elem/s 35.133 elem/s 35.875 elem/s]
change:
time: [-9.6415% -8.4922% -7.3327%] (p = 0.00 < 0.05)
thrpt: [+7.9129% +9.2803% +10.670%]
Performance has improved.
Found 1 outliers among 10 measurements (10.00%)
1 (10.00%) low mild
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment