Created
November 29, 2023 01:37
-
-
Save breandan/947cf938fab5f7a475bddb9f24081494 to your computer and use it in GitHub Desktop.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Repairing: START NAME NAME '(' ')' ':' NEWLINE 98 NAME '=' '[' STRING ',' STRING ']' NEWLINE 'def' NAME '(' NAME ')' ':' NEWLINE 98 'return' NAME '+' NAME NEWLINE 99 'return' NAME NEWLINE 99 NAME '=' NAME '(' ')' END | |
| Found length-2 fix in 279ms after 8697 total and 5 valid samples (31 samples/ms, first valid sample: 244ms) | |
| Average time to find human fix: ~674ms (367 trials, 53 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~62742 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~154 | |
| Repairing: START NAME '=' '(' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' END | |
| Sampling timeout expired after (3444387, 14959) (total, valid) samples (146 samples/ms, first valid sample: 10000ms), ground truth repair was 1 edits: | |
| START NAME '=' '(' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' END | |
| START NAME '=' '(' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' ')' END | |
| -2147483648 40 58 52 1 54 1 54 1 54 1 54 1 54 1 54 2147483647 | |
| -2147483648 40 58 52 1 54 1 54 1 54 1 54 1 54 1 54 53 2147483647 | |
| Repairing: START NAME '=' NAME '.' NAME '(' NAME '(' NAME ')' NAME '=' '(' NAME '.' NAME '!=' STRING ')' ')' END | |
| Found length-1 fix in 214ms after 8705 total and 22 valid samples (40 samples/ms, first valid sample: 173ms) | |
| Average time to find human fix: ~673ms (368 trials, 54 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~62595 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~154 | |
| Repairing: START 'from' NAME '.' NAME 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' NAME ',' STRING ')' NEWLINE NAME ':' NAME STRING 'is' 'not' NAME END | |
| Found length-1 fix in 1085ms after 137322 total and 58 valid samples (126 samples/ms, first valid sample: 620ms) | |
| Average time to find human fix: ~674ms (369 trials, 54 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~62798 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~154 | |
| Repairing: START 'class' NAME '(' NAME ')' ':' NEWLINE '@' 'def' NAME '(' ')' ':' NEWLINE 98 STRING NEWLINE 99 END | |
| Found length-2 fix in 41ms after 2961 total and 1 valid samples (70 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~672ms (370 trials, 54 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~62636 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~153 | |
| Repairing: START STRING NAME NUMBER STRING END | |
| Found length-2 fix in 50ms after 3734 total and 13 valid samples (73 samples/ms, first valid sample: 41ms) | |
| Average time to find human fix: ~670ms (371 trials, 54 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~62477 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~153 | |
| Repairing: START UNKNOWN_CHAR 'from' NAME '.' NAME 'import' NAME NEWLINE NAME '=' NAME '(' STRING ',' STRING ')' '.' NAME '(' ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' UNKNOWN_CHAR END | |
| Found length-2 fix in 304ms after 21563 total and 1 valid samples (70 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~669ms (372 trials, 54 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~62367 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~152 | |
| Repairing: START NEWLINE 98 'try' ':' NEWLINE 'from' NAME 'import' NAME NEWLINE 99 'except' NAME ':' NEWLINE 98 'import' NAME NEWLINE 99 END | |
| Sampling timeout expired after (3587768, 1) (total, valid) samples (138 samples/ms, first valid sample: 0ms), ground truth repair was 3 edits: | |
| START NEWLINE 98 'try' ':' NEWLINE 'from' NAME 'import' NAME NEWLINE 99 'except' NAME ':' NEWLINE 98 'import' NAME NEWLINE 99 END | |
| START 'try' ':' NEWLINE 98 'from' NAME 'import' NAME NEWLINE 99 'except' NAME ':' NEWLINE 98 'import' NAME NEWLINE 99 END | |
| -2147483648 39 98 19 55 39 7 40 8 40 39 99 22 40 55 39 98 8 40 39 99 2147483647 | |
| -2147483648 19 55 39 98 7 40 8 40 39 99 22 40 55 39 98 8 40 39 99 2147483647 | |
| Repairing: START '{' NUMBER ':' '[' STRING ',' STRING ']' ',' NUMBER ':' '[' STRING ',' STRING ',' UNKNOWN_CHAR NAME ']' '}' END | |
| Found length-2 fix in 5ms after 278 total and 1 valid samples (46 samples/ms, first valid sample: 5ms) | |
| Average time to find human fix: ~668ms (373 trials, 55 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~62201 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~152 | |
| Repairing: START 'class' NAME ':' NEWLINE 'def' NAME '(' NAME ',' NAME ',' NAME ')' ':' NEWLINE 98 NAME '.' NAME '=' NAME NEWLINE NAME '.' NAME '=' NAME NEWLINE 99 END | |
| Found length-2 fix in 80ms after 613 total and 1 valid samples (7 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~666ms (374 trials, 55 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~62036 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~152 | |
| Repairing: START 'import' NAME NEWLINE NAME '(' NAME '.' NAME '(' STRING ')' END | |
| Found length-1 fix in 6ms after 97 total and 2 valid samples (13 samples/ms, first valid sample: 5ms) | |
| Average time to find human fix: ~664ms (375 trials, 55 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~61871 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~151 | |
| Repairing: START '[' '[' STRING ',' '[' STRING ',' '[' STRING ',' '[' STRING ']' ',' STRING ']' ']' ',' STRING ',' '[' STRING ']' ']' END | |
| Found length-1 fix in 971ms after 81350 total and 588 valid samples (83 samples/ms, first valid sample: 487ms) | |
| Average time to find human fix: ~665ms (376 trials, 55 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~61923 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~152 | |
| Repairing: START 'def' NAME '(' NAME '=' '[' STRING ']' ')' ':' NEWLINE 98 NAME '.' NAME '(' NUMBER ')' NEWLINE NAME NAME NEWLINE 99 NAME '(' ')' NEWLINE NAME '(' ')' END | |
| Found length-1 fix in 205ms after 1098 total and 5 valid samples (5 samples/ms, first valid sample: 201ms) | |
| Average time to find human fix: ~664ms (377 trials, 55 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~61761 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~152 | |
| Repairing: START 'class' NAME '(' NAME ')' ':' NEWLINE 'class' NAME ':' NEWLINE 98 NAME '=' NAME NEWLINE NAME '=' STRING NEWLINE 99 END | |
| Found length-3 fix in 1469ms after 194446 total and 411 valid samples (132 samples/ms, first valid sample: 654ms) | |
| Average time to find human fix: ~666ms (378 trials, 55 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~62112 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~153 | |
| Repairing: START NAME '=' '{' STRING ':' NUMBER '}' NEWLINE NAME '=' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ']' NEWLINE NAME '(' '[' NAME ',' '**' NAME ')' END | |
| Found length-1 fix in 591ms after 47982 total and 21 valid samples (81 samples/ms, first valid sample: 317ms) | |
| Average time to find human fix: ~666ms (379 trials, 55 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~62075 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~152 | |
| Repairing: START UNKNOWN_CHAR NAME '=' NAME '(' '[' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ']' ',' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ']' ']' ')' UNKNOWN_CHAR END | |
| Found length-2 fix in 3ms after 12 total and 1 valid samples (3 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~664ms (380 trials, 55 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~61912 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~152 | |
| Repairing: START NAME '=' '{' STRING ':' '(' STRING ',' 'None' ')' ',' END | |
| Sampling timeout expired after (5959308, 22952) (total, valid) samples (149 samples/ms, first valid sample: 10000ms), ground truth repair was 1 edits: | |
| START NAME '=' '{' STRING ':' '(' STRING ',' 'None' ')' ',' END | |
| START NAME '=' '{' STRING ':' '(' STRING ',' 'None' ')' ',' '}' END | |
| -2147483648 40 58 72 1 55 52 1 54 28 53 54 2147483647 | |
| -2147483648 40 58 72 1 55 52 1 54 28 53 54 73 2147483647 | |
| Repairing: START '[' '{' STRING ':' STRING ',' STRING ':' STRING '}' ',' '{' STRING ':' STRING ',' STRING ',' STRING '}' ']' END | |
| Found length-1 fix in 252ms after 10699 total and 28 valid samples (42 samples/ms, first valid sample: 182ms) | |
| Average time to find human fix: ~663ms (381 trials, 56 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~61777 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~151 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ']' NEWLINE NAME '=' '[' STRING '.' STRING ']' END | |
| Found length-1 fix in 365ms after 24379 total and 12 valid samples (66 samples/ms, first valid sample: 275ms) | |
| Average time to find human fix: ~662ms (382 trials, 56 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~61679 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~151 | |
| Repairing: START NAME '=' '{' NAME ':' '{' STRING ':' NUMBER ',' STRING ':' NUMBER '}' NAME ':' '{' STRING ':' NUMBER ',' STRING ':' NUMBER '}' NAME ':' '{' STRING ':' NUMBER ',' STRING ':' NUMBER '}' '}' END | |
| Found length-2 fix in 231ms after 4254 total and 1 valid samples (18 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~661ms (383 trials, 56 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~61529 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~151 | |
| Repairing: START NAME '=' NAME '(' 'lambda' NAME ':' STRING '.' NAME '(' NAME '.' NAME '(' ')' ')' ',' NAME '.' NAME ')' NEWLINE NAME '=' NAME '(' NAME '(' ')' NAME ',' NAME ')' END | |
| Found length-1 fix in 424ms after 22711 total and 23 valid samples (53 samples/ms, first valid sample: 296ms) | |
| Average time to find human fix: ~660ms (384 trials, 56 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~61428 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~150 | |
| Repairing: START NAME '=' NAME '.' NAME '.' NAME '(' NAME '=' STRING ')' '.' NAME '(' NAME '=' NAME '(' STRING ')' ')' '.' NAME '(' STRING ')' NAME '(' STRING ')' END | |
| Found length-1 fix in 459ms after 17751 total and 79 valid samples (38 samples/ms, first valid sample: 388ms) | |
| Average time to find human fix: ~660ms (385 trials, 56 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~61315 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~150 | |
| Repairing: START NAME '=' NAME '(' STRING ')' NEWLINE NAME '=' NAME '.' NAME '(' ')' NEWLINE NAME '=' NAME '(' NAME ')' NEWLINE NAME '(' STRING ',' NAME END | |
| Sampling timeout expired after (1790806, 2885) (total, valid) samples (89 samples/ms, first valid sample: 10003ms), ground truth repair was 2 edits: | |
| START NAME '=' NAME '(' STRING ')' NEWLINE NAME '=' NAME '.' NAME '(' ')' NEWLINE NAME '=' NAME '(' NAME ')' NEWLINE NAME '(' STRING ',' NAME END | |
| START NAME '=' NAME '(' STRING ')' NEWLINE NAME '=' NAME '.' NAME '(' ')' NEWLINE NAME '=' NAME '(' NAME ')' NEWLINE NAME '(' STRING ',' NAME ')' NEWLINE END | |
| -2147483648 40 58 40 52 1 53 39 40 58 40 49 40 52 53 39 40 58 40 52 40 53 39 40 52 1 54 40 2147483647 | |
| -2147483648 40 58 40 52 1 53 39 40 58 40 49 40 52 53 39 40 58 40 52 40 53 39 40 52 1 54 40 53 39 2147483647 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 98 NAME '=' NAME '(' NAME ')' NEWLINE NAME '.' '.' NEWLINE 99 END | |
| Found length-2 fix in 9858ms after 1141378 total and 184 valid samples (115 samples/ms, first valid sample: 3828ms) | |
| Average time to find human fix: ~684ms (386 trials, 57 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~64113 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~150 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 98 'for' NAME 'in' NAME '(' NUMBER ',' NAME ')' ':' NEWLINE 98 'return' NAME '(' NAME ')' NEWLINE 99 99 NAME NAME '(' STRING ')' END | |
| Found length-1 fix in 144ms after 957 total and 34 valid samples (6 samples/ms, first valid sample: 140ms) | |
| Average time to find human fix: ~682ms (387 trials, 57 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~63950 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~150 | |
| Repairing: START NEWLINE NAME '=' STRING NEWLINE NAME '=' NAME '.' NAME '(' NAME '.' NAME '(' ')' ',' STRING ')' NEWLINE NAME '.' NAME '(' NAME ',' '{' STRING ':' NAME '}' ')' UNKNOWN_CHAR END | |
| Found length-1 fix in 229ms after 563 total and 2 valid samples (2 samples/ms, first valid sample: 228ms) | |
| Average time to find human fix: ~681ms (388 trials, 57 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~63786 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~150 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 'for' NAME 'in' NAME ':' NEWLINE 98 'yield' NAME NEWLINE 99 END | |
| Found length-2 fix in 8ms after 181 total and 1 valid samples (20 samples/ms, first valid sample: 8ms) | |
| Average time to find human fix: ~679ms (389 trials, 57 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~63623 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~149 | |
| Repairing: START 'def' NAME '(' ')' ':' NEWLINE 98 'for' NAME 'in' NAME '(' NUMBER ')' ':' NEWLINE 'yield' NAME NEWLINE 99 END | |
| Found length-2 fix in 172ms after 9089 total and 8 valid samples (52 samples/ms, first valid sample: 131ms) | |
| Average time to find human fix: ~678ms (390 trials, 57 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~63483 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~149 | |
| Repairing: START 'from' NAME 'import' NAME NEWLINE 'def' NAME '(' ')' ':' NEWLINE 98 NAME '(' UNKNOWN_CHAR NAME ')' NEWLINE 99 NAME '(' ')' END | |
| Found length-2 fix in 77ms after 4407 total and 5 valid samples (56 samples/ms, first valid sample: 68ms) | |
| Average time to find human fix: ~677ms (391 trials, 57 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~63332 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~148 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ']' NEWLINE NAME '=' '[' STRING ',' NAME STRING NAME UNKNOWN_CHAR ']' NEWLINE NAME '=' '[' NUMBER ',' NUMBER ',' NUMBER ']' END | |
| Found length-3 fix in 756ms after 39463 total and 1 valid samples (52 samples/ms, first valid sample: 722ms) | |
| Average time to find human fix: ~677ms (392 trials, 57 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~63271 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~148 | |
| Repairing: START NAME '=' STRING NEWLINE NAME ')' NAME '=' STRING END | |
| Found length-2 fix in 1037ms after 214065 total and 362 valid samples (206 samples/ms, first valid sample: 599ms) | |
| Average time to find human fix: ~678ms (393 trials, 57 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~63655 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~149 | |
| Repairing: START 'import' NAME '.' NAME 'as' END | |
| Sampling timeout expired after (11301310, 1) (total, valid) samples (248 samples/ms, first valid sample: 0ms), ground truth repair was 1 edits: | |
| START 'import' NAME '.' NAME 'as' END | |
| START 'import' NAME '.' NAME 'as' NAME END | |
| -2147483648 8 40 49 40 9 2147483647 | |
| -2147483648 8 40 49 40 9 40 2147483647 | |
| Repairing: START NAME '=' '(' '(' STRING ',' NUMBER ')' ',' '(' STRING ':' NUMBER ')' ',' '(' STRING ':' NUMBER ')' ')' NEWLINE NAME '(' NAME ')' END | |
| Found length-2 fix in 410ms after 16846 total and 1 valid samples (40 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~677ms (394 trials, 58 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~63536 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~148 | |
| Repairing: START '{' STRING ':' '{' STRING ':' NUMBER '}' ',' STRING ':' '{' STRING ':' '{' STRING ':' '{' STRING ':' '{' STRING ':' STRING ',' STRING ':' STRING '}' '}' '}' '}' END | |
| Found length-1 fix in 182ms after 2911 total and 86 valid samples (15 samples/ms, first valid sample: 160ms) | |
| Average time to find human fix: ~676ms (395 trials, 58 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~63382 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~148 | |
| Repairing: START NAME '=' '(' '(' STRING ',' ')' ',' '(' STRING ',' ')' ',' '(' STRING ',' ')' END | |
| Found length-1 fix in 2ms after 37 total and 3 valid samples (12 samples/ms, first valid sample: 1ms) | |
| Average time to find human fix: ~674ms (396 trials, 58 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~63223 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~148 | |
| Repairing: START NAME '=' NAME '.' NAME '(' NAME '.' NAME '[' NAME ',' NAME ',' NUMBER ',' NAME ']' ',' NAME '=' NAME ')' ')' END | |
| Found length-1 fix in 66ms after 1310 total and 9 valid samples (19 samples/ms, first valid sample: 61ms) | |
| Average time to find human fix: ~672ms (397 trials, 58 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~63067 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~147 | |
| Repairing: START '@' NAME '(' NUMBER ')' NEWLINE 'def' NAME '(' NAME ')' ':' NEWLINE 98 'assert' NAME '=' NUMBER NEWLINE 99 END | |
| Found length-1 fix in 73ms after 61 total and 1 valid samples (0 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~671ms (398 trials, 58 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~62908 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~147 | |
| Repairing: START 'from' NAME 'import' NAME NEWLINE NAME '=' NAME '.' NAME '.' NAME '(' STRING ')' NEWLINE NAME '.' NAME '.' NAME '(' '%' NAME ')' END | |
| Found length-2 fix in 2872ms after 361174 total and 23 valid samples (125 samples/ms, first valid sample: 2114ms) | |
| Average time to find human fix: ~677ms (399 trials, 58 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~63656 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~147 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 'if' NAME '<' NUMBER ':' NEWLINE 98 'return' STRING NEWLINE 99 'elif' NAME '>=' NUMBER ':' NEWLINE 98 'return' STRING NEWLINE 99 'else' ':' NEWLINE 98 'return' NAME '.' NAME NEWLINE 99 END | |
| Found length-2 fix in 64ms after 2436 total and 9 valid samples (37 samples/ms, first valid sample: 54ms) | |
| Average time to find human fix: ~675ms (400 trials, 58 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~63503 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~146 | |
| Repairing: START NAME '(' STRING ')' NEWLINE NAME '(' STRING ')' NEWLINE NAME '=' NAME '(' ')' NAME NAME NAME NEWLINE NAME '(' STRING '+' NAME ')' END | |
| Sampling timeout expired after (1779478, 857) (total, valid) samples (96 samples/ms, first valid sample: 10010ms), ground truth repair was 3 edits: | |
| START NAME '(' STRING ')' NEWLINE NAME '(' STRING ')' NEWLINE NAME '=' NAME '(' ')' NAME NAME NAME NEWLINE NAME '(' STRING '+' NAME ')' END | |
| START NAME '(' STRING ')' NEWLINE NAME '(' STRING ')' NEWLINE NAME '=' NAME '(' ')' NEWLINE NAME '(' STRING '+' NAME ')' END | |
| -2147483648 40 52 1 53 39 40 52 1 53 39 40 58 40 52 53 40 40 40 39 40 52 1 66 40 53 2147483647 | |
| -2147483648 40 52 1 53 39 40 52 1 53 39 40 58 40 52 53 39 40 52 1 66 40 53 2147483647 | |
| Repairing: START NAME '=' '[' NAME '(' STRING ',' NAME '.' NAME ',' NAME '=' STRING ')' ',' NAME '(' STRING ',' NAME '.' NAME ',' NAME '=' STRING ')' ']' UNKNOWN_CHAR END | |
| Found length-1 fix in 301ms after 5593 total and 11 valid samples (18 samples/ms, first valid sample: 268ms) | |
| Average time to find human fix: ~674ms (401 trials, 59 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~63358 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~146 | |
| Repairing: START 'def' NAME '(' NAME ',' NAME ',' NAME ')' NEWLINE 98 NAME '=' NAME '+' NAME NEWLINE 'return' NAME NEWLINE 99 END | |
| Found length-1 fix in 39ms after 2822 total and 6 valid samples (70 samples/ms, first valid sample: 33ms) | |
| Average time to find human fix: ~672ms (402 trials, 59 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~63208 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~146 | |
| Repairing: START 'import' NAME '.' NAME NEWLINE NAME '=' '[' STRING ',' STRING ',' STRING ']' NEWLINE NAME '.' NAME '.' NAME '(' STRING ',' NAME '=' '{' STRING ':' NAME ')' END | |
| Found length-1 fix in 501ms after 9350 total and 2 valid samples (18 samples/ms, first valid sample: 445ms) | |
| Average time to find human fix: ~672ms (403 trials, 59 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~63074 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~145 | |
| Repairing: START NAME '=' NAME '(' '%' NAME ',' STRING '%' '(' NAME ')' ')' END | |
| Found length-2 fix in 236ms after 9462 total and 5 valid samples (39 samples/ms, first valid sample: 211ms) | |
| Average time to find human fix: ~671ms (404 trials, 59 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~62941 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~145 | |
| Repairing: START STRING UNKNOWN_CHAR NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' '.' NAME '(' ')' END | |
| Found length-1 fix in 334ms after 12877 total and 7 valid samples (38 samples/ms, first valid sample: 300ms) | |
| Average time to find human fix: ~670ms (405 trials, 59 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~62818 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~145 | |
| Repairing: START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 'return' NAME '==' NAME NEWLINE 99 NAME '=' NAME '(' NAME ')' NEWLINE 'assert' 'True' '=' NAME '(' STRING ',' STRING ')' END | |
| Sampling timeout expired after (1764980, 1) (total, valid) samples (112 samples/ms, first valid sample: 10624ms), ground truth repair was 2 edits: | |
| START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 'return' NAME '==' NAME NEWLINE 99 NAME '=' NAME '(' NAME ')' NEWLINE 'assert' 'True' '=' NAME '(' STRING ',' STRING ')' END | |
| START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 'return' NAME '==' NAME NEWLINE 99 NAME '=' NAME '(' NAME ')' NEWLINE 'assert' NAME '(' STRING ',' STRING ')' END | |
| -2147483648 4 40 52 40 54 40 53 55 39 98 5 40 76 40 39 99 40 58 40 52 40 53 39 12 29 58 40 52 1 54 1 53 2147483647 | |
| -2147483648 4 40 52 40 54 40 53 55 39 98 5 40 76 40 39 99 40 58 40 52 40 53 39 12 40 52 1 54 1 53 2147483647 | |
| Repairing: START NAME '=' STRING NAME STRING END | |
| Found length-1 fix in 46ms after 368 total and 5 valid samples (7 samples/ms, first valid sample: 45ms) | |
| Average time to find human fix: ~669ms (406 trials, 60 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~62664 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~144 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 98 'return' '(' NAME '*' NUMBER '&' NUMBER ')' '%' NUMBER UNKNOWN_CHAR NEWLINE 99 END | |
| Found length-1 fix in 143ms after 6382 total and 1 valid samples (44 samples/ms, first valid sample: 126ms) | |
| Average time to find human fix: ~667ms (407 trials, 60 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~62526 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~144 | |
| Repairing: START 'from' NAME 'import' NAME '.' NAME NEWLINE NAME ',' NAME ',' NAME '=' NAME '.' NAME '(' ')' END | |
| Found length-2 fix in 59ms after 1003 total and 1 valid samples (16 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~666ms (408 trials, 60 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~62375 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~144 | |
| Repairing: START NAME '[' NAME ']' '[' STRING ']' '=' NAME '[' NAME ']' NEWLINE 'and' NEWLINE NAME '[' NAME ']' '[' STRING ']' '=' NUMBER END | |
| Found length-2 fix in 1358ms after 113149 total and 6 valid samples (83 samples/ms, first valid sample: 937ms) | |
| Average time to find human fix: ~667ms (409 trials, 60 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~62499 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~143 | |
| Repairing: START NAME '=' '[' '(' '[' STRING ']' ',' '[' STRING ']' ')' ',' '[' STRING ']' ',' '[' STRING ']' ')' ']' NEWLINE NAME '=' '[' STRING ',' STRING ']' END | |
| Found length-1 fix in 687ms after 26917 total and 14 valid samples (39 samples/ms, first valid sample: 596ms) | |
| Average time to find human fix: ~668ms (410 trials, 60 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~62412 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~143 | |
| Repairing: START NAME '=' '[' '{' STRING ':' NUMBER ',' STRING ':' NUMBER '}' '{' STRING ':' NUMBER ',' STRING ':' NUMBER '}' ']' END | |
| Found length-1 fix in 486ms after 47688 total and 180 valid samples (97 samples/ms, first valid sample: 234ms) | |
| Average time to find human fix: ~667ms (411 trials, 60 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~62376 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~143 | |
| Repairing: START '@' NAME '.' NAME '(' STRING ')' NEWLINE 'def' NAME '(' ')' ':' NEWLINE 'return' NAME '(' STRING ',' NAME '=' NAME ')' NEWLINE END | |
| Sampling timeout expired after (2569078, 2046) (total, valid) samples (117 samples/ms, first valid sample: 10007ms), ground truth repair was 2 edits: | |
| START '@' NAME '.' NAME '(' STRING ')' NEWLINE 'def' NAME '(' ')' ':' NEWLINE 'return' NAME '(' STRING ',' NAME '=' NAME ')' NEWLINE END | |
| START '@' NAME '.' NAME '(' STRING ')' NEWLINE 'def' NAME '(' ')' ':' NEWLINE 98 'return' NAME '(' STRING ',' NAME '=' NAME ')' NEWLINE 99 END | |
| -2147483648 81 40 49 40 52 1 53 39 4 40 52 53 55 39 5 40 52 1 54 40 58 40 53 39 2147483647 | |
| -2147483648 81 40 49 40 52 1 53 39 4 40 52 53 55 39 98 5 40 52 1 54 40 58 40 53 39 99 2147483647 | |
| Repairing: START NAME '=' NAME '(' STRING ',' NAME '(' STRING '+' STRING '+' STRING '+' STRING '+' STRING '+' STRING '+' STRING '+' STRING '+' STRING ',' NAME ')' ',' END | |
| Found length-2 fix in 218ms after 521 total and 7 valid samples (2 samples/ms, first valid sample: 214ms) | |
| Average time to find human fix: ~666ms (412 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~62226 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~143 | |
| Repairing: START NAME '=' '[' STRING ',' NAME ',' NAME ',' STRING ',' NAME NAME ']' END | |
| Found length-1 fix in 243ms after 12721 total and 368 valid samples (52 samples/ms, first valid sample: 177ms) | |
| Average time to find human fix: ~665ms (413 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~62106 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~143 | |
| Repairing: START '(' NAME '*' NUMBER '&' NUMBER ')' '%' NUMBER UNKNOWN_CHAR END | |
| Found length-1 fix in 2ms after 134 total and 2 valid samples (44 samples/ms, first valid sample: 2ms) | |
| Average time to find human fix: ~663ms (414 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~61957 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~143 | |
| Repairing: START NAME '=' NAME '.' NAME '(' '[' STRING ',' STRING ')' NAME '=' NAME '.' NAME '(' '[' '[' NUMBER ',' NUMBER ']' ',' '[' NUMBER ',' NUMBER ']' ']' ')' END | |
| Found length-2 fix in 55ms after 709 total and 1 valid samples (12 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~662ms (415 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~61809 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~143 | |
| Repairing: START NAME '=' NAME ',' NAME '=' NAME ',' NAME '=' NUMBER ',' NAME '=' NUMBER ',' NAME '=' STRING ')' NEWLINE END | |
| Found length-2 fix in 871ms after 76086 total and 312 valid samples (87 samples/ms, first valid sample: 662ms) | |
| Average time to find human fix: ~662ms (416 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~61843 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~143 | |
| Repairing: START NAME '[' ':' ',' NUMBER ']' '=' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ']' UNKNOWN_CHAR END | |
| Found length-1 fix in 99ms after 1362 total and 4 valid samples (13 samples/ms, first valid sample: 94ms) | |
| Average time to find human fix: ~661ms (417 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~61698 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~143 | |
| Repairing: START UNKNOWN_CHAR NAME '[' NUMBER ']' '=' STRING NEWLINE NAME '[' NUMBER ']' '=' STRING NEWLINE NAME '[' NUMBER ']' '=' STRING NEWLINE NAME '[' NUMBER ']' '=' STRING NEWLINE '...' UNKNOWN_CHAR END | |
| Found length-2 fix in 3214ms after 366547 total and 1 valid samples (114 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~667ms (418 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~62428 | |
| Average repair throughput / ms: ~56 | |
| Average valid repairs detected: ~142 | |
| Repairing: START NAME NAME ')' NAME '(' NAME ')' NEWLINE END | |
| Found length-3 fix in 8347ms after 1855835 total and 35955 valid samples (222 samples/ms, first valid sample: 3398ms) | |
| Average time to find human fix: ~685ms (419 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~66708 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~228 | |
| Repairing: START 'def' NAME ':' NEWLINE 98 NAME '=' STRING NEWLINE NAME '=' NUMBER NEWLINE 99 END | |
| Found length-1 fix in 140ms after 14390 total and 6 valid samples (102 samples/ms, first valid sample: 114ms) | |
| Average time to find human fix: ~684ms (420 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~66583 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~227 | |
| Repairing: START 'import' NAME '.' NAME NEWLINE '//' NAME END | |
| Found length-1 fix in 117ms after 30132 total and 1 valid samples (255 samples/ms, first valid sample: 104ms) | |
| Average time to find human fix: ~683ms (421 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~66497 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~227 | |
| Repairing: START NAME '=' '[' '{' STRING ':' STRING ',' STRING ':' STRING '}' ',' '{' STRING ':' STRING ',' STRING ':' STRING '}' ',' '{' STRING ':' STRING ',' STRING ':' STRING ']' END | |
| Found length-1 fix in 162ms after 7006 total and 15 valid samples (42 samples/ms, first valid sample: 118ms) | |
| Average time to find human fix: ~682ms (422 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~66356 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~226 | |
| Repairing: START NAME '=' '[' NUMBER NUMBER ',' NUMBER ',' NUMBER NUMBER ',' NUMBER ',' NUMBER ']' NEWLINE NAME '=' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ']' END | |
| Found length-2 fix in 131ms after 4382 total and 19 valid samples (33 samples/ms, first valid sample: 108ms) | |
| Average time to find human fix: ~680ms (423 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~66209 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~226 | |
| Repairing: START 'while' NAME '!=' STRING ':' END | |
| Found length-1 fix in 111ms after 16059 total and 1 valid samples (143 samples/ms, first valid sample: 75ms) | |
| Average time to find human fix: ~679ms (424 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~66091 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~225 | |
| Repairing: START NAME '=' NAME '.' NAME '.' NAME '(' NAME '.' NAME ',' NAME '.' NAME ',' NAME '.' NAME '.' NAME '(' STRING ')' '.' NAME '(' ')' END | |
| Found length-1 fix in 515ms after 47840 total and 1517 valid samples (92 samples/ms, first valid sample: 323ms) | |
| Average time to find human fix: ~679ms (425 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~66048 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~228 | |
| Repairing: START NAME '=' NAME ',' NAME ',' NAME ',' NAME ',' NAME NAME ',' NAME END | |
| Found length-1 fix in 254ms after 18503 total and 228 valid samples (72 samples/ms, first valid sample: 184ms) | |
| Average time to find human fix: ~678ms (426 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~65936 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~228 | |
| Repairing: START NAME '=' STRING NEWLINE NAME '=' UNKNOWN_CHAR NAME NEWLINE NAME '(' STRING '%' '(' ')' ')' END | |
| Found length-1 fix in 199ms after 19712 total and 9 valid samples (98 samples/ms, first valid sample: 153ms) | |
| Average time to find human fix: ~676ms (427 trials, 61 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~65828 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~228 | |
| Repairing: START 'while' 'True' ':' NEWLINE NAME '=' NAME '(' STRING ')' NEWLINE 'if' NAME '==' STRING ':' NEWLINE 98 NAME '(' STRING ')' NEWLINE 'break' NEWLINE 99 'else' ':' NEWLINE 98 NAME '(' STRING ')' NEWLINE 'continue' NEWLINE 99 END | |
| Sampling timeout expired after (1658180, 4497) (total, valid) samples (93 samples/ms, first valid sample: 10002ms), ground truth repair was 3 edits: | |
| START 'while' 'True' ':' NEWLINE NAME '=' NAME '(' STRING ')' NEWLINE 'if' NAME '==' STRING ':' NEWLINE 98 NAME '(' STRING ')' NEWLINE 'break' NEWLINE 99 'else' ':' NEWLINE 98 NAME '(' STRING ')' NEWLINE 'continue' NEWLINE 99 END | |
| START 'while' 'True' ':' NEWLINE 98 NAME '=' NAME '(' STRING ')' NEWLINE 99 'if' NAME '==' STRING ':' NEWLINE 98 NAME '(' STRING ')' NEWLINE 'break' NEWLINE 99 'else' ':' NEWLINE 98 NAME '(' STRING ')' NEWLINE NAME NEWLINE 99 END | |
| -2147483648 16 29 55 39 40 58 40 52 1 53 39 13 40 76 1 55 39 98 40 52 1 53 39 36 39 99 15 55 39 98 40 52 1 53 39 35 39 99 2147483647 | |
| -2147483648 16 29 55 39 98 40 58 40 52 1 53 39 99 13 40 76 1 55 39 98 40 52 1 53 39 36 39 99 15 55 39 98 40 52 1 53 39 40 39 99 2147483647 | |
| Repairing: START NAME '(' NAME '(' NAME '.' NAME '(' STRING ',' NAME ')' ')' END | |
| Found length-1 fix in 6ms after 357 total and 20 valid samples (51 samples/ms, first valid sample: 4ms) | |
| Average time to find human fix: ~675ms (428 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~65675 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~227 | |
| Repairing: START '[' '(' STRING ',' STRING ',' STRING ')' ',' '(' STRING ',' STRING ',' STRING ')' ',' '(' STRING ',' STRING NAME UNKNOWN_CHAR ')' ',' '...' ']' END | |
| Found length-2 fix in 354ms after 9508 total and 33 valid samples (26 samples/ms, first valid sample: 299ms) | |
| Average time to find human fix: ~674ms (429 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~65544 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~227 | |
| Repairing: START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 'for' NAME 'in' NAME '(' NAME ')' ':' NEWLINE 98 NAME '=' NAME '**' NAME NEWLINE 99 END | |
| Found length-2 fix in 79ms after 2846 total and 7 valid samples (35 samples/ms, first valid sample: 67ms) | |
| Average time to find human fix: ~673ms (430 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~65398 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~226 | |
| Repairing: START NAME '=' NUMBER ',' NUMBER '.' '.' 'and' NAME '=' NUMBER ',' NUMBER NEWLINE END | |
| Found length-2 fix in 80ms after 850 total and 1 valid samples (10 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~671ms (431 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~65249 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~226 | |
| Repairing: START NAME '=' '[' ']' NEWLINE 'for' NAME 'in' NAME ':' NEWLINE 98 NAME '.' NAME '(' NAME '[' NAME ']' NEWLINE 99 END | |
| Found length-1 fix in 72ms after 1881 total and 9 valid samples (25 samples/ms, first valid sample: 62ms) | |
| Average time to find human fix: ~670ms (432 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~65102 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~225 | |
| Repairing: START NAME NAME '(' ')' ':' NEWLINE 98 NAME '=' NUMBER NEWLINE 'while' '(' NAME '<' NUMBER ')' ':' NEWLINE 98 NAME '+=' NUMBER NEWLINE 'yield' NAME NEWLINE 99 99 END | |
| Found length-2 fix in 110ms after 6864 total and 9 valid samples (61 samples/ms, first valid sample: 85ms) | |
| Average time to find human fix: ~669ms (433 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~64968 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~225 | |
| Repairing: START NAME '.' NAME '.' NAME '(' NAME '=' NAME '.' NAME '.' NAME '(' NAME '=' '(' NAME ',' NAME '(' NAME '=' NUMBER ')' ')' ')' ')' '.' END | |
| Found length-1 fix in 91ms after 1304 total and 1 valid samples (14 samples/ms, first valid sample: 89ms) | |
| Average time to find human fix: ~667ms (434 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~64821 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~224 | |
| Repairing: START NAME '=' NAME '(' STRING ',' STRING ')' NEWLINE NAME '=' '[' '{' STRING ':' STRING ',' STRING ':' NUMBER '}' ',' '{' STRING ':' STRING ',' STRING ':' NUMBER '}' ']' NEWLINE NAME '>>' NAME ',' NAME '*' END | |
| Found length-1 fix in 483ms after 11893 total and 2 valid samples (24 samples/ms, first valid sample: 431ms) | |
| Average time to find human fix: ~667ms (435 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~64699 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~224 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 'while' NAME '!=' NUMBER ':' NEWLINE 98 NAME '=' NAME '(' NAME ')' NEWLINE 'return' NAME NEWLINE 99 END | |
| Found length-2 fix in 4609ms after 570073 total and 628 valid samples (123 samples/ms, first valid sample: 2071ms) | |
| Average time to find human fix: ~676ms (436 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~65858 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~225 | |
| Repairing: START NAME '(' NAME ')' ':' NEWLINE 98 NAME '=' STRING NEWLINE NAME '=' '[' NAME ',' NAME ']' NEWLINE 'def' NAME '(' NAME ')' ':' NEWLINE 98 'pass' NEWLINE 99 99 END | |
| Found length-2 fix in 72ms after 768 total and 3 valid samples (10 samples/ms, first valid sample: 71ms) | |
| Average time to find human fix: ~675ms (437 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~65709 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~224 | |
| Repairing: START '*' NAME '*' '=' STRING END | |
| Found length-1 fix in 796ms after 289791 total and 257 valid samples (363 samples/ms, first valid sample: 360ms) | |
| Average time to find human fix: ~675ms (438 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~66221 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~224 | |
| Repairing: START '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING NAME UNKNOWN_CHAR STRING ',' STRING ':' STRING ',' STRING ':' STRING '}' END | |
| Found length-2 fix in 86ms after 2614 total and 1 valid samples (30 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~674ms (439 trials, 62 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~66076 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~224 | |
| Repairing: START 'import' NAME NEWLINE NAME '.' NAME '(' STRING END | |
| Sampling timeout expired after (4966248, 4763) (total, valid) samples (167 samples/ms, first valid sample: 7227ms), ground truth repair was 1 edits: | |
| START 'import' NAME NEWLINE NAME '.' NAME '(' STRING END | |
| START 'import' NAME NEWLINE NAME '.' NAME '(' STRING ')' END | |
| -2147483648 8 40 39 40 49 40 52 1 2147483647 | |
| -2147483648 8 40 39 40 49 40 52 1 53 2147483647 | |
| Repairing: START NAME '=' NAME '.' NAME '(' '{' STRING ':' NAME ',' STRING ':' NAME '}' ')' NEWLINE NAME '=' NAME '.' NAME '(' STRING NAME ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' END | |
| Found length-1 fix in 438ms after 7409 total and 17 valid samples (16 samples/ms, first valid sample: 406ms) | |
| Average time to find human fix: ~673ms (440 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~65943 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~223 | |
| Repairing: START NAME '=' '[' '[' STRING ',' STRING ',' STRING ']' NAME '=' '[' '[' STRING ',' STRING ',' STRING ']' END | |
| Found length-3 fix in 1508ms after 154951 total and 32 valid samples (102 samples/ms, first valid sample: 570ms) | |
| Average time to find human fix: ~675ms (441 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~66145 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~223 | |
| Repairing: START NAME '=' '{' STRING ':' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' '}' END | |
| Found length-1 fix in 184ms after 3097 total and 31 valid samples (16 samples/ms, first valid sample: 166ms) | |
| Average time to find human fix: ~674ms (442 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~66002 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~222 | |
| Repairing: START '@' NAME '.' NAME '(' STRING NAME UNKNOWN_CHAR ']' ')' NEWLINE 'def' NAME '(' ')' ':' NEWLINE 98 NAME '=' NAME '(' ')' NEWLINE 99 END | |
| Found length-2 fix in 479ms after 29990 total and 2 valid samples (62 samples/ms, first valid sample: 398ms) | |
| Average time to find human fix: ~673ms (443 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~65921 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~222 | |
| Repairing: START NAME '=' NAME '(' ')' NEWLINE NAME '(' NAME '.' NAME '(' NUMBER ',' NUMBER ',' NUMBER ')' END | |
| Found length-1 fix in 11ms after 215 total and 5 valid samples (17 samples/ms, first valid sample: 10ms) | |
| Average time to find human fix: ~672ms (444 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~65773 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~221 | |
| Repairing: START 'return' NAME '(' STRING ')' UNKNOWN_CHAR END | |
| Found length-1 fix in 1ms after 82 total and 1 valid samples (41 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~670ms (445 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~65625 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~221 | |
| Repairing: START '{' STRING ':' '{' STRING ',' STRING ':' STRING '}' '}' END | |
| Found length-2 fix in 75ms after 3952 total and 21 valid samples (52 samples/ms, first valid sample: 54ms) | |
| Average time to find human fix: ~669ms (446 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~65487 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~220 | |
| Repairing: START NAME '=' '{' NUMBER ':' '[' NAME 'is' NUMBER ',' NAME ',' NAME ']' ',' NUMBER ':' '[' NAME 'is' NUMBER ',' NAME ',' NAME ']' END | |
| Found length-1 fix in 745ms after 42947 total and 1 valid samples (57 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~669ms (447 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~65436 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~220 | |
| Repairing: START NAME '=' NAME '.' NAME '.' NAME '(' NAME '=' NUMBER ',' NAME '=' NUMBER ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME '.' NAME '(' '...' ')' '.' NAME '(' STRING ')' END | |
| Found length-1 fix in 57ms after 952 total and 14 valid samples (16 samples/ms, first valid sample: 53ms) | |
| Average time to find human fix: ~668ms (448 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~65292 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~219 | |
| Repairing: START 'from' NAME '.' NAME '.' NAME 'import' NAME NEWLINE 'class' NAME '(' NAME '.' NAME ')' ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' NAME '=' STRING NEWLINE 99 END | |
| Found length-1 fix in 238ms after 10647 total and 38 valid samples (44 samples/ms, first valid sample: 180ms) | |
| Average time to find human fix: ~667ms (449 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~65171 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~219 | |
| Repairing: START NAME '=' NAME '.' NAME '(' UNKNOWN_CHAR NAME ')' END | |
| Found length-2 fix in 18ms after 353 total and 2 valid samples (18 samples/ms, first valid sample: 17ms) | |
| Average time to find human fix: ~665ms (450 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~65027 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~219 | |
| Repairing: START '[' '{' STRING ':' '{' STRING ':' STRING '}' ',' STRING ':' STRING ',' STRING ':' NUMBER '}' END | |
| Found length-1 fix in 2042ms after 201793 total and 3 valid samples (98 samples/ms, first valid sample: 815ms) | |
| Average time to find human fix: ~668ms (451 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~65330 | |
| Average repair throughput / ms: ~57 | |
| Average valid repairs detected: ~218 | |
| Repairing: START 'in' '=' STRING END | |
| Found length-1 fix in 35ms after 12579 total and 44 valid samples (349 samples/ms, first valid sample: 27ms) | |
| Average time to find human fix: ~667ms (452 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~65213 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~218 | |
| Repairing: START 'for' NAME 'in' NAME ':' NEWLINE 98 'if' '(' NAME '[' NUMBER ':' NUMBER ']' '==' STRING ')' ':' NEWLINE 99 END | |
| Found length-1 fix in 240ms after 7418 total and 12 valid samples (30 samples/ms, first valid sample: 206ms) | |
| Average time to find human fix: ~666ms (453 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~65086 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~217 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING ']' '.' END | |
| Found length-1 fix in 73ms after 3658 total and 9 valid samples (49 samples/ms, first valid sample: 60ms) | |
| Average time to find human fix: ~665ms (454 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~64950 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~217 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ']' NEWLINE NAME ',' NAME ',' NAME '=' 'in' '.' NAME '(' NAME ')' END | |
| Found length-1 fix in 1957ms after 202673 total and 5 valid samples (103 samples/ms, first valid sample: 1458ms) | |
| Average time to find human fix: ~668ms (455 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~65253 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~216 | |
| Repairing: START 'import' NAME NEWLINE NAME '.' NAME '.' END | |
| Found length-1 fix in 51ms after 958 total and 1 valid samples (18 samples/ms, first valid sample: 49ms) | |
| Average time to find human fix: ~666ms (456 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~65112 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~216 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING '...' NAME ']' END | |
| Found length-1 fix in 595ms after 78104 total and 5 valid samples (131 samples/ms, first valid sample: 228ms) | |
| Average time to find human fix: ~666ms (457 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~65140 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~215 | |
| Repairing: START 'class' NAME ':' NEWLINE 'def' NAME '(' NAME ')' ':' NEWLINE 98 NAME '.' NAME '=' STRING NEWLINE NAME '.' NAME '=' NUMBER NEWLINE NAME '.' NAME '=' NUMBER NEWLINE 99 END | |
| Found length-2 fix in 77ms after 359 total and 3 valid samples (4 samples/ms, first valid sample: 76ms) | |
| Average time to find human fix: ~665ms (458 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~64999 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~215 | |
| Repairing: START 'if' NAME 'in' NAME ':' NEWLINE 98 NAME NUMBER NEWLINE 'break' NEWLINE 99 END | |
| Found length-2 fix in 113ms after 510 total and 3 valid samples (4 samples/ms, first valid sample: 112ms) | |
| Average time to find human fix: ~664ms (459 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~64858 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~214 | |
| Repairing: START NUMBER ',' '[' '(' STRING NAME ',' NUMBER ')' ']' NEWLINE NUMBER ',' '[' '(' STRING NAME ',' NUMBER ')' ']' END | |
| Found length-2 fix in 52ms after 22 total and 1 valid samples (0 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~662ms (460 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~64717 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~214 | |
| Repairing: START NAME '=' 'True' ')' NEWLINE NAME '=' NAME '.' NAME '(' ')' NEWLINE 'return' NAME '.' NAME '.' NAME '(' NAME ',' NAME '=' 'False' ')' END | |
| Found length-2 fix in 5471ms after 723359 total and 71 valid samples (132 samples/ms, first valid sample: 3547ms) | |
| Average time to find human fix: ~673ms (461 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~66146 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~214 | |
| Repairing: START NAME '=' NAME '.' NAME '.' NAME '(' NAME ',' STRING ')' NEWLINE NAME '=' STRING NEWLINE NAME '=' '(' NAME ',' ')' NEWLINE NAME NAME NEWLINE NAME NAME NEWLINE NAME NAME END | |
| Found length-3 fix in 544ms after 18991 total and 15 valid samples (34 samples/ms, first valid sample: 446ms) | |
| Average time to find human fix: ~672ms (462 trials, 63 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~66044 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~213 | |
| Repairing: START 'import' NAME NEWLINE NAME '.' NAME '(' STRING END | |
| Sampling timeout expired after (7002273, 6691) (total, valid) samples (169 samples/ms, first valid sample: 10003ms), ground truth repair was 1 edits: | |
| START 'import' NAME NEWLINE NAME '.' NAME '(' STRING END | |
| START 'import' NAME NEWLINE NAME '.' NAME '(' STRING ')' END | |
| -2147483648 8 40 39 40 49 40 52 1 2147483647 | |
| -2147483648 8 40 39 40 49 40 52 1 53 2147483647 | |
| Repairing: START NEWLINE 98 'class' NAME '(' NAME '.' NAME ')' ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE 99 99 'def' NAME '(' NAME ')' ':' NEWLINE 98 'return' NAME '.' NAME NEWLINE 99 END | |
| Sampling timeout expired after (1759146, 1) (total, valid) samples (115 samples/ms, first valid sample: 11148ms), ground truth repair was 3 edits: | |
| START NEWLINE 98 'class' NAME '(' NAME '.' NAME ')' ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE 99 99 'def' NAME '(' NAME ')' ':' NEWLINE 98 'return' NAME '.' NAME NEWLINE 99 END | |
| START 'class' NAME '(' NAME '.' NAME ')' ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE 99 'def' NAME '(' NAME ')' ':' NEWLINE 98 'return' NAME '.' NAME NEWLINE 99 END | |
| -2147483648 39 98 31 40 52 40 49 40 53 55 39 98 40 58 40 49 40 52 40 53 39 99 99 4 40 52 40 53 55 39 98 5 40 49 40 39 99 2147483647 | |
| -2147483648 31 40 52 40 49 40 53 55 39 98 40 58 40 49 40 52 40 53 39 99 4 40 52 40 53 55 39 98 5 40 49 40 39 99 2147483647 | |
| Repairing: START UNKNOWN_CHAR NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME UNKNOWN_CHAR END | |
| Sampling timeout expired after (2984260, 308) (total, valid) samples (176 samples/ms, first valid sample: 10009ms), ground truth repair was 3 edits: | |
| START UNKNOWN_CHAR NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME UNKNOWN_CHAR END | |
| START STRING NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME END | |
| -2147483648 97 40 39 40 39 40 39 40 39 40 39 40 39 40 39 40 97 2147483647 | |
| -2147483648 1 39 40 39 40 39 40 39 40 39 40 39 40 39 40 2147483647 | |
| Repairing: START 'import' NAME NEWLINE NAME '(' NAME '.' NAME '(' STRING ')' END | |
| Found length-1 fix in 3ms after 202 total and 1 valid samples (50 samples/ms, first valid sample: 3ms) | |
| Average time to find human fix: ~671ms (463 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~65902 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~213 | |
| Repairing: START NAME '=' NUMBER NUMBER NAME NEWLINE NAME '=' NAME '&' NAME NEWLINE END | |
| Found length-2 fix in 1634ms after 324149 total and 236 valid samples (198 samples/ms, first valid sample: 744ms) | |
| Average time to find human fix: ~673ms (464 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~66458 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~213 | |
| Repairing: START '>' NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME END | |
| Found length-1 fix in 98ms after 5503 total and 10 valid samples (55 samples/ms, first valid sample: 91ms) | |
| Average time to find human fix: ~672ms (465 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~66327 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~212 | |
| Repairing: START '[' '{' STRING ':' STRING STRING ':' STRING '}' ',' '{' STRING ':' STRING STRING ':' STRING '}' ']' END | |
| Found length-2 fix in 8ms after 76 total and 1 valid samples (8 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~670ms (466 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~66185 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~212 | |
| Repairing: START NAME '=' '(' STRING '%' STRING '.' NAME '(' STRING '*' NAME '(' NAME ')' UNKNOWN_CHAR ')' ')' NEWLINE NAME '.' NAME '(' NAME ',' NAME ',' NAME '[' NUMBER ']' ')' END | |
| Found length-1 fix in 811ms after 63733 total and 9 valid samples (78 samples/ms, first valid sample: 521ms) | |
| Average time to find human fix: ~671ms (467 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~66180 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~211 | |
| Repairing: START NAME '.' NAME '==' '[' STRING ']' NEWLINE NAME '.' NAME '.' NAME '(' '[' '[' STRING ']' ')' NAME '.' NAME '.' NAME '(' '[' STRING ']' ')' END | |
| Found length-2 fix in 55ms after 1212 total and 1 valid samples (21 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~669ms (468 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~66041 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~211 | |
| Repairing: START NAME NEWLINE NAME '/' NAME NAME NEWLINE NAME '.' NAME NEWLINE NAME '.' NAME NEWLINE NAME '.' NAME NEWLINE NAME '.' NAME END | |
| Found length-1 fix in 357ms after 22841 total and 123 valid samples (63 samples/ms, first valid sample: 285ms) | |
| Average time to find human fix: ~669ms (469 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~65949 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~211 | |
| Repairing: START '*' NAME '*' '=' STRING END | |
| Found length-1 fix in 544ms after 155534 total and 151 valid samples (285 samples/ms, first valid sample: 301ms) | |
| Average time to find human fix: ~668ms (470 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~66140 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~211 | |
| Repairing: START NAME '=' NAME '.' NAME '(' ')' NEWLINE NAME '.' NAME '(' STRING ')' NEWLINE NAME NAME NAME END | |
| Found length-2 fix in 82ms after 2236 total and 13 valid samples (26 samples/ms, first valid sample: 72ms) | |
| Average time to find human fix: ~667ms (471 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~66004 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~210 | |
| Repairing: START '{' STRING ':' NUMBER '}' NEWLINE '...' NEWLINE NAME ':' NAME STRING 'is' 'not' NAME END | |
| Found length-1 fix in 242ms after 21380 total and 36 valid samples (87 samples/ms, first valid sample: 162ms) | |
| Average time to find human fix: ~666ms (472 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~65909 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~210 | |
| Repairing: START UNKNOWN_CHAR NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '.' NAME '(' NUMBER ')' NAME '(' NAME ')' '.' NAME '(' NAME ')' '.' NAME '(' ')' '.' NAME '(' ')' UNKNOWN_CHAR END | |
| Found length-3 fix in 201ms after 53 total and 1 valid samples (0 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~665ms (473 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~65770 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~209 | |
| Repairing: START '{' STRING ':' 'None' ',' STRING ':' 'None' STRING ':' STRING ',' STRING ':' 'None' '}' END | |
| Found length-1 fix in 470ms after 66416 total and 151 valid samples (141 samples/ms, first valid sample: 168ms) | |
| Average time to find human fix: ~665ms (474 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~65772 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~209 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ']' NEWLINE NAME '=' '[' STRING ',' NAME UNKNOWN_CHAR ']' NEWLINE NAME '==' '(' STRING ',' STRING ')' NEWLINE NAME '==' '(' STRING ',' STRING ')' END | |
| Found length-1 fix in 450ms after 29964 total and 17 valid samples (66 samples/ms, first valid sample: 346ms) | |
| Average time to find human fix: ~664ms (475 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~65696 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~209 | |
| Repairing: START 'from' NAME '.' NAME 'import' NAME NEWLINE NAME '=' NAME '(' STRING ',' UNKNOWN_CHAR '/' NAME '/' NAME '/' NAME ')' '.' NAME '(' ')' END | |
| Found length-1 fix in 532ms after 32227 total and 4 valid samples (60 samples/ms, first valid sample: 469ms) | |
| Average time to find human fix: ~664ms (476 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~65626 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~209 | |
| Repairing: START '%' NAME NAME NEWLINE NAME '=' NAME '.' NAME '(' '[' STRING ']' ')' '[' STRING ']' NEWLINE NAME '.' NAME '(' ')' '.' NAME '(' NAME '=' STRING ',' NAME '=' NUMBER ')' END | |
| Found length-2 fix in 511ms after 29248 total and 8 valid samples (57 samples/ms, first valid sample: 422ms) | |
| Average time to find human fix: ~664ms (477 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~65550 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~208 | |
| Invalid Python: 4 40 52 40 53 55 39 98 13 40 49 40 76 1 55 39 98 50 39 99 15 55 39 98 50 39 99 39 99 | |
| Invalid Python: 1 40 1 40 1 1 40 2 1 40 1 40 1 40 1 40 2 1 40 2 1 1 40 2 1 40 2 40 2 | |
| Invalid Python: START 'def' NAME '(' NAME ')' ':' NEWLINE 98 'if' NAME '.' NAME '==' STRING ':' NEWLINE 98 '...' NEWLINE 99 'else' ':' NEWLINE 98 '...' NEWLINE 99 NEWLINE 99 END | |
| Repairing: START NAME '.' NAME '(' NAME ':' '//' NAME '.' NAME '.' NAME ')' NEWLINE NAME '.' NAME '.' NAME '(' STRING ')' END | |
| Found length-1 fix in 282ms after 8320 total and 5 valid samples (29 samples/ms, first valid sample: 246ms) | |
| Average time to find human fix: ~663ms (478 trials, 66 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~65430 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~208 | |
| Repairing: START NAME '.' NAME '(' STRING END | |
| Sampling timeout expired after (9347801, 55647) (total, valid) samples (204 samples/ms, first valid sample: 10000ms), ground truth repair was 2 edits: | |
| START NAME '.' NAME '(' STRING END | |
| START NAME '.' NAME '(' STRING ',' ')' END | |
| -2147483648 40 49 40 52 1 2147483647 | |
| -2147483648 40 49 40 52 1 54 53 2147483647 | |
| Repairing: START 'for' NAME 'in' NAME '(' NAME ')' NEWLINE 98 'for' NAME 'in' NAME '(' NAME ')' NEWLINE NAME '=' '(' NAME '[' NAME ']' '[' NAME ']' '>>' NUMBER ')' '&' NUMBER NEWLINE 99 END | |
| Found length-2 fix in 100ms after 5800 total and 1 valid samples (57 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~662ms (479 trials, 67 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~65305 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~207 | |
| Repairing: START '[' NUMBER NUMBER NUMBER ']' END | |
| Found length-2 fix in 0ms after 0 total and 1 valid samples (0 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~660ms (480 trials, 67 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~65169 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~207 | |
| Repairing: START UNKNOWN_CHAR NAME '=' NAME '(' '[' '[' NAME '(' '[' NUMBER ']' ')' ']' ',' '[' NAME '(' '[' ']' ')' ']' ',' '[' NAME '(' '[' NUMBER ']' ')' ']' ']' ',' NAME '=' NAME ')' UNKNOWN_CHAR END | |
| Found length-2 fix in 20ms after 272 total and 1 valid samples (12 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~659ms (481 trials, 67 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~65034 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~206 | |
| Repairing: START NAME '[' NAME UNKNOWN_CHAR ']' '=' NAME '.' NAME '(' 'lambda' NAME ':' '[' NAME 'for' NAME 'in' NAME ']' ',' NAME '=' NUMBER ')' END | |
| Found length-1 fix in 69ms after 264 total and 1 valid samples (3 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~658ms (482 trials, 67 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~64900 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~206 | |
| Repairing: START 'class' NAME ':' NEWLINE 'def' NAME '(' NAME ')' ':' NEWLINE 98 NAME '.' NAME '=' '[' ']' NEWLINE 'return' NEWLINE 99 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 'return' NAME '*' NAME NEWLINE 99 END | |
| Found length-2 fix in 244ms after 2319 total and 7 valid samples (9 samples/ms, first valid sample: 234ms) | |
| Average time to find human fix: ~657ms (483 trials, 67 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~64770 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~206 | |
| Repairing: START STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER ',' NAME ':' STRING ',' NEWLINE STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER ',' NAME ':' STRING ',' END | |
| Found length-3 fix in 2234ms after 151886 total and 20 valid samples (67 samples/ms, first valid sample: 1531ms) | |
| Average time to find human fix: ~660ms (484 trials, 67 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~64950 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~205 | |
| Repairing: START NAME '=' '{' STRING ':' STRING ',' STRING ':' 'False' UNKNOWN_CHAR ',' STRING ':' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING '}' '}' END | |
| Found length-1 fix in 4474ms after 464410 total and 54 valid samples (103 samples/ms, first valid sample: 1897ms) | |
| Average time to find human fix: ~668ms (485 trials, 67 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~65774 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~205 | |
| Repairing: START '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' '[' '{' STRING ':' '[' STRING ']' '}' ',' STRING ':' STRING '}' END | |
| Found length-1 fix in 2446ms after 243146 total and 214 valid samples (99 samples/ms, first valid sample: 898ms) | |
| Average time to find human fix: ~672ms (486 trials, 67 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~66139 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~205 | |
| Repairing: START STRING UNKNOWN_CHAR NEWLINE 'with' NAME '(' STRING ',' NAME '(' NAME '=' STRING ')' ')' ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' ')' NEWLINE 99 NAME '(' STRING '==' NAME ')' END | |
| Found length-1 fix in 253ms after 14910 total and 5 valid samples (58 samples/ms, first valid sample: 195ms) | |
| Average time to find human fix: ~671ms (487 trials, 67 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~66034 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~204 | |
| Repairing: START NAME NEWLINE NAME '-' NAME NAME END | |
| Found length-1 fix in 40ms after 235 total and 2 valid samples (5 samples/ms, first valid sample: 39ms) | |
| Average time to find human fix: ~670ms (488 trials, 67 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~65899 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~204 | |
| Repairing: START 'def' NAME '(' NUMBER ',' STRING ')' ':' NEWLINE 98 'return' NAME NEWLINE 99 END | |
| Sampling timeout expired after (4396401, 981) (total, valid) samples (150 samples/ms, first valid sample: 10004ms), ground truth repair was 3 edits: | |
| START 'def' NAME '(' NUMBER ',' STRING ')' ':' NEWLINE 98 'return' NAME NEWLINE 99 END | |
| START 'def' NAME '(' NAME ',' NAME '=' STRING ')' ':' NEWLINE 98 'return' NAME NEWLINE 99 END | |
| -2147483648 4 40 52 2 54 1 53 55 39 98 5 40 39 99 2147483647 | |
| -2147483648 4 40 52 40 54 40 58 1 53 55 39 98 5 40 39 99 2147483647 | |
| Repairing: START '@' NAME NEWLINE 98 'class' NAME '(' NAME ')' ':' NEWLINE 98 '@' NAME NEWLINE 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 NAME '.' NAME NEWLINE 99 99 99 END | |
| Found length-2 fix in 226ms after 9814 total and 1 valid samples (43 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~669ms (489 trials, 68 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~65784 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~204 | |
| Repairing: START NAME '=' '[' NAME '(' NAME ')' 'if' NAME '(' NAME ')' '%' NUMBER '==' NUMBER 'for' NAME 'in' NAME ']' END | |
| Found length-2 fix in 3743ms after 405009 total and 15 valid samples (108 samples/ms, first valid sample: 1876ms) | |
| Average time to find human fix: ~675ms (490 trials, 68 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~66477 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~203 | |
| Repairing: START NAME '=' NAME '.' NAME '(' '[' NUMBER ',' NUMBER NUMBER ',' NUMBER ']' ')' END | |
| Found length-1 fix in 34ms after 2187 total and 13 valid samples (62 samples/ms, first valid sample: 23ms) | |
| Average time to find human fix: ~674ms (491 trials, 68 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~66346 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~203 | |
| Repairing: START NAME '.' NAME '(' STRING END | |
| Found length-2 fix in 6322ms after 1289989 total and 7728 valid samples (204 samples/ms, first valid sample: 1616ms) | |
| Average time to find human fix: ~685ms (492 trials, 68 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~68833 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~218 | |
| Repairing: START NUMBER NAME '[' STRING ']' '=' NAME '.' NAME '(' NAME '[' STRING ']' ')' END | |
| Found length-1 fix in 490ms after 51361 total and 638 valid samples (104 samples/ms, first valid sample: 295ms) | |
| Average time to find human fix: ~685ms (493 trials, 68 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~68797 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~219 | |
| Repairing: START NAME '=' '[' '(' STRING ',' NUMBER ')' ',' '(' STRING ',' NUMBER ')' ',' '(' NAME UNKNOWN_CHAR ',' NUMBER ')' ']' END | |
| Found length-1 fix in 186ms after 2012 total and 3 valid samples (10 samples/ms, first valid sample: 176ms) | |
| Average time to find human fix: ~684ms (494 trials, 68 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~68662 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~219 | |
| Repairing: START NAME '=' NAME '.' NAME '(' NAME '.' NAME ')' NEWLINE NAME '(' NAME ')' NEWLINE NAME '(' NAME '(' NAME ')' ')' NAME ',' NAME 'is' ':' END | |
| Sampling timeout expired after (2014366, 11) (total, valid) samples (104 samples/ms, first valid sample: 10603ms), ground truth repair was 3 edits: | |
| START NAME '=' NAME '.' NAME '(' NAME '.' NAME ')' NEWLINE NAME '(' NAME ')' NEWLINE NAME '(' NAME '(' NAME ')' ')' NAME ',' NAME 'is' ':' END | |
| START NAME '=' NAME '.' NAME '(' NAME '.' NAME ')' NEWLINE NAME '(' NAME ')' NEWLINE NAME '(' NAME '(' NAME ')' ')' ',' NAME END | |
| -2147483648 40 58 40 49 40 52 40 49 40 53 39 40 52 40 53 39 40 52 40 52 40 53 53 40 54 40 27 55 2147483647 | |
| -2147483648 40 58 40 49 40 52 40 49 40 53 39 40 52 40 53 39 40 52 40 52 40 53 53 54 40 2147483647 | |
| Repairing: START NAME '[' STRING ']' '=' '(' NAME '[' STRING ']' ')' '.' NAME '(' NAME ')' '.' END | |
| Found length-1 fix in 76ms after 2599 total and 14 valid samples (33 samples/ms, first valid sample: 64ms) | |
| Average time to find human fix: ~683ms (495 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~339ms | |
| Average samples before matched: ~68529 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~218 | |
| Repairing: START UNKNOWN_CHAR NAME '-' '-' NAME NEWLINE UNKNOWN_CHAR NAME '-' '-' NAME END | |
| Found length-2 fix in 43ms after 496 total and 1 valid samples (11 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~681ms (496 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~68391 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~218 | |
| Repairing: START '{' NAME ':' '{' NAME ':' STRING ',' NAME ':' STRING '}' NAME ':' '{' NAME ':' STRING ',' NAME ':' STRING '}' '}' END | |
| Found length-1 fix in 432ms after 30433 total and 9 valid samples (70 samples/ms, first valid sample: 220ms) | |
| Average time to find human fix: ~681ms (497 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~68315 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~217 | |
| Repairing: START NAME '=' NUMBER NEWLINE NAME '(' NAME '.' NAME '(' NUMBER ',' NUMBER ')' END | |
| Found length-1 fix in 4ms after 291 total and 3 valid samples (58 samples/ms, first valid sample: 3ms) | |
| Average time to find human fix: ~679ms (498 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~68178 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~217 | |
| Repairing: START NAME '=' UNKNOWN_CHAR NAME '.' NAME '.' NAME END | |
| Found length-2 fix in 26ms after 197 total and 2 valid samples (7 samples/ms, first valid sample: 26ms) | |
| Average time to find human fix: ~678ms (499 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~68042 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~216 | |
| Repairing: START 'from' NAME 'import' NAME NEWLINE 'class' NAME ':' NEWLINE 'def' NAME '(' NAME ')' ':' NEWLINE 98 NAME '.' NAME '=' NAME '(' ')' '.' NAME '(' 'lambda' NAME ':' NAME '*' NUMBER ')' NEWLINE 99 END | |
| Found length-2 fix in 53ms after 738 total and 1 valid samples (13 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~677ms (500 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~67908 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~216 | |
| Repairing: START 'if' NAME '.' NAME 'or' NAME '.' NAME '>=' NAME ':' END | |
| Found length-1 fix in 247ms after 18723 total and 11 valid samples (75 samples/ms, first valid sample: 194ms) | |
| Average time to find human fix: ~676ms (501 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~67809 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~216 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME NAME NEWLINE NUMBER END | |
| Found length-1 fix in 4697ms after 777685 total and 14438 valid samples (165 samples/ms, first valid sample: 1932ms) | |
| Average time to find human fix: ~684ms (502 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~339ms | |
| Average samples before matched: ~69224 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~244 | |
| Repairing: START NAME '=' STRING NEWLINE NAME '=' NAME '.' NAME '(' NAME '=' STRING ')' NEWLINE NAME '(' NAME '.' NAME '(' STRING ')' ')' NEWLINE NAME '(' STRING '.' NAME '(' NAME '=' STRING ')' ')' UNKNOWN_CHAR END | |
| Found length-1 fix in 295ms after 4042 total and 9 valid samples (13 samples/ms, first valid sample: 280ms) | |
| Average time to find human fix: ~683ms (503 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~339ms | |
| Average samples before matched: ~69094 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~243 | |
| Repairing: START NAME '=' '{' UNKNOWN_CHAR NAME UNKNOWN_CHAR ':' '[' NUMBER ',' NUMBER ',' NAME ']' '}' END | |
| Found length-3 fix in 625ms after 72893 total and 1 valid samples (116 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~683ms (504 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~69102 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~243 | |
| Repairing: START '[' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ']' END | |
| Found length-2 fix in 93ms after 2148 total and 1 valid samples (22 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~682ms (505 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~68969 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~242 | |
| Repairing: START 'class' NAME '(' NAME '.' NAME ')' ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' ')' NEWLINE '...' '.' NEWLINE 99 END | |
| Found length-1 fix in 379ms after 24471 total and 24 valid samples (64 samples/ms, first valid sample: 252ms) | |
| Average time to find human fix: ~681ms (506 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~68881 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~242 | |
| Repairing: START '[' '(' NUMBER ',' STRING ')' ',' '(' NUMBER ',' STRING ')' ',' '(' NUMBER ',' STRING ')' ']' UNKNOWN_CHAR END | |
| Found length-1 fix in 37ms after 1079 total and 10 valid samples (28 samples/ms, first valid sample: 33ms) | |
| Average time to find human fix: ~680ms (507 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~68747 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~242 | |
| Invalid Python: 40 52 57 40 54 57 40 54 57 40 53 39 98 39 99 | |
| Invalid Python: 40 1 1 40 1 1 40 1 1 40 1 40 2 40 2 | |
| Invalid Python: START NAME '(' '**' NAME ',' '**' NAME ',' '**' NAME ')' NEWLINE 98 NEWLINE 99 END | |
| Repairing: START NAME '[' STRING ']' '=' NAME '[' STRING ']' '+' STRING '/' END | |
| Found length-1 fix in 955ms after 127323 total and 27 valid samples (133 samples/ms, first valid sample: 363ms) | |
| Average time to find human fix: ~681ms (508 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~68863 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~241 | |
| Repairing: START NAME '.' NAME '(' NUMBER ')' NAME NAME ',' END | |
| Found length-3 fix in 1073ms after 172484 total and 4464 valid samples (160 samples/ms, first valid sample: 393ms) | |
| Average time to find human fix: ~681ms (509 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~69066 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START NAME NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING STRING ']' END | |
| Found length-1 fix in 194ms after 12492 total and 129 valid samples (64 samples/ms, first valid sample: 140ms) | |
| Average time to find human fix: ~680ms (510 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~68955 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START 'for' NAME 'in' NAME ':' NEWLINE 98 'if' NAME '%' NUMBER '==' NUMBER ':' NEWLINE 98 NAME '.' NAME '(' NAME ')' NEWLINE 99 99 NAME NAME END | |
| Found length-2 fix in 176ms after 9839 total and 67 valid samples (55 samples/ms, first valid sample: 135ms) | |
| Average time to find human fix: ~679ms (511 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~68840 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START 'class' NAME ':' NEWLINE 'def' NAME '(' NAME ',' NAME '=' '[' ']' ')' ':' NEWLINE 98 NAME '.' NAME '=' NAME NEWLINE 99 'def' NAME '(' NAME ')' ':' NEWLINE 98 'return' NAME '.' NAME NEWLINE 99 END | |
| Found length-2 fix in 424ms after 2944 total and 2 valid samples (6 samples/ms, first valid sample: 420ms) | |
| Average time to find human fix: ~679ms (512 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~68711 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START NAME '=' NAME '(' NAME '=' STRING ',' NAME '=' STRING ',' NAME '=' STRING UNKNOWN_CHAR ',' NAME '=' STRING ',' NAME '=' STRING ')' NEWLINE NAME '.' NAME '(' ')' END | |
| Found length-1 fix in 181ms after 92 total and 1 valid samples (0 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~678ms (513 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~68577 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~248 | |
| Repairing: START NAME NEWLINE NAME NEWLINE NAME NEWLINE NAME NEWLINE '...' '.' END | |
| Found length-1 fix in 4291ms after 564718 total and 59 valid samples (131 samples/ms, first valid sample: 1414ms) | |
| Average time to find human fix: ~685ms (514 trials, 69 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~69542 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START 'import' NAME NEWLINE NAME '=' NAME '.' NAME '.' NAME '(' STRING ',' STRING ')' NEWLINE NAME '=' NAME '.' NAME '.' NAME '(' STRING ':' STRING NAME UNKNOWN_CHAR ')' NEWLINE NAME '.' NAME '(' NAME ',' NAME ')' END | |
| Sampling timeout expired after (1446460, 2) (total, valid) samples (74 samples/ms, first valid sample: 10197ms), ground truth repair was 3 edits: | |
| START 'import' NAME NEWLINE NAME '=' NAME '.' NAME '.' NAME '(' STRING ',' STRING ')' NEWLINE NAME '=' NAME '.' NAME '.' NAME '(' STRING ':' STRING NAME UNKNOWN_CHAR ')' NEWLINE NAME '.' NAME '(' NAME ',' NAME ')' END | |
| START 'import' NAME NEWLINE NAME '=' NAME '.' NAME '.' NAME '(' STRING ',' STRING ')' NEWLINE NAME '=' NAME '.' NAME '.' NAME '(' STRING ',' STRING STRING ')' NEWLINE NAME '.' NAME '(' NAME ',' NAME ')' END | |
| -2147483648 8 40 39 40 58 40 49 40 49 40 52 1 54 1 53 39 40 58 40 49 40 49 40 52 1 55 1 40 97 53 39 40 49 40 52 40 54 40 53 2147483647 | |
| -2147483648 8 40 39 40 58 40 49 40 49 40 52 1 54 1 53 39 40 58 40 49 40 49 40 52 1 54 1 1 53 39 40 49 40 52 40 54 40 53 2147483647 | |
| Repairing: START NAME '=' '[' NAME 'as' NAME 'in' NAME 'if' NAME '[' NUMBER ']' '==' NUMBER 'and' NAME '[' NUMBER ']' '==' STRING ']' END | |
| Found length-1 fix in 435ms after 39779 total and 9 valid samples (91 samples/ms, first valid sample: 268ms) | |
| Average time to find human fix: ~685ms (515 trials, 70 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~69485 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START '>' NAME '=' NAME '(' STRING ',' STRING ',' NAME '=' STRING ')' NEWLINE '>' NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE '>' NAME '(' NAME ')' END | |
| Found length-3 fix in 8511ms after 927992 total and 1 valid samples (109 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~700ms (516 trials, 70 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71148 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START NAME '=' '{' NAME ':' '[' NUMBER ',' NUMBER ']' NAME ':' '[' NUMBER ',' NUMBER ']' NAME ':' '[' NUMBER ',' NUMBER ']' '}' END | |
| Found length-2 fix in 350ms after 7584 total and 1 valid samples (21 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~699ms (517 trials, 70 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71025 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~246 | |
| Repairing: START NEWLINE 'try' ':' NEWLINE 98 'if' NAME '[' UNKNOWN_CHAR NAME ']' '==' STRING ':' NEWLINE 98 NAME NEWLINE 99 99 'except' ':' NEWLINE 98 NAME '(' STRING ')' NEWLINE 99 END | |
| Found length-2 fix in 90ms after 493 total and 1 valid samples (5 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~698ms (518 trials, 70 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70889 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~246 | |
| Repairing: START NAME NAME ':' NEWLINE '[' STRING ',' STRING ',' STRING ',' STRING ']' END | |
| Found length-2 fix in 22ms after 1347 total and 6 valid samples (58 samples/ms, first valid sample: 17ms) | |
| Average time to find human fix: ~697ms (519 trials, 70 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70755 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START 'from' NAME '.' NAME 'import' NAME ',' NAME UNKNOWN_CHAR END | |
| Found length-1 fix in 15ms after 851 total and 18 valid samples (53 samples/ms, first valid sample: 13ms) | |
| Average time to find human fix: ~695ms (520 trials, 70 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~70621 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START '[' '[' '[' NAME ']' ',' '[' 'is' ']' ']' ',' '[' '[' NAME ']' ',' '[' NAME ']' ']' ',' '[' '[' NAME ']' ',' '[' NAME ']' ']' ']' END | |
| Found length-1 fix in 674ms after 33269 total and 5 valid samples (49 samples/ms, first valid sample: 566ms) | |
| Average time to find human fix: ~695ms (521 trials, 70 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70549 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~244 | |
| Repairing: START NAME '=' '[' STRING ',' STRING UNKNOWN_CHAR NAME ']' NEWLINE NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING ']' '.' END | |
| Sampling timeout expired after (2267808, 46) (total, valid) samples (96 samples/ms, first valid sample: 8983ms), ground truth repair was 3 edits: | |
| START NAME '=' '[' STRING ',' STRING UNKNOWN_CHAR NAME ']' NEWLINE NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING ']' '.' END | |
| START NAME '=' '[' STRING ',' STRING STRING ']' NEWLINE NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING ']' END | |
| -2147483648 40 58 59 1 54 1 97 40 60 39 40 58 59 1 54 1 54 1 54 1 60 49 2147483647 | |
| -2147483648 40 58 59 1 54 1 1 60 39 40 58 59 1 54 1 54 1 54 1 60 2147483647 | |
| Repairing: START NAME '=' '[' ']' NEWLINE 98 NAME '=' STRING '.' NAME '(' NAME ',' NAME ',' NAME ')' NEWLINE NAME '.' NAME '(' NAME ')' NEWLINE 99 'return' NAME END | |
| Found length-2 fix in 3054ms after 274052 total and 1 valid samples (89 samples/ms, first valid sample: 2993ms) | |
| Average time to find human fix: ~700ms (522 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~70939 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~244 | |
| Repairing: START NAME '=' '[' '[' STRING ',' NUMBER ']' ',' '[' STRING ',' NUMBER ']' ',' '[' STRING ',' NUMBER ']' ',' '[' STRING ',' NUMBER ']' ',' '[' STRING NAME ',' NUMBER ']' ']' END | |
| Found length-1 fix in 327ms after 12217 total and 41 valid samples (37 samples/ms, first valid sample: 258ms) | |
| Average time to find human fix: ~699ms (523 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~70827 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~243 | |
| Repairing: START 'class' NAME '(' NAME '.' NAME ')' ':' NEWLINE 'def' NAME '(' NAME ')' ':' NEWLINE 98 'return' STRING NEWLINE 99 END | |
| Found length-3 fix in 81ms after 505 total and 4 valid samples (6 samples/ms, first valid sample: 79ms) | |
| Average time to find human fix: ~698ms (524 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~339ms | |
| Average samples before matched: ~70692 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~243 | |
| Repairing: START NUMBER NAME NEWLINE NUMBER NAME NEWLINE '...' END | |
| Found length-2 fix in 47ms after 9440 total and 50 valid samples (196 samples/ms, first valid sample: 27ms) | |
| Average time to find human fix: ~697ms (525 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~339ms | |
| Average samples before matched: ~70576 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~243 | |
| Repairing: START NAME '=' '{' STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER '}' '.' END | |
| Found length-1 fix in 150ms after 7065 total and 8 valid samples (46 samples/ms, first valid sample: 122ms) | |
| Average time to find human fix: ~696ms (526 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~70455 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~242 | |
| Repairing: START 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' ')' NEWLINE NAME '=' NAME '.' NAME '(' 'None' ',' '-' NUMBER STRING ')' NEWLINE NAME '.' NAME '(' ')' NEWLINE NAME '.' NAME '(' ')' END | |
| Found length-1 fix in 1135ms after 81233 total and 19 valid samples (71 samples/ms, first valid sample: 886ms) | |
| Average time to find human fix: ~696ms (527 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~339ms | |
| Average samples before matched: ~70475 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~242 | |
| Repairing: START NAME '=' NAME '.' NAME '(' NAME ',' NAME '=' STRING ',' NAME '=' 'lambda' ':' NAME '(' NAME ',' NAME ')' '.' NAME '(' ')' END | |
| Found length-1 fix in 91ms after 331 total and 6 valid samples (3 samples/ms, first valid sample: 90ms) | |
| Average time to find human fix: ~695ms (528 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~339ms | |
| Average samples before matched: ~70343 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~241 | |
| Repairing: START 'for' NAME NAME '.' NAME '(' ')' ':' NEWLINE 98 'if' NAME '.' NAME '==' STRING ':' NEWLINE 98 NAME '=' NAME NEWLINE 99 99 END | |
| Found length-1 fix in 182ms after 18697 total and 17 valid samples (102 samples/ms, first valid sample: 110ms) | |
| Average time to find human fix: ~694ms (529 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~70245 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~241 | |
| Repairing: START NAME '=' NAME '.' NAME '(' NAME '.' NAME '.' NAME '(' STRING ')' ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME '.' NAME '.' NAME '(' STRING ')' END | |
| Found length-2 fix in 258ms after 648 total and 11 valid samples (2 samples/ms, first valid sample: 255ms) | |
| Average time to find human fix: ~693ms (530 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~70114 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~240 | |
| Repairing: START '[' STRING ',' STRING ',' STRING ',' STRING '...' ']' END | |
| Found length-1 fix in 325ms after 45701 total and 11 valid samples (140 samples/ms, first valid sample: 171ms) | |
| Average time to find human fix: ~693ms (531 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~70068 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~240 | |
| Repairing: START NAME '=' '{' STRING ':' STRING STRING ':' '{' STRING ':' STRING ',' STRING ':' STRING '}' ',' STRING ':' STRING STRING ':' NUMBER '}' END | |
| Found length-2 fix in 23ms after 363 total and 1 valid samples (15 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~691ms (532 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~69937 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~240 | |
| Repairing: START NAME '=' '[' NAME NAME NAME ']' END | |
| Found length-2 fix in 54ms after 2366 total and 30 valid samples (43 samples/ms, first valid sample: 42ms) | |
| Average time to find human fix: ~690ms (533 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~69810 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~239 | |
| Repairing: START NAME NAME NEWLINE '[' STRING ',' STRING ',' STRING ',' STRING ']' END | |
| Found length-2 fix in 176ms after 12168 total and 373 valid samples (68 samples/ms, first valid sample: 133ms) | |
| Average time to find human fix: ~689ms (534 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~69702 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~239 | |
| Repairing: START 'from' NAME 'import' NEWLINE 'return' NAME '(' NAME '(' STRING ')' ',' NAME '=' STRING ')' END | |
| Found length-1 fix in 194ms after 9118 total and 3 valid samples (46 samples/ms, first valid sample: 173ms) | |
| Average time to find human fix: ~688ms (535 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~69589 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~239 | |
| Repairing: START '[' NAME '(' NAME ')' 'for' NAME 'in' '(' '(' NAME '(' NAME '*' NUMBER ')' '.' NAME '(' NAME '[' ':' NAME ']' ')' ')' ']' END | |
| Found length-1 fix in 606ms after 27853 total and 390 valid samples (45 samples/ms, first valid sample: 381ms) | |
| Average time to find human fix: ~688ms (536 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~69511 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~239 | |
| Repairing: START '(' NAME '.' NAME ',' NUMBER ')' '==' '(' NAME '.' NAME ',' NUMBER ')' '.' END | |
| Found length-1 fix in 13ms after 330 total and 4 valid samples (23 samples/ms, first valid sample: 11ms) | |
| Average time to find human fix: ~687ms (537 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~69382 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~239 | |
| Repairing: START UNKNOWN_CHAR NAME '=' NAME '.' NAME '(' NAME '=' STRING ')' END | |
| Found length-1 fix in 11ms after 41 total and 1 valid samples (3 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~686ms (538 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~69253 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~238 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' UNKNOWN_CHAR NAME ']' NEWLINE NAME '=' NAME '(' NAME ')' NEWLINE NAME '(' NAME ')' END | |
| Found length-2 fix in 212ms after 5372 total and 2 valid samples (25 samples/ms, first valid sample: 194ms) | |
| Average time to find human fix: ~685ms (539 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~69135 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~238 | |
| Repairing: START NAME '=' NUMBER NEWLINE 'for' NAME 'in' NAME ':' NEWLINE 98 'if' NAME '%' NUMBER '==' NUMBER NEWLINE NAME '.' NAME '(' NAME ')' NEWLINE NAME '+=' NUMBER NEWLINE 99 END | |
| Found length-1 fix in 1073ms after 84130 total and 10 valid samples (78 samples/ms, first valid sample: 667ms) | |
| Average time to find human fix: ~686ms (540 trials, 71 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~69162 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~237 | |
| Repairing: START 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME NAME END | |
| Sampling timeout expired after (3757903, 17866) (total, valid) samples (167 samples/ms, first valid sample: 10001ms), ground truth repair was 2 edits: | |
| START 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME NAME END | |
| START 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '(' NAME ')' END | |
| -2147483648 8 40 39 40 58 40 49 40 52 1 53 39 40 40 2147483647 | |
| -2147483648 8 40 39 40 58 40 49 40 52 1 53 39 40 52 40 53 2147483647 | |
| Repairing: START NAME '.' NAME '=' NEWLINE 'import' NAME END | |
| Found length-1 fix in 64ms after 14511 total and 29 valid samples (223 samples/ms, first valid sample: 34ms) | |
| Average time to find human fix: ~684ms (541 trials, 72 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~69061 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~237 | |
| Repairing: START NAME '=' NAME '(' STRING END | |
| Found length-1 fix in 535ms after 76084 total and 358 valid samples (141 samples/ms, first valid sample: 200ms) | |
| Average time to find human fix: ~684ms (542 trials, 72 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~69074 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~237 | |
| Repairing: START '[' STRING ',' STRING ',' STRING '...' ']' '-' NAME ',' NUMBER NAME END | |
| Sampling timeout expired after (4863863, 2278) (total, valid) samples (182 samples/ms, first valid sample: 10001ms), ground truth repair was 3 edits: | |
| START '[' STRING ',' STRING ',' STRING '...' ']' '-' NAME ',' NUMBER NAME END | |
| START '[' STRING ',' STRING ',' STRING '-' NAME ',' NUMBER ']' END | |
| -2147483648 59 1 54 1 54 1 50 60 67 40 54 2 40 2147483647 | |
| -2147483648 59 1 54 1 54 1 67 40 54 2 60 2147483647 | |
| Repairing: START NAME '=' '[' NUMBER ':' '[' NUMBER ',' NUMBER ',' NUMBER ']' ',' NUMBER ':' '[' NUMBER ',' NUMBER ']' ',' NUMBER ':' '[' NUMBER ',' NUMBER ']' ',' ']' END | |
| Found length-2 fix in 689ms after 34850 total and 24 valid samples (50 samples/ms, first valid sample: 531ms) | |
| Average time to find human fix: ~684ms (543 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~69011 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~237 | |
| Repairing: START NAME '=' NAME '|' NAME '|' NAME UNKNOWN_CHAR '|' NAME UNKNOWN_CHAR '|' NAME NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' END | |
| Found length-2 fix in 520ms after 56565 total and 1 valid samples (108 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~684ms (544 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~68988 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~236 | |
| Repairing: START 'import' NAME NEWLINE NAME '(' UNKNOWN_CHAR NAME ')' END | |
| Found length-2 fix in 8ms after 41 total and 1 valid samples (4 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~683ms (545 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~68862 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~236 | |
| Repairing: START NAME '=' '[' NAME 'as' NAME 'in' NAME 'if' NAME ']' END | |
| Found length-1 fix in 210ms after 17233 total and 1 valid samples (81 samples/ms, first valid sample: 169ms) | |
| Average time to find human fix: ~682ms (546 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~68767 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~236 | |
| Repairing: START '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING NAME UNKNOWN_CHAR ']' END | |
| Found length-2 fix in 44ms after 2189 total and 14 valid samples (48 samples/ms, first valid sample: 35ms) | |
| Average time to find human fix: ~681ms (547 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~68646 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~235 | |
| Repairing: START 'for' NAME 'in' NAME ':' NEWLINE 98 'del' '(' NAME '[' NUMBER ']' ')' NEWLINE 99 NAME '=' '[' NAME '(' NAME ')' 'for' NAME 'in' NAME '(' '*' NAME ')' ']' NEWLINE NAME NAME END | |
| Found length-1 fix in 301ms after 407 total and 2 valid samples (1 samples/ms, first valid sample: 300ms) | |
| Average time to find human fix: ~680ms (548 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~68521 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~235 | |
| Repairing: START NAME NAME '.' NAME '.' NAME END | |
| Found length-1 fix in 35ms after 1645 total and 19 valid samples (45 samples/ms, first valid sample: 29ms) | |
| Average time to find human fix: ~679ms (549 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68399 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~234 | |
| Repairing: START NAME '=' STRING '.' NAME '(' ')' NEWLINE 'def' NAME '(' NAME ')' ':' NEWLINE NAME '=' NAME '.' NAME '(' NUMBER ',' NAME '(' NAME ')' '-' NUMBER ')' NEWLINE 'return' NAME '[' NAME ']' END | |
| Found length-2 fix in 254ms after 513 total and 1 valid samples (2 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~678ms (550 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68276 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~234 | |
| Repairing: START NAME NAME 'import' '*' NEWLINE NAME '=' NAME '(' ')' NEWLINE NAME '=' NAME '(' NAME ',' NAME '=' STRING ',' NAME '=' STRING ')' END | |
| Found length-2 fix in 468ms after 23332 total and 4 valid samples (49 samples/ms, first valid sample: 428ms) | |
| Average time to find human fix: ~678ms (551 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68194 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~234 | |
| Repairing: START NAME ',' NAME ',' NAME '=' NAME '.' NAME '(' NAME NAME ')' END | |
| Found length-1 fix in 97ms after 3178 total and 207 valid samples (32 samples/ms, first valid sample: 85ms) | |
| Average time to find human fix: ~676ms (552 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68076 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~234 | |
| Repairing: START NAME '=' NEWLINE '{' STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' '[' '{' STRING ':' NUMBER STRING ':' '[' '{' STRING ':' NUMBER '}' ']' '}' ']' '}' END | |
| Found length-2 fix in 162ms after 7840 total and 12 valid samples (48 samples/ms, first valid sample: 102ms) | |
| Average time to find human fix: ~676ms (553 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~67968 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~233 | |
| Repairing: START NAME '=' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' NAME NAME '}' END | |
| Found length-1 fix in 216ms after 15382 total and 145 valid samples (70 samples/ms, first valid sample: 135ms) | |
| Average time to find human fix: ~675ms (554 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~67873 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~233 | |
| Repairing: START NAME '[' STRING ']' '=' UNKNOWN_CHAR '/' NAME END | |
| Found length-1 fix in 118ms after 10678 total and 3 valid samples (89 samples/ms, first valid sample: 108ms) | |
| Average time to find human fix: ~674ms (555 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~67770 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~233 | |
| Repairing: START NAME '(' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ']' ')' '.' NAME '(' ')' NAME 'return' '[' NUMBER ',' NUMBER ']' END | |
| Found length-2 fix in 3511ms after 449322 total and 3 valid samples (127 samples/ms, first valid sample: 2146ms) | |
| Average time to find human fix: ~679ms (556 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~68456 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~232 | |
| Repairing: START '[' NAME '.' NAME '(' NAME '[' NUMBER ']' ',' NAME ',' NAME '[' NAME ']' ')' 'if' NAME 'in' NAME '[' NUMBER ']' 'for' NAME 'in' NAME '.' NAME '(' ')' 'for' NAME 'in' NAME '.' NAME ']' END | |
| Found length-2 fix in 2760ms after 164364 total and 5 valid samples (59 samples/ms, first valid sample: 1643ms) | |
| Average time to find human fix: ~683ms (557 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~68628 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~232 | |
| Repairing: START 'for' NAME 'in' NAME '(' NAME '.' NAME '[' NUMBER ']' ')' ':' NEWLINE NAME '+=' NUMBER NEWLINE 'if' NAME '<' NUMBER ':' NEWLINE 98 'continue' NEWLINE 99 'elif' NAME '>' NUMBER ':' NEWLINE 98 'break' NEWLINE 99 END | |
| Found length-3 fix in 610ms after 26799 total and 252 valid samples (43 samples/ms, first valid sample: 481ms) | |
| Average time to find human fix: ~682ms (558 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~68553 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~232 | |
| Repairing: START NAME '=' '[' '{' '}' ',' NAME '(' '[' ']' ')' ',' '[' ']' ')' END | |
| Found length-1 fix in 32ms after 325 total and 1 valid samples (9 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~681ms (559 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~68431 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~231 | |
| Repairing: START 'from' NAME 'import' '*' NEWLINE NAME '(' STRING ')' NEWLINE '**' NEWLINE NAME '(' NUMBER ')' END | |
| Found length-2 fix in 2694ms after 546727 total and 11 valid samples (202 samples/ms, first valid sample: 1548ms) | |
| Average time to find human fix: ~685ms (560 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~69285 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~231 | |
| Repairing: START NAME '=' NAME '(' STRING ',' NAME '=' STRING ',' NAME '=' NAME '(' STRING UNKNOWN_CHAR ')' ',' ')' END | |
| Found length-1 fix in 93ms after 806 total and 2 valid samples (8 samples/ms, first valid sample: 89ms) | |
| Average time to find human fix: ~684ms (561 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~69163 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~231 | |
| Repairing: START NAME '=' '[' NAME 'as' NAME 'in' NAME 'if' NAME '[' NUMBER ']' '==' NUMBER ']' END | |
| Found length-1 fix in 200ms after 15302 total and 3 valid samples (76 samples/ms, first valid sample: 181ms) | |
| Average time to find human fix: ~683ms (562 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~69067 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~230 | |
| Repairing: START NAME '=' NUMBER NEWLINE NAME '=' NAME '(' STRING ')' NEWLINE NAME '=' NAME '.' NAME '(' ')' NEWLINE 'for' NAME 'in' NAME ':' NEWLINE 'if' NAME '==' STRING ':' NEWLINE 98 NAME '+=' NUMBER NEWLINE 99 END | |
| Found length-2 fix in 194ms after 3215 total and 3 valid samples (16 samples/ms, first valid sample: 187ms) | |
| Average time to find human fix: ~682ms (563 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~68950 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~230 | |
| Repairing: START NAME '=' '(' STRING ',' ')' NAME END | |
| Found length-1 fix in 62ms after 5450 total and 36 valid samples (86 samples/ms, first valid sample: 51ms) | |
| Average time to find human fix: ~681ms (564 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~68838 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~229 | |
| Repairing: START '{' NAME ':' '[' '[' NUMBER ',' ']' ',' '[' ']' ']' END | |
| Found length-1 fix in 57ms after 1474 total and 1 valid samples (25 samples/ms, first valid sample: 50ms) | |
| Average time to find human fix: ~680ms (565 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~68718 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~229 | |
| Repairing: START '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' '{' STRING ':' STRING ',' STRING ':' STRING '}' END | |
| Found length-1 fix in 54ms after 461 total and 11 valid samples (8 samples/ms, first valid sample: 52ms) | |
| Average time to find human fix: ~679ms (566 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~68598 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~229 | |
| Repairing: START NAME NAME '.' NAME 'import' NAME END | |
| Found length-2 fix in 8ms after 250 total and 1 valid samples (27 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~678ms (567 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~68477 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~228 | |
| Repairing: START STRING ':' '{' '}' ',' NEWLINE STRING ':' '{' STRING ':' '{' STRING ':' STRING '}' '}' END | |
| Found length-3 fix in 17ms after 1001 total and 7 valid samples (55 samples/ms, first valid sample: 14ms) | |
| Average time to find human fix: ~676ms (568 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~68358 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~228 | |
| Repairing: START NAME '=' NAME '.' NAME '.' NAME '(' ')' NEWLINE NAME '=' NAME '.' NAME NEWLINE NAME '=' NAME '.' NAME NEWLINE NAME '=' NAME ',' NAME NEWLINE NAME '=' NAME '.' NAME '.' NAME '(' NAME ')' UNKNOWN_CHAR END | |
| Found length-1 fix in 290ms after 635 total and 1 valid samples (2 samples/ms, first valid sample: 290ms) | |
| Average time to find human fix: ~676ms (569 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~68239 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~227 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '.' NAME '(' NAME ',' STRING ',' STRING ',' '[' NAME ']' END | |
| Found length-1 fix in 641ms after 40016 total and 74 valid samples (62 samples/ms, first valid sample: 421ms) | |
| Average time to find human fix: ~676ms (570 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~68190 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~227 | |
| Repairing: START '*' 'from' NAME '.' NAME 'import' NAME NEWLINE NAME '=' NAME '(' NAME ')' NEWLINE NAME '.' NAME '(' NAME ',' NAME ')' '*' END | |
| Found length-2 fix in 3418ms after 393658 total and 1 valid samples (115 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~680ms (571 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~68760 | |
| Average repair throughput / ms: ~58 | |
| Average valid repairs detected: ~227 | |
| Repairing: START '*' NAME '*' '=' STRING END | |
| Found length-1 fix in 936ms after 341971 total and 274 valid samples (364 samples/ms, first valid sample: 405ms) | |
| Average time to find human fix: ~681ms (572 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~69238 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~227 | |
| Repairing: START NUMBER NEWLINE NUMBER NEWLINE NUMBER NEWLINE NUMBER NEWLINE NUMBER NEWLINE UNKNOWN_CHAR END | |
| Found length-1 fix in 35ms after 2926 total and 1 valid samples (81 samples/ms, first valid sample: 33ms) | |
| Average time to find human fix: ~680ms (573 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~69122 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~226 | |
| Repairing: START NAME '=' '[' STRING ',' STRING NAME UNKNOWN_CHAR ']' END | |
| Found length-2 fix in 21ms after 1815 total and 21 valid samples (82 samples/ms, first valid sample: 15ms) | |
| Average time to find human fix: ~679ms (574 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~69005 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~226 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 98 STRING NEWLINE 'return' NAME '(' NAME '(' NAME '(' ',' STRING ',' STRING ')' ')' ')' '.' NAME '(' STRING ')' ';' NEWLINE 99 END | |
| Found length-1 fix in 648ms after 37380 total and 23 valid samples (57 samples/ms, first valid sample: 357ms) | |
| Average time to find human fix: ~679ms (575 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68950 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~226 | |
| Repairing: START '[' STRING UNKNOWN_CHAR ',' STRING ',' STRING ',' STRING ']' END | |
| Found length-1 fix in 125ms after 9837 total and 6 valid samples (78 samples/ms, first valid sample: 80ms) | |
| Average time to find human fix: ~678ms (576 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68847 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~225 | |
| Repairing: START NAME ',' NAME '=' NAME '.' NAME '.' NAME '.' NAME '(' '**' NAME '**' ',' NAME ',' NAME ')' END | |
| Found length-1 fix in 601ms after 43242 total and 8 valid samples (71 samples/ms, first valid sample: 516ms) | |
| Average time to find human fix: ~677ms (577 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68803 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~225 | |
| Repairing: START NAME '.' NAME '.' NAME '(' STRING '{' STRING ':' STRING ',' STRING ':' NAME '(' NUMBER ')' ',' STRING ':' NAME '(' NUMBER ')' '}' ')' END | |
| Found length-1 fix in 302ms after 10366 total and 6 valid samples (34 samples/ms, first valid sample: 243ms) | |
| Average time to find human fix: ~677ms (578 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68701 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~225 | |
| Repairing: START NUMBER NEWLINE NUMBER NEWLINE NUMBER NEWLINE NUMBER NEWLINE '...' '...' END | |
| Found length-1 fix in 274ms after 65682 total and 61 valid samples (238 samples/ms, first valid sample: 131ms) | |
| Average time to find human fix: ~676ms (579 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68696 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~224 | |
| Repairing: START '>>' '[' STRING ',' STRING ',' STRING ']' END | |
| Found length-1 fix in 30ms after 981 total and 1 valid samples (31 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~675ms (580 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68580 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~224 | |
| Repairing: START 'if' NAME '==' NUMBER ':' NEWLINE 98 NAME STRING NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE 99 END | |
| Found length-1 fix in 404ms after 19049 total and 137 valid samples (47 samples/ms, first valid sample: 332ms) | |
| Average time to find human fix: ~675ms (581 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68494 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~224 | |
| Repairing: START '=' '[' '(' STRING ',' STRING ')' ',' '(' STRING ',' STRING ',' STRING ')' ',' '(' STRING ')' ',' '(' STRING ',' STRING ')' ',' '(' STRING ')' ']' END | |
| Found length-1 fix in 719ms after 40633 total and 27 valid samples (56 samples/ms, first valid sample: 549ms) | |
| Average time to find human fix: ~675ms (582 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68446 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~223 | |
| Repairing: START NAME NAME NAME NAME END | |
| Found length-3 fix in 107ms after 4532 total and 35 valid samples (41 samples/ms, first valid sample: 87ms) | |
| Average time to find human fix: ~674ms (583 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68337 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~223 | |
| Repairing: START NAME '=' NAME '.' NAME '.' NAME '[' UNKNOWN_CHAR NAME ']' END | |
| Found length-2 fix in 17ms after 628 total and 1 valid samples (34 samples/ms, first valid sample: 16ms) | |
| Average time to find human fix: ~673ms (584 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68221 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~223 | |
| Repairing: START 'import' NUMBER NEWLINE NUMBER NAME '(' ')' END | |
| Found length-2 fix in 123ms after 15981 total and 2 valid samples (128 samples/ms, first valid sample: 106ms) | |
| Average time to find human fix: ~672ms (585 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68132 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~222 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ';' STRING ']' END | |
| Found length-1 fix in 225ms after 21545 total and 9 valid samples (95 samples/ms, first valid sample: 125ms) | |
| Average time to find human fix: ~671ms (586 trials, 73 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68052 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~222 | |
| Repairing: START '{' STRING ':' STRING ',' STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER END | |
| Sampling timeout expired after (3997251, 3521) (total, valid) samples (130 samples/ms, first valid sample: 10005ms), ground truth repair was 1 edits: | |
| START '{' STRING ':' STRING ',' STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER END | |
| START '{' STRING ':' STRING ',' STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER '}' END | |
| -2147483648 72 1 55 1 54 1 55 2 54 1 55 2 54 1 55 2 2147483647 | |
| -2147483648 72 1 55 1 54 1 55 2 54 1 55 2 54 1 55 2 73 2147483647 | |
| Invalid Python: 40 52 57 40 54 57 40 54 57 40 53 39 98 39 99 | |
| Invalid Python: 40 1 1 40 1 1 40 1 1 40 1 40 2 40 2 | |
| Invalid Python: START NAME '(' '**' NAME ',' '**' NAME ',' '**' NAME ')' NEWLINE 98 NEWLINE 99 END | |
| Repairing: START NAME '=' NAME '[' NUMBER ',' NUMBER ',' NUMBER ']' ')' NEWLINE NAME '=' NAME '(' '[' NUMBER ',' NUMBER ']' ')' END | |
| Found length-1 fix in 182ms after 1083 total and 1 valid samples (5 samples/ms, first valid sample: 179ms) | |
| Average time to find human fix: ~670ms (587 trials, 74 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~67938 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~222 | |
| Repairing: START '[' '{' STRING ':' NAME ',' STRING ':' NUMBER '}' ',' STRING ':' NAME ',' STRING ':' NUMBER '}' ']' END | |
| Found length-1 fix in 258ms after 6907 total and 4 valid samples (26 samples/ms, first valid sample: 218ms) | |
| Average time to find human fix: ~669ms (588 trials, 74 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~67834 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~221 | |
| Repairing: START 'def' NAME '(' ')' ':' NEWLINE 98 NAME '=' NUMBER NEWLINE NAME ':' NEWLINE 98 NAME '=' NAME NEWLINE 99 NAME NAME ':' NEWLINE 98 NAME '=' NAME NEWLINE 99 NAME '=' NAME NEWLINE NAME '+=' NUMBER NEWLINE 99 END | |
| Sampling timeout expired after (1440219, 1) (total, valid) samples (82 samples/ms, first valid sample: 0ms), ground truth repair was 3 edits: | |
| START 'def' NAME '(' ')' ':' NEWLINE 98 NAME '=' NUMBER NEWLINE NAME ':' NEWLINE 98 NAME '=' NAME NEWLINE 99 NAME NAME ':' NEWLINE 98 NAME '=' NAME NEWLINE 99 NAME '=' NAME NEWLINE NAME '+=' NUMBER NEWLINE 99 END | |
| START 'def' NAME '(' ')' ':' NEWLINE 98 NAME '=' NUMBER NEWLINE 'try' ':' NEWLINE 98 NAME '=' NAME NEWLINE 99 'except' NAME ':' NEWLINE 98 NAME '=' NAME NEWLINE 99 NAME '=' NAME NEWLINE NAME '+=' NUMBER NEWLINE 99 END | |
| -2147483648 4 40 52 53 55 39 98 40 58 2 39 40 55 39 98 40 58 40 39 99 40 40 55 39 98 40 58 40 39 99 40 58 40 39 40 83 2 39 99 2147483647 | |
| -2147483648 4 40 52 53 55 39 98 40 58 2 39 19 55 39 98 40 58 40 39 99 22 40 55 39 98 40 58 40 39 99 40 58 40 39 40 83 2 39 99 2147483647 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' END | |
| Sampling timeout expired after (8150530, 6395) (total, valid) samples (273 samples/ms, first valid sample: 10002ms), ground truth repair was 2 edits: | |
| START 'def' NAME '(' NAME ')' ':' END | |
| START 'def' NAME '(' NAME ')' ':' '[' ']' END | |
| -2147483648 4 40 52 40 53 55 2147483647 | |
| -2147483648 4 40 52 40 53 55 59 60 2147483647 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING '.' STRING ',' STRING ']' END | |
| Found length-1 fix in 70ms after 3458 total and 1 valid samples (48 samples/ms, first valid sample: 54ms) | |
| Average time to find human fix: ~668ms (589 trials, 76 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~67725 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~221 | |
| Repairing: START NAME '=' NAME '(' NAME ',' NAME '.' NAME '(' STRING ')' ')' UNKNOWN_CHAR END | |
| Found length-1 fix in 8ms after 405 total and 5 valid samples (45 samples/ms, first valid sample: 6ms) | |
| Average time to find human fix: ~667ms (590 trials, 76 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~67611 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~220 | |
| Repairing: START '[' STRING ',' STRING NAME UNKNOWN_CHAR ']' END | |
| Found length-2 fix in 6ms after 62 total and 1 valid samples (8 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~666ms (591 trials, 76 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~67496 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~220 | |
| Repairing: START 'in' '=' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ']' END | |
| Found length-1 fix in 367ms after 26770 total and 17 valid samples (72 samples/ms, first valid sample: 349ms) | |
| Average time to find human fix: ~666ms (592 trials, 76 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~67428 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~220 | |
| Repairing: START NAME '.' NAME '[' ':' ':' NAME ']' '=' NUMBER UNKNOWN_CHAR END | |
| Found length-1 fix in 53ms after 6284 total and 12 valid samples (116 samples/ms, first valid sample: 35ms) | |
| Average time to find human fix: ~664ms (593 trials, 76 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67325 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~219 | |
| Repairing: START NAME ',' NAME ',' NAME ',' NAME ',' NAME ',' NAME ',' NAME NUMBER ',' NAME NUMBER END | |
| Found length-2 fix in 1424ms after 187437 total and 134 valid samples (131 samples/ms, first valid sample: 684ms) | |
| Average time to find human fix: ~666ms (594 trials, 76 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~67527 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~219 | |
| Repairing: START NAME '=' '[' '[' NAME 'for' NAME 'in' NAME '.' NAME '(' ')' ']' 'for' NAME 'in' NAME ']' NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE NAME NAME END | |
| Sampling timeout expired after (2025730, 8749) (total, valid) samples (110 samples/ms, first valid sample: 10000ms), ground truth repair was 2 edits: | |
| START NAME '=' '[' '[' NAME 'for' NAME 'in' NAME '.' NAME '(' ')' ']' 'for' NAME 'in' NAME ']' NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE NAME NAME END | |
| START NAME '=' '[' '[' NAME 'for' NAME 'in' NAME '.' NAME '(' ')' ']' 'for' NAME 'in' NAME ']' NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE NAME '(' NAME ')' END | |
| -2147483648 40 58 59 59 40 17 40 18 40 49 40 52 53 60 17 40 18 40 60 39 40 58 40 49 40 52 40 53 39 40 40 2147483647 | |
| -2147483648 40 58 59 59 40 17 40 18 40 49 40 52 53 60 17 40 18 40 60 39 40 58 40 49 40 52 40 53 39 40 52 40 53 2147483647 | |
| Repairing: START '[' '[' NAME ',' NAME ',' NUMBER ']' ',' '[' NAME ',' NAME ',' NUMBER ']' ',' '[' NAME ',' NAME ',' NUMBER ']' ',' '.' '.' ']' '.' END | |
| Found length-3 fix in 5310ms after 459401 total and 1 valid samples (86 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~674ms (595 trials, 77 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~68185 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~219 | |
| Repairing: START NAME '=' STRING NAME STRING STRING NAME STRING END | |
| Found length-2 fix in 24ms after 1034 total and 2 valid samples (41 samples/ms, first valid sample: 19ms) | |
| Average time to find human fix: ~672ms (596 trials, 77 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~68073 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~219 | |
| Repairing: START '{' STRING ':' '{' STRING ':' STRING '}' STRING ':' '{' STRING ':' STRING '}' '}' END | |
| Found length-1 fix in 56ms after 1732 total and 24 valid samples (30 samples/ms, first valid sample: 48ms) | |
| Average time to find human fix: ~671ms (597 trials, 77 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67962 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~218 | |
| Repairing: START UNKNOWN_CHAR NAME NEWLINE STRING NEWLINE STRING END | |
| Found length-2 fix in 107ms after 25390 total and 360 valid samples (235 samples/ms, first valid sample: 83ms) | |
| Average time to find human fix: ~671ms (598 trials, 77 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67890 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~218 | |
| Invalid Python: 4 40 52 40 54 40 53 55 39 98 40 58 40 49 40 52 40 53 39 99 4 40 52 40 53 55 39 98 40 58 40 52 40 54 1 53 39 39 99 | |
| Invalid Python: 1 40 1 40 1 40 1 1 40 2 40 1 40 1 40 1 40 1 40 2 1 40 1 40 1 1 40 2 40 1 40 1 40 1 40 1 40 40 2 | |
| Invalid Python: START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE 99 'def' NAME '(' NAME ')' ':' NEWLINE 98 NAME '=' NAME '(' NAME ',' STRING ')' NEWLINE NEWLINE 99 END | |
| Repairing: START NAME '=' '[' STRING NAME STRING NAME UNKNOWN_CHAR ']' NEWLINE NAME '=' '[' STRING ',' STRING ',' STRING ']' END | |
| Sampling timeout expired after (1427151, 191) (total, valid) samples (93 samples/ms, first valid sample: 6212ms), ground truth repair was 3 edits: | |
| START NAME '=' '[' STRING NAME STRING NAME UNKNOWN_CHAR ']' NEWLINE NAME '=' '[' STRING ',' STRING ',' STRING ']' END | |
| START NAME '=' '[' STRING ',' STRING STRING ',' ']' NEWLINE NAME '=' '[' STRING ',' STRING ',' STRING ']' END | |
| -2147483648 40 58 59 1 40 1 40 97 60 39 40 58 59 1 54 1 54 1 60 2147483647 | |
| -2147483648 40 58 59 1 54 1 1 54 60 39 40 58 59 1 54 1 54 1 60 2147483647 | |
| Repairing: START 'class' NAME '(' NAME '.' NAME ')' ':' NEWLINE 98 NAME '=' NAME NAME NEWLINE NAME '=' NAME NAME NEWLINE NAME '=' NAME NAME NEWLINE 99 END | |
| Found length-3 fix in 4286ms after 346859 total and 265 valid samples (80 samples/ms, first valid sample: 2738ms) | |
| Average time to find human fix: ~677ms (599 trials, 78 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68356 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~219 | |
| Repairing: START NAME '=' '[' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ']' '.' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ']' ',' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ']' ']' END | |
| Found length-1 fix in 4791ms after 390557 total and 64 valid samples (81 samples/ms, first valid sample: 2522ms) | |
| Average time to find human fix: ~683ms (600 trials, 78 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~68893 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~218 | |
| Repairing: START 'class' NAME '(' NAME '.' NAME ')' ':' NEWLINE 'class' NAME ':' NEWLINE 98 NAME '=' NAME NEWLINE 99 END | |
| Found length-2 fix in 96ms after 4780 total and 3 valid samples (49 samples/ms, first valid sample: 84ms) | |
| Average time to find human fix: ~682ms (601 trials, 78 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~68786 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~218 | |
| Repairing: START NAME NAME '(' NAME ')' ':' NEWLINE 98 'def' NAME '(' NAME ',' NAME ',' NAME ')' ':' NEWLINE 98 NAME '.' NAME '=' NAME NEWLINE NAME '.' NAME '=' NAME NEWLINE 99 99 END | |
| Found length-2 fix in 305ms after 1369 total and 1 valid samples (4 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~682ms (602 trials, 78 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~68674 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~218 | |
| Repairing: START 'if' NAME '==' STRING NEWLINE NAME '=' NAME '(' ')' NEWLINE 'elif' NAME '==' STRING NEWLINE NAME '=' NAME '(' ')' END | |
| Sampling timeout expired after (1383861, 1) (total, valid) samples (128 samples/ms, first valid sample: 0ms), ground truth repair was 2 edits: | |
| START 'if' NAME '==' STRING NEWLINE NAME '=' NAME '(' ')' NEWLINE 'elif' NAME '==' STRING NEWLINE NAME '=' NAME '(' ')' END | |
| START 'if' NAME '==' STRING ':' NAME '=' NAME '(' ')' NEWLINE 'elif' NAME '==' STRING ':' NAME '=' NAME '(' ')' END | |
| -2147483648 13 40 76 1 39 40 58 40 52 53 39 14 40 76 1 39 40 58 40 52 53 2147483647 | |
| -2147483648 13 40 76 1 55 40 58 40 52 53 39 14 40 76 1 55 40 58 40 52 53 2147483647 | |
| Repairing: START NAME '=' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER '...' ']' END | |
| Found length-1 fix in 350ms after 47074 total and 34 valid samples (134 samples/ms, first valid sample: 187ms) | |
| Average time to find human fix: ~681ms (603 trials, 79 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~68639 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~217 | |
| Repairing: START NAME '=' '[' '{' STRING ':' STRING ',' STRING ':' STRING '}' ',' '{' STRING ':' STRING ',' STRING ':' STRING '}' ',' '{' STRING ':' STRING ',' STRING ':' STRING '}' ']' UNKNOWN_CHAR END | |
| Found length-1 fix in 137ms after 965 total and 5 valid samples (6 samples/ms, first valid sample: 131ms) | |
| Average time to find human fix: ~680ms (604 trials, 79 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68527 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~217 | |
| Repairing: START 'for' NAME 'in' NAME '(' NAME '(' NAME ')' ')' ':' NEWLINE 'if' NAME '.' NAME '.' NAME '[' NAME ']' '>' NUMBER ':' NEWLINE 98 'break' NEWLINE 99 END | |
| Found length-3 fix in 341ms after 8837 total and 37 valid samples (25 samples/ms, first valid sample: 297ms) | |
| Average time to find human fix: ~680ms (605 trials, 79 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68428 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~217 | |
| Invalid Python: 13 40 52 40 53 78 2 55 39 98 40 52 1 53 39 98 39 99 99 | |
| Invalid Python: 1 40 1 40 1 1 40 1 40 2 40 1 40 1 40 2 40 2 2 | |
| Invalid Python: START 'if' NAME '(' NAME ')' '<=' NUMBER ':' NEWLINE 98 NAME '(' STRING ')' NEWLINE 98 NEWLINE 99 99 END | |
| Repairing: START NAME '=' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER '...' ']' END | |
| Found length-1 fix in 180ms after 20383 total and 10 valid samples (112 samples/ms, first valid sample: 107ms) | |
| Average time to find human fix: ~679ms (606 trials, 79 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68349 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~216 | |
| Repairing: START NAME '=' NAME '.' NAME '(' NUMBER '/' NAME '.' NAME '(' NAME ')' END | |
| Found length-1 fix in 1ms after 11 total and 1 valid samples (5 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~678ms (607 trials, 79 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68236 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~216 | |
| Repairing: START NAME '=' '[' '{' STRING ':' NUMBER '}' ',' '{' STRING ':' NUMBER ']' END | |
| Found length-1 fix in 107ms after 2077 total and 23 valid samples (19 samples/ms, first valid sample: 96ms) | |
| Average time to find human fix: ~677ms (608 trials, 79 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68127 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~216 | |
| Repairing: START NAME '=' '[' '(' STRING ',' NUMBER ',' NUMBER ')' ',' '(' STRING ',' NUMBER ',' NUMBER ')' ')' ']' NEWLINE NAME '=' '[' STRING ',' STRING ']' NEWLINE END | |
| Found length-1 fix in 364ms after 5248 total and 9 valid samples (14 samples/ms, first valid sample: 344ms) | |
| Average time to find human fix: ~676ms (609 trials, 79 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68024 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~215 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 'for' NAME 'in' NAME ':' NEWLINE 98 'if' NAME '(' NAME ')' '.' NAME '(' ')' ':' NEWLINE 98 'return' 'True' NEWLINE 99 'else' ':' NEWLINE 98 'return' 'False' NEWLINE 99 99 END | |
| Found length-3 fix in 3206ms after 227050 total and 774 valid samples (70 samples/ms, first valid sample: 2137ms) | |
| Average time to find human fix: ~681ms (610 trials, 79 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~68285 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~216 | |
| Repairing: START '{' STRING ':' NUMBER STRING ':' NUMBER STRING ':' NUMBER '}' ',' END | |
| Found length-2 fix in 4ms after 23 total and 1 valid samples (4 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~679ms (611 trials, 79 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~68173 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~216 | |
| Repairing: START '@' NAME '.' NAME '(' STRING ')' NEWLINE 'def' NAME '(' NAME ',' NAME ')' END | |
| Sampling timeout expired after (3759413, 4) (total, valid) samples (229 samples/ms, first valid sample: 10680ms), ground truth repair was 2 edits: | |
| START '@' NAME '.' NAME '(' STRING ')' NEWLINE 'def' NAME '(' NAME ',' NAME ')' END | |
| START '@' NAME '.' NAME '(' STRING ')' NEWLINE 'def' NAME '(' NAME ',' NAME ')' ':' '...' END | |
| -2147483648 81 40 49 40 52 1 53 39 4 40 52 40 54 40 53 2147483647 | |
| -2147483648 81 40 49 40 52 1 53 39 4 40 52 40 54 40 53 55 50 2147483647 | |
| Repairing: START 'from' NAME '.' NAME 'import' NAME NAME NAME NEWLINE NAME '(' NAME '.' NAME ')' END | |
| Found length-2 fix in 230ms after 13431 total and 50 valid samples (58 samples/ms, first valid sample: 176ms) | |
| Average time to find human fix: ~679ms (612 trials, 80 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~68083 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~216 | |
| Repairing: START '(' NUMBER ',' NUMBER ')' '(' NUMBER ',' NUMBER ')' NEWLINE '(' NUMBER ',' NUMBER ')' '(' NUMBER ',' NUMBER END | |
| Sampling timeout expired after (3678128, 1232) (total, valid) samples (115 samples/ms, first valid sample: 10009ms), ground truth repair was 1 edits: | |
| START '(' NUMBER ',' NUMBER ')' '(' NUMBER ',' NUMBER ')' NEWLINE '(' NUMBER ',' NUMBER ')' '(' NUMBER ',' NUMBER END | |
| START '(' NUMBER ',' NUMBER ')' '(' NUMBER ',' NUMBER ')' NEWLINE '(' NUMBER ',' NUMBER ')' '(' NUMBER ',' NUMBER ')' END | |
| -2147483648 52 2 54 2 53 52 2 54 2 53 39 52 2 54 2 53 52 2 54 2 2147483647 | |
| -2147483648 52 2 54 2 53 52 2 54 2 53 39 52 2 54 2 53 52 2 54 2 53 2147483647 | |
| Repairing: START 'from' NAME 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' ')' NAME '.' NAME '(' STRING ',' NAME '.' NAME ')' NEWLINE NAME '(' STRING ',' NAME '(' NAME '.' NAME ')' ')' ',' END | |
| Found length-1 fix in 150ms after 74 total and 1 valid samples (0 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~678ms (613 trials, 81 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~67973 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~215 | |
| Repairing: START NAME '=' NAME '(' ')' NEWLINE NAME '=' NAME '.' NAME '(' ')' NEWLINE NAME '.' NAME '<' '/' NAME '>' END | |
| Found length-2 fix in 2452ms after 382151 total and 1 valid samples (155 samples/ms, first valid sample: 2263ms) | |
| Average time to find human fix: ~681ms (614 trials, 81 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~68484 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~215 | |
| Repairing: START 'if' NAME ':' NEWLINE 98 NAME STRING NEWLINE 99 END | |
| Found length-2 fix in 9113ms after 1745558 total and 49145 valid samples (191 samples/ms, first valid sample: 2787ms) | |
| Average time to find human fix: ~694ms (615 trials, 81 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~71211 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~294 | |
| Repairing: START NUMBER NAME '=' '[' '[' NUMBER ',' NUMBER ',' NUMBER ']' ',' '[' NUMBER ',' NUMBER ',' NUMBER ']' ',' '[' NUMBER ',' NUMBER ',' NUMBER ']' ']' END | |
| Found length-1 fix in 506ms after 26044 total and 98 valid samples (51 samples/ms, first valid sample: 379ms) | |
| Average time to find human fix: ~694ms (616 trials, 81 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~71138 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~294 | |
| Repairing: START 'from' NAME 'import' '*' NEWLINE 98 NAME '=' NUMBER NEWLINE NAME '=' NAME '(' ')' NEWLINE NAME '=' NAME '+' NUMBER NEWLINE NAME '(' STRING ')' NEWLINE 99 END | |
| Sampling timeout expired after (2261319, 4) (total, valid) samples (140 samples/ms, first valid sample: 10586ms), ground truth repair was 3 edits: | |
| START 'from' NAME 'import' '*' NEWLINE 98 NAME '=' NUMBER NEWLINE NAME '=' NAME '(' ')' NEWLINE NAME '=' NAME '+' NUMBER NEWLINE NAME '(' STRING ')' NEWLINE 99 END | |
| START 'from' NAME 'import' '*' NEWLINE NAME '=' NUMBER NEWLINE NAME '=' NAME '(' ')' NEWLINE NAME '=' NAME '+' NUMBER NEWLINE NAME '(' STRING ')' END | |
| -2147483648 7 40 8 51 39 98 40 58 2 39 40 58 40 52 53 39 40 58 40 66 2 39 40 52 1 53 39 99 2147483647 | |
| -2147483648 7 40 8 51 39 40 58 2 39 40 58 40 52 53 39 40 58 40 66 2 39 40 52 1 53 2147483647 | |
| Repairing: START NAME '=' NAME '(' NAME '.' NAME '(' NAME ')' ')' NEWLINE NAME ':' NAME NAME 'is' NAME END | |
| Found length-1 fix in 358ms after 18291 total and 47 valid samples (50 samples/ms, first valid sample: 277ms) | |
| Average time to find human fix: ~694ms (617 trials, 82 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~71052 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~294 | |
| Repairing: START NAME '=' NAME UNKNOWN_CHAR NAME ':' UNKNOWN_CHAR NAME NEWLINE NAME '=' STRING END | |
| Found length-2 fix in 171ms after 11548 total and 1 valid samples (67 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~693ms (618 trials, 82 expired after 10000ms) | |
| Average time to find valid fix: ~339ms | |
| Average samples before matched: ~70956 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~293 | |
| Repairing: START NUMBER '|' NAME '|' NAME '|' NAME '|' NAME UNKNOWN_CHAR '*' NAME UNKNOWN_CHAR '*' NAME UNKNOWN_CHAR '*' NAME '|' NAME END | |
| Found length-3 fix in 1094ms after 169412 total and 1 valid samples (154 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~693ms (619 trials, 82 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~71115 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~293 | |
| Repairing: START NAME '=' '{' NUMBER '=' STRING ',' NUMBER '=' STRING ',' STRING '=' STRING '}' NEWLINE '[' STRING ',' STRING ',' STRING ']' END | |
| Found length-3 fix in 3838ms after 392789 total and 1 valid samples (102 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~698ms (620 trials, 82 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~71634 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~292 | |
| Repairing: START '[' STRING ',' STRING '.' STRING ',' STRING ',' STRING ']' END | |
| Found length-1 fix in 39ms after 2326 total and 1 valid samples (58 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~697ms (621 trials, 82 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71522 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~292 | |
| Repairing: START NAME '=' UNKNOWN_CHAR '(' STRING ',' STRING ',' STRING ')' UNKNOWN_CHAR END | |
| Found length-2 fix in 37ms after 769 total and 1 valid samples (20 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~696ms (622 trials, 82 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71408 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~291 | |
| Repairing: START 'import' NAME NEWLINE NAME ':' NAME NAME NAME STRING END | |
| Found length-3 fix in 683ms after 74289 total and 13 valid samples (108 samples/ms, first valid sample: 354ms) | |
| Average time to find human fix: ~696ms (623 trials, 82 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71413 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~291 | |
| Repairing: START '{' STRING ':' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ']' ',' STRING ':' '{' '...' END | |
| Sampling timeout expired after (3028983, 1) (total, valid) samples (91 samples/ms, first valid sample: 0ms), ground truth repair was 2 edits: | |
| START '{' STRING ':' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ']' ',' STRING ':' '{' '...' END | |
| START '{' STRING ':' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ']' ',' STRING ':' '{' '...' '}' '}' END | |
| -2147483648 72 1 55 59 1 54 1 54 1 54 1 54 1 54 1 54 1 60 54 1 55 72 50 2147483647 | |
| -2147483648 72 1 55 59 1 54 1 54 1 54 1 54 1 54 1 54 1 60 54 1 55 72 50 73 73 2147483647 | |
| Repairing: START 'if' NAME '[' NAME '.' NAME ']' ':' NEWLINE 'if' NAME '.' NAME '<' NUMBER ':' NEWLINE 98 'import' NAME NEWLINE 99 END | |
| Sampling timeout expired after (3010865, 11357) (total, valid) samples (124 samples/ms, first valid sample: 10001ms), ground truth repair was 3 edits: | |
| START 'if' NAME '[' NAME '.' NAME ']' ':' NEWLINE 'if' NAME '.' NAME '<' NUMBER ':' NEWLINE 98 'import' NAME NEWLINE 99 END | |
| START 'if' NAME '[' NAME '.' NAME ']' ':' NEWLINE 98 'if' NAME '.' NAME '<' NUMBER ':' 'import' NAME NEWLINE 99 END | |
| -2147483648 13 40 59 40 49 40 60 55 39 13 40 49 40 74 2 55 39 98 8 40 39 99 2147483647 | |
| -2147483648 13 40 59 40 49 40 60 55 39 98 13 40 49 40 74 2 55 8 40 39 99 2147483647 | |
| Repairing: START NAME '=' NAME '(' NAME '=' NAME '.' NAME ')' NEWLINE 98 NAME '=' NAME '.' NAME NEWLINE 99 END | |
| Sampling timeout expired after (2946743, 55) (total, valid) samples (153 samples/ms, first valid sample: 10017ms), ground truth repair was 3 edits: | |
| START NAME '=' NAME '(' NAME '=' NAME '.' NAME ')' NEWLINE 98 NAME '=' NAME '.' NAME NEWLINE 99 END | |
| START NAME '=' NAME '(' NAME '=' NAME '.' NAME ')' NEWLINE NAME '=' NAME '.' NAME END | |
| -2147483648 40 58 40 52 40 58 40 49 40 53 39 98 40 58 40 49 40 39 99 2147483647 | |
| -2147483648 40 58 40 52 40 58 40 49 40 53 39 40 58 40 49 40 2147483647 | |
| Repairing: START '{' STRING ':' '[' '{' STRING ':' STRING '}' ',' '{' STRING ':' STRING '}' ']' END | |
| Found length-1 fix in 167ms after 2625 total and 1 valid samples (15 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~695ms (624 trials, 85 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71303 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~290 | |
| Repairing: START 'class' NAME '(' NAME '.' NAME ')' ':' NEWLINE 'class' NAME ':' NEWLINE 98 NAME '=' NAME NEWLINE 99 END | |
| Found length-2 fix in 30ms after 1122 total and 2 valid samples (36 samples/ms, first valid sample: 27ms) | |
| Average time to find human fix: ~694ms (625 trials, 85 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71191 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~290 | |
| Repairing: START NAME NAME '-' NAME END | |
| Found length-1 fix in 302ms after 41783 total and 330 valid samples (137 samples/ms, first valid sample: 155ms) | |
| Average time to find human fix: ~694ms (626 trials, 85 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71144 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~290 | |
| Repairing: START NAME '.' NAME '=' NAME '.' NAME '.' NAME '.' NAME '(' NAME '.' NAME ',' STRING ',' 'None' ',' 'None' ')' NAME NAME NAME END | |
| Found length-3 fix in 866ms after 45172 total and 102 valid samples (52 samples/ms, first valid sample: 657ms) | |
| Average time to find human fix: ~694ms (627 trials, 85 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71102 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~290 | |
| Repairing: START NAME '[' STRING ']' '=' NAME '.' NAME '(' NAME '[' STRING ']' END | |
| Found length-1 fix in 159ms after 9052 total and 38 valid samples (56 samples/ms, first valid sample: 107ms) | |
| Average time to find human fix: ~693ms (628 trials, 85 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71003 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~289 | |
| Repairing: START '{' '@' STRING ':' STRING ',' STRING ':' '{' STRING ':' '{' STRING ':' STRING '}' ',' STRING ':' '{' STRING ':' STRING '}' '}' '}' END | |
| Found length-2 fix in 428ms after 31015 total and 8 valid samples (72 samples/ms, first valid sample: 302ms) | |
| Average time to find human fix: ~693ms (629 trials, 85 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70940 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~289 | |
| Repairing: START NAME '=' '[' NUMBER NUMBER NUMBER ']' END | |
| Found length-2 fix in 0ms after 30 total and 1 valid samples (30 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~692ms (630 trials, 85 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70827 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~288 | |
| Repairing: START NAME '=' NAME '.' NAME '(' NAME ',' NAME '=' '[' STRING ']' END | |
| Found length-1 fix in 171ms after 10637 total and 50 valid samples (61 samples/ms, first valid sample: 115ms) | |
| Average time to find human fix: ~691ms (631 trials, 85 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70732 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~288 | |
| Repairing: START 'import' NAME NEWLINE NAME '=' STRING NEWLINE 'if' NAME 'not' 'in' NAME '.' NAME ':' NEWLINE '>>' '>>' NAME '.' NAME '=' '[' NAME ']' '+' NAME '.' NAME NEWLINE 'from' NAME 'import' NAME 'as' NAME END | |
| Sampling timeout expired after (2011900, 1) (total, valid) samples (111 samples/ms, first valid sample: 0ms), ground truth repair was 3 edits: | |
| START 'import' NAME NEWLINE NAME '=' STRING NEWLINE 'if' NAME 'not' 'in' NAME '.' NAME ':' NEWLINE '>>' '>>' NAME '.' NAME '=' '[' NAME ']' '+' NAME '.' NAME NEWLINE 'from' NAME 'import' NAME 'as' NAME END | |
| START 'import' NAME NEWLINE NAME '=' STRING NEWLINE 'if' NAME 'not' 'in' NAME '.' NAME ':' NEWLINE 98 NAME '.' NAME '=' '[' NAME ']' '+' NAME '.' NAME NEWLINE 99 'from' NAME 'import' NAME 'as' NAME END | |
| -2147483648 8 40 39 40 58 1 39 13 40 26 18 40 49 40 55 39 65 65 40 49 40 58 59 40 60 66 40 49 40 39 7 40 8 40 9 40 2147483647 | |
| -2147483648 8 40 39 40 58 1 39 13 40 26 18 40 49 40 55 39 98 40 49 40 58 59 40 60 66 40 49 40 39 99 7 40 8 40 9 40 2147483647 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING NAME '-' NAME '-' NAME '.' '/' NAME '.' NAME STRING ']' END | |
| Found length-3 fix in 4433ms after 504406 total and 8 valid samples (113 samples/ms, first valid sample: 2153ms) | |
| Average time to find human fix: ~697ms (632 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~71418 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~288 | |
| Repairing: START UNKNOWN_CHAR NAME '-' '-' NAME END | |
| Found length-1 fix in 56ms after 4636 total and 19 valid samples (81 samples/ms, first valid sample: 49ms) | |
| Average time to find human fix: ~696ms (633 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71313 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~287 | |
| Repairing: START NAME NAME NEWLINE NAME '=' NAME '.' NAME '.' NAME '(' ')' NEWLINE NAME '(' NAME '.' NAME '(' STRING ')' ')' END | |
| Found length-2 fix in 82ms after 540 total and 6 valid samples (6 samples/ms, first valid sample: 80ms) | |
| Average time to find human fix: ~695ms (634 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71201 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~287 | |
| Repairing: START 'from' NAME END | |
| Found length-1 fix in 190ms after 91729 total and 1 valid samples (480 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~694ms (635 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71233 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~286 | |
| Repairing: START NAME '=' NAME '.' NAME '(' '(' NUMBER ')' NAME '=' NAME '.' NAME '.' NAME '.' NAME '(' NAME ',' NAME '=' NUMBER ',' NAME '=' NAME ')' END | |
| Found length-2 fix in 257ms after 1459 total and 14 valid samples (5 samples/ms, first valid sample: 249ms) | |
| Average time to find human fix: ~693ms (636 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71123 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~286 | |
| Repairing: START NAME '=' '[' ']' NEWLINE NAME '.' NAME '(' STRING ')' NEWLINE NAME '[' NUMBER ']' '=' STRING NEWLINE NAME NAME NAME ':' END | |
| Found length-3 fix in 1757ms after 144080 total and 9 valid samples (81 samples/ms, first valid sample: 1096ms) | |
| Average time to find human fix: ~695ms (637 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71238 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~285 | |
| Repairing: START NAME '=' NAME '.' NAME '*' NUMBER '<' NAME '>' NEWLINE NAME '=' NAME '(' ')' END | |
| Found length-1 fix in 85ms after 1407 total and 3 valid samples (16 samples/ms, first valid sample: 82ms) | |
| Average time to find human fix: ~694ms (638 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71129 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~285 | |
| Repairing: START '>>' '>' STRING '%' '(' STRING ')' NEWLINE STRING END | |
| Found length-2 fix in 19ms after 2594 total and 3 valid samples (129 samples/ms, first valid sample: 17ms) | |
| Average time to find human fix: ~693ms (639 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71021 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~284 | |
| Repairing: START 'def' NAME '(' NAME '=' NUMBER ',' NAME '=' NUMBER ')' ':' NEWLINE 98 NAME '(' NAME '(' NAME ')' ',' NAME '(' NAME ')' ')' NEWLINE 99 NAME '(' ',' NUMBER ')' END | |
| Found length-1 fix in 566ms after 12996 total and 2 valid samples (22 samples/ms, first valid sample: 535ms) | |
| Average time to find human fix: ~693ms (640 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~70931 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~284 | |
| Repairing: START 'for' NAME 'in' NAME ':' NEWLINE 'for' NAME 'in' NAME '(' NUMBER ',' NUMBER ')' ':' NEWLINE 98 'if' NAME '==' NAME ':' NEWLINE 98 NAME '[' STRING ']' '+=' NUMBER NEWLINE 99 99 END | |
| Found length-2 fix in 63ms after 2211 total and 2 valid samples (34 samples/ms, first valid sample: 50ms) | |
| Average time to find human fix: ~692ms (641 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70823 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~284 | |
| Repairing: START NAME '(' NAME ')' ':' NEWLINE NAME '=' NAME '(' NAME ')' NEWLINE 'return' NAME '[' '-' NUMBER ']' ',' NAME '[' NUMBER ':' '-' NUMBER ']' ',' NAME '[' NUMBER ']' END | |
| Found length-3 fix in 1121ms after 95283 total and 179 valid samples (84 samples/ms, first valid sample: 743ms) | |
| Average time to find human fix: ~692ms (642 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~70862 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~283 | |
| Repairing: START 'class' NAME '(' NAME ')' ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' ')' NEWLINE 99 NAME '=' NAME '(' NAME ',' NAME '=' STRING ')' NEWLINE NAME '.' NAME '(' ')' NAME NAME NAME END | |
| Found length-3 fix in 922ms after 42171 total and 39 valid samples (45 samples/ms, first valid sample: 715ms) | |
| Average time to find human fix: ~693ms (643 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~70817 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~283 | |
| Repairing: START 'while' 'True' ':' NEWLINE 98 NAME '=' NAME '+' NUMBER NEWLINE NAME '.' NAME '(' NUMBER ')' NEWLINE 'if' '(' NAME '=' NAME ')' ':' NEWLINE 98 'break' NEWLINE 99 99 END | |
| Found length-2 fix in 409ms after 2644 total and 3 valid samples (6 samples/ms, first valid sample: 398ms) | |
| Average time to find human fix: ~692ms (644 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~70711 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~283 | |
| Repairing: START NAME '=' NAME '[' '~' NAME '.' NAME '(' NAME ')' ']' 'for' NAME NAME 'in' NAME END | |
| Found length-2 fix in 1792ms after 167526 total and 16 valid samples (93 samples/ms, first valid sample: 891ms) | |
| Average time to find human fix: ~694ms (645 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~70861 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~282 | |
| Repairing: START 'import' NAME NEWLINE NAME '.' NAME '(' STRING END | |
| Found length-1 fix in 6923ms after 1089653 total and 1060 valid samples (157 samples/ms, first valid sample: 1537ms) | |
| Average time to find human fix: ~704ms (646 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~72438 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~283 | |
| Repairing: START NAME '.' NAME '(' STRING ')' NEWLINE '-' '-' '->' NAME NAME END | |
| Found length-2 fix in 219ms after 28654 total and 6 valid samples (130 samples/ms, first valid sample: 130ms) | |
| Average time to find human fix: ~703ms (647 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~72371 | |
| Average repair throughput / ms: ~61 | |
| Average valid repairs detected: ~283 | |
| Repairing: START STRING 'in' NAME '.' NAME '(' ')' NEWLINE NAME 'False' END | |
| Found length-1 fix in 409ms after 70350 total and 9 valid samples (171 samples/ms, first valid sample: 312ms) | |
| Average time to find human fix: ~702ms (648 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~72367 | |
| Average repair throughput / ms: ~61 | |
| Average valid repairs detected: ~283 | |
| Repairing: START '[' '(' STRING ',' STRING ',' STRING ')' ',' '(' STRING ',' STRING ',' STRING ')' ',' '(' STRING ')' ',' STRING ',' STRING ')' ']' END | |
| Found length-1 fix in 396ms after 22965 total and 87 valid samples (57 samples/ms, first valid sample: 289ms) | |
| Average time to find human fix: ~702ms (649 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~72291 | |
| Average repair throughput / ms: ~61 | |
| Average valid repairs detected: ~282 | |
| Repairing: START 'def' NAME '(' NAME ')' NEWLINE NAME '=' NAME '.' NAME '(' STRING ',' NAME ')' NEWLINE 'return' NAME END | |
| Found length-1 fix in 192ms after 5433 total and 4 valid samples (28 samples/ms, first valid sample: 181ms) | |
| Average time to find human fix: ~701ms (650 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~340ms | |
| Average samples before matched: ~72188 | |
| Average repair throughput / ms: ~61 | |
| Average valid repairs detected: ~282 | |
| Repairing: START NAME '=' STRING NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE 'if' NAME '==' NAME NEWLINE 98 NAME '.' NAME '(' STRING ')' NEWLINE 99 'else' NEWLINE 98 NAME NEWLINE 99 END | |
| Found length-2 fix in 311ms after 1430 total and 1 valid samples (4 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~701ms (651 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~339ms | |
| Average samples before matched: ~72080 | |
| Average repair throughput / ms: ~61 | |
| Average valid repairs detected: ~281 | |
| Repairing: START NAME '(' STRING '.' NAME '(' NAME ',' NAME ')' END | |
| Found length-1 fix in 4ms after 144 total and 3 valid samples (28 samples/ms, first valid sample: 3ms) | |
| Average time to find human fix: ~700ms (652 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~339ms | |
| Average samples before matched: ~71969 | |
| Average repair throughput / ms: ~61 | |
| Average valid repairs detected: ~281 | |
| Repairing: START NAME NAME 'as' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ',' NAME '=' STRING ',' NAME '=' NAME ')' END | |
| Found length-2 fix in 420ms after 37164 total and 24 valid samples (88 samples/ms, first valid sample: 260ms) | |
| Average time to find human fix: ~699ms (653 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~71916 | |
| Average repair throughput / ms: ~61 | |
| Average valid repairs detected: ~281 | |
| Repairing: START '(' NAME '.' NAME '(' '[' NUMBER ',' NUMBER ']' ')' ',' NAME '.' NAME '(' '[' NUMBER ',' NUMBER ']' ')' END | |
| Found length-1 fix in 8ms after 315 total and 9 valid samples (35 samples/ms, first valid sample: 7ms) | |
| Average time to find human fix: ~698ms (654 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~338ms | |
| Average samples before matched: ~71807 | |
| Average repair throughput / ms: ~61 | |
| Average valid repairs detected: ~280 | |
| Repairing: START NAME '=' '(' NAME '.' NAME '(' NAME ')' '-' NAME '.' NAME '(' NAME '.' NAME '(' NAME ')' ')' '/' NAME '.' NAME '(' NAME ')' END | |
| Found length-1 fix in 9ms after 98 total and 2 valid samples (9 samples/ms, first valid sample: 8ms) | |
| Average time to find human fix: ~697ms (655 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71697 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~280 | |
| Repairing: START NAME NAME '=' NUMBER END | |
| Found length-1 fix in 27ms after 396 total and 7 valid samples (14 samples/ms, first valid sample: 25ms) | |
| Average time to find human fix: ~696ms (656 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71588 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~279 | |
| Repairing: START '>>' '>' NAME '=' '{' NUMBER ':' STRING ',' NUMBER ':' STRING ',' NUMBER ':' STRING ',' NUMBER ':' STRING '}' END | |
| Found length-2 fix in 0ms after 32 total and 1 valid samples (32 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~695ms (657 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71480 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~279 | |
| Repairing: START NAME '=' '[' STRING ',' STRING NAME UNKNOWN_CHAR ']' NEWLINE NAME '-' NAME '[' NAME '.' NAME '(' NAME '(' NAME ')' ')' ']' END | |
| Found length-2 fix in 582ms after 32969 total and 82 valid samples (56 samples/ms, first valid sample: 393ms) | |
| Average time to find human fix: ~695ms (658 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71421 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~279 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING ']' '.' END | |
| Found length-1 fix in 111ms after 2167 total and 9 valid samples (19 samples/ms, first valid sample: 103ms) | |
| Average time to find human fix: ~694ms (659 trials, 86 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71316 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~278 | |
| Repairing: START STRING 'in' NAME '.' NAME '(' ')' NEWLINE 'for' NAME NAME UNKNOWN_CHAR END | |
| Sampling timeout expired after (3148028, 37) (total, valid) samples (171 samples/ms, first valid sample: 5732ms), ground truth repair was 3 edits: | |
| START STRING 'in' NAME '.' NAME '(' ')' NEWLINE 'for' NAME NAME UNKNOWN_CHAR END | |
| START STRING 'in' NAME '.' NAME '(' ')' NEWLINE NAME END | |
| -2147483648 1 18 40 49 40 52 53 39 17 40 40 97 2147483647 | |
| -2147483648 1 18 40 49 40 52 53 39 40 2147483647 | |
| Repairing: START 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME ',' NAME ')' NEWLINE NAME '.' NAME '(' END | |
| Sampling timeout expired after (2141733, 39) (total, valid) samples (127 samples/ms, first valid sample: 10153ms), ground truth repair was 1 edits: | |
| START 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME ',' NAME ')' NEWLINE NAME '.' NAME '(' END | |
| START 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME ',' NAME ')' NEWLINE NAME '.' NAME '(' ')' END | |
| -2147483648 8 40 39 40 58 40 49 40 52 1 53 39 40 58 40 49 40 52 40 54 40 53 39 40 49 40 52 2147483647 | |
| -2147483648 8 40 39 40 58 40 49 40 52 1 53 39 40 58 40 49 40 52 40 54 40 53 39 40 49 40 52 53 2147483647 | |
| Repairing: START '.' NAME '.' NAME '(' STRING ',' STRING ')' END | |
| Found length-1 fix in 103ms after 4134 total and 1 valid samples (39 samples/ms, first valid sample: 101ms) | |
| Average time to find human fix: ~693ms (660 trials, 88 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~71214 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~278 | |
| Repairing: START NAME '(' NUMBER ',' STRING ',' NUMBER ',' '<' NAME '>' ')' END | |
| Found length-2 fix in 232ms after 28716 total and 1 valid samples (123 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~692ms (661 trials, 88 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~71150 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~277 | |
| Repairing: START NAME '=' '[' '[' NUMBER ',' NUMBER ',' NUMBER ',' STRING ',' NUMBER ',' NUMBER ',' NUMBER ']' '[' NUMBER ',' STRING ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ']' END | |
| Found length-1 fix in 190ms after 641 total and 4 valid samples (3 samples/ms, first valid sample: 186ms) | |
| Average time to find human fix: ~692ms (662 trials, 88 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~71043 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~277 | |
| Repairing: START NAME '=' '{' NAME ':' '{' NAME ':' NAME ',' NAME ',' NAME '}' ',' NAME ':' '{' NAME ':' NAME ',' NAME ',' NAME '}' '}' END | |
| Found length-2 fix in 166ms after 428 total and 1 valid samples (2 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~691ms (663 trials, 88 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70937 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~276 | |
| Repairing: START NAME '=' STRING NEWLINE NAME '=' '[' '{' STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER '}' ',' '{' STRING ':' NUMBER NAME ',' STRING ':' NUMBER NAME ',' STRING ':' NUMBER NAME '}' ']' END | |
| Sampling timeout expired after (1783941, 1) (total, valid) samples (77 samples/ms, first valid sample: 0ms), ground truth repair was 3 edits: | |
| START NAME '=' STRING NEWLINE NAME '=' '[' '{' STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER '}' ',' '{' STRING ':' NUMBER NAME ',' STRING ':' NUMBER NAME ',' STRING ':' NUMBER NAME '}' ']' END | |
| START NAME '=' STRING NEWLINE NAME '=' '[' '{' STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER '}' ',' '{' STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER '}' ']' END | |
| -2147483648 40 58 1 39 40 58 59 72 1 55 2 54 1 55 2 54 1 55 2 73 54 72 1 55 2 40 54 1 55 2 40 54 1 55 2 40 73 60 2147483647 | |
| -2147483648 40 58 1 39 40 58 59 72 1 55 2 54 1 55 2 54 1 55 2 73 54 72 1 55 2 54 1 55 2 54 1 55 2 73 60 2147483647 | |
| Repairing: START NAME '=' NUMBER NEWLINE 'for' NAME 'in' NAME '(' STRING ')' ':' NEWLINE 'if' NAME '==' STRING ':' NEWLINE 98 NAME '+=' NUMBER NEWLINE 99 END | |
| Found length-2 fix in 15ms after 78 total and 1 valid samples (4 samples/ms, first valid sample: 15ms) | |
| Average time to find human fix: ~690ms (664 trials, 89 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~70830 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~276 | |
| Repairing: START NAME '=' NAME '(' NAME '(' ')' ',' NAME '=' '{' STRING ':' STRING '}' ',' NAME '=' '[' '{' STRING ':' STRING '}' ',' NAME '=' 'True' ')' END | |
| Found length-1 fix in 434ms after 16774 total and 8 valid samples (38 samples/ms, first valid sample: 334ms) | |
| Average time to find human fix: ~689ms (665 trials, 89 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~70749 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~276 | |
| Repairing: START 'import' NAME '.' NAME NEWLINE NAME '.' NAME '.' NAME '(' STRING ')' '.' NAME '(' UNKNOWN_CHAR NAME '.' NAME ',' NAME '=' 'True' ',' NAME '=' 'True' ')' END | |
| Found length-2 fix in 130ms after 2781 total and 1 valid samples (21 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~688ms (666 trials, 89 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~70647 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~275 | |
| Repairing: START NAME '=' NEWLINE STRING END | |
| Found length-2 fix in 93ms after 17202 total and 73 valid samples (183 samples/ms, first valid sample: 61ms) | |
| Average time to find human fix: ~688ms (667 trials, 89 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~70567 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~275 | |
| Repairing: START 'from' NAME '.' NAME 'import' NAME ',' NAME NEWLINE 'try' ':' NEWLINE 'except' NAME 'as' NAME ':' NEWLINE 98 NAME '(' NAME ')' NEWLINE 'raise' NAME '.' NAME '(' NAME ')' NEWLINE 99 'return' NAME END | |
| Found length-2 fix in 2863ms after 207602 total and 130 valid samples (72 samples/ms, first valid sample: 1871ms) | |
| Average time to find human fix: ~691ms (668 trials, 89 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70772 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~275 | |
| Repairing: START 'in' '=' '[' '[' STRING ']' ',' '[' STRING ']' ',' '[' STRING ']' ',' '[' STRING ']' ']' END | |
| Found length-1 fix in 223ms after 4321 total and 11 valid samples (19 samples/ms, first valid sample: 220ms) | |
| Average time to find human fix: ~690ms (669 trials, 89 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70672 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~274 | |
| Repairing: START '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING '=' STRING '}' END | |
| Found length-1 fix in 96ms after 3697 total and 8 valid samples (38 samples/ms, first valid sample: 79ms) | |
| Average time to find human fix: ~689ms (670 trials, 89 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70573 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~274 | |
| Repairing: START NAME '=' '[' '{' STRING ':' '[' NUMBER ',' STRING ']' '}' '{' STRING ':' '[' NUMBER ',' STRING ']' '}' '{' STRING ':' '[' NUMBER ',' STRING ']' '}' ']' END | |
| Found length-2 fix in 164ms after 1353 total and 1 valid samples (8 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~688ms (671 trials, 89 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~70469 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~274 | |
| Repairing: START 'import' NAME NEWLINE 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '/' NAME NAME ':' NEWLINE NAME NAME END | |
| Sampling timeout expired after (1678331, 198) (total, valid) samples (120 samples/ms, first valid sample: 7248ms), ground truth repair was 3 edits: | |
| START 'import' NAME NEWLINE 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '/' NAME NAME ':' NEWLINE NAME NAME END | |
| START 'import' NAME NEWLINE 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '/' NAME ':' NAME END | |
| -2147483648 8 40 39 8 40 39 40 58 40 49 40 52 1 53 39 40 68 40 40 55 39 40 40 2147483647 | |
| -2147483648 8 40 39 8 40 39 40 58 40 49 40 52 1 53 39 40 68 40 55 40 2147483647 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 98 'if' 'not' NAME '.' NAME '(' STRING ')' ':' NEWLINE 98 NAME '+=' STRING NEWLINE 99 NAME NAME NEWLINE 99 NAME '(' STRING ')' END | |
| Found length-2 fix in 465ms after 12822 total and 171 valid samples (27 samples/ms, first valid sample: 417ms) | |
| Average time to find human fix: ~688ms (672 trials, 90 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~70384 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~273 | |
| Repairing: START '>' NAME NEWLINE STRING NEWLINE END | |
| Found length-1 fix in 9ms after 189 total and 7 valid samples (18 samples/ms, first valid sample: 9ms) | |
| Average time to find human fix: ~687ms (673 trials, 90 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~70279 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~273 | |
| Repairing: START NAME '=' UNKNOWN_CHAR NAME ',' NAME ',' NAME NEWLINE NAME ',' NAME ',' NAME NEWLINE NAME ',' NAME ',' NAME NEWLINE NAME ',' NAME ',' NAME UNKNOWN_CHAR END | |
| Found length-3 fix in 1660ms after 195615 total and 7 valid samples (117 samples/ms, first valid sample: 1164ms) | |
| Average time to find human fix: ~689ms (674 trials, 90 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70465 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~273 | |
| Repairing: START '(' '[' STRING ',' STRING ',' NAME STRING NAME UNKNOWN_CHAR ')' ',' END | |
| Sampling timeout expired after (2431927, 468) (total, valid) samples (112 samples/ms, first valid sample: 5336ms), ground truth repair was 3 edits: | |
| START '(' '[' STRING ',' STRING ',' NAME STRING NAME UNKNOWN_CHAR ')' ',' END | |
| START '(' '[' STRING ',' STRING ',' NAME ']' ')' ',' END | |
| -2147483648 52 59 1 54 1 54 40 1 40 97 53 54 2147483647 | |
| -2147483648 52 59 1 54 1 54 40 60 53 54 2147483647 | |
| Repairing: START '[' STRING ',' STRING ',' STRING ',' STRING NAME STRING NAME UNKNOWN_CHAR ']' END | |
| Found length-3 fix in 5433ms after 628086 total and 512 valid samples (115 samples/ms, first valid sample: 1822ms) | |
| Average time to find human fix: ~696ms (675 trials, 91 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71291 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~273 | |
| Repairing: START NAME '=' NAME '(' STRING ',' '**' NAME '(' STRING ')' '**' ')' NEWLINE NAME '.' NAME '(' NAME ')' END | |
| Found length-1 fix in 214ms after 9674 total and 1 valid samples (44 samples/ms, first valid sample: 209ms) | |
| Average time to find human fix: ~695ms (676 trials, 91 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71200 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~273 | |
| Repairing: START NAME '.' NAME '(' STRING ',' NAME '=' 'True' ')' ';' NAME NAME NEWLINE NAME '.' NAME '(' STRING ',' NAME '=' 'True' ')' ';' END | |
| Found length-1 fix in 136ms after 2030 total and 43 valid samples (14 samples/ms, first valid sample: 128ms) | |
| Average time to find human fix: ~694ms (677 trials, 91 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~71098 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~272 | |
| Repairing: START 'for' NAME ',' NAME ',' NAME 'in' NAME '(' NAME ')' ',' NAME '(' NAME ')' ',' NAME '(' NAME ')' ':' NEWLINE 98 NAME '(' NAME '[' '(' NAME ',' NAME ',' NAME ')' ']' NEWLINE 99 END | |
| Found length-1 fix in 240ms after 3275 total and 11 valid samples (13 samples/ms, first valid sample: 218ms) | |
| Average time to find human fix: ~693ms (678 trials, 91 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~70998 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~272 | |
| Repairing: START NAME '=' NAME '(' NAME '=' NAME ',' NAME '=' NAME UNKNOWN_CHAR NAME '=' '[' STRING ',' STRING ',' STRING ']' ',' NAME '=' STRING ',' NAME '=' STRING ')' END | |
| Found length-1 fix in 587ms after 36000 total and 19 valid samples (61 samples/ms, first valid sample: 411ms) | |
| Average time to find human fix: ~693ms (679 trials, 91 expired after 10000ms) | |
| Average time to find valid fix: ~337ms | |
| Average samples before matched: ~70946 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~271 | |
| Repairing: START NAME '=' '{' STRING ':' NUMBER STRING ':' NUMBER '}' END | |
| Found length-1 fix in 44ms after 1792 total and 8 valid samples (39 samples/ms, first valid sample: 37ms) | |
| Average time to find human fix: ~692ms (680 trials, 91 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70845 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~271 | |
| Repairing: START NAME '.' NAME '(' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER NUMBER ')' END | |
| Found length-1 fix in 72ms after 3403 total and 20 valid samples (46 samples/ms, first valid sample: 61ms) | |
| Average time to find human fix: ~691ms (681 trials, 91 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70746 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~271 | |
| Repairing: START 'if' NAME ':' NEWLINE 98 NAME '=' NAME '(' ')' NEWLINE 'if' NAME ':' NEWLINE 98 NAME '=' NAME '(' ')' NEWLINE 99 '...' '.' NEWLINE 99 END | |
| Found length-1 fix in 323ms after 4783 total and 1 valid samples (14 samples/ms, first valid sample: 307ms) | |
| Average time to find human fix: ~691ms (682 trials, 91 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70649 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~270 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ',' NAME STRING NAME UNKNOWN_CHAR ']' NEWLINE NAME '=' '[' STRING ',' STRING ',' STRING ']' END | |
| Sampling timeout expired after (2432728, 563) (total, valid) samples (100 samples/ms, first valid sample: 10015ms), ground truth repair was 3 edits: | |
| START NAME '=' '[' STRING ',' STRING ',' STRING ',' NAME STRING NAME UNKNOWN_CHAR ']' NEWLINE NAME '=' '[' STRING ',' STRING ',' STRING ']' END | |
| START NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ']' NEWLINE NAME '=' '[' STRING ',' STRING ',' STRING ']' END | |
| -2147483648 40 58 59 1 54 1 54 1 54 40 1 40 97 60 39 40 58 59 1 54 1 54 1 60 2147483647 | |
| -2147483648 40 58 59 1 54 1 54 1 54 1 54 1 60 39 40 58 59 1 54 1 54 1 60 2147483647 | |
| Repairing: START 'if' NAME '[' NUMBER ']' '==' STRING NEWLINE 98 NAME NEWLINE 99 END | |
| Found length-1 fix in 93ms after 2296 total and 2 valid samples (24 samples/ms, first valid sample: 84ms) | |
| Average time to find human fix: ~690ms (683 trials, 92 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70549 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~270 | |
| Repairing: START 'from' NAME 'import' NAME NEWLINE NAME '=' NAME '(' ')' NEWLINE NAME '=' NAME '.' NAME '(' NUMBER ')' NEWLINE NAME '.' NAME '(' NAME ',' NAME ')' '**' END | |
| Found length-1 fix in 396ms after 22749 total and 15 valid samples (57 samples/ms, first valid sample: 333ms) | |
| Average time to find human fix: ~690ms (684 trials, 92 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70479 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~270 | |
| Repairing: START '{' NAME ':' '[' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING '}' ',' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING '}' ']' END | |
| Found length-1 fix in 839ms after 48016 total and 9 valid samples (57 samples/ms, first valid sample: 528ms) | |
| Average time to find human fix: ~690ms (685 trials, 92 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70446 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~269 | |
| Repairing: START NAME '=' NAME '.' NAME '(' '[' STRING ',' NAME UNKNOWN_CHAR ']' ',' NAME '=' 'False' ')' '.' NAME '(' ')' END | |
| Found length-1 fix in 67ms after 448 total and 1 valid samples (6 samples/ms, first valid sample: 66ms) | |
| Average time to find human fix: ~689ms (686 trials, 92 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70344 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~269 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING NAME UNKNOWN_CHAR ']' END | |
| Found length-2 fix in 32ms after 581 total and 11 valid samples (17 samples/ms, first valid sample: 30ms) | |
| Average time to find human fix: ~688ms (687 trials, 92 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70243 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~268 | |
| Repairing: START NAME '=' '[' NAME '.' NAME '(' NAME '.' NAME '(' NUMBER ')' ')' ',' STRING 'if' '(' NAME ')' 'else' NAME 'for' NAME 'in' NAME '[' NAME ']' 'if' NAME '.' NAME '(' NAME ')' ']' END | |
| Found length-2 fix in 1648ms after 114818 total and 743 valid samples (69 samples/ms, first valid sample: 733ms) | |
| Average time to find human fix: ~689ms (688 trials, 92 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70307 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~269 | |
| Repairing: START 'for' NAME 'in' NAME ':' NEWLINE 98 'if' NAME '=' NAME ':' NEWLINE 98 NAME '+=' NUMBER NEWLINE 99 99 'return' NAME END | |
| Found length-1 fix in 189ms after 8058 total and 8 valid samples (42 samples/ms, first valid sample: 165ms) | |
| Average time to find human fix: ~689ms (689 trials, 92 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70217 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~269 | |
| Repairing: START NEWLINE NAME '=' NAME '(' NAME '(' STRING ')' ')' ';' NAME NAME '**' '(' NUMBER '/' NUMBER ')' END | |
| Found length-2 fix in 1ms after 44 total and 1 valid samples (22 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~688ms (690 trials, 92 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70115 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~268 | |
| Repairing: START 'try' ':' NEWLINE 98 NAME '.' NAME '.' NAME NEWLINE 99 'except' NAME ':' NEWLINE 98 '...' '.' NEWLINE 99 END | |
| Found length-2 fix in 1009ms after 105626 total and 122 valid samples (104 samples/ms, first valid sample: 409ms) | |
| Average time to find human fix: ~688ms (691 trials, 92 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70167 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~268 | |
| Repairing: START NAME STRING 'not' NAME 'in' '<' NAME ':' '...' NEWLINE '{' STRING ':' '[' STRING ']' ',' STRING ':' '[' STRING ']' ',' STRING ':' '[' STRING ']' ',' STRING ':' '[' STRING ']' '}' END | |
| Sampling timeout expired after (2033172, 1) (total, valid) samples (92 samples/ms, first valid sample: 11708ms), ground truth repair was 3 edits: | |
| START NAME STRING 'not' NAME 'in' '<' NAME ':' '...' NEWLINE '{' STRING ':' '[' STRING ']' ',' STRING ':' '[' STRING ']' ',' STRING ':' '[' STRING ']' ',' STRING ':' '[' STRING ']' '}' END | |
| START 'not' NAME 'in' NAME ':' '...' NEWLINE '{' STRING ':' '[' STRING ']' ',' STRING ':' '[' STRING ']' ',' STRING ':' '[' STRING ']' ',' STRING ':' '[' STRING ']' '}' END | |
| -2147483648 40 1 26 40 18 74 40 55 50 39 72 1 55 59 1 60 54 1 55 59 1 60 54 1 55 59 1 60 54 1 55 59 1 60 73 2147483647 | |
| -2147483648 26 40 18 40 55 50 39 72 1 55 59 1 60 54 1 55 59 1 60 54 1 55 59 1 60 54 1 55 59 1 60 73 2147483647 | |
| Repairing: START NAME '=' '[' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING '}' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING '}' ']' END | |
| Found length-1 fix in 407ms after 10198 total and 14 valid samples (24 samples/ms, first valid sample: 352ms) | |
| Average time to find human fix: ~688ms (692 trials, 93 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~70080 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~268 | |
| Repairing: START NAME '=' NAME '(' NAME '(' STRING ')' ')' NEWLINE NAME '=' NAME '(' NAME '(' STRING ')' ')' NEWLINE NAME '=' NAME '*' NAME NEWLINE NAME '(' STRING ',' NAME ',' STRING ')' UNKNOWN_CHAR END | |
| Found length-1 fix in 339ms after 4760 total and 6 valid samples (14 samples/ms, first valid sample: 319ms) | |
| Average time to find human fix: ~687ms (693 trials, 93 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~69986 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~267 | |
| Repairing: START 'import' NAME NEWLINE 'class' '(' NAME ')' ':' NEWLINE 98 'def' NAME '(' ')' ':' NEWLINE 98 'pass' NEWLINE 99 99 END | |
| Sampling timeout expired after (3326249, 102) (total, valid) samples (194 samples/ms, first valid sample: 10267ms), ground truth repair was 3 edits: | |
| START 'import' NAME NEWLINE 'class' '(' NAME ')' ':' NEWLINE 98 'def' NAME '(' ')' ':' NEWLINE 98 'pass' NEWLINE 99 99 END | |
| START 'import' NAME NEWLINE 'class' NAME '(' ')' ':' NEWLINE 98 'def' NAME '(' ')' ':' NEWLINE 98 NAME NEWLINE 99 99 END | |
| -2147483648 8 40 39 31 52 40 53 55 39 98 4 40 52 53 55 39 98 34 39 99 99 2147483647 | |
| -2147483648 8 40 39 31 40 52 53 55 39 98 4 40 52 53 55 39 98 40 39 99 99 2147483647 | |
| Repairing: START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 NAME '=' NAME '[' NAME UNKNOWN_CHAR NAME '==' NAME ']' NEWLINE 'return' '(' NAME UNKNOWN_CHAR NAME ',' NAME UNKNOWN_CHAR NAME ')' NEWLINE 99 END | |
| Sampling timeout expired after (1975056, 1) (total, valid) samples (82 samples/ms, first valid sample: 0ms), ground truth repair was 3 edits: | |
| START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 NAME '=' NAME '[' NAME UNKNOWN_CHAR NAME '==' NAME ']' NEWLINE 'return' '(' NAME UNKNOWN_CHAR NAME ',' NAME UNKNOWN_CHAR NAME ')' NEWLINE 99 END | |
| START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 NAME '=' NAME '[' NAME '.' NAME '==' NAME ']' NEWLINE 'return' '(' NAME '.' NAME ',' NAME '.' NAME ')' NEWLINE 99 END | |
| -2147483648 4 40 52 40 54 40 53 55 39 98 40 58 40 59 40 97 40 76 40 60 39 5 52 40 97 40 54 40 97 40 53 39 99 2147483647 | |
| -2147483648 4 40 52 40 54 40 53 55 39 98 40 58 40 59 40 49 40 76 40 60 39 5 52 40 49 40 54 40 49 40 53 39 99 2147483647 | |
| Repairing: START NAME '.' NAME '(' NAME ')' NEWLINE NAME '.' NAME NEWLINE NAME '.' NAME NEWLINE 'class' '.' NAME END | |
| Found length-1 fix in 1270ms after 174381 total and 1 valid samples (137 samples/ms, first valid sample: 1111ms) | |
| Average time to find human fix: ~688ms (694 trials, 95 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70136 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~267 | |
| Repairing: START NAME '=' '{' STRING ':' '{' STRING ':' NUMBER '}' ',' '{' STRING ':' NUMBER '}' '}' END | |
| Found length-2 fix in 81ms after 3411 total and 10 valid samples (41 samples/ms, first valid sample: 69ms) | |
| Average time to find human fix: ~687ms (695 trials, 95 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70040 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~267 | |
| Repairing: START '[' STRING STRING STRING STRING STRING '/' '...' '/' ']' END | |
| Found length-1 fix in 602ms after 99238 total and 127 valid samples (164 samples/ms, first valid sample: 360ms) | |
| Average time to find human fix: ~687ms (696 trials, 95 expired after 10000ms) | |
| Average time to find valid fix: ~336ms | |
| Average samples before matched: ~70082 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~266 | |
| Repairing: START '{' STRING ':' '{' STRING ':' NUMBER '}' ',' '{' STRING ':' '{' STRING ':' NUMBER ',' STRING ':' NUMBER '}' '}' END | |
| Found length-1 fix in 138ms after 1158 total and 14 valid samples (8 samples/ms, first valid sample: 131ms) | |
| Average time to find human fix: ~686ms (697 trials, 95 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~69983 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~266 | |
| Repairing: START NAME '=' '[' '{' STRING ':' '[' NUMBER ',' STRING ']' '}' '{' STRING ':' '[' NUMBER ',' STRING ']' '}' '{' STRING ':' '[' NUMBER ',' STRING ']' '}' ']' END | |
| Found length-2 fix in 72ms after 105 total and 1 valid samples (1 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~685ms (698 trials, 95 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~69883 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~266 | |
| Repairing: START NAME '=' STRING NEWLINE NAME '=' NAME '.' NAME '(' NAME ',' NAME '.' NAME ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' ')' END | |
| Found length-1 fix in 524ms after 36613 total and 76 valid samples (69 samples/ms, first valid sample: 407ms) | |
| Average time to find human fix: ~685ms (699 trials, 95 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~69836 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~265 | |
| Repairing: START NAME '=' '{' NUMBER ':' NUMBER ',' NUMBER ':' NUMBER ',' NUMBER ':' NUMBER ',' NUMBER ':' NUMBER ',' NUMBER ':' NUMBER ')' END | |
| Found length-1 fix in 278ms after 16205 total and 3 valid samples (58 samples/ms, first valid sample: 220ms) | |
| Average time to find human fix: ~684ms (700 trials, 95 expired after 10000ms) | |
| Average time to find valid fix: ~335ms | |
| Average samples before matched: ~69759 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~265 | |
| Repairing: START '>>' '>' NAME '(' '[' '[' NUMBER ',' NUMBER ']' ',' '[' NUMBER ',' NUMBER ']' ',' '[' NUMBER ',' NUMBER ',' NUMBER ']' ']' ')' END | |
| Found length-2 fix in 3ms after 4 total and 1 valid samples (1 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~683ms (701 trials, 95 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~69659 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~265 | |
| Repairing: START NAME '=' '{' STRING ':' NUMBER STRING ':' NUMBER '}' END | |
| Found length-1 fix in 70ms after 448 total and 4 valid samples (6 samples/ms, first valid sample: 69ms) | |
| Average time to find human fix: ~683ms (702 trials, 95 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~69561 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~264 | |
| Repairing: START 'for' NAME 'in' NAME '.' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 NAME '.' NAME '(' '[' NAME '[' NUMBER ']' ',' NAME '[' NUMBER ']' ']' NEWLINE 99 END | |
| Found length-1 fix in 143ms after 1583 total and 6 valid samples (10 samples/ms, first valid sample: 138ms) | |
| Average time to find human fix: ~682ms (703 trials, 95 expired after 10000ms) | |
| Average time to find valid fix: ~334ms | |
| Average samples before matched: ~69464 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~264 | |
| Repairing: START 'lambda' '(' NAME ')' ':' '(' NAME '^' '(' NAME '<<' NUMBER ')' '^' NUMBER ')' '*' NUMBER END | |
| Found length-2 fix in 9ms after 604 total and 1 valid samples (60 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~681ms (704 trials, 95 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~69366 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~264 | |
| Repairing: START NAME '=' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING END | |
| Sampling timeout expired after (1973203, 133) (total, valid) samples (96 samples/ms, first valid sample: 10061ms), ground truth repair was 1 edits: | |
| START NAME '=' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING END | |
| START NAME '=' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING '}' END | |
| -2147483648 40 58 72 1 55 1 54 1 55 1 54 1 55 1 54 1 55 1 54 1 55 1 54 1 55 1 54 1 55 1 54 1 55 1 2147483647 | |
| -2147483648 40 58 72 1 55 1 54 1 55 1 54 1 55 1 54 1 55 1 54 1 55 1 54 1 55 1 54 1 55 1 54 1 55 1 73 2147483647 | |
| Repairing: START NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE NAME '=' NAME '(' STRING ')' NEWLINE NAME NAME END | |
| Found length-1 fix in 285ms after 22823 total and 104 valid samples (79 samples/ms, first valid sample: 199ms) | |
| Average time to find human fix: ~680ms (705 trials, 96 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~69300 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~263 | |
| Repairing: START NAME '=' NAME '(' STRING ')' '.' NAME '(' ')' NEWLINE NAME '=' '[' NUMBER ':' ']' '[' NUMBER ':' ']' END | |
| Found length-1 fix in 302ms after 44633 total and 16 valid samples (147 samples/ms, first valid sample: 187ms) | |
| Average time to find human fix: ~680ms (706 trials, 96 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~69265 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~263 | |
| Repairing: START NAME '(' UNKNOWN_CHAR NAME UNKNOWN_CHAR ')' NEWLINE NAME '(' STRING ')' END | |
| Found length-3 fix in 389ms after 56738 total and 11 valid samples (145 samples/ms, first valid sample: 233ms) | |
| Average time to find human fix: ~679ms (707 trials, 96 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~69248 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~263 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING ',' NAME '(' NUMBER ':' NUMBER ')' ')' ';' END | |
| Found length-3 fix in 412ms after 24574 total and 55 valid samples (59 samples/ms, first valid sample: 240ms) | |
| Average time to find human fix: ~679ms (708 trials, 96 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~69185 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~262 | |
| Repairing: START NAME '=' NAME '.' NAME '.' NAME '(' ')' '<' NAME '>' NEWLINE NAME '.' NAME END | |
| Found length-1 fix in 214ms after 15462 total and 42 valid samples (71 samples/ms, first valid sample: 171ms) | |
| Average time to find human fix: ~678ms (709 trials, 96 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~69109 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~262 | |
| Repairing: START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 'return' NAME '(' NAME '[' NAME '(' NAME ')' ']' '[' NUMBER ']' ')' NEWLINE 99 NAME '(' NAME '(' NAME ',' '**' STRING '**' ')' ')' END | |
| Found length-1 fix in 891ms after 41143 total and 13 valid samples (46 samples/ms, first valid sample: 616ms) | |
| Average time to find human fix: ~679ms (710 trials, 96 expired after 10000ms) | |
| Average time to find valid fix: ~333ms | |
| Average samples before matched: ~69069 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~262 | |
| Repairing: START UNKNOWN_CHAR 'import' NAME NEWLINE NAME '=' STRING NEWLINE NAME '=' '[' NAME '.' NAME '(' NAME ')' 'for' NAME 'in' NAME '(' NAME ')' ']' UNKNOWN_CHAR END | |
| Found length-2 fix in 203ms after 1026 total and 1 valid samples (5 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~678ms (711 trials, 96 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68974 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~261 | |
| Repairing: START '{' STRING ':' STRING END | |
| Sampling timeout expired after (8005338, 17684) (total, valid) samples (210 samples/ms, first valid sample: 7627ms), ground truth repair was 1 edits: | |
| START '{' STRING ':' STRING END | |
| START '{' STRING ':' STRING '}' END | |
| -2147483648 72 1 55 1 2147483647 | |
| -2147483648 72 1 55 1 73 2147483647 | |
| Repairing: START '[' '{' STRING ':' STRING ',' STRING ':' STRING '}' ',' '{' STRING ':' STRING ',' STRING NAME STRING NAME UNKNOWN_CHAR '}' ']' END | |
| Sampling timeout expired after (1806440, 2) (total, valid) samples (99 samples/ms, first valid sample: 10701ms), ground truth repair was 3 edits: | |
| START '[' '{' STRING ':' STRING ',' STRING ':' STRING '}' ',' '{' STRING ':' STRING ',' STRING NAME STRING NAME UNKNOWN_CHAR '}' ']' END | |
| START '[' '{' STRING ':' STRING ',' STRING ':' STRING '}' ',' '{' STRING ':' STRING ',' STRING ':' STRING '}' ']' END | |
| -2147483648 59 72 1 55 1 54 1 55 1 73 54 72 1 55 1 54 1 40 1 40 97 73 60 2147483647 | |
| -2147483648 59 72 1 55 1 54 1 55 1 73 54 72 1 55 1 54 1 55 1 73 60 2147483647 | |
| Repairing: START '[' NUMBER ':' STRING ',' NUMBER ':' STRING ',' NUMBER ':' STRING ']' END | |
| Found length-2 fix in 174ms after 10749 total and 2 valid samples (61 samples/ms, first valid sample: 120ms) | |
| Average time to find human fix: ~677ms (712 trials, 98 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68892 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~261 | |
| Repairing: START NAME '=' NAME '(' NAME '.' NAME '.' NAME '(' UNKNOWN_CHAR '~' '/' NAME '/' NAME '.' NAME ')' ')' NEWLINE NAME '=' NAME '(' NAME ')' NEWLINE NAME '=' STRING '.' NAME '(' NAME '(' NAME ')' ')' END | |
| Sampling timeout expired after (1677069, 1) (total, valid) samples (69 samples/ms, first valid sample: 0ms), ground truth repair was 2 edits: | |
| START NAME '=' NAME '(' NAME '.' NAME '.' NAME '(' UNKNOWN_CHAR '~' '/' NAME '/' NAME '.' NAME ')' ')' NEWLINE NAME '=' NAME '(' NAME ')' NEWLINE NAME '=' STRING '.' NAME '(' NAME '(' NAME ')' ')' END | |
| START NAME '=' NAME '(' NAME '.' NAME '.' NAME '(' STRING '/' NAME '/' NAME '.' NAME ')' ')' NEWLINE NAME '=' NAME '(' NAME ')' NEWLINE NAME '=' STRING '.' NAME '(' NAME '(' NAME ')' ')' END | |
| -2147483648 40 58 40 52 40 49 40 49 40 52 97 71 68 40 68 40 49 40 53 53 39 40 58 40 52 40 53 39 40 58 1 49 40 52 40 52 40 53 53 2147483647 | |
| -2147483648 40 58 40 52 40 49 40 49 40 52 1 68 40 68 40 49 40 53 53 39 40 58 40 52 40 53 39 40 58 1 49 40 52 40 52 40 53 53 2147483647 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 'for' NAME 'in' NAME '.' NAME ':' NEWLINE NAME '=' NAME '.' NAME '.' NAME '(' NAME ')' NEWLINE NAME '.' NAME '(' NAME ',' NAME ')' END | |
| Sampling timeout expired after (1789658, 437) (total, valid) samples (88 samples/ms, first valid sample: 10003ms), ground truth repair was 3 edits: | |
| START 'def' NAME '(' NAME ')' ':' NEWLINE 'for' NAME 'in' NAME '.' NAME ':' NEWLINE NAME '=' NAME '.' NAME '.' NAME '(' NAME ')' NEWLINE NAME '.' NAME '(' NAME ',' NAME ')' END | |
| START 'def' NAME '(' NAME ')' ':' NEWLINE 98 'for' NAME 'in' NAME '.' NAME ':' NAME '=' NAME '.' NAME '.' NAME '(' NAME ')' NEWLINE 99 NAME '.' NAME '(' NAME ',' NAME ')' END | |
| -2147483648 4 40 52 40 53 55 39 17 40 18 40 49 40 55 39 40 58 40 49 40 49 40 52 40 53 39 40 49 40 52 40 54 40 53 2147483647 | |
| -2147483648 4 40 52 40 53 55 39 98 17 40 18 40 49 40 55 40 58 40 49 40 49 40 52 40 53 39 99 40 49 40 52 40 54 40 53 2147483647 | |
| Repairing: START UNKNOWN_CHAR NAME '=' STRING NEWLINE NAME '=' '{' STRING ':' NAME '(' STRING ',' STRING ')' '}' NEWLINE NAME '=' NAME '.' NAME '(' NAME ',' NAME '=' NAME ')' UNKNOWN_CHAR NEWLINE END | |
| Found length-2 fix in 154ms after 853 total and 1 valid samples (5 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~677ms (713 trials, 100 expired after 10000ms) | |
| Average time to find valid fix: ~332ms | |
| Average samples before matched: ~68797 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~261 | |
| Repairing: START NAME ':' '(' NUMBER ',' NUMBER ')' NEWLINE NAME ':' '(' NUMBER ',' NUMBER ')' NEWLINE NAME ':' '(' NUMBER ',' END | |
| Sampling timeout expired after (3338197, 161) (total, valid) samples (114 samples/ms, first valid sample: 10087ms), ground truth repair was 1 edits: | |
| START NAME ':' '(' NUMBER ',' NUMBER ')' NEWLINE NAME ':' '(' NUMBER ',' NUMBER ')' NEWLINE NAME ':' '(' NUMBER ',' END | |
| START NAME ':' '(' NUMBER ',' NUMBER ')' NEWLINE NAME ':' '(' NUMBER ',' NUMBER ')' NEWLINE NAME ':' '(' NUMBER ',' ')' END | |
| -2147483648 40 55 52 2 54 2 53 39 40 55 52 2 54 2 53 39 40 55 52 2 54 2147483647 | |
| -2147483648 40 55 52 2 54 2 53 39 40 55 52 2 54 2 53 39 40 55 52 2 54 53 2147483647 | |
| Repairing: START '[' '[' STRING ',' STRING ']' ',' '[' STRING ',' STRING NAME STRING NAME UNKNOWN_CHAR ']' ']' END | |
| Found length-3 fix in 197ms after 7321 total and 7 valid samples (36 samples/ms, first valid sample: 157ms) | |
| Average time to find human fix: ~676ms (714 trials, 101 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68710 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~260 | |
| Repairing: START NAME '=' '[' STRING ',' UNKNOWN_CHAR NAME ']' END | |
| Found length-2 fix in 1ms after 91 total and 2 valid samples (45 samples/ms, first valid sample: 1ms) | |
| Average time to find human fix: ~675ms (715 trials, 101 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68614 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~260 | |
| Repairing: START 'def' NAME '(' NAME ',' NAME ',' NAME ',' NAME ',' NAME ')' ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' NAME '=' NAME ',' NAME '=' NAME '.' NAME '(' NAME ')' ',' NEWLINE 99 END | |
| Sampling timeout expired after (1665409, 11161) (total, valid) samples (88 samples/ms, first valid sample: 10001ms), ground truth repair was 2 edits: | |
| START 'def' NAME '(' NAME ',' NAME ',' NAME ',' NAME ',' NAME ')' ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' NAME '=' NAME ',' NAME '=' NAME '.' NAME '(' NAME ')' ',' NEWLINE 99 END | |
| START 'def' NAME '(' NAME ',' NAME ',' NAME ',' NAME ',' NAME ')' ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' NAME '=' NAME ',' NAME '=' NAME '.' NAME '(' NAME ')' ',' ')' ',' NEWLINE 99 END | |
| -2147483648 4 40 52 40 54 40 54 40 54 40 54 40 53 55 39 98 40 58 40 49 40 52 40 58 40 54 40 58 40 49 40 52 40 53 54 39 99 2147483647 | |
| -2147483648 4 40 52 40 54 40 54 40 54 40 54 40 53 55 39 98 40 58 40 49 40 52 40 58 40 54 40 58 40 49 40 52 40 53 54 53 54 39 99 2147483647 | |
| Repairing: START '[' STRING ',' STRING ']' NEWLINE '[' STRING ',' STRING ']' NEWLINE '[' STRING ',' STRING ']' NEWLINE '[' STRING NUMBER NAME NAME UNKNOWN_CHAR ']' NEWLINE '[' STRING ',' STRING ']' NEWLINE END | |
| Sampling timeout expired after (1910226, 6) (total, valid) samples (82 samples/ms, first valid sample: 12867ms), ground truth repair was 3 edits: | |
| START '[' STRING ',' STRING ']' NEWLINE '[' STRING ',' STRING ']' NEWLINE '[' STRING ',' STRING ']' NEWLINE '[' STRING NUMBER NAME NAME UNKNOWN_CHAR ']' NEWLINE '[' STRING ',' STRING ']' NEWLINE END | |
| START '[' STRING ',' STRING ']' NEWLINE '[' STRING ',' STRING ']' NEWLINE '[' STRING ',' STRING ']' NEWLINE '[' STRING ',' NAME ']' NEWLINE '[' STRING ',' STRING ']' NEWLINE END | |
| -2147483648 59 1 54 1 60 39 59 1 54 1 60 39 59 1 54 1 60 39 59 1 2 40 40 97 60 39 59 1 54 1 60 39 2147483647 | |
| -2147483648 59 1 54 1 60 39 59 1 54 1 60 39 59 1 54 1 60 39 59 1 54 40 60 39 59 1 54 1 60 39 2147483647 | |
| Repairing: START NAME '=' NUMBER NEWLINE NAME '=' STRING NEWLINE 'for' NAME 'in' NAME ':' NEWLINE 98 'if' NAME 'in' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ']' ':' NEWLINE NAME '+=' NUMBER NEWLINE 99 END | |
| Found length-2 fix in 41ms after 1890 total and 5 valid samples (45 samples/ms, first valid sample: 30ms) | |
| Average time to find human fix: ~674ms (716 trials, 103 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68521 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~259 | |
| Repairing: START NAME '.' NAME '(' STRING END | |
| Sampling timeout expired after (3203842, 18919) (total, valid) samples (207 samples/ms, first valid sample: 3907ms), ground truth repair was 2 edits: | |
| START NAME '.' NAME '(' STRING END | |
| START NAME '.' NAME '(' STRING ',' ')' END | |
| -2147483648 40 49 40 52 1 2147483647 | |
| -2147483648 40 49 40 52 1 54 53 2147483647 | |
| Repairing: START NAME '=' '[' '(' NUMBER ',' STRING ',' STRING ',' STRING ',' STRING ')' ',' '(' NUMBER ',' STRING ',' STRING ',' STRING ')' ',' '(' NUMBER ',' STRING ')' END | |
| Found length-1 fix in 107ms after 5806 total and 2 valid samples (53 samples/ms, first valid sample: 83ms) | |
| Average time to find human fix: ~673ms (717 trials, 104 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68434 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~259 | |
| Repairing: START NAME '.' NAME '(' ')' '.' NAME '(' 'lambda' NAME ',' NAME ':' NAME '==' STRING ')' NEWLINE '.' NAME '(' 'lambda' NAME ',' NAME ':' NAME ')' '.' NAME '(' ')' END | |
| Found length-1 fix in 388ms after 16009 total and 2 valid samples (41 samples/ms, first valid sample: 375ms) | |
| Average time to find human fix: ~673ms (718 trials, 104 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68361 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~259 | |
| Repairing: START '>>' '[' STRING ',' STRING ',' STRING ',' STRING STRING ',' STRING ',' STRING ']' END | |
| Found length-1 fix in 876ms after 89267 total and 38 valid samples (101 samples/ms, first valid sample: 573ms) | |
| Average time to find human fix: ~673ms (719 trials, 104 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68390 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~258 | |
| Repairing: START NAME '=' '[' '[' STRING ',' STRING ']' ',' '[' STRING ',' STRING ']' ',' '[' STRING ',' STRING ']' ']' UNKNOWN_CHAR END | |
| Found length-1 fix in 104ms after 3229 total and 14 valid samples (30 samples/ms, first valid sample: 90ms) | |
| Average time to find human fix: ~672ms (720 trials, 104 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68299 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~258 | |
| Repairing: START 'def' NAME '(' ')' ':' NEWLINE 98 'return' STRING NEWLINE 99 'def' NAME '(' ')' ':' NEWLINE 98 'return' STRING NEWLINE 99 '...' '.' END | |
| Found length-1 fix in 716ms after 43910 total and 73 valid samples (61 samples/ms, first valid sample: 460ms) | |
| Average time to find human fix: ~672ms (721 trials, 104 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68266 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~258 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 'return' '(' NAME '(' NAME ',' NAME '=' NAME ')' ')' END | |
| Sampling timeout expired after (3314483, 7388) (total, valid) samples (123 samples/ms, first valid sample: 10005ms), ground truth repair was 3 edits: | |
| START 'def' NAME '(' NAME ')' ':' NEWLINE 'return' '(' NAME '(' NAME ',' NAME '=' NAME ')' ')' END | |
| START 'def' NAME '(' NAME ')' ':' NEWLINE 98 'return' '(' NAME '(' NAME ',' NAME '=' NAME ')' ')' NEWLINE 99 END | |
| -2147483648 4 40 52 40 53 55 39 5 52 40 52 40 54 40 58 40 53 53 2147483647 | |
| -2147483648 4 40 52 40 53 55 39 98 5 52 40 52 40 54 40 58 40 53 53 39 99 2147483647 | |
| Repairing: START UNKNOWN_CHAR 'class' NAME ':' NEWLINE 98 'pass' UNKNOWN_CHAR NEWLINE 99 END | |
| Found length-3 fix in 273ms after 84036 total and 1 valid samples (306 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~672ms (722 trials, 105 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68287 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~257 | |
| Repairing: START NAME '(' NUMBER ')' '==' NAME '.' END | |
| Found length-1 fix in 39ms after 1073 total and 3 valid samples (26 samples/ms, first valid sample: 38ms) | |
| Average time to find human fix: ~671ms (723 trials, 105 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~68194 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~257 | |
| Repairing: START NAME '=' '[' '[' STRING ',' STRING ',' STRING ',' STRING ']' ',' '[' STRING ',' STRING ',' STRING ',' STRING ']' ']' '.' END | |
| Found length-2 fix in 231ms after 11983 total and 23 valid samples (51 samples/ms, first valid sample: 169ms) | |
| Average time to find human fix: ~670ms (724 trials, 105 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~68117 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~257 | |
| Repairing: START NUMBER 'import' NAME NEWLINE NUMBER NEWLINE NUMBER NAME '.' NAME '(' STRING ')' END | |
| Found length-2 fix in 983ms after 130805 total and 2 valid samples (132 samples/ms, first valid sample: 819ms) | |
| Average time to find human fix: ~671ms (725 trials, 105 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68203 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~256 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 'assert' NAME '>' NUMBER NEWLINE 98 'if' NAME ':' NEWLINE 98 'return' NAME NEWLINE 99 'else' ':' NEWLINE 98 'return' NAME NEWLINE 99 99 END | |
| Found length-2 fix in 271ms after 6912 total and 1 valid samples (25 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~670ms (726 trials, 105 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~68119 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~256 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING '*' NUMBER ',' NAME '(' NUMBER ':' NUMBER ')' ')' ';' END | |
| Found length-3 fix in 963ms after 66072 total and 141 valid samples (68 samples/ms, first valid sample: 494ms) | |
| Average time to find human fix: ~671ms (727 trials, 105 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68116 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~256 | |
| Repairing: START 'import' NAME NEWLINE 'import' NAME 'as' NAME NEWLINE 'import' NAME NEWLINE NAME NAME ':' NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' END | |
| Found length-2 fix in 201ms after 3972 total and 2 valid samples (19 samples/ms, first valid sample: 199ms) | |
| Average time to find human fix: ~670ms (728 trials, 105 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68028 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~256 | |
| Repairing: START NAME '.' NAME '(' STRING ',' NAME '=' NAME '.' NAME '(' ')' END | |
| Found length-1 fix in 1ms after 2 total and 1 valid samples (1 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~669ms (729 trials, 105 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~67935 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~255 | |
| Repairing: START '{' STRING ':' STRING ',' END | |
| Sampling timeout expired after (2624833, 69982) (total, valid) samples (204 samples/ms, first valid sample: 2741ms), ground truth repair was 1 edits: | |
| START '{' STRING ':' STRING ',' END | |
| START '{' STRING ':' STRING ',' '}' END | |
| -2147483648 72 1 55 1 54 2147483647 | |
| -2147483648 72 1 55 1 54 73 2147483647 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 'if' NAME '[' STRING ']' '<=' NAME '[' STRING ']' '.' NAME '(' NUMBER ')' ':' NEWLINE 98 'return' NUMBER NEWLINE 99 'else' ':' NEWLINE 98 'return' NUMBER NEWLINE 99 END | |
| Found length-2 fix in 52ms after 1085 total and 1 valid samples (20 samples/ms, first valid sample: 47ms) | |
| Average time to find human fix: ~668ms (730 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~67843 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~255 | |
| Repairing: START '{' STRING ':' UNKNOWN_CHAR NAME ',' STRING ':' STRING '}' END | |
| Found length-2 fix in 20ms after 165 total and 1 valid samples (7 samples/ms, first valid sample: 19ms) | |
| Average time to find human fix: ~667ms (731 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~67750 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~255 | |
| Repairing: START 'class' NAME '(' NAME '.' NAME ')' ':' NEWLINE NAME '=' NAME '.' NAME '(' NAME '=' NUMBER ',' NAME '=' 'True' ')' NEWLINE 'def' NAME '(' NAME ')' ':' NEWLINE 98 'return' NAME '.' NAME NEWLINE 99 END | |
| Found length-2 fix in 186ms after 889 total and 4 valid samples (4 samples/ms, first valid sample: 182ms) | |
| Average time to find human fix: ~667ms (732 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~67659 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~254 | |
| Repairing: START NAME '=' NAME '+' NUMBER NAME '==' END | |
| Found length-2 fix in 213ms after 24690 total and 1 valid samples (115 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~666ms (733 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~67600 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~254 | |
| Repairing: START NAME '=' NAME '(' NAME ',' NAME '=' NAME '(' NAME '.' NAME '[' NAME ']' '[' NUMBER ']' 'for' NAME 'in' NAME '(' NAME '(' NAME '.' NAME ')' ')' ')' END | |
| Found length-1 fix in 19ms after 168 total and 6 valid samples (8 samples/ms, first valid sample: 18ms) | |
| Average time to find human fix: ~665ms (734 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67509 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~253 | |
| Repairing: START NAME '=' STRING UNKNOWN_CHAR NEWLINE NAME '=' STRING NEWLINE NAME '=' STRING END | |
| Found length-1 fix in 212ms after 21848 total and 23 valid samples (102 samples/ms, first valid sample: 166ms) | |
| Average time to find human fix: ~665ms (735 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67446 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~253 | |
| Repairing: START NAME '=' NAME '.' NAME '(' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ']' END | |
| Found length-1 fix in 151ms after 6558 total and 1 valid samples (43 samples/ms, first valid sample: 138ms) | |
| Average time to find human fix: ~664ms (736 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67364 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~253 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ':' STRING ']' END | |
| Found length-1 fix in 255ms after 28747 total and 92 valid samples (112 samples/ms, first valid sample: 140ms) | |
| Average time to find human fix: ~663ms (737 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67311 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~253 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '=' '{' NAME '.' NAME '[' STRING ']' 'for' NAME 'in' NAME '}' NEWLINE NAME NAME END | |
| Found length-1 fix in 381ms after 14213 total and 82 valid samples (37 samples/ms, first valid sample: 317ms) | |
| Average time to find human fix: ~663ms (738 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67239 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~252 | |
| Repairing: START '[' NUMBER NUMBER ',' NUMBER ',' NUMBER ']' END | |
| Found length-1 fix in 21ms after 234 total and 1 valid samples (10 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~662ms (739 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67149 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~252 | |
| Repairing: START NAME '(' NAME ')' NAME NAME 'is' NUMBER END | |
| Found length-2 fix in 286ms after 31413 total and 706 valid samples (109 samples/ms, first valid sample: 147ms) | |
| Average time to find human fix: ~662ms (740 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67100 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~253 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' UNKNOWN_CHAR NAME ']' NEWLINE NAME '=' NUMBER END | |
| Found length-2 fix in 18ms after 1355 total and 6 valid samples (71 samples/ms, first valid sample: 13ms) | |
| Average time to find human fix: ~661ms (741 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~325ms | |
| Average samples before matched: ~67012 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~252 | |
| Repairing: START '**' NAME '.' NAME ':' '**' NEWLINE NAME ',' NAME NEWLINE NUMBER ',' NUMBER NEWLINE NUMBER ',' NUMBER NEWLINE NUMBER ',' NUMBER END | |
| Found length-3 fix in 784ms after 63587 total and 1 valid samples (81 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~661ms (742 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~325ms | |
| Average samples before matched: ~67007 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~252 | |
| Repairing: START NAME '=' '[' '[' STRING ',' STRING ',' STRING ']' ',' STRING ']' ',' '[' '[' STRING ',' STRING ',' STRING ']' ',' STRING ']' ']' END | |
| Found length-1 fix in 427ms after 16576 total and 42 valid samples (38 samples/ms, first valid sample: 355ms) | |
| Average time to find human fix: ~661ms (743 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~325ms | |
| Average samples before matched: ~66939 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~252 | |
| Repairing: START NAME '=' NAME '(' STRING ')' NEWLINE NAME '=' NAME '(' STRING ')' NEWLINE NAME '=' NAME '(' STRING NUMBER NAME '=' '[' NAME ',' NAME ',' NAME ']' END | |
| Found length-2 fix in 475ms after 11159 total and 1 valid samples (23 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~660ms (744 trials, 106 expired after 10000ms) | |
| Average time to find valid fix: ~325ms | |
| Average samples before matched: ~66864 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~251 | |
| Repairing: START NAME '[' STRING ']' '[' STRING ']' '[' STRING ']' '[' STRING NAME NAME UNKNOWN_CHAR END | |
| Sampling timeout expired after (4192547, 48) (total, valid) samples (117 samples/ms, first valid sample: 10183ms), ground truth repair was 3 edits: | |
| START NAME '[' STRING ']' '[' STRING ']' '[' STRING ']' '[' STRING NAME NAME UNKNOWN_CHAR END | |
| START NAME '[' STRING ']' '[' STRING ']' '[' STRING ']' '[' STRING ']' '=' STRING END | |
| -2147483648 40 59 1 60 59 1 60 59 1 60 59 1 40 40 97 2147483647 | |
| -2147483648 40 59 1 60 59 1 60 59 1 60 59 1 60 58 1 2147483647 | |
| Repairing: START NAME '=' NEWLINE NAME '.' NAME '(' STRING ',' STRING ')' END | |
| Found length-1 fix in 178ms after 18518 total and 17 valid samples (103 samples/ms, first valid sample: 137ms) | |
| Average time to find human fix: ~660ms (745 trials, 107 expired after 10000ms) | |
| Average time to find valid fix: ~324ms | |
| Average samples before matched: ~66799 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~251 | |
| Repairing: START NAME '=' STRING NEWLINE '>>' '>' NAME '.' NAME '(' NAME ')' NEWLINE '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ']' END | |
| Found length-2 fix in 346ms after 11666 total and 8 valid samples (33 samples/ms, first valid sample: 303ms) | |
| Average time to find human fix: ~659ms (746 trials, 107 expired after 10000ms) | |
| Average time to find valid fix: ~324ms | |
| Average samples before matched: ~66725 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~251 | |
| Repairing: START '>>' '>' '[' STRING ',' STRING ',' STRING ']' END | |
| Found length-2 fix in 2ms after 188 total and 1 valid samples (62 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~658ms (747 trials, 107 expired after 10000ms) | |
| Average time to find valid fix: ~324ms | |
| Average samples before matched: ~66636 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~250 | |
| Repairing: START NAME NUMBER '=' NUMBER '-' NUMBER NEWLINE NAME NUMBER '=' NUMBER '-' NUMBER NEWLINE NAME NUMBER '=' NUMBER '-' NUMBER NEWLINE '...' END | |
| Sampling timeout expired after (3152668, 33) (total, valid) samples (148 samples/ms, first valid sample: 10483ms), ground truth repair was 3 edits: | |
| START NAME NUMBER '=' NUMBER '-' NUMBER NEWLINE NAME NUMBER '=' NUMBER '-' NUMBER NEWLINE NAME NUMBER '=' NUMBER '-' NUMBER NEWLINE '...' END | |
| START NAME '=' NUMBER '-' NUMBER NEWLINE NAME '=' NUMBER '-' NUMBER NEWLINE NAME '=' NUMBER '-' NUMBER NEWLINE '...' END | |
| -2147483648 40 2 58 2 67 2 39 40 2 58 2 67 2 39 40 2 58 2 67 2 39 50 2147483647 | |
| -2147483648 40 58 2 67 2 39 40 58 2 67 2 39 40 58 2 67 2 39 50 2147483647 | |
| Repairing: START NAME '=' '{' STRING ':' '[' NUMBER ']' ',' STRING ':' '[' NUMBER ',' NUMBER ']' ',' STRING ':' '[' NUMBER ',' NUMBER ']' ')' END | |
| Found length-1 fix in 518ms after 39193 total and 2 valid samples (75 samples/ms, first valid sample: 368ms) | |
| Average time to find human fix: ~658ms (748 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~324ms | |
| Average samples before matched: ~66600 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~250 | |
| Repairing: START NAME '(' ')' NEWLINE NAME '(' ')' NEWLINE NAME NAME NAME END | |
| Found length-2 fix in 37ms after 1506 total and 17 valid samples (39 samples/ms, first valid sample: 31ms) | |
| Average time to find human fix: ~657ms (749 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66513 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~250 | |
| Repairing: START NAME '.' NAME '(' STRING END | |
| Found length-1 fix in 452ms after 73986 total and 426 valid samples (163 samples/ms, first valid sample: 186ms) | |
| Average time to find human fix: ~657ms (750 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66523 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~250 | |
| Repairing: START NAME '.' NAME '[' NAME '[' STRING ']' '=' STRING ',' STRING ']' '.' NAME '(' STRING ',' STRING ',' NAME '=' 'True' ',' NAME '=' 'True' ')' END | |
| Found length-1 fix in 279ms after 5926 total and 4 valid samples (21 samples/ms, first valid sample: 246ms) | |
| Average time to find human fix: ~657ms (751 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66442 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~250 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING NAME STRING NAME UNKNOWN_CHAR ']' END | |
| Found length-3 fix in 5371ms after 631626 total and 253 valid samples (117 samples/ms, first valid sample: 1727ms) | |
| Average time to find human fix: ~663ms (752 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~325ms | |
| Average samples before matched: ~67194 | |
| Average repair throughput / ms: ~60 | |
| Average valid repairs detected: ~250 | |
| Repairing: START '[' '(' NUMBER ',' NUMBER ')' ',' '(' NUMBER ',' NUMBER ')' ',' '...' '.' ']' END | |
| Found length-1 fix in 107ms after 629 total and 1 valid samples (5 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~662ms (753 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~325ms | |
| Average samples before matched: ~67105 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START 'from' NAME 'import' NAME NEWLINE NAME '=' NAME '(' NAME ')' NEWLINE 'from' NAME 'import' NAME '.' NAME END | |
| Found length-2 fix in 119ms after 3246 total and 1 valid samples (27 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~661ms (754 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~324ms | |
| Average samples before matched: ~67020 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START '{' STRING ':' '{' STRING ':' STRING '}' ',' '{' STRING ':' STRING '}' '}' END | |
| Found length-2 fix in 51ms after 3851 total and 28 valid samples (74 samples/ms, first valid sample: 35ms) | |
| Average time to find human fix: ~661ms (755 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~324ms | |
| Average samples before matched: ~66937 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START NAME '=' '{' STRING ':' '{' STRING ':' STRING ',' STRING ':' NAME '.' NAME '.' NAME '(' NAME ',' STRING ')' ',' '}' END | |
| Found length-1 fix in 63ms after 593 total and 1 valid samples (9 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~660ms (756 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66849 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START NAME '=' '[' '(' STRING ',' STRING ',' STRING ',' STRING ']' END | |
| Found length-1 fix in 410ms after 48365 total and 476 valid samples (117 samples/ms, first valid sample: 199ms) | |
| Average time to find human fix: ~659ms (757 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66825 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START NAME '=' STRING '%' NUMBER NEWLINE NAME '=' NAME '.' NAME '(' NAME ',' NAME ')' NEWLINE NAME NAME UNKNOWN_CHAR END | |
| Found length-2 fix in 171ms after 5287 total and 2 valid samples (30 samples/ms, first valid sample: 166ms) | |
| Average time to find human fix: ~659ms (758 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66743 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START NAME '=' '{' STRING ':' '{' STRING ':' NUMBER ',' STRING ':' NUMBER '}' STRING ':' '{' STRING ':' NUMBER ',' STRING ':' NUMBER '}' '}' END | |
| Found length-1 fix in 203ms after 3167 total and 14 valid samples (15 samples/ms, first valid sample: 186ms) | |
| Average time to find human fix: ~658ms (759 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66660 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START 'import' NAME NEWLINE '...' '.' NEWLINE NAME '=' NAME '.' NAME '(' NAME '(' STRING ',' STRING ')' ',' NAME '=' STRING ')' NEWLINE NAME '.' NAME '(' NAME ')' END | |
| Found length-1 fix in 286ms after 318 total and 1 valid samples (1 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~658ms (760 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~322ms | |
| Average samples before matched: ~66572 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START NAME STRING '.' NAME '(' STRING '%' '(' NAME ',' NAME ')' 'for' NAME ',' NAME 'in' NAME ')' END | |
| Found length-2 fix in 1ms after 49 total and 1 valid samples (24 samples/ms, first valid sample: 1ms) | |
| Average time to find human fix: ~657ms (761 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~322ms | |
| Average samples before matched: ~66485 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING ',' NAME '(' NUMBER ':' NUMBER ')' ')' ';' END | |
| Found length-3 fix in 1333ms after 124965 total and 292 valid samples (93 samples/ms, first valid sample: 455ms) | |
| Average time to find human fix: ~658ms (762 trials, 108 expired after 10000ms) | |
| Average time to find valid fix: ~322ms | |
| Average samples before matched: ~66562 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START NEWLINE 98 NAME '=' NAME '(' NAME ')' NEWLINE 99 'if' NAME 'in' '(' NUMBER ',' NUMBER ',' NUMBER ')' ':' NEWLINE 98 'return' NAME NEWLINE 99 END | |
| Sampling timeout expired after (1578676, 29) (total, valid) samples (130 samples/ms, first valid sample: 7113ms), ground truth repair was 3 edits: | |
| START NEWLINE 98 NAME '=' NAME '(' NAME ')' NEWLINE 99 'if' NAME 'in' '(' NUMBER ',' NUMBER ',' NUMBER ')' ':' NEWLINE 98 'return' NAME NEWLINE 99 END | |
| START NAME '=' NAME '(' NAME ')' NEWLINE 'if' NAME 'in' '(' NUMBER ',' NUMBER ',' NUMBER ')' ':' NEWLINE 98 'return' NAME NEWLINE 99 END | |
| -2147483648 39 98 40 58 40 52 40 53 39 99 13 40 18 52 2 54 2 54 2 53 55 39 98 5 40 39 99 2147483647 | |
| -2147483648 40 58 40 52 40 53 39 13 40 18 52 2 54 2 54 2 53 55 39 98 5 40 39 99 2147483647 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING '*' NUMBER ',' NAME '(' NUMBER ':' NUMBER ')' ')' ';' END | |
| Found length-3 fix in 4673ms after 428204 total and 1070 valid samples (91 samples/ms, first valid sample: 1399ms) | |
| Average time to find human fix: ~663ms (763 trials, 109 expired after 10000ms) | |
| Average time to find valid fix: ~324ms | |
| Average samples before matched: ~67036 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START NAME '(' STRING ',' STRING ')' NEWLINE NAME ':' NAME 'not' NAME NAME 'in' NAME END | |
| Found length-2 fix in 230ms after 14977 total and 6 valid samples (64 samples/ms, first valid sample: 174ms) | |
| Average time to find human fix: ~662ms (764 trials, 109 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66968 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START NAME NAME ':' NEWLINE 98 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 NAME '.' NAME '=' NAME NEWLINE 'return' NAME '.' NAME NEWLINE 99 99 END | |
| Found length-2 fix in 265ms after 4396 total and 2 valid samples (16 samples/ms, first valid sample: 260ms) | |
| Average time to find human fix: ~662ms (765 trials, 109 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66886 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START NAME '=' NUMBER NEWLINE NAME '=' NAME NEWLINE NAME '=' NUMBER NEWLINE NAME NAME END | |
| Sampling timeout expired after (3932201, 20255) (total, valid) samples (171 samples/ms, first valid sample: 10000ms), ground truth repair was 2 edits: | |
| START NAME '=' NUMBER NEWLINE NAME '=' NAME NEWLINE NAME '=' NUMBER NEWLINE NAME NAME END | |
| START NAME '=' NUMBER NEWLINE NAME '=' NAME NEWLINE NAME '=' NUMBER NEWLINE NAME '(' NAME ')' END | |
| -2147483648 40 58 2 39 40 58 40 39 40 58 2 39 40 40 2147483647 | |
| -2147483648 40 58 2 39 40 58 40 39 40 58 2 39 40 52 40 53 2147483647 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING ',' NAME '=' STRING ')' UNKNOWN_CHAR END | |
| Found length-1 fix in 9ms after 281 total and 2 valid samples (28 samples/ms, first valid sample: 8ms) | |
| Average time to find human fix: ~661ms (766 trials, 110 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66799 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START NAME NAME ':' NEWLINE 98 'def' NAME '(' NAME ')' ':' NEWLINE 98 NAME '=' NAME NEWLINE 'return' NAME NEWLINE 99 99 END | |
| Found length-2 fix in 200ms after 238 total and 1 valid samples (1 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~660ms (767 trials, 110 expired after 10000ms) | |
| Average time to find valid fix: ~322ms | |
| Average samples before matched: ~66712 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START NAME NAME '*' NEWLINE NAME '(' NAME '*' NAME ',' NAME '*' NAME ',' NAME '*' NAME ')' NEWLINE '{' END | |
| Sampling timeout expired after (3221436, 1) (total, valid) samples (126 samples/ms, first valid sample: 0ms), ground truth repair was 3 edits: | |
| START NAME NAME '*' NEWLINE NAME '(' NAME '*' NAME ',' NAME '*' NAME ',' NAME '*' NAME ')' NEWLINE '{' END | |
| START NAME '*' NAME '(' NAME '*' NAME ',' NAME '*' NAME ',' NAME '*' NAME ')' NEWLINE END | |
| -2147483648 40 40 51 39 40 52 40 51 40 54 40 51 40 54 40 51 40 53 39 72 2147483647 | |
| -2147483648 40 51 40 52 40 51 40 54 40 51 40 54 40 51 40 53 39 2147483647 | |
| Repairing: START NAME '=' '[' NAME '(' STRING STRING ',' NAME ',' NAME '=' STRING ')' ',' END | |
| Sampling timeout expired after (3991331, 21629) (total, valid) samples (124 samples/ms, first valid sample: 10038ms), ground truth repair was 1 edits: | |
| START NAME '=' '[' NAME '(' STRING STRING ',' NAME ',' NAME '=' STRING ')' ',' END | |
| START NAME '=' '[' NAME '(' STRING STRING ',' NAME ',' NAME '=' STRING ')' ',' ']' END | |
| -2147483648 40 58 59 40 52 1 1 54 40 54 40 58 1 53 54 2147483647 | |
| -2147483648 40 58 59 40 52 1 1 54 40 54 40 58 1 53 54 60 2147483647 | |
| Repairing: START NAME '=' '(' NAME '.' NAME '(' NAME ',' NAME '=' NAME ')' 'for' NAME 'in' NAME ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' '.' END | |
| Found length-1 fix in 189ms after 853 total and 1 valid samples (4 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~660ms (768 trials, 112 expired after 10000ms) | |
| Average time to find valid fix: ~322ms | |
| Average samples before matched: ~66626 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE NAME '=' NUMBER NEWLINE 'for' NAME 'in' NAME ':' NEWLINE 98 NAME '+=' NAME NEWLINE 99 'return' NAME END | |
| Found length-2 fix in 99ms after 718 total and 1 valid samples (7 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~659ms (769 trials, 112 expired after 10000ms) | |
| Average time to find valid fix: ~322ms | |
| Average samples before matched: ~66541 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING '*' NUMBER ',' NAME '(' NUMBER ':' NUMBER ')' ')' ';' END | |
| Found length-3 fix in 239ms after 13208 total and 34 valid samples (55 samples/ms, first valid sample: 145ms) | |
| Average time to find human fix: ~659ms (770 trials, 112 expired after 10000ms) | |
| Average time to find valid fix: ~321ms | |
| Average samples before matched: ~66471 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~246 | |
| Repairing: START NEWLINE NAME '=' '[' STRING NAME '-' NUMBER STRING NAME '-' NUMBER UNKNOWN_CHAR ']' END | |
| Sampling timeout expired after (4529447, 59) (total, valid) samples (152 samples/ms, first valid sample: 10065ms), ground truth repair was 3 edits: | |
| START NEWLINE NAME '=' '[' STRING NAME '-' NUMBER STRING NAME '-' NUMBER UNKNOWN_CHAR ']' END | |
| START NEWLINE NAME '=' '[' STRING ',' '-' NUMBER ',' NAME '-' NUMBER ']' END | |
| -2147483648 39 40 58 59 1 40 67 2 1 40 67 2 97 60 2147483647 | |
| -2147483648 39 40 58 59 1 54 67 2 54 40 67 2 60 2147483647 | |
| Repairing: START NAME '(' NAME ',' NUMBER ')' ':' END | |
| Found length-1 fix in 14ms after 1365 total and 3 valid samples (91 samples/ms, first valid sample: 11ms) | |
| Average time to find human fix: ~658ms (771 trials, 113 expired after 10000ms) | |
| Average time to find valid fix: ~321ms | |
| Average samples before matched: ~66387 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~246 | |
| Repairing: START STRING ',' STRING ',' STRING ',' NAME UNKNOWN_CHAR END | |
| Found length-1 fix in 22ms after 23 total and 1 valid samples (1 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~657ms (772 trials, 113 expired after 10000ms) | |
| Average time to find valid fix: ~321ms | |
| Average samples before matched: ~66301 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~246 | |
| Repairing: START UNKNOWN_CHAR NAME '.' NAME '=' NAME '.' NAME '(' NAME '.' NAME ',' NAME '=' '[' STRING ']' ')' UNKNOWN_CHAR '.' END | |
| Found length-3 fix in 268ms after 10400 total and 1 valid samples (38 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~656ms (773 trials, 113 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66229 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START STRING NAME NAME NAME STRING END | |
| Found length-3 fix in 2004ms after 292889 total and 72 valid samples (146 samples/ms, first valid sample: 507ms) | |
| Average time to find human fix: ~658ms (774 trials, 113 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66521 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START 'class' NAME '(' ')' ':' NEWLINE NAME '=' NAME '(' ')' NEWLINE 'def' NAME '(' NAME ')' ':' NEWLINE 98 NAME '=' STRING NEWLINE 99 END | |
| Found length-3 fix in 501ms after 39173 total and 235 valid samples (78 samples/ms, first valid sample: 307ms) | |
| Average time to find human fix: ~658ms (775 trials, 113 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66486 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START UNKNOWN_CHAR 'def' NAME '(' ')' ':' NEWLINE 98 'return' '[' 'lambda' NAME ',' NAME '=' NAME ':' NAME '*' NAME 'for' NAME 'in' NAME '(' NUMBER ')' ']' UNKNOWN_CHAR NEWLINE 99 END | |
| Found length-2 fix in 272ms after 10416 total and 1 valid samples (38 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~657ms (776 trials, 113 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66414 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START NAME '=' NAME NUMBER ',' NUMBER NEWLINE NAME '=' NAME '.' NAME '(' STRING ',' STRING ',' NAME ')' END | |
| Found length-1 fix in 304ms after 19674 total and 11 valid samples (64 samples/ms, first valid sample: 244ms) | |
| Average time to find human fix: ~657ms (777 trials, 113 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66354 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING '*' NUMBER ',' NAME '(' NUMBER ':' NUMBER ')' ')' ';' END | |
| Found length-3 fix in 1873ms after 175712 total and 468 valid samples (93 samples/ms, first valid sample: 577ms) | |
| Average time to find human fix: ~658ms (778 trials, 113 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66494 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START 'for' NAME 'in' NAME ':' NEWLINE 'try' ':' NEWLINE 98 NAME '.' NAME '(' NAME '[' STRING ']' ')' NEWLINE 99 'except' NAME ':' NEWLINE 98 'break' NEWLINE 99 END | |
| Found length-3 fix in 850ms after 34894 total and 91 valid samples (41 samples/ms, first valid sample: 657ms) | |
| Average time to find human fix: ~659ms (779 trials, 113 expired after 10000ms) | |
| Average time to find valid fix: ~321ms | |
| Average samples before matched: ~66454 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START NAME '=' '[' END | |
| Sampling timeout expired after (13207127, 1) (total, valid) samples (228 samples/ms, first valid sample: 0ms), ground truth repair was 2 edits: | |
| START NAME '=' '[' END | |
| START NAME '=' '[' STRING ']' END | |
| -2147483648 40 58 59 2147483647 | |
| -2147483648 40 58 59 1 60 2147483647 | |
| Repairing: START 'from' NAME 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '.' NAME '(' ')' NEWLINE NAME NAME '(' NAME '.' NAME '(' NAME ')' ')' END | |
| Found length-2 fix in 6ms after 80 total and 1 valid samples (11 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~658ms (780 trials, 114 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66369 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~244 | |
| Repairing: START 'def' NAME '(' ')' '{' '}' END | |
| Found length-2 fix in 71ms after 9526 total and 1 valid samples (132 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~657ms (781 trials, 114 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66296 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~244 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' NAME STRING NAME STRING ']' END | |
| Found length-3 fix in 132ms after 2394 total and 7 valid samples (18 samples/ms, first valid sample: 118ms) | |
| Average time to find human fix: ~656ms (782 trials, 114 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66214 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~244 | |
| Repairing: START '[' '[' NUMBER ',' NUMBER NUMBER ',' NUMBER ']' ',' '[' NUMBER NUMBER ',' NUMBER ',' NUMBER ']' ']' END | |
| Found length-2 fix in 24ms after 96 total and 1 valid samples (3 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~656ms (783 trials, 114 expired after 10000ms) | |
| Average time to find valid fix: ~319ms | |
| Average samples before matched: ~66130 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~243 | |
| Repairing: START NAME ':' NAME ',' NAME ',' NAME ',' NAME NEWLINE NAME ':' NAME ',' NAME ',' NAME NEWLINE NAME ':' NAME ',' NAME ',' NAME ',' NAME END | |
| Sampling timeout expired after (2150816, 3) (total, valid) samples (124 samples/ms, first valid sample: 13035ms), ground truth repair was 3 edits: | |
| START NAME ':' NAME ',' NAME ',' NAME ',' NAME NEWLINE NAME ':' NAME ',' NAME ',' NAME NEWLINE NAME ':' NAME ',' NAME ',' NAME ',' NAME END | |
| START NAME ',' NAME ',' NAME ',' NAME ',' NAME NEWLINE NAME ',' NAME ',' NAME ',' NAME NEWLINE NAME ',' NAME ',' NAME ',' NAME ',' NAME END | |
| -2147483648 40 55 40 54 40 54 40 54 40 39 40 55 40 54 40 54 40 39 40 55 40 54 40 54 40 54 40 2147483647 | |
| -2147483648 40 54 40 54 40 54 40 54 40 39 40 54 40 54 40 54 40 39 40 54 40 54 40 54 40 54 40 2147483647 | |
| Repairing: START UNKNOWN_CHAR NAME '=' '{' STRING ':' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' '}' '}' UNKNOWN_CHAR END | |
| Found length-2 fix in 82ms after 150 total and 1 valid samples (1 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~655ms (784 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~319ms | |
| Average samples before matched: ~66046 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~243 | |
| Repairing: START '{' STRING ':' '{' STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER '}' ',' STRING ':' '{' STRING ':' NUMBER ',' STRING ':' NUMBER ',' STRING ':' NUMBER '}' END | |
| Found length-1 fix in 179ms after 648 total and 13 valid samples (3 samples/ms, first valid sample: 176ms) | |
| Average time to find human fix: ~654ms (785 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~319ms | |
| Average samples before matched: ~65962 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~243 | |
| Repairing: START 'import' NAME NEWLINE 'def' NAME ':' NEWLINE 98 NAME '=' NAME '.' NAME '(' ')' NEWLINE 99 END | |
| Found length-2 fix in 178ms after 4590 total and 1 valid samples (25 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~654ms (786 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~318ms | |
| Average samples before matched: ~65884 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~242 | |
| Repairing: START NAME '=' NAME '(' NAME '.' NAME '(' STRING ',' NAME '=' STRING ')' END | |
| Found length-1 fix in 8ms after 196 total and 4 valid samples (21 samples/ms, first valid sample: 8ms) | |
| Average time to find human fix: ~653ms (787 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~318ms | |
| Average samples before matched: ~65801 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~242 | |
| Repairing: START '>' NAME STRING STRING END | |
| Found length-2 fix in 26ms after 2810 total and 99 valid samples (104 samples/ms, first valid sample: 17ms) | |
| Average time to find human fix: ~652ms (788 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~317ms | |
| Average samples before matched: ~65721 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~242 | |
| Repairing: START NAME '=' NEWLINE 'for' NAME 'in' NAME ':' NEWLINE 98 'if' NAME '.' NAME '(' ')' ':' NEWLINE 98 NAME '+=' NAME NEWLINE 99 99 END | |
| Found length-1 fix in 1706ms after 168468 total and 70 valid samples (98 samples/ms, first valid sample: 1198ms) | |
| Average time to find human fix: ~653ms (789 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~318ms | |
| Average samples before matched: ~65851 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~242 | |
| Repairing: START NAME '(' '(' NAME ')' ',' '+' '(' STRING ')' END | |
| Found length-1 fix in 3ms after 335 total and 11 valid samples (83 samples/ms, first valid sample: 2ms) | |
| Average time to find human fix: ~653ms (790 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~318ms | |
| Average samples before matched: ~65768 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~241 | |
| Repairing: START '(' '[' '(' STRING ',' STRING ',' STRING ')' ',' '(' STRING ',' STRING ',' STRING ')' ',' '(' STRING ',' STRING ',' STRING ')' ']' ',' END | |
| Found length-1 fix in 2770ms after 221385 total and 237 valid samples (79 samples/ms, first valid sample: 1400ms) | |
| Average time to find human fix: ~655ms (791 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~319ms | |
| Average samples before matched: ~65965 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~241 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING '*' '(' NAME '/' NUMBER ')' ',' NAME '(' NUMBER ':' NAME ')' ')' ';' END | |
| Found length-3 fix in 1855ms after 157963 total and 7 valid samples (85 samples/ms, first valid sample: 614ms) | |
| Average time to find human fix: ~657ms (792 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66081 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~241 | |
| Repairing: START 'try' ':' NEWLINE NAME '[' NUMBER ']' NEWLINE 'except' NAME NEWLINE NAME '=' NUMBER END | |
| Found length-3 fix in 1040ms after 124817 total and 31 valid samples (119 samples/ms, first valid sample: 450ms) | |
| Average time to find human fix: ~657ms (793 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66155 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~241 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING ')' ',' STRING ')' NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' END | |
| Found length-1 fix in 276ms after 7861 total and 15 valid samples (28 samples/ms, first valid sample: 256ms) | |
| Average time to find human fix: ~657ms (794 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66082 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~241 | |
| Repairing: START '{' '(' STRING ',' STRING ':' NUMBER ',' '(' STRING ',' STRING ')' ':' NUMBER ',' '(' STRING ',' STRING ')' ':' NUMBER ',' '(' STRING ',' STRING ')' ':' NUMBER '}' END | |
| Found length-1 fix in 1241ms after 97547 total and 32 valid samples (78 samples/ms, first valid sample: 699ms) | |
| Average time to find human fix: ~658ms (795 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66121 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~240 | |
| Repairing: START NAME '.' NAME '(' NAME '=' NAME '.' NAME '(' STRING ',' STRING ')' END | |
| Found length-1 fix in 3ms after 8 total and 1 valid samples (2 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~657ms (796 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~66038 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~240 | |
| Repairing: START NAME '.' NAME '(' NAME ',' NAME '=' '{' STRING ',' STRING '%' NAME ')' END | |
| Found length-1 fix in 178ms after 12633 total and 12 valid samples (70 samples/ms, first valid sample: 113ms) | |
| Average time to find human fix: ~656ms (797 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~320ms | |
| Average samples before matched: ~65971 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~240 | |
| Repairing: START NAME '=' '[' '(' NUMBER ',' NUMBER ',' STRING ')' ',' '(' NUMBER ',' NUMBER ',' STRING ')' '...' NUMBER NAME ']' END | |
| Found length-2 fix in 7886ms after 879323 total and 23 valid samples (111 samples/ms, first valid sample: 2994ms) | |
| Average time to find human fix: ~665ms (798 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66990 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~239 | |
| Repairing: START 'import' NAME NEWLINE NAME '=' NAME '.' NAME NEWLINE NAME '=' UNKNOWN_CHAR NAME '*' NAME '(' NAME ')' NEWLINE NAME '=' NAME '(' NAME ',' NAME ')' END | |
| Found length-1 fix in 239ms after 2931 total and 1 valid samples (12 samples/ms, first valid sample: 231ms) | |
| Average time to find human fix: ~665ms (799 trials, 115 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66910 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~239 | |
| Repairing: START NAME '(' NAME ',' STRING '%' NAME '(' NAME ')' ',' NAME '.' NAME '(' NAME ')' ',' NAME '=' STRING END | |
| Sampling timeout expired after (3002134, 47515) (total, valid) samples (119 samples/ms, first valid sample: 10000ms), ground truth repair was 1 edits: | |
| START NAME '(' NAME ',' STRING '%' NAME '(' NAME ')' ',' NAME '.' NAME '(' NAME ')' ',' NAME '=' STRING END | |
| START NAME '(' NAME ',' STRING '%' NAME '(' NAME ')' ',' NAME '.' NAME '(' NAME ')' ',' NAME '=' STRING ')' END | |
| -2147483648 40 52 40 54 1 69 40 52 40 53 54 40 49 40 52 40 53 54 40 58 1 2147483647 | |
| -2147483648 40 52 40 54 1 69 40 52 40 53 54 40 49 40 52 40 53 54 40 58 1 53 2147483647 | |
| Repairing: START '{' STRING ':' '[' STRING ']' ',' STRING ':' '[' STRING ',' STRING ']' ',' STRING ':' '[' STRING ']' END | |
| Found length-1 fix in 161ms after 9063 total and 7 valid samples (55 samples/ms, first valid sample: 111ms) | |
| Average time to find human fix: ~664ms (800 trials, 116 expired after 10000ms) | |
| Average time to find valid fix: ~323ms | |
| Average samples before matched: ~66838 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~239 | |
| Repairing: START NAME '=' '[' NAME 'if' NAME 'in' NAME '.' NAME 'for' NAME 'in' NAME ']' NEWLINE NAME '=' '[' NAME 'if' NAME 'not' 'in' NAME '.' NAME 'for' NAME 'in' NAME ']' END | |
| Sampling timeout expired after (2159220, 1) (total, valid) samples (89 samples/ms, first valid sample: 0ms), ground truth repair was 3 edits: | |
| START NAME '=' '[' NAME 'if' NAME 'in' NAME '.' NAME 'for' NAME 'in' NAME ']' NEWLINE NAME '=' '[' NAME 'if' NAME 'not' 'in' NAME '.' NAME 'for' NAME 'in' NAME ']' END | |
| START NAME '=' '[' NAME 'for' NAME 'in' NAME '.' NAME 'for' NAME 'in' NAME ']' NEWLINE NAME '=' '[' NAME 'for' NAME 'in' NAME '.' NAME 'for' NAME 'in' NAME ']' END | |
| -2147483648 40 58 59 40 13 40 18 40 49 40 17 40 18 40 60 39 40 58 59 40 13 40 26 18 40 49 40 17 40 18 40 60 2147483647 | |
| -2147483648 40 58 59 40 17 40 18 40 49 40 17 40 18 40 60 39 40 58 59 40 17 40 18 40 49 40 17 40 18 40 60 2147483647 | |
| Repairing: START NAME '.' NAME '(' NAME ',' NAME NAME ')' END | |
| Found length-1 fix in 51ms after 866 total and 76 valid samples (16 samples/ms, first valid sample: 48ms) | |
| Average time to find human fix: ~663ms (801 trials, 117 expired after 10000ms) | |
| Average time to find valid fix: ~322ms | |
| Average samples before matched: ~66755 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~239 | |
| Repairing: START NAME '=' '(' STRING '}' END | |
| Found length-1 fix in 40ms after 1173 total and 2 valid samples (28 samples/ms, first valid sample: 36ms) | |
| Average time to find human fix: ~662ms (802 trials, 117 expired after 10000ms) | |
| Average time to find valid fix: ~322ms | |
| Average samples before matched: ~66674 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~238 | |
| Repairing: START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 NAME '=' '(' NUMBER '/' NUMBER ')' '*' NAME '*' NAME NEWLINE 'return' NAME NEWLINE 99 NAME '=' NAME '(' NUMBER ',' NUMBER ')' NEWLINE NAME NAME END | |
| Sampling timeout expired after (1778893, 7122) (total, valid) samples (106 samples/ms, first valid sample: 10000ms), ground truth repair was 2 edits: | |
| START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 NAME '=' '(' NUMBER '/' NUMBER ')' '*' NAME '*' NAME NEWLINE 'return' NAME NEWLINE 99 NAME '=' NAME '(' NUMBER ',' NUMBER ')' NEWLINE NAME NAME END | |
| START 'def' NAME '(' NAME ',' NAME ')' ':' NEWLINE 98 NAME '=' '(' NUMBER '/' NUMBER ')' '*' NAME '*' NAME NEWLINE 'return' NAME NEWLINE 99 NAME '=' NAME '(' NUMBER ',' NUMBER ')' NEWLINE NAME '(' NAME ')' END | |
| -2147483648 4 40 52 40 54 40 53 55 39 98 40 58 52 2 68 2 53 51 40 51 40 39 5 40 39 99 40 58 40 52 2 54 2 53 39 40 40 2147483647 | |
| -2147483648 4 40 52 40 54 40 53 55 39 98 40 58 52 2 68 2 53 51 40 51 40 39 5 40 39 99 40 58 40 52 2 54 2 53 39 40 52 40 53 2147483647 | |
| Repairing: START NAME '=' '{' STRING '=' STRING ',' STRING '=' STRING ',' STRING '=' STRING '}' END | |
| Found length-3 fix in 138ms after 1092 total and 1 valid samples (7 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~662ms (803 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~322ms | |
| Average samples before matched: ~66592 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~238 | |
| Repairing: START '[' STRING ',' STRING ',' STRING ',' STRING ']' '.' END | |
| Found length-1 fix in 35ms after 565 total and 2 valid samples (15 samples/ms, first valid sample: 32ms) | |
| Average time to find human fix: ~661ms (804 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~321ms | |
| Average samples before matched: ~66510 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~238 | |
| Repairing: START NAME '(' '[' NAME '(' NAME ')' 'for' NAME 'in' NAME '[' NUMBER ':' NUMBER ']' ')' '[' NUMBER ']' END | |
| Found length-1 fix in 143ms after 3637 total and 15 valid samples (25 samples/ms, first valid sample: 125ms) | |
| Average time to find human fix: ~660ms (805 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~321ms | |
| Average samples before matched: ~66432 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~238 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' STRING NAME STRING ',' STRING ']' END | |
| Found length-1 fix in 131ms after 871 total and 4 valid samples (6 samples/ms, first valid sample: 127ms) | |
| Average time to find human fix: ~660ms (806 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~321ms | |
| Average samples before matched: ~66350 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~237 | |
| Repairing: START 'def' NAME '(' ')' ':' NEWLINE 98 'return' STRING NEWLINE 99 'def' NAME '(' ')' ':' NEWLINE 98 NAME STRING NEWLINE 99 NAME '(' ')' END | |
| Found length-2 fix in 7120ms after 989872 total and 9290 valid samples (139 samples/ms, first valid sample: 3925ms) | |
| Average time to find human fix: ~668ms (807 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~325ms | |
| Average samples before matched: ~67495 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START '[' NAME '[' NUMBER ']' ',' '[' NAME '[' NUMBER ']' ',' NAME '[' NUMBER ']' ']' ']' ',' '[' NAME '[' NUMBER ']' ',' NAME '[' NUMBER ']' ']' ']' END | |
| Found length-1 fix in 3713ms after 342721 total and 1632 valid samples (92 samples/ms, first valid sample: 1872ms) | |
| Average time to find human fix: ~672ms (808 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67835 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~250 | |
| Repairing: START 'from' NAME '.' NAME 'import' NAME NEWLINE NAME NAME '(' NAME '.' NAME ')' NEWLINE 98 NAME '=' NAME '.' NAME '(' NAME '=' NUMBER ')' NEWLINE 99 END | |
| Found length-3 fix in 1992ms after 235173 total and 6 valid samples (117 samples/ms, first valid sample: 1097ms) | |
| Average time to find human fix: ~673ms (809 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~68042 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~250 | |
| Repairing: START '-' NUMBER NAME '^' NUMBER '+' NUMBER NAME '-' NUMBER '=' NUMBER END | |
| Found length-2 fix in 96ms after 4046 total and 69 valid samples (41 samples/ms, first valid sample: 86ms) | |
| Average time to find human fix: ~672ms (810 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~67963 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~250 | |
| Repairing: START 'import' NAME NEWLINE NAME '.' NAME '(' ')' ':' END | |
| Found length-1 fix in 45ms after 471 total and 1 valid samples (10 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~672ms (811 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67880 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START 'with' NAME '(' STRING ',' NAME ')' 'as' NAME ':' NEWLINE 98 'for' NAME 'in' NAME ':' NEWLINE 98 NAME '=' NAME '.' NAME '.' NAME '(' STRING ')' NEWLINE 99 99 NAME NAME END | |
| Found length-1 fix in 294ms after 1164 total and 6 valid samples (3 samples/ms, first valid sample: 288ms) | |
| Average time to find human fix: ~671ms (812 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67798 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START NAME '=' NAME '(' STRING ',' STRING ')' NEWLINE NAME NAME '.' NAME '(' ')' NEWLINE NAME '.' NAME '(' ')' END | |
| Found length-2 fix in 2ms after 2 total and 1 valid samples (0 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~670ms (813 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67715 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START NAME '=' NAME '.' NAME '(' NAME '.' NAME ')' NEWLINE NAME NAME '.' NAME '(' NAME ',' NAME '=' NUMBER ',' NAME '=' 'True' ')' END | |
| Found length-1 fix in 187ms after 1837 total and 53 valid samples (9 samples/ms, first valid sample: 179ms) | |
| Average time to find human fix: ~670ms (814 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67634 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START '>>' '>' 'import' NAME NEWLINE '>>' '>' NAME '.' NAME '(' STRING ')' END | |
| Found length-3 fix in 382ms after 54094 total and 1 valid samples (141 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~669ms (815 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67617 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START '[' STRING ',' '[' '[' STRING ',' '[' ']' ']' ',' '[' STRING ',' '[' ']' ']' ']' END | |
| Found length-1 fix in 112ms after 970 total and 7 valid samples (8 samples/ms, first valid sample: 108ms) | |
| Average time to find human fix: ~669ms (816 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67535 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START NAME '=' '[' '[' STRING ',' STRING ',' UNKNOWN_CHAR NUMBER ']' ',' '[' STRING ',' STRING ',' STRING ']' ',' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ']' ']' END | |
| Found length-2 fix in 1997ms after 134245 total and 7 valid samples (67 samples/ms, first valid sample: 1281ms) | |
| Average time to find human fix: ~670ms (817 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67617 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START NAME '=' '{' '(' NAME ',' NUMBER ',' NUMBER ')' ':' NUMBER '(' NAME ',' NUMBER ',' NUMBER ')' ':' NUMBER '}' END | |
| Found length-1 fix in 608ms after 56598 total and 36 valid samples (92 samples/ms, first valid sample: 320ms) | |
| Average time to find human fix: ~670ms (818 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67603 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START '[' NAME ',' NAME ']' '[' NAME ',' NAME ']' '[' NAME ',' NAME ']' NAME '...' END | |
| Found length-3 fix in 8380ms after 1012513 total and 1546 valid samples (120 samples/ms, first valid sample: 3372ms) | |
| Average time to find human fix: ~680ms (819 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~331ms | |
| Average samples before matched: ~68757 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START '>>' '>' '[' STRING ',' STRING ',' STRING ']' END | |
| Found length-2 fix in 2ms after 104 total and 1 valid samples (34 samples/ms, first valid sample: 2ms) | |
| Average time to find human fix: ~679ms (820 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68674 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~249 | |
| Repairing: START NAME NEWLINE NUMBER NEWLINE NUMBER NEWLINE NUMBER NEWLINE NUMBER NEWLINE NUMBER NEWLINE NAME NEWLINE UNKNOWN_CHAR END | |
| Found length-1 fix in 283ms after 24434 total and 8 valid samples (86 samples/ms, first valid sample: 246ms) | |
| Average time to find human fix: ~678ms (821 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68620 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START '>>' '>' NAME '=' '[' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ',' STRING ']' END | |
| Found length-2 fix in 4ms after 169 total and 1 valid samples (33 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~678ms (822 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68536 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START '//' NAME '=' NAME '[' STRING ']' END | |
| Found length-1 fix in 492ms after 93128 total and 108 valid samples (188 samples/ms, first valid sample: 153ms) | |
| Average time to find human fix: ~677ms (823 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68566 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START 'import' NAME UNKNOWN_CHAR NAME '=' NAME '.' NAME '(' STRING ',' STRING ')' END | |
| Found length-1 fix in 190ms after 21947 total and 1 valid samples (114 samples/ms, first valid sample: 147ms) | |
| Average time to find human fix: ~677ms (824 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~330ms | |
| Average samples before matched: ~68510 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~248 | |
| Repairing: START NAME '(' '[' '(' STRING ':' NAME '(' STRING ')' ')' ']' ')' END | |
| Found length-1 fix in 89ms after 362 total and 1 valid samples (4 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~676ms (825 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~68427 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START NAME '=' NAME NAME NEWLINE NAME '=' NAME NAME NEWLINE NAME '=' NAME NAME END | |
| Found length-3 fix in 435ms after 20041 total and 17 valid samples (45 samples/ms, first valid sample: 359ms) | |
| Average time to find human fix: ~676ms (826 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~68368 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START NAME '=' '[' '[' NUMBER NUMBER ']' '[' NUMBER NUMBER ']' ']' END | |
| Found length-2 fix in 162ms after 19849 total and 232 valid samples (121 samples/ms, first valid sample: 88ms) | |
| Average time to find human fix: ~675ms (827 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~68310 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START NAME '=' STRING ']' UNKNOWN_CHAR END | |
| Found length-2 fix in 54ms after 10569 total and 40 valid samples (192 samples/ms, first valid sample: 33ms) | |
| Average time to find human fix: ~674ms (828 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~68240 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START NAME '.' NAME '[' STRING ']' NAME NUMBER END | |
| Found length-2 fix in 253ms after 46160 total and 214 valid samples (181 samples/ms, first valid sample: 94ms) | |
| Average time to find human fix: ~674ms (829 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~68213 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~247 | |
| Repairing: START NAME '=' NAME '.' NAME '(' STRING ',' STRING ')' NEWLINE NAME '=' NAME '.' NAME '(' STRING STRING '-' NAME '-' UNKNOWN_CHAR ')' END | |
| Found length-2 fix in 2061ms after 199206 total and 1 valid samples (96 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~676ms (830 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~68371 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~246 | |
| Repairing: START '[' '(' STRING ',' STRING ',' NUMBER ')' ',' '(' STRING ',' STRING ',' NUMBER ')' ',' '(' STRING ',' STRING ',' NUMBER ')' ']' ',' '(' STRING ',' STRING ',' NUMBER ')' ']' END | |
| Found length-1 fix in 261ms after 17276 total and 4 valid samples (65 samples/ms, first valid sample: 220ms) | |
| Average time to find human fix: ~675ms (831 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~68310 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~246 | |
| Repairing: START NAME '=' NAME '(' NAME ')' NEWLINE 'for' NAME 'in' NAME '.' NAME '(' STRING ')' NEWLINE NAME '.' NAME '(' ')' END | |
| Found length-1 fix in 265ms after 12498 total and 4 valid samples (46 samples/ms, first valid sample: 234ms) | |
| Average time to find human fix: ~675ms (832 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~68243 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~246 | |
| Repairing: START NAME '=' NAME '/' NAME '/' NAME '/' NAME '.' NAME NAME NAME NEWLINE NAME '.' NAME '(' NAME ',' NAME '=' 'True' ')' END | |
| Found length-2 fix in 47ms after 2733 total and 29 valid samples (56 samples/ms, first valid sample: 36ms) | |
| Average time to find human fix: ~674ms (833 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~68164 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~246 | |
| Repairing: START NAME NAME '.' NAME '(' NAME ',' NUMBER ',' STRING ',' '(' NUMBER ',' NUMBER ')' ')' END | |
| Found length-1 fix in 29ms after 1045 total and 73 valid samples (34 samples/ms, first valid sample: 25ms) | |
| Average time to find human fix: ~673ms (834 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~68084 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START 'class' NAME '(' NAME ')' ':' NEWLINE 98 'def' NAME '(' ')' NEWLINE 98 'pass' NEWLINE 99 99 END | |
| Found length-2 fix in 3ms after 23 total and 1 valid samples (5 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~672ms (835 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~68002 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START '[' '{' STRING ':' NUMBER ',' '**' STRING ':' '{' STRING ':' STRING '}' ',' STRING ':' '{' STRING ':' STRING '}' ',' '**' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING '}' ',' '...' ']' END | |
| Found length-2 fix in 276ms after 640 total and 1 valid samples (2 samples/ms, first valid sample: 274ms) | |
| Average time to find human fix: ~672ms (836 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67921 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~245 | |
| Repairing: START NAME '=' '{' STRING ':' '{' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' STRING ':' STRING ',' '}' END | |
| Found length-1 fix in 245ms after 6781 total and 56 valid samples (27 samples/ms, first valid sample: 206ms) | |
| Average time to find human fix: ~671ms (837 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67848 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~244 | |
| Repairing: START 'if' NAME 'in' '(' STRING ',' STRING ',' STRING ',' STRING ',' STRING ')' ':' NEWLINE 98 'return' NAME UNKNOWN_CHAR NEWLINE 99 END | |
| Found length-1 fix in 184ms after 2638 total and 4 valid samples (14 samples/ms, first valid sample: 172ms) | |
| Average time to find human fix: ~671ms (838 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67771 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~244 | |
| Repairing: START NAME '=' '[' STRING ',' '(' NUMBER ',' STRING NAME UNKNOWN_CHAR ')' ']' END | |
| Found length-2 fix in 5ms after 389 total and 3 valid samples (64 samples/ms, first valid sample: 4ms) | |
| Average time to find human fix: ~670ms (839 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67690 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~244 | |
| Repairing: START NAME '=' '{' STRING ':' '[' NAME ']' ',' STRING ':' '[' NAME ',' NAME ']' ',' STRING ':' '[' NAME ']' ',' STRING ':' '[' NAME ']' ',' STRING ':' '[' NAME UNKNOWN_CHAR ']' '}' END | |
| Found length-1 fix in 271ms after 8395 total and 23 valid samples (30 samples/ms, first valid sample: 226ms) | |
| Average time to find human fix: ~669ms (840 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67620 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~244 | |
| Repairing: START NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE NAME '=' NAME '.' NAME '(' ')' NEWLINE NAME NAME END | |
| Found length-1 fix in 336ms after 12888 total and 46 valid samples (38 samples/ms, first valid sample: 285ms) | |
| Average time to find human fix: ~669ms (841 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67555 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~243 | |
| Repairing: START NAME '=' '{' STRING ':' STRING ',' STRING ',' STRING '}' NEWLINE NAME '=' STRING NEWLINE NAME '(' NAME ',' NAME ')' END | |
| Found length-1 fix in 319ms after 16777 total and 11 valid samples (52 samples/ms, first valid sample: 232ms) | |
| Average time to find human fix: ~669ms (842 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~325ms | |
| Average samples before matched: ~67494 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~243 | |
| Repairing: START NAME '=' NAME '+' NAME NEWLINE NAME '+=' NAME NEWLINE 'return' NAME '=' NAME END | |
| Found length-1 fix in 3374ms after 601197 total and 346 valid samples (178 samples/ms, first valid sample: 2041ms) | |
| Average time to find human fix: ~672ms (843 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~68127 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~243 | |
| Repairing: START UNKNOWN_CHAR 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' NEWLINE NAME '=' NAME '.' NAME '(' STRING ')' END | |
| Found length-1 fix in 248ms after 20152 total and 2 valid samples (80 samples/ms, first valid sample: 222ms) | |
| Average time to find human fix: ~671ms (844 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~68071 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~243 | |
| Repairing: START NAME '=' NAME '.' NAME '(' '{' STRING ':' STRING '}' NAME '.' NAME '(' NAME ',' NAME '+' NUMBER ',' NAME '[' NUMBER ']' ',' NAME ')' END | |
| Found length-2 fix in 217ms after 1239 total and 3 valid samples (5 samples/ms, first valid sample: 208ms) | |
| Average time to find human fix: ~671ms (845 trials, 118 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67991 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~243 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 98 STRING NEWLINE NAME '=' STRING NEWLINE NAME '+=' STRING '(' NAME ')' NEWLINE NAME '=' '+' UNKNOWN_CHAR NAME UNKNOWN_CHAR NAME NEWLINE 'return' NAME NEWLINE 99 END | |
| Sampling timeout expired after (2005587, 10) (total, valid) samples (125 samples/ms, first valid sample: 10720ms), ground truth repair was 3 edits: | |
| START 'def' NAME '(' NAME ')' ':' NEWLINE 98 STRING NEWLINE NAME '=' STRING NEWLINE NAME '+=' STRING '(' NAME ')' NEWLINE NAME '=' '+' UNKNOWN_CHAR NAME UNKNOWN_CHAR NAME NEWLINE 'return' NAME NEWLINE 99 END | |
| START 'def' NAME '(' NAME ')' ':' NEWLINE 98 STRING NEWLINE NAME '=' STRING NEWLINE NAME '+=' STRING '(' NAME ')' NEWLINE NAME '=' '+' NAME NEWLINE 'return' NAME NEWLINE 99 END | |
| -2147483648 4 40 52 40 53 55 39 98 1 39 40 58 1 39 40 83 1 52 40 53 39 40 58 66 97 40 97 40 39 5 40 39 99 2147483647 | |
| -2147483648 4 40 52 40 53 55 39 98 1 39 40 58 1 39 40 83 1 52 40 53 39 40 58 66 40 39 5 40 39 99 2147483647 | |
| Repairing: START STRING '{' UNKNOWN_CHAR STRING UNKNOWN_CHAR END | |
| Found length-3 fix in 209ms after 21016 total and 3 valid samples (100 samples/ms, first valid sample: 145ms) | |
| Average time to find human fix: ~670ms (846 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67936 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~242 | |
| Repairing: START 'from' NAME '-' NAME 'import' '*' END | |
| Found length-2 fix in 2ms after 40 total and 1 valid samples (13 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~669ms (847 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67856 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~242 | |
| Repairing: START NAME '=' NUMBER NUMBER NAME END | |
| Found length-2 fix in 80ms after 8067 total and 51 valid samples (99 samples/ms, first valid sample: 63ms) | |
| Average time to find human fix: ~669ms (848 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67785 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~242 | |
| Repairing: START 'import' NAME NEWLINE 'from' NAME 'import' NAME NEWLINE NAME NAME '.' NAME '(' NAME '.' NAME '(' STRING ')' ')' END | |
| Found length-1 fix in 148ms after 1241 total and 52 valid samples (8 samples/ms, first valid sample: 143ms) | |
| Average time to find human fix: ~668ms (849 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67707 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~242 | |
| Repairing: START 'with' NAME '.' NAME '(' STRING ')' 'as' NAME ':' NEWLINE 'for' NAME 'in' NAME ':' NEWLINE 98 NAME '[' NUMBER ']' '=' NUMBER NEWLINE 99 END | |
| Found length-2 fix in 20ms after 223 total and 1 valid samples (10 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~667ms (850 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67628 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~241 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 98 'if' NAME '>' NUMBER ':' NEWLINE 98 'return' STRING NEWLINE 99 'elif' NAME '<' NUMBER ':' NEWLINE 98 'return' STRING NEWLINE 99 99 'else' ':' NEWLINE 98 'return' STRING NEWLINE 99 END | |
| Found length-3 fix in 2744ms after 263152 total and 25 valid samples (95 samples/ms, first valid sample: 2140ms) | |
| Average time to find human fix: ~670ms (851 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~328ms | |
| Average samples before matched: ~67857 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~241 | |
| Repairing: START 'for' NAME 'in' NAME '(' NAME ')' ':' END | |
| Found length-2 fix in 40ms after 3871 total and 1 valid samples (94 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~669ms (852 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67782 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~241 | |
| Repairing: START NEWLINE NAME '.' '.' NAME '(' ')' '.' NAME '(' 'lambda' NAME ':' '(' NAME '[' NUMBER ']' ',' NAME '(' NAME '[' NUMBER ']' ')' ')' ')' NEWLINE NAME '(' NAME '.' NAME '(' ')' ')' END | |
| Found length-1 fix in 266ms after 6104 total and 2 valid samples (22 samples/ms, first valid sample: 246ms) | |
| Average time to find human fix: ~669ms (853 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67710 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~241 | |
| Repairing: START NAME '=' '{' STRING ':' NUMBER ',' STRING ':' '=' NUMBER ',' STRING '=' NUMBER '}' END | |
| Found length-2 fix in 150ms after 4474 total and 1 valid samples (29 samples/ms, first valid sample: 139ms) | |
| Average time to find human fix: ~668ms (854 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67636 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~240 | |
| Repairing: START NAME '=' '[' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' NUMBER ',' '...' '...' NAME ']' END | |
| Found length-2 fix in 212ms after 15246 total and 2 valid samples (71 samples/ms, first valid sample: 160ms) | |
| Average time to find human fix: ~667ms (855 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67575 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~240 | |
| Repairing: START NAME '=' NEWLINE NAME '=' NAME '.' NAME '(' NAME '=' NUMBER ')' NEWLINE NAME '=' NAME '.' NAME '(' NAME ')' NEWLINE NAME '=' NAME '.' NAME END | |
| Found length-1 fix in 788ms after 57245 total and 20 valid samples (72 samples/ms, first valid sample: 639ms) | |
| Average time to find human fix: ~668ms (856 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67562 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~240 | |
| Repairing: START 'def' NAME '(' NAME ')' ':' NEWLINE 98 STRING NEWLINE 'for' NAME 'in' NAME ':' NEWLINE 98 NAME NAME NEWLINE 99 99 END | |
| Found length-1 fix in 59ms after 1178 total and 33 valid samples (19 samples/ms, first valid sample: 54ms) | |
| Average time to find human fix: ~667ms (857 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67485 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~240 | |
| Repairing: START NAME '=' NAME '(' NAME '.' NAME UNKNOWN_CHAR ')' NEWLINE 'for' NAME 'in' NAME '.' NAME '(' STRING ')' ':' NEWLINE 98 NAME '(' NAME '.' NAME '(' STRING ')' ')' NEWLINE 99 END | |
| Found length-1 fix in 256ms after 9837 total and 13 valid samples (38 samples/ms, first valid sample: 211ms) | |
| Average time to find human fix: ~666ms (858 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~327ms | |
| Average samples before matched: ~67418 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~239 | |
| Repairing: START 'def' NAME '(' ')' ':' NEWLINE 98 '...' '...' NEWLINE '...' '...' NEWLINE 'yield' NAME NEWLINE 99 END | |
| Found length-2 fix in 194ms after 5496 total and 1 valid samples (28 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~666ms (859 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67346 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~239 | |
| Repairing: START NAME '=' '[' STRING ',' STRING ',' NUMBER UNKNOWN_CHAR ']' END | |
| Found length-1 fix in 141ms after 7378 total and 3 valid samples (51 samples/ms, first valid sample: 117ms) | |
| Average time to find human fix: ~665ms (860 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67276 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~239 | |
| Repairing: START NAME '=' '[' '[' '{' STRING ':' NUMBER '}' ',' '{' STRING NAME STRING NAME UNKNOWN_CHAR ':' NUMBER '}' ']' ']' END | |
| Found length-3 fix in 630ms after 33368 total and 1 valid samples (52 samples/ms, first valid sample: 471ms) | |
| Average time to find human fix: ~665ms (861 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67237 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~238 | |
| Repairing: START NAME '=' NAME '.' '(' STRING ',' STRING ')' END | |
| Found length-1 fix in 67ms after 2712 total and 4 valid samples (39 samples/ms, first valid sample: 55ms) | |
| Average time to find human fix: ~664ms (862 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67162 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~238 | |
| Repairing: START '[' STRING ',' '[' STRING ',' UNKNOWN_CHAR NAME NUMBER ']' ']' END | |
| Found length-3 fix in 333ms after 20535 total and 15 valid samples (61 samples/ms, first valid sample: 217ms) | |
| Average time to find human fix: ~664ms (863 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67108 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~238 | |
| Repairing: START NAME '.' NAME '(' NAME ')' NEWLINE NAME '.' NAME '(' NAME '(' NAME ')' END | |
| Found length-1 fix in 4ms after 268 total and 1 valid samples (53 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~663ms (864 trials, 119 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~67030 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~238 | |
| Repairing: START 'import' NAME NEWLINE 'from' NAME 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' NAME '=' STRING ',' NAME '=' STRING ',' NAME END | |
| Sampling timeout expired after (2861494, 17068) (total, valid) samples (122 samples/ms, first valid sample: 10000ms), ground truth repair was 1 edits: | |
| START 'import' NAME NEWLINE 'from' NAME 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' NAME '=' STRING ',' NAME '=' STRING ',' NAME END | |
| START 'import' NAME NEWLINE 'from' NAME 'import' NAME NEWLINE NAME '=' NAME '.' NAME '(' NAME '=' STRING ',' NAME '=' STRING ',' NAME ')' END | |
| -2147483648 8 40 39 7 40 8 40 39 40 58 40 49 40 52 40 58 1 54 40 58 1 54 40 2147483647 | |
| -2147483648 8 40 39 7 40 8 40 39 40 58 40 49 40 52 40 58 1 54 40 58 1 54 40 53 2147483647 | |
| Repairing: START NAME '.' NAME ',' NAME '.' NAME ',' '...' ',' NAME '**' NUMBER '**' '.' NAME END | |
| Sampling timeout expired after (4077747, 5) (total, valid) samples (189 samples/ms, first valid sample: 10563ms), ground truth repair was 3 edits: | |
| START NAME '.' NAME ',' NAME '.' NAME ',' '...' ',' NAME '**' NUMBER '**' '.' NAME END | |
| START NAME '.' NAME ',' NAME '.' NAME ',' '...' ',' NAME '.' NAME END | |
| -2147483648 40 49 40 54 40 49 40 54 50 54 40 57 2 57 49 40 2147483647 | |
| -2147483648 40 49 40 54 40 49 40 54 50 54 40 49 40 2147483647 | |
| Repairing: START '>>' '>' NAME '=' STRING NEWLINE '>>' '>' NAME '.' NAME '(' NAME ')' NEWLINE '[' STRING ',' STRING ',' STRING ']' END | |
| Found length-3 fix in 344ms after 31455 total and 4 valid samples (91 samples/ms, first valid sample: 316ms) | |
| Average time to find human fix: ~663ms (865 trials, 121 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~66989 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~237 | |
| Repairing: START NAME '=' NAME '.' NAME '(' NAME '.' NAME STRING ',' UNKNOWN_CHAR ')' NEWLINE NAME '.' NAME '(' NAME ')' END | |
| Found length-2 fix in 215ms after 3792 total and 2 valid samples (17 samples/ms, first valid sample: 209ms) | |
| Average time to find human fix: ~662ms (866 trials, 121 expired after 10000ms) | |
| Average time to find valid fix: ~325ms | |
| Average samples before matched: ~66916 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~237 | |
| Repairing: START NAME '=' '{' STRING ':' '{' STRING '{' '}' ',' STRING ':' '{' '}' ',' '}' ',' STRING ':' '{' STRING ':' '{' '}' ',' STRING ':' '{' '}' ',' '}' '}' END | |
| Found length-1 fix in 639ms after 41512 total and 57 valid samples (64 samples/ms, first valid sample: 456ms) | |
| Average time to find human fix: ~662ms (867 trials, 121 expired after 10000ms) | |
| Average time to find valid fix: ~326ms | |
| Average samples before matched: ~66887 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~237 | |
| Repairing: START NAME '(' STRING '.' NAME '(' NAME '.' NAME '(' ')' ',' NAME ',' NAME ')' ')' '**' '**' END | |
| Found length-2 fix in 315ms after 17530 total and 1 valid samples (55 samples/ms, first valid sample: 0ms) | |
| Average time to find human fix: ~662ms (868 trials, 121 expired after 10000ms) | |
| Average time to find valid fix: ~325ms | |
| Average samples before matched: ~66830 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~237 | |
| Repairing: START NAME '=' NAME '.' NAME '(' '[' NUMBER ',' NUMBER ',' NUMBER ']' ',' '[' NUMBER ',' NUMBER ',' NUMBER ']' ',' '[' NUMBER ',' NUMBER ',' NUMBER ']' ',' '[' NUMBER ',' NUMBER ',' NUMBER ']' ']' ')' END | |
| Found length-1 fix in 389ms after 4481 total and 12 valid samples (11 samples/ms, first valid sample: 368ms) | |
| Average time to find human fix: ~662ms (869 trials, 121 expired after 10000ms) | |
| Average time to find valid fix: ~325ms | |
| Average samples before matched: ~66758 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~236 | |
| Repairing: START NAME '=' NAME '(' STRING ',' STRING ')' NEWLINE 'for' NAME 'in' NAME ':' NEWLINE 98 'if' NAME '(' NAME ')' '=' NUMBER NEWLINE NAME '.' NAME '(' NAME ')' NEWLINE 99 END | |
| Found length-2 fix in 3604ms after 291743 total and 1 valid samples (80 samples/ms, first valid sample: 3478ms) | |
| Average time to find human fix: ~665ms (870 trials, 121 expired after 10000ms) | |
| Average time to find valid fix: ~329ms | |
| Average samples before matched: ~67017 | |
| Average repair throughput / ms: ~59 | |
| Average valid repairs detected: ~236 | |
| BUILD SUCCESSFUL in 1h 41s | |
| 9 actionable tasks: 4 executed, 5 up-to-date | |
| (base) ➜ gym-fs git:(master) ✗ |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment