Skip to content

Instantly share code, notes, and snippets.

@breandan

breandan/doc_synth_graphcodebert.txt

Last active October 15, 2021 14:40
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save breandan/470f4bf98a95b62d19f1048d8000c459 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save breandan/470f4bf98a95b62d19f1048d8000c459 to your computer and use it in GitHub Desktop.
Download ZIP
GraphCodeBERT document synthesis experiments.
Raw
doc_synth_graphcodebert.txt
> python embedding_server.py --model=microsoft/graphcodebert-base --offline
Starting embeddings server...
Started embeddings server at http://localhost:8000/?query=
Ground truth doc: This method is called during OGNL's bytecode enhancement optimizations in order to determine better-
Synth origin doc: Helpers to provide a string suitable in calling all Java methods of Object for each object
Synth refact doc: This provides two forms to access index value to object properties to avoid using any abstract access
Rouge score before refactoring: 0.33604336043360433
Rouge score after refactoring: 0.12059620596205962
Relative difference: 1.7865168539325842
Put 1.7865168539325842 in (14, renameTokens)
\begin{table}[H]
\begin{tabular}{l|c}
Complexity & renameTokens \\\hline\\
140-150 & 1.786 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: This method is called during OGNL's bytecode enhancement optimizations in order to determine better-
Synth origin doc: Helpers to provide a string suitable in calling all Java methods of Object for each object
Synth refact doc: Helpers to provide a string suitable in calling all Java source methods of this ClassBuilder
Rouge score before refactoring: 0.33604336043360433
Rouge score after refactoring: 0.3428184281842818
Relative difference: -0.01976284584980232
Put -0.01976284584980232 in (14, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cc}
Complexity & renameTokens & swapMultilineNo \\\hline\\
140-150 & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: This method is called during OGNL's bytecode enhancement optimizations in order to determine better-
Synth origin doc: Internal impl to facilitate use by Java code that has a pattern capable by calling any number
Synth refact doc: Internal impl to facilitate non standard implementations to support Java for use and other static or abstract
Rouge score before refactoring: 0.26422764227642276
Rouge score after refactoring: 0.07181571815718157
Relative difference: 2.6792452830188678
Put 2.6792452830188678 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cc}
Complexity & renameTokens & swapMultilineNo \\\hline\\
100-110 & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: This method is called during OGNL's bytecode enhancement optimizations in order to determine better-
Synth origin doc: Internal impl to facilitate use by Java code that has a pattern capable by calling any number
Synth refact doc: Helping of generating Java methods of implementations that need some context and then creating their implementation
Rouge score before refactoring: 0.26422764227642276
Rouge score after refactoring: 0.09078590785907859
Relative difference: 1.91044776119403
Put 1.91044776119403 in (10, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
100-110 & 1.910 ± 0.0 (1) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: We precompute the AttributeDefinition of the target attribute in order to being able to use much
Synth origin doc: faster implementations are provided instead to implement additional and more sophisticated or intuitive or useful but
Synth refact doc: add some internal static variables that use our custom implementation which contains several slower methods than
Rouge score before refactoring: 0.3422913719943423
Rouge score after refactoring: 0.157001414427157
Relative difference: 1.1801801801801801
Put 1.1801801801801801 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
90-100 & NaN ± NaN (0) & 1.180 ± 0.0 (1) & NaN ± NaN (0) \\
100-110 & 1.910 ± 0.0 (1) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: We precompute the AttributeDefinition of the target attribute in order to being able to use much
Synth origin doc: faster implementations are provided instead to implement additional and more sophisticated or intuitive or useful but
Synth refact doc: also use this as alternative or add to subclass that contains alternative and has some options
Rouge score before refactoring: 0.3422913719943423
Rouge score after refactoring: 0.18528995756718528
Relative difference: 0.8473282442748092
Put 0.8473282442748092 in (9, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
90-100 & 0.847 ± 0.0 (1) & 1.180 ± 0.0 (1) & NaN ± NaN (0) \\
100-110 & 1.910 ± 0.0 (1) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: We precompute the AttributeDefinition of the target attribute in order to being able to use much
Synth origin doc: faster implementations are provided instead to implement additional and more sophisticated or intuitive or useful but
Synth refact doc: Helped in for tests and mocking and to provide the flexibility to implement custom templates
Rouge score before refactoring: 0.3422913719943423
Rouge score after refactoring: 0.15275813295615276
Relative difference: 1.2407407407407407
Put 1.2407407407407407 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
90-100 & 0.847 ± 0.0 (1) & 1.210 ± 9.168 (2) & NaN ± NaN (0) \\
100-110 & 1.910 ± 0.0 (1) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: We precompute the AttributeDefinition of the target attribute in order to being able to use much
Synth origin doc: faster implementations are provided instead to implement additional and more sophisticated or intuitive or useful but
Synth refact doc: also use this as alternative or add to subclass that contains alternative and has some options
Rouge score before refactoring: 0.3422913719943423
Rouge score after refactoring: 0.18528995756718528
Relative difference: 0.8473282442748092
Put 0.8473282442748092 in (9, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
90-100 & 0.847 ± 0.0 (2) & 1.210 ± 9.168 (2) & NaN ± NaN (0) \\
100-110 & 1.910 ± 0.0 (1) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: This processor is a no-op. It can simply be used for referencing specific elements in markup, but
Synth origin doc: empty element tags will not run if it itself is rendered or when its children rendered or parsed or
Synth refact doc: empty element tags will and hence may be executed and this function itself never ensures execution and it will
Rouge score before refactoring: 0.49224806201550386
Rouge score after refactoring: 0.4844961240310077
Relative difference: 0.016000000000000028
Put 0.016000000000000028 in (7, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 0.847 ± 0.0 (2) & 1.210 ± 9.168 (2) & NaN ± NaN (0) \\
100-110 & 1.910 ± 0.0 (1) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: This processor is a no-op. It can simply be used for referencing specific elements in markup, but
Synth origin doc: empty element tags will not run if it itself is rendered or when its children rendered or parsed or
Synth refact doc: execution error handler always exits if execution of template element tags with parameters parameters parameters values values null and
Rouge score before refactoring: 0.49224806201550386
Rouge score after refactoring: 0.046511627906976744
Relative difference: 9.583333333333334
Put 9.583333333333334 in (7, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.847 ± 0.0 (2) & 1.210 ± 9.168 (2) & NaN ± NaN (0) \\
100-110 & 1.910 ± 0.0 (1) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: We precompute the AttributeDefinition of the target attribute in order to being able to use much
Synth origin doc: slower versions are implemented with these additional methods which call additional methods for avoiding duplicate values
Synth refact doc: add some utility code below that adds a bit bit faster to add some generic code
Rouge score before refactoring: 0.36633663366336633
Rouge score after refactoring: 0.04809052333804809
Relative difference: 6.617647058823529
Put 6.617647058823529 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.847 ± 0.0 (2) & 3.012 ± 6.497 (3) & NaN ± NaN (0) \\
100-110 & 1.910 ± 0.0 (1) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: We precompute the AttributeDefinition of the target attribute in order to being able to use much
Synth origin doc: slower versions are implemented with these additional methods which call additional methods for avoiding duplicate values
Synth refact doc: faster code path and thus more and safer methods are created for convenience by all methods
Rouge score before refactoring: 0.36633663366336633
Rouge score after refactoring: 0.33946251768033947
Relative difference: 0.07916666666666662
Put 0.07916666666666662 in (9, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 3.012 ± 6.497 (3) & NaN ± NaN (0) \\
100-110 & 1.910 ± 0.0 (1) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: We precompute the AttributeDefinition of the target attribute in order to being able to use much
Synth origin doc: faster implementations are required for the generation but cannot override or replace attributes instead of just
Synth refact doc: slower calls are made with these definitions in place and calls will only affect these attributes
Rouge score before refactoring: 0.4200848656294201
Rouge score after refactoring: 0.5968882602545968
Relative difference: -0.29620853080568715
Put -0.29620853080568715 in (11, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 3.012 ± 6.497 (3) & NaN ± NaN (0) \\
100-110 & 1.910 ± 0.0 (1) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & -0.29 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: We precompute the AttributeDefinition of the target attribute in order to being able to use much
Synth origin doc: faster implementations are required for the generation but cannot override or replace attributes instead of just
Synth refact doc: helper functions to implement more specific behavior and other general purpose behavior to call in this
Rouge score before refactoring: 0.4200848656294201
Rouge score after refactoring: 0.1669024045261669
Relative difference: 1.516949152542373
Put 1.516949152542373 in (11, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 3.012 ± 6.497 (3) & NaN ± NaN (0) \\
100-110 & 1.910 ± 0.0 (1) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
110-120 & 1.516 ± 0.0 (1) & -0.29 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: We will only use RESTRICTED expression execution mode for TEXT template mode, as it could be used for
Synth origin doc: Advanced Text Tags for simple situations and thus enabling rich languages by only considering the purpose to avoid code
Synth refact doc: Advanced Text tags and other contexts require special cases when there can arise troublesatic in code or for
Rouge score before refactoring: 0.16876971608832808
Rouge score after refactoring: 0.09305993690851735
Relative difference: 0.8135593220338982
Put 0.8135593220338982 in (10, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 3.012 ± 6.497 (3) & NaN ± NaN (0) \\
100-110 & 1.362 ± 0.300 (2) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
110-120 & 1.516 ± 0.0 (1) & -0.29 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: We precompute the AttributeDefinition of the target attribute in order to being able to use much
Synth origin doc: faster implementations are required for the generation but cannot override or replace attributes instead of just
Synth refact doc: also use these two more expensive and less compacted version or fewer optimized but also
Rouge score before refactoring: 0.4200848656294201
Rouge score after refactoring: 0.12588401697312587
Relative difference: 2.337078651685394
Put 2.337078651685394 in (11, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 3.012 ± 6.497 (3) & NaN ± NaN (0) \\
100-110 & 1.362 ± 0.300 (2) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
110-120 & 1.516 ± 0.0 (1) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: We precompute the AttributeDefinition of the target attribute in order to being able to use much
Synth origin doc: faster implementations are required for the generation but cannot override or replace attributes instead of just
Synth refact doc: slower implementations or also other slower or equivalent methods are encouraged and can instead invoke only
Rouge score before refactoring: 0.4200848656294201
Rouge score after refactoring: 0.3338048090523338
Relative difference: 0.2584745762711866
Put 0.2584745762711866 in (11, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 3.012 ± 6.497 (3) & NaN ± NaN (0) \\
100-110 & 1.362 ± 0.300 (2) & 2.679 ± 0.0 (1) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: char[] are mutable but this is not an issue as this class is package-protected and the code from
Synth origin doc: Note the thread in process the callbacks are for which event listeners and thus that it identifies a
Synth refact doc: Note the thread object in context on initialization of methods to ensure execution in method execution context when object
Rouge score before refactoring: 0.36507936507936506
Rouge score after refactoring: 0.031746031746031744
Relative difference: 10.5
Put 10.5 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 3.012 ± 6.497 (3) & NaN ± NaN (0) \\
100-110 & 1.362 ± 0.300 (2) & 6.589 ± 15.29 (2) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: char[] are mutable but this is not an issue as this class is package-protected and the code from
Synth origin doc: Note the thread in process the callbacks are for which event listeners and thus that it identifies a
Synth refact doc: Note the thread in process the call stack from to here and which frame is being tracked are which
Rouge score before refactoring: 0.36507936507936506
Rouge score after refactoring: 0.3373015873015873
Relative difference: 0.08235294117647045
Put 0.08235294117647045 in (10, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 3.012 ± 6.497 (3) & NaN ± NaN (0) \\
100-110 & 0.935 ± 0.564 (3) & 6.589 ± 15.29 (2) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: No need to control overflow here. The fact that this has overflow will be used as a flag to determine
Synth origin doc: Notification to write method is not recommended as this is true for any stream which declares a method
Synth refact doc: tell that we're inspecting output and thus it should show it and tell us whether to obscure anything
Rouge score before refactoring: 0.33866995073891626
Rouge score after refactoring: 0.0603448275862069
Relative difference: 4.612244897959183
Put 4.612244897959183 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 3.412 ± 5.353 (4) & NaN ± NaN (0) \\
100-110 & 0.935 ± 0.564 (3) & 6.589 ± 15.29 (2) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: No need to control overflow here. The fact that this has overflow will be used as a flag to determine
Synth origin doc: Check that and if true do a clean clean flush to avoid confusion or warning or warning without concern
Synth refact doc: Note here that there's nothing in memory yet and so this will not check for coverage nor check
Rouge score before refactoring: 0.16379310344827586
Rouge score after refactoring: 0.13669950738916256
Relative difference: 0.19819819819819817
Put 0.19819819819819817 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 2.769 ± 5.935 (5) & NaN ± NaN (0) \\
100-110 & 0.935 ± 0.564 (3) & 6.589 ± 15.29 (2) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: Even if not completely correct to return 'true' for entries that might not exist, this is needed
Synth origin doc: we add some common helper functions in our method callbacks for element names and values in mapaccess
Synth refact doc: TODOT add some utility function below here instead of as the method is not a normal object here
Rouge score before refactoring: 0.054252199413489736
Rouge score after refactoring: 0.3519061583577713
Relative difference: -0.8458333333333333
Put -0.8458333333333333 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 2.769 ± 5.935 (5) & NaN ± NaN (0) \\
100-110 & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: This being a cache key, its equals and hashCode methods will potentially execute many
Synth origin doc: and cache expressions internally only called the first few time or more often at a
Synth refact doc: caching happens at the first level than repeated access is called multiple than time or
Rouge score before refactoring: 0.07325383304940375
Rouge score after refactoring: 0.42759795570698467
Relative difference: -0.8286852589641435
Put -0.8286852589641435 in (12, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 2.769 ± 5.935 (5) & NaN ± NaN (0) \\
100-110 & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & -0.82 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: This being a cache key, its equals and hashCode methods will potentially execute many
Synth origin doc: and cache expressions internally only called the first few time or more often at a
Synth refact doc: and call the cache every 10ms and twice every 15minutes and finally
Rouge score before refactoring: 0.07325383304940375
Rouge score after refactoring: 0.03236797274275979
Relative difference: 1.2631578947368423
Put 1.2631578947368423 in (12, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 2.769 ± 5.935 (5) & NaN ± NaN (0) \\
100-110 & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: This being a cache key, its equals and hashCode methods will potentially execute many
Synth origin doc: and cache expressions internally only called the first few time or more often at a
Synth refact doc: multiple this constructor invocation multiple time is slower for faster compilation at any rate but
Rouge score before refactoring: 0.07325383304940375
Rouge score after refactoring: 0.39522998296422485
Relative difference: -0.814655172413793
Put -0.814655172413793 in (12, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 2.769 ± 5.935 (5) & NaN ± NaN (0) \\
100-110 & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: Setter overload actually goes against the JavaBeans spec, but having this one is good for legacy
Synth origin doc: Used in testing reasons not to support all but one in case for some other than the
Synth refact doc: Provides to allow mocking across architectures but mostly here here just mostly as necessary as to retain
Rouge score before refactoring: 0.3935309973045822
Rouge score after refactoring: 0.03167115902964959
Relative difference: 11.425531914893618
Put 11.425531914893618 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 0.591 ± 0.131 (3) & 4.212 ± 15.35 (6) & NaN ± NaN (0) \\
100-110 & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: Setter overload actually goes against the JavaBeans spec, but having this one is good for legacy
Synth origin doc: Used in testing reasons not to support all but one in case for some other than the
Synth refact doc: Used in the backwards compatibility with backwards compatibility in nonstandard frameworks as per standard Java
Rouge score before refactoring: 0.3935309973045822
Rouge score after refactoring: 0.02830188679245283
Relative difference: 12.904761904761903
Put 12.904761904761903 in (9, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 3.669 ± 28.52 (4) & 4.212 ± 15.35 (6) & NaN ± NaN (0) \\
100-110 & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: Setter overload actually goes against the JavaBeans spec, but having this one is good for legacy
Synth origin doc: Used in testing reasons not to support all but one in case for some other than the
Synth refact doc: Provides to allow legacy support to support some common legacy style and behavior combination to serve with
Rouge score before refactoring: 0.3935309973045822
Rouge score after refactoring: 0.07345013477088949
Relative difference: 4.3577981651376145
Put 4.3577981651376145 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|ccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument \\\hline\\
70-80 & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 3.669 ± 28.52 (4) & 4.233 ± 13.16 (7) & NaN ± NaN (0) \\
100-110 & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: Setter overload actually goes against the JavaBeans spec, but having this one is good for legacy
Synth origin doc: Used in testing reasons not to support all but one in case for some other than the
Synth refact doc: Provides support of for compatibility purposes with previous version and not just because they exist mainly here
Rouge score before refactoring: 0.3935309973045822
Rouge score after refactoring: 0.06132075471698113
Relative difference: 5.417582417582417
Put 5.417582417582417 in (9, addExtraLogging)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.233 ± 13.16 (7) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: Setter overload actually goes against the JavaBeans spec, but having this one is good for legacy
Synth origin doc: Used in testing reasons not to support all but one in case for some other than the
Synth refact doc: preserved in order and only provided in backwards compatibilitites to facilitate legacy or partial
Rouge score before refactoring: 0.3935309973045822
Rouge score after refactoring: 0.03773584905660377
Relative difference: 9.428571428571429
Put 9.428571428571429 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: release memory
Synth origin doc: endregion
Synth refact doc: call the
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| protected void onDestroy() { | protected void onDestroy() { |
| super.onDestroy(); | super.onDestroy(); |
| // ~release memory~ | // **endregion** |
| if(mRecyclerView != null){ | if(mRecyclerView != null){ |
| mRecyclerView.destroy(); | mRecyclerView.destroy(); |
| mRecyclerView = null; | mRecyclerView = null; |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| protected void onDestroy() { | protected void onDestroy() { |
| super.onDestroy(); | super.onDestroy(); |
| // ~release~ ~memory~ | // **call** **the** |
| if(~mRecyclerView~ != null){ | if(**viiRecyclerEyeful** != null){ |
| ~mRecyclerView~.destroy(); | **viiRecyclerEyeful**.destroy(); |
| ~mRecyclerView~ = null; | **viiRecyclerEyeful** = null; |
| } | } |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.017964071856287425
Relative difference: -1.0
Put -1.0 in (13, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: release memory
Synth origin doc: endregion
Synth refact doc: removeAll
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| protected void onDestroy() { | protected void onDestroy() { |
| super.onDestroy(); | super.onDestroy(); |
| // ~release memory~ | // **endregion** |
| if(mRecyclerView != null){ | if(mRecyclerView != null){ |
| mRecyclerView.destroy(); | mRecyclerView.destroy(); |
| mRecyclerView = null; | mRecyclerView = null; |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| protected void onDestroy() { | protected void onDestroy() { |
| super.onDestroy(); | super.onDestroy(); |
| ~ // release memory~ | |
| if(mRecyclerView != null){ | if(mRecyclerView != null){ |
| | ** // removeAll** |
| mRecyclerView.destroy(); | mRecyclerView.destroy(); |
| mRecyclerView = null; | mRecyclerView = null; |
| } | } |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.059880239520958084
Relative difference: -1.0
Put -1.0 in (13, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: release memory
Synth origin doc: endregion
Synth refact doc: DEBUG call
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| protected void onDestroy() { | protected void onDestroy() { |
| super.onDestroy(); | super.onDestroy(); |
| // ~release memory~ | // **endregion** |
| if(mRecyclerView != null){ | if(mRecyclerView != null){ |
| mRecyclerView.destroy(); | mRecyclerView.destroy(); |
| mRecyclerView = null; | mRecyclerView = null; |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| protected void onDestroy() { | protected void onDestroy() { |
| super.onDestroy(); | super.onDestroy(); |
| // ~release~ ~memory~ | // **DEBUG** **call** |
| if(mRecyclerView != null){ | if(mRecyclerView != null){ |
| mRecyclerView.destroy(); | mRecyclerView.destroy(); |
| | ** System.out.println("debug");** |
| mRecyclerView = null; | mRecyclerView = null; |
| } | } |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.017964071856287425
Relative difference: -1.0
Put -1.0 in (13, addExtraLogging)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: Nested classes interrupt wrapped line indentation. Stash the current wrapping state and put
Synth origin doc: put nothing but instead just put and put the line to get and to
Synth refact doc: save code for the code to recompose then emit code that can automatically
Rouge score before refactoring: 0.357609710550887
Rouge score after refactoring: 0.018674136321195144
Relative difference: 18.150000000000002
Put 18.150000000000002 in (4, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & NaN ± NaN (0) & NaN ± NaN (0) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: Nested classes interrupt wrapped line indentation. Stash the current wrapping state and put
Synth origin doc: put nothing but instead just put and put the line to get and to
Synth refact doc: will also save to the memory cache but not put back or will instead
Rouge score before refactoring: 0.357609710550887
Rouge score after refactoring: 0.13258636788048553
Relative difference: 1.6971830985915493
Put 1.6971830985915493 in (4, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & NaN ± NaN (0) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: Nested classes interrupt wrapped line indentation. Stash the current wrapping state and put
Synth origin doc: put nothing but instead just put and put the line to get and to
Synth refact doc: save code before executing it to easily turn back to the code before we
Rouge score before refactoring: 0.357609710550887
Rouge score after refactoring: 0.04855275443510738
Relative difference: 6.365384615384616
Put 6.365384615384616 in (4, addExtraLogging)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 4.111 ± 22.47 (3) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: In theorie to 256, but only first 50 are interesting
Synth origin doc: change colors per pixel per filter per percentage per palette value
Synth refact doc: set the level threshold as percent change per percent level per
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| override fun adjust(percentage: Int) { | override fun adjust(percentage: Int) { |
| // ~In~ ~theorie~ ~to~ ~256,~ ~but~ ~only~ ~first~ ~50~ ~are~ ~interesting~ | // **change** **colors** **per** **pixel** **per** **filter** **per** **percentage** **per** **palette value** |
| filter.setColorLevels(range(percentage, 1, 50)) | filter.setColorLevels(range(percentage, 1, 50)) |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| override fun adjust(~percentage:~ Int) { | override fun adjust(**proportion:** Int) { |
| // ~In~ ~theorie~ ~to~ ~256,~ ~but~ ~only~ ~first~ ~50~ ~are~ ~interesting~ | // **set** **the** **level** **threshold** **as** **percent** **change** **per** **percent** **level** **per |
| filter.setColorLevels(range(~percentage~, 1, 50)) | **filter.setColorLevels(range(**proportion**, 1, 50)) |
| } | } |
| } | } |
Rouge score before refactoring: 0.08401976935749589
Rouge score after refactoring: 0.12026359143327842
Relative difference: -0.30136986301369856
Put -0.30136986301369856 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: Ignored, sorry :)
Synth origin doc: internal call instead of outside
Synth refact doc: ignore the Exception thrown in
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.15315315315315314
Relative difference: -1.0
Put -1.0 in (8, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 1.786 ± 0.0 (1) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: set all supported protocols
Synth origin doc: private final Socket sock
Synth refact doc: private void doInit
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| private void enableSecureProtocols(Socket socket) { | private void enableSecureProtocols(Socket socket) { |
| // ~set~ ~all~ ~supported~ ~protocols~ | // **private** **final** **Socket** **sock** |
| SSLParameters params = sslContext.getSupportedSSLParameters(); | SSLParameters params = sslContext.getSupportedSSLParameters(); |
| ((SSLSocket) socket).setEnabledProtocols(params.getProtocols()); | ((SSLSocket) socket).setEnabledProtocols(params.getProtocols()); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| private void enableSecureProtocols(Socket ~socket~) { | private void enableSecureProtocols(Socket **cavum**) { |
| // ~set~ ~all~ ~supported protocols~ | // **private** **void** **doInit** |
| SSLParameters params = sslContext.getSupportedSSLParameters(); | SSLParameters params = sslContext.getSupportedSSLParameters(); |
| ((SSLSocket) ~socket~).setEnabledProtocols(params.getProtocols()); | ((SSLSocket) **cavum**).setEnabledProtocols(params.getProtocols()); |
| } | } |
Rouge score before refactoring: 0.0018018018018018018
Rouge score after refactoring: 0.05225225225225225
Relative difference: -0.9655172413793103
Put -0.9655172413793103 in (14, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 0.410 ± 1.893 (2) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: It is a good practice to remove location requests when the activity is in a paused or
Synth origin doc: clears location Updates to enter an unusual time consuming steady or not yet reached into its next
Synth refact doc: clears all current positioning update listeners of view's internal updates with its previous positions into its
Rouge score before refactoring: 0.11030595813204509
Rouge score after refactoring: 0.10144927536231885
Relative difference: 0.08730158730158727
Put 0.08730158730158727 in (6, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & NaN ± NaN (0) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 0.410 ± 1.893 (2) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: It is a good practice to remove location requests when the activity is in a paused or
Synth origin doc: clears location Updates to enter an unusual time consuming steady or not yet reached into its next
Synth refact doc: no more use and should never use it anymore but instead are not being shown it as
Rouge score before refactoring: 0.11030595813204509
Rouge score after refactoring: 0.21336553945249598
Relative difference: -0.4830188679245283
Put -0.4830188679245283 in (6, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 0.410 ± 1.893 (2) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: The INITIAL_TRIGGER_ENTER flag indicates that geofencing service should trigger a
Synth origin doc: Register an immediate immediate default for handling any ongoing or complete ongoing and final
Synth refact doc: Precondit check the server to trigger for device presence in an immediate
Rouge score before refactoring: 0.07307692307692308
Rouge score after refactoring: 0.10384615384615385
Relative difference: -0.2962962962962963
Put -0.2962962962962963 in (14, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 0.174 ± 1.373 (3) & -0.01 ± 0.0 (1)
\end{tabular}
\end{table}
Ground truth doc: The INITIAL_TRIGGER_ENTER flag indicates that geofencing service should trigger a
Synth origin doc: Register an immediate immediate default for handling any ongoing or complete ongoing and final
Synth refact doc: Fire an immediate default default of an implicit initialTrigger containing only an optional
Rouge score before refactoring: 0.07307692307692308
Rouge score after refactoring: 0.15384615384615385
Relative difference: -0.525
Put -0.525 in (14, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & NaN ± NaN (0) & NaN ± NaN (0) & 0.174 ± 1.373 (3) & -0.27 ± 0.063 (2)
\end{tabular}
\end{table}
Ground truth doc: Called when a client (MainActivity in case of this sample) comes to the foreground
Synth origin doc: closes all existing active connections to services in your local system and discovers the target app
Synth refact doc: Stop this application from listening incoming events and all subsequent application listeners which also stops all
Rouge score before refactoring: 0.14032869785082175
Rouge score after refactoring: 0.05815423514538559
Relative difference: 1.4130434782608694
Put 1.4130434782608694 in (14, addExtraLogging)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.174 ± 1.373 (3) & -0.27 ± 0.063 (2)
\end{tabular}
\end{table}
Ground truth doc: If we have not yet retrieved the user location, we process the user's request by setting
Synth origin doc: sets the property on view with the key identifying address to hold the current Location of the application's
Synth refact doc: Reset to state containing setting of the field with flag of setting to reset to set all values
Rouge score before refactoring: 0.48770491803278687
Rouge score after refactoring: 0.38524590163934425
Relative difference: 0.26595744680851063
Put 0.26595744680851063 in (14, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.27 ± 0.063 (2)
\end{tabular}
\end{table}
Ground truth doc: If we have not yet retrieved the user location, we process the user's request by setting
Synth origin doc: sets the property on view with the key identifying address to hold the current Location of the application's
Synth refact doc: setting up state variables for set of fields setting the state var sets all the methods of the fields
Rouge score before refactoring: 0.48770491803278687
Rouge score after refactoring: 0.3729508196721312
Relative difference: 0.30769230769230754
Put 0.30769230769230754 in (14, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.07 ± 0.117 (3)
\end{tabular}
\end{table}
Ground truth doc: We use FLAG_UPDATE_CURRENT so that we get the same pending intent back when calling
Synth origin doc: initialisation of intent calls from the SDK and later by calls on Intent services after both call
Synth refact doc: initialisation of Intent and methods for handling the request and to callers like the method calls
Rouge score before refactoring: 0.25227963525835867
Rouge score after refactoring: 0.2826747720364742
Relative difference: -0.10752688172043012
Put -0.10752688172043012 in (13, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.882 ± 14.46 (8) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.07 ± 0.117 (3)
\end{tabular}
\end{table}
Ground truth doc: The Sun HTTP Client retries all requests once on an IOException, which makes testing retry
Synth origin doc: Makes loading other packages into our own Java Java file will makes some less common code
Synth refact doc: Makes much other obscurely usedSunRetrieveReHeared and rehes
Rouge score before refactoring: 0.6155378486055777
Rouge score after refactoring: 0.6613545816733067
Relative difference: -0.06927710843373489
Put -0.06927710843373489 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 3.669 ± 28.52 (4) & 4.332 ± 15.28 (9) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.07 ± 0.117 (3)
\end{tabular}
\end{table}
Ground truth doc: The Sun HTTP Client retries all requests once on an IOException, which makes testing retry
Synth origin doc: Makes loading other packages into our own Java Java file will makes some less common code
Synth refact doc: Makes much faster but it is still to run other parts the way which is the
Rouge score before refactoring: 0.6155378486055777
Rouge score after refactoring: 0.6274900398406374
Relative difference: -0.019047619047619032
Put -0.019047619047619032 in (9, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & NaN ± NaN (0) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.07 ± 0.117 (3)
\end{tabular}
\end{table}
Ground truth doc: The Sun HTTP Client retries all requests once on an IOException, which makes testing retry
Synth origin doc: Makes loading other packages into our own Java Java file will makes some less common code
Synth refact doc: should this not have ever used but seems it will probably no be going back but
Rouge score before refactoring: 0.6155378486055777
Rouge score after refactoring: 0.17330677290836655
Relative difference: 2.5517241379310343
Put 2.5517241379310343 in (9, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & NaN ± NaN (0) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.07 ± 0.117 (3)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: The
Synth refact doc: act
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.023809523809523808
Relative difference: -1.0
Put -1.0 in (11, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.887 ± 0.395 (2) & 1.020 ± 1.733 (2) & -1.0 ± 0.0 (1) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.07 ± 0.117 (3)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: The
Synth refact doc: Construct
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkNotNullInputNullNotNullNullOutputNullPointerException() { | public void checkNotNullInputNullNotNullNullOutputNullPointerException() { |
| // ~Arrange~ | // **The** |
| final Object reference = null; | final Object reference = null; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| final Object[] errorMessageArgs = null; | final Object[] errorMessageArgs = null; |
| // Act | // Act |
| thrown.expect(NullPointerException.class); | thrown.expect(NullPointerException.class); |
| Util.checkNotNull(reference, errorMessageTemplate, errorMessageArgs); | Util.checkNotNull(reference, errorMessageTemplate, errorMessageArgs); |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkNotNullInputNullNotNullNullOutputNullPointerException() { | public void checkNotNullInputNullNotNullNullOutputNullPointerException() { |
| // ~Arrange~ | // **Construct** |
| final Object reference = null; | final Object reference = null; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| final Object[] errorMessageArgs = null; | final Object[] errorMessageArgs = null; |
| // Act | // Act |
| thrown.expect(NullPointerException.class); | thrown.expect(NullPointerException.class); |
| Util.checkNotNull(~reference~, errorMessageTemplate,~ errorMessageArgs~); | Util.checkNotNull(** errorMessageArgs**, errorMessageTemplate,**reference**); |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.011904761904761904
Relative difference: -1.0
Put -1.0 in (11, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.258 ± 1.055 (3) & 1.020 ± 1.733 (2) & -1.0 ± 0.0 (1) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.07 ± 0.117 (3)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: The
Synth refact doc: act
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkNotNullInputNullNotNullNullOutputNullPointerException() { | public void checkNotNullInputNullNotNullNullOutputNullPointerException() { |
| // ~Arrange~ | // **The** |
| final Object reference = null; | final Object reference = null; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| final Object[] errorMessageArgs = null; | final Object[] errorMessageArgs = null; |
| // Act | // Act |
| thrown.expect(NullPointerException.class); | thrown.expect(NullPointerException.class); |
| Util.checkNotNull(reference, errorMessageTemplate, errorMessageArgs); | Util.checkNotNull(reference, errorMessageTemplate, errorMessageArgs); |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkNotNullInputNullNotNullNullOutputNullPointerException() { | public void checkNotNullInputNullNotNullNullOutputNullPointerException() { |
| // ~Arrange~ | // **act** |
| final Object reference = null; | final Object reference = null; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| ~ final Object[] errorMessageArgs = null;~ | |
| // Act | // Act |
| ~thrown.expect(NullPointerException.class);~ | **final Object[] errorMessageArgs = null;** |
| Util.checkNotNull(reference, errorMessageTemplate, errorMessageArgs); | Util.checkNotNull(reference, errorMessageTemplate, errorMessageArgs); |
| | ** thrown.expect(NullPointerException.class);** |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.023809523809523808
Relative difference: -1.0
Put -1.0 in (11, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & NaN ± NaN (0) & 0.258 ± 1.055 (3) & 1.020 ± 1.733 (2) & -1.0 ± 0.0 (2) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.07 ± 0.117 (3)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: The
Synth refact doc: Construct
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkNotNullInputNullNotNullNullOutputNullPointerException() { | public void checkNotNullInputNullNotNullNullOutputNullPointerException() { |
| // ~Arrange~ | // **The** |
| final Object reference = null; | final Object reference = null; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| final Object[] errorMessageArgs = null; | final Object[] errorMessageArgs = null; |
| // Act | // Act |
| thrown.expect(NullPointerException.class); | thrown.expect(NullPointerException.class); |
| Util.checkNotNull(reference, errorMessageTemplate, errorMessageArgs); | Util.checkNotNull(reference, errorMessageTemplate, errorMessageArgs); |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkNotNullInputNullNotNullNullOutputNullPointerException() { | public void checkNotNullInputNullNotNullNullOutputNullPointerException() { |
| // ~Arrange~ | // **Construct** |
| final Object reference = null; | final Object reference = null; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| | ** System.out.println("debug");** |
| final Object[] errorMessageArgs = null; | final Object[] errorMessageArgs = null; |
| // Act | // Act |
| thrown.expect(NullPointerException.class); | thrown.expect(NullPointerException.class); |
| | ** System.out.println("debug");** |
| Util.checkNotNull(reference, errorMessageTemplate, errorMessageArgs); | Util.checkNotNull(reference, errorMessageTemplate, errorMessageArgs); |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.011904761904761904
Relative difference: -1.0
Put -1.0 in (11, addExtraLogging)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 0.258 ± 1.055 (3) & 1.020 ± 1.733 (2) & -1.0 ± 0.0 (2) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.07 ± 0.117 (3)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Creat
Synth refact doc: Create
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.08333333333333333
Relative difference: -1.0
Put -1.0 in (14, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 0.258 ± 1.055 (3) & 1.020 ± 1.733 (2) & -1.0 ± 0.0 (2) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: The
Synth refact doc: Construct
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkStateInputFalseNotNullNullOutputIllegalStateException() { | public void checkStateInputFalseNotNullNullOutputIllegalStateException() { |
| // ~Arrange~ | // **The** |
| final boolean expression = false; | final boolean expression = false; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| final Object[] errorMessageArgs = null; | final Object[] errorMessageArgs = null; |
| // Act | // Act |
| thrown.expect(IllegalStateException.class); | thrown.expect(IllegalStateException.class); |
| Util.checkState(expression, errorMessageTemplate, errorMessageArgs); | Util.checkState(expression, errorMessageTemplate, errorMessageArgs); |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkStateInputFalseNotNullNullOutputIllegalStateException() { | public void checkStateInputFalseNotNullNullOutputIllegalStateException() { |
| // ~Arrange~ | // **Construct** |
| final boolean ~expression~ = false; | final boolean **southernism** = false; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| final Object[] errorMessageArgs = null; | final Object[] errorMessageArgs = null; |
| // Act | // Act |
| thrown.expect(IllegalStateException.class); | thrown.expect(IllegalStateException.class); |
| Util.checkState(~expression~, errorMessageTemplate, errorMessageArgs); | Util.checkState(**southernism**, errorMessageTemplate, errorMessageArgs); |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.011904761904761904
Relative difference: -1.0
Put -1.0 in (11, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 0.258 ± 1.055 (3) & 0.346 ± 2.062 (3) & -1.0 ± 0.0 (2) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: The
Synth refact doc: Construct
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkStateInputFalseNotNullNullOutputIllegalStateException() { | public void checkStateInputFalseNotNullNullOutputIllegalStateException() { |
| // ~Arrange~ | // **The** |
| final boolean expression = false; | final boolean expression = false; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| final Object[] errorMessageArgs = null; | final Object[] errorMessageArgs = null; |
| // Act | // Act |
| thrown.expect(IllegalStateException.class); | thrown.expect(IllegalStateException.class); |
| Util.checkState(expression, errorMessageTemplate, errorMessageArgs); | Util.checkState(expression, errorMessageTemplate, errorMessageArgs); |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkStateInputFalseNotNullNullOutputIllegalStateException() { | public void checkStateInputFalseNotNullNullOutputIllegalStateException() { |
| // ~Arrange~ | // **Construct** |
| final boolean expression = false; | final boolean expression = false; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| final Object[] errorMessageArgs = null; | final Object[] errorMessageArgs = null; |
| // Act | // Act |
| thrown.expect(IllegalStateException.class); | thrown.expect(IllegalStateException.class); |
| Util.checkState(~expression,~ errorMessageTemplate, errorMessageArgs); | Util.checkState( errorMessageTemplate, errorMessageArgs**,expression**); |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.011904761904761904
Relative difference: -1.0
Put -1.0 in (11, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.05 ± 1.088 (4) & 0.346 ± 2.062 (3) & -1.0 ± 0.0 (2) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: The
Synth refact doc: Create
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkStateInputFalseNotNullNullOutputIllegalStateException() { | public void checkStateInputFalseNotNullNullOutputIllegalStateException() { |
| // ~Arrange~ | // **The** |
| final boolean expression = false; | final boolean expression = false; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| final Object[] errorMessageArgs = null; | final Object[] errorMessageArgs = null; |
| // Act | // Act |
| thrown.expect(IllegalStateException.class); | thrown.expect(IllegalStateException.class); |
| Util.checkState(expression, errorMessageTemplate, errorMessageArgs); | Util.checkState(expression, errorMessageTemplate, errorMessageArgs); |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void checkStateInputFalseNotNullNullOutputIllegalStateException() { | public void checkStateInputFalseNotNullNullOutputIllegalStateException() { |
| // ~Arrange~ | // **Create** |
| final boolean expression = false; | final boolean expression = false; |
| final String errorMessageTemplate = ""; | final String errorMessageTemplate = ""; |
| ~ final Object[] errorMessageArgs = null;~ | |
| // Act | // Act |
| ~thrown.expect(IllegalStateException.class);~ | **final Object[] errorMessageArgs = null;** |
| Util.checkState(expression, errorMessageTemplate, errorMessageArgs); | Util.checkState(expression, errorMessageTemplate, errorMessageArgs); |
| | ** thrown.expect(IllegalStateException.class);** |
| // Method is not expected to return due to exception thrown | // Method is not expected to return due to exception thrown |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.08333333333333333
Relative difference: -1.0
Put -1.0 in (11, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & NaN ± NaN (0) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.05 ± 1.088 (4) & 0.346 ± 2.062 (3) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Initial
Synth refact doc: Construct
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void isBlankInputNotNullOutputFalse() { | public void isBlankInputNotNullOutputFalse() { |
| // ~Arrange~ | // **Initial** |
| final String value = "AAAAAAAA"; | final String value = "AAAAAAAA"; |
| // Act | // Act |
| final boolean retval = Util.isBlank(value); | final boolean retval = Util.isBlank(value); |
| // Assert result | // Assert result |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void isBlankInputNotNullOutputFalse() { | public void isBlankInputNotNullOutputFalse() { |
| // ~Arrange~ | // **Construct** |
| ~ final String value = "AAAAAAAA";~ | |
| // Act | // Act |
| final ~boolean~ ~retval~ = ~Util.isBlank(value);~ | final **String** **value** = **"AAAAAAAA";** |
| // Assert result | // Assert result |
| | ** final boolean retval = Util.isBlank(value);** |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.011904761904761904
Relative difference: -1.0
Put -1.0 in (8, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.05 ± 1.088 (4) & 0.346 ± 2.062 (3) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Initial
Synth refact doc: Construct
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void isNotBlankInputNotNullOutputFalse() { | public void isNotBlankInputNotNullOutputFalse() { |
| // ~Arrange~ | // **Initial** |
| final String value = ""; | final String value = ""; |
| // Act | // Act |
| final boolean retval = Util.isNotBlank(value); | final boolean retval = Util.isNotBlank(value); |
| // Assert result | // Assert result |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void isNotBlankInputNotNullOutputFalse() { | public void isNotBlankInputNotNullOutputFalse() { |
| // ~Arrange~ | // **Construct** |
| ~ final String value = "";~ | |
| // Act | // Act |
| final ~boolean~ ~retval~ = ~Util.isNotBlank(value);~ | final **String** **value** = **"";** |
| // Assert result | // Assert result |
| | ** final boolean retval = Util.isNotBlank(value);** |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.011904761904761904
Relative difference: -1.0
Put -1.0 in (8, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.05 ± 1.088 (4) & 0.346 ± 2.062 (3) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.82 ± 0.0 (1) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Act
Synth origin doc: Default
Synth refact doc: Creating
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void nullMap() { | public void nullMap() { |
| // ~Act~ | // **Default** |
| Map<String, Collection<String>> actualMap = caseInsensitiveCopyOf(null); | Map<String, Collection<String>> actualMap = caseInsensitiveCopyOf(null); |
| // Assert result | // Assert result |
| assertThat(actualMap) | assertThat(actualMap) |
| .isNotNull() | .isNotNull() |
| .isEmpty(); | .isEmpty(); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void nullMap() { | public void nullMap() { |
| // ~Act~ | // **Creating** |
| Map<String, Collection<String>> ~actualMap~ = caseInsensitiveCopyOf(null); | Map<String, Collection<String>> **afootShow** = caseInsensitiveCopyOf(null); |
| // Assert result | // Assert result |
| assertThat(~actualMap~) | assertThat(**afootShow**) |
| .isNotNull() | .isNotNull() |
| .isEmpty(); | .isEmpty(); |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.038461538461538464
Relative difference: -1.0
Put -1.0 in (12, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.05 ± 1.088 (4) & 0.346 ± 2.062 (3) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: 1990 distinct devices tracked by Bluedroid will cause a crash. But we don't know how many
Synth origin doc: count for how far we ve detected any other malicious device from any set up list with which there
Synth refact doc: If too far number we tracked before any crashes for some number more that total count number the set
Rouge score before refactoring: 0.08695652173913043
Rouge score after refactoring: 0.2907608695652174
Relative difference: -0.7009345794392524
Put -0.7009345794392524 in (5, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.05 ± 1.088 (4) & 0.346 ± 2.062 (3) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: This re-initialization is a bit expensive on memory, but it only happens when either the world is
Synth origin doc: when component resolution should not by updated and its components must by changed and they may only only by
Synth refact doc: when outer layer isn t anymore needed anymore and the region size was just increased either we re not
Rouge score before refactoring: 0.19624217118997914
Rouge score after refactoring: 0.5219206680584552
Relative difference: -0.6240000000000001
Put -0.6240000000000001 in (8, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & NaN ± NaN (0) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.05 ± 1.088 (4) & 0.346 ± 2.062 (3) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: This re-initialization is a bit expensive on memory, but it only happens when either the world is
Synth origin doc: when component resolution should not by updated and its components must by changed and they may only only by
Synth refact doc: when it can only later by either being changed or the component definition gets modified either being changed by
Rouge score before refactoring: 0.19624217118997914
Rouge score after refactoring: 0.5908141962421712
Relative difference: -0.667844522968198
Put -0.667844522968198 in (8, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.05 ± 1.088 (4) & 0.346 ± 2.062 (3) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Re-sizing the arena results in a compaction, so any free space in the arena will be
Synth origin doc: Buffer memory can then safely by memory is being recycled will now safely grow that will now get more
Synth refact doc: elements must all all already allocated but they may need additional data and must also need extra extra elements
Rouge score before refactoring: 0.4194577352472089
Rouge score after refactoring: 0.022328548644338118
Relative difference: 17.785714285714285
Put 17.785714285714285 in (11, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.05 ± 1.088 (4) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Re-sizing the arena results in a compaction, so any free space in the arena will be
Synth origin doc: Buffer memory can then safely by memory is being recycled will now safely grow that will now get more
Synth refact doc: memory memory should always by being zeroed or more and memory memory must then always get it allocated
Rouge score before refactoring: 0.4194577352472089
Rouge score after refactoring: 0.38596491228070173
Relative difference: 0.08677685950413226
Put 0.08677685950413226 in (11, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & NaN ± NaN (0) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.02 ± 0.874 (5) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Accumulate bits on each axis for the given block position. This avoids needing to
Synth origin doc: call the above for this point in order avoid adding one block of each point
Synth refact doc: call the above function before entering each Block in each iteration of each iteration that
Rouge score before refactoring: 0.2761795166858458
Rouge score after refactoring: 0.1852704257767549
Relative difference: 0.4906832298136644
Put 0.4906832298136644 in (6, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 0.087 ± 0.0 (1) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.02 ± 0.874 (5) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Nada
Synth origin doc: simple
Synth refact doc: nothing
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void single(Object a1) { | public void single(Object a1) { |
| //~Nada~ | //** simple** |
| } | } |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~single~(Object a1) { | public void **one-man**(Object a1) { |
| //~Nada~ | //** nothing** |
| } | } |
| } | } |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 1.0
Relative difference: -1.0
Put -1.0 in (6, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.02 ± 0.874 (5) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & -1.0 ± 0.0 (1) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Invoke test
Synth origin doc: return tested
Synth refact doc: Call actual
Rouge score before refactoring: 0.3291139240506329
Rouge score after refactoring: 0.12658227848101267
Relative difference: 1.5999999999999996
Put 1.5999999999999996 in (13, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.02 ± 0.874 (5) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & -0.10 ± 0.0 (1) & 0.299 ± 1.689 (2) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Invoke test
Synth origin doc: return tested
Synth refact doc: return t
Rouge score before refactoring: 0.3291139240506329
Rouge score after refactoring: 0.06329113924050633
Relative difference: 4.199999999999999
Put 4.199999999999999 in (13, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.02 ± 0.874 (5) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.046 ± 4.638 (2) & 0.299 ± 1.689 (2) & -1.0 ± 0.0 (1) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Invoke test
Synth origin doc: return tested
Synth refact doc: null return
Rouge score before refactoring: 0.3291139240506329
Rouge score after refactoring: 0.06329113924050633
Relative difference: 4.199999999999999
Put 4.199999999999999 in (13, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.02 ± 0.874 (5) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 1.263 ± 0.0 (1) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.046 ± 4.638 (2) & 0.299 ± 1.689 (2) & 1.599 ± 6.759 (2) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Moved from ChunkProviderServer
Synth origin doc: CALLBOOK
Synth refact doc: CallBack Information
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.037366548042704624
Relative difference: -1.0
Put -1.0 in (12, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 9.583 ± 0.0 (1) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.02 ± 0.874 (5) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.046 ± 4.638 (2) & 0.299 ± 1.689 (2) & 1.599 ± 6.759 (2) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: In Forge Vanilla, this method is called AFTER capture drops is set to true,
Synth origin doc: This class defines wrapper methods for methods whose parameter values contain objects which have an object
Synth refact doc: Note here the outer list of wrapped data exists so far and some methods which
Rouge score before refactoring: 0.09644670050761421
Rouge score after refactoring: 0.0583756345177665
Relative difference: 0.6521739130434782
Put 0.6521739130434782 in (7, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 5.117 ± 19.94 (2) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & -0.02 ± 0.874 (5) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.046 ± 4.638 (2) & 0.299 ± 1.689 (2) & 1.599 ± 6.759 (2) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Make Gradle use the temporary build folder by overriding the buildDir property
Synth origin doc: Extract Build File Path and Path Properties for compiling files from J
Synth refact doc: Optional parameter for test execution execution invocation execution process execution process process
Rouge score before refactoring: 0.30397236614853196
Rouge score after refactoring: 0.031088082901554404
Relative difference: 8.777777777777779
Put 8.777777777777779 in (11, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 5.117 ± 19.94 (2) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.046 ± 4.638 (2) & 0.299 ± 1.689 (2) & 1.599 ± 6.759 (2) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Make sure the test build setup actually compiles
Synth origin doc: build the tests with gradletuce compiler
Synth refact doc: build the actual code for test suite generation
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void testBuildSucceeds(String gradleVersion) throws IOException { | public void testBuildSucceeds(String gradleVersion) throws IOException { |
| setup( gradleVersion ); | setup( gradleVersion ); |
| // ~Make~ ~sure ~the ~test~ ~build~ ~setup~ ~actually compiles~ | // **build** the **tests** **with** **gradletuce** **compiler** |
| BuildResult buildResult = getRunner().build(); | BuildResult buildResult = getRunner().build(); |
| assertCompileOutcome( buildResult, SUCCESS ); | assertCompileOutcome( buildResult, SUCCESS ); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void testBuildSucceeds(String ~gradleVersion~) throws IOException { | public void testBuildSucceeds(String **gradleAdaptation**) throws IOException { |
| setup( ~gradleVersion~ ); | setup( **gradleAdaptation** ); |
| // ~Make~ ~sure ~the ~test~ ~build~ ~setup~ ~actually~ ~compiles~ | // **build** the **actual** **code** **for** **test** **suite generation** |
| BuildResult buildResult = getRunner().build(); | BuildResult buildResult = getRunner().build(); |
| assertCompileOutcome( buildResult, SUCCESS ); | assertCompileOutcome( buildResult, SUCCESS ); |
| } | } |
Rouge score before refactoring: 0.2147117296222664
Rouge score after refactoring: 0.24055666003976142
Relative difference: -0.10743801652892561
Put -0.10743801652892561 in (13, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 5.117 ± 19.94 (2) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.046 ± 4.638 (2) & 0.164 ± 1.163 (3) & 1.599 ± 6.759 (2) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: MapStruct annotations in multi-module reactor build or IDE
Synth origin doc: App module name in the built in application package directory
Synth refact doc: App Build Annotations for test application builds in project files
Rouge score before refactoring: 0.6619047619047619
Rouge score after refactoring: 0.7285714285714285
Relative difference: -0.09150326797385619
Put -0.09150326797385619 in (13, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 5.117 ± 19.94 (2) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.046 ± 4.638 (2) & 0.100 ± 0.884 (4) & 1.599 ± 6.759 (2) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Act
Synth refact doc: Call
Rouge score before refactoring: 0.023809523809523808
Rouge score after refactoring: 0.03571428571428571
Relative difference: -0.3333333333333333
Put -0.3333333333333333 in (13, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 5.117 ± 19.94 (2) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & 0.100 ± 0.884 (4) & 1.599 ± 6.759 (2) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Act
Synth refact doc: Construct
Rouge score before refactoring: 0.023809523809523808
Rouge score after refactoring: 0.011904761904761904
Relative difference: 1.0
Put 1.0 in (13, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 5.117 ± 19.94 (2) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & 0.100 ± 0.884 (4) & 1.399 ± 4.586 (3) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Act
Synth origin doc: Cop
Synth refact doc: Copy
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.03076923076923077
Relative difference: -1.0
Put -1.0 in (13, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 5.117 ± 19.94 (2) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & -0.11 ± 0.901 (5) & 1.399 ± 4.586 (3) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Act
Synth origin doc: Cop
Synth refact doc: Throw
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.04230769230769231
Relative difference: -1.0
Put -1.0 in (13, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 5.117 ± 19.94 (2) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 4.706 ± 58.56 (4) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & -0.11 ± 0.901 (5) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: TODO: Fix so we don't need fully qualified name here. This is to get IntelliJ to recognize
Synth origin doc: overriding is possible for overriding from elsewhere to override with or not with overriding in addition for just
Synth refact doc: override method cannot simply refer somewhere other in other classes or be accessed from directly in lieu by simply
Rouge score before refactoring: 0.27413587604290823
Rouge score after refactoring: 0.3170441001191895
Relative difference: -0.13533834586466156
Put -0.13533834586466156 in (11, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 5.117 ± 19.94 (2) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -1.0 ± 0.0 (3) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & -0.11 ± 0.901 (5) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: TODO: Fix so we don't need fully qualified name here. This is to get IntelliJ to recognize
Synth origin doc: overriding is possible for overriding from elsewhere to override with or not with overriding in addition for just
Synth refact doc: Note this private constructor returns the name but its public final version which for example if used by a
Rouge score before refactoring: 0.27413587604290823
Rouge score after refactoring: 0.18116805721096543
Relative difference: 0.5131578947368421
Put 0.5131578947368421 in (11, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 5.117 ± 19.94 (2) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.81 ± 0.035 (2) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & -0.11 ± 0.901 (5) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: create a simulated token; since this is a demo extension that does not perform an actual
Synth origin doc: without an explicit user profile for an authorization via token or userProfileData during your account
Synth refact doc: after first token in this list after first user after an implicit auth or token after any
Rouge score before refactoring: 0.06201550387596899
Rouge score after refactoring: 0.06666666666666667
Relative difference: -0.06976744186046512
Put -0.06976744186046512 in (8, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 5.117 ± 19.94 (2) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.56 ± 0.145 (3) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & -0.11 ± 0.901 (5) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Act
Synth origin doc: Use
Synth refact doc: Begin
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void testWrongPartSize() { | public void testWrongPartSize() { |
| // ~Act~ | // **Use** |
| new BackblazeDataTransferClient(monitor, backblazeS3ClientFactory, 10, 0); | new BackblazeDataTransferClient(monitor, backblazeS3ClientFactory, 10, 0); |
| // Assert: expected exception | // Assert: expected exception |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void testWrongPartSize() { | public void testWrongPartSize() { |
| // ~Act~ | // **Begin** |
| ~ new BackblazeDataTransferClient(monitor, backblazeS3ClientFactory, 10, 0);~ | |
| // Assert: expected exception | // Assert: expected exception |
| | ** new BackblazeDataTransferClient(monitor, backblazeS3ClientFactory, 10, 0);** |
| } | } |
Rouge score before refactoring: 0.04230769230769231
Rouge score after refactoring: 0.023076923076923078
Relative difference: 0.8333333333333334
Put 0.8333333333333334 in (7, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.56 ± 0.145 (3) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.935 ± 0.564 (3) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & -0.11 ± 0.901 (5) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Init
Synth refact doc: Construct
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void testUploadFileNonInitialized() throws IOException { | public void testUploadFileNonInitialized() throws IOException { |
| // ~Arrange~ | // **Init** |
| BackblazeDataTransferClient client = createDefaultClient(); | BackblazeDataTransferClient client = createDefaultClient(); |
| // Act | // Act |
| client.uploadFile(FILE_KEY, testFile); | client.uploadFile(FILE_KEY, testFile); |
| // Assert: expected exception | // Assert: expected exception |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void testUploadFileNonInitialized() throws IOException { | public void testUploadFileNonInitialized() throws IOException { |
| // ~Arrange~ | // **Construct** |
| BackblazeDataTransferClient client = createDefaultClient(); | BackblazeDataTransferClient client = createDefaultClient(); |
| // Act | // Act |
| client.uploadFile(~FILE_KEY,~ testFile); | client.uploadFile( testFile**,FILE_KEY**); |
| // Assert: expected exception | // Assert: expected exception |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.011904761904761904
Relative difference: -1.0
Put -1.0 in (10, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.56 ± 0.145 (3) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 3.008 ± 20.51 (4) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & -0.11 ± 0.901 (5) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Ensure credential is populated
Synth origin doc: call beforeSaveCallback
Synth refact doc: Create a cred object
Rouge score before refactoring: 0.02097902097902098
Rouge score after refactoring: 0.07342657342657342
Relative difference: -0.7142857142857143
Put -0.7142857142857143 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.56 ± 0.145 (3) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & -0.11 ± 0.901 (5) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: SOLID outputs lines like:
Synth origin doc: Like the original style is
Synth refact doc: example is this is a
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| private static String fixProblematicPeriods(String source) { | private static String fixProblematicPeriods(String source) { |
| // ~SOLID~ ~outputs~ ~lines~ ~like:~ | // **Like** **the** **original** **style is** |
| // st:size 4096. | // st:size 4096. |
| // And jena thinks the trailing '.' belongs to the number, and not the end of | // And jena thinks the trailing '.' belongs to the number, and not the end of |
| // the stanza. So this turn cases like that into: | // the stanza. So this turn cases like that into: |
| // st:size 4096.0. | // st:size 4096.0. |
| // which everyone likes | // which everyone likes |
| return PROBLEMATIC_TURTLE.matcher(source).replaceAll("$10.\n"); | return PROBLEMATIC_TURTLE.matcher(source).replaceAll("$10.\n"); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| private static String fixProblematicPeriods(String ~source~) { | private static String fixProblematicPeriods(String **root**) { |
| // ~SOLID~ ~outputs~ ~lines~ ~like:~ | // **example** **is** **this** **is a** |
| // st:size 4096. | // st:size 4096. |
| // And jena thinks the trailing '.' belongs to the number, and not the end of | // And jena thinks the trailing '.' belongs to the number, and not the end of |
| // the stanza. So this turn cases like that into: | // the stanza. So this turn cases like that into: |
| // st:size 4096.0. | // st:size 4096.0. |
| // which everyone likes | // which everyone likes |
| return PROBLEMATIC_TURTLE.matcher(~source~).replaceAll("$10.\n"); | return PROBLEMATIC_TURTLE.matcher(**root**).replaceAll("$10.\n"); |
| } | } |
Rouge score before refactoring: 0.11764705882352941
Rouge score after refactoring: 0.03571428571428571
Relative difference: 2.294117647058824
Put 2.294117647058824 in (13, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & -0.45 ± 0.295 (2) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.56 ± 0.145 (3) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & 0.282 ± 1.560 (6) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: dark greylist in Android P
Synth origin doc: internal method only in the
Synth refact doc: internal usage mostly for backwards
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void appNotRespondingViaProvider(IContentProvider icp) { | public void appNotRespondingViaProvider(IContentProvider icp) { |
| // ~dark~ ~greylist~ in ~Android P~ | // **internal** **method** **only **in **the** |
| // mBase.appNotRespondingViaProvider(icp); | // mBase.appNotRespondingViaProvider(icp); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~appNotRespondingViaProvider~(IContentProvider icp) { | public void **appNonExplodeViaProvider**(IContentProvider icp) { |
| // ~dark~ ~greylist~ ~in~ ~Android~ ~P~ | // **internal** **usage** **mostly** **for** **backwards** |
| // mBase.~appNotRespondingViaProvider~(icp); | // mBase.**appNonExplodeViaProvider**(icp); |
| } | } |
Rouge score before refactoring: 0.23648648648648649
Rouge score after refactoring: 0.006756756756756757
Relative difference: 33.99999999999999
Put 33.99999999999999 in (6, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.56 ± 0.145 (3) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & -1.0 ± 0.0 (1) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & 0.282 ± 1.560 (6) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: close pig
Synth origin doc: end if
Synth refact doc: shutdown everything
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void stop() { | public void stop() { |
| // ~close~ ~pig~ | // **end** **if** |
| if (pig != null) { | if (pig != null) { |
| pig.shutdown(); | pig.shutdown(); |
| pig = null; | pig = null; |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void stop() { | public void stop() { |
| // ~close~ ~pig~ | // **shutdown** **everything** |
| if (pig != null) { | if (pig != null) { |
| pig.shutdown(); | pig.shutdown(); |
| | ** System.out.println("debug");** |
| pig = null; | pig = null; |
| } | } |
| } | } |
Rouge score before refactoring: 0.07718120805369127
Rouge score after refactoring: 0.010067114093959731
Relative difference: 6.666666666666667
Put 6.666666666666667 in (11, addExtraLogging)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.56 ± 0.145 (3) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 2.833 ± 14.69 (2) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & 0.282 ± 1.560 (6) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: We don't set a property here to guard against adding a token to the
Synth origin doc: Use an argument of length 0 with this a specific set for a new local location
Synth refact doc: Use an argument of kind same as calling initWith a String String as location of each different
Rouge score before refactoring: 0.6264880952380952
Rouge score after refactoring: 0.09077380952380952
Relative difference: 5.901639344262295
Put 5.901639344262295 in (13, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.56 ± 0.145 (3) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 2.833 ± 14.69 (2) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 1.253 ± 4.350 (3) & 1.085 ± 5.203 (7) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: We don't set a property here to guard against adding a token to the
Synth origin doc: Use an argument of length 0 with this a specific set for a new local location
Synth refact doc: Use an argument with each specific RunSettcher to configure your same Job and
Rouge score before refactoring: 0.6264880952380952
Rouge score after refactoring: 0.03571428571428571
Relative difference: 16.541666666666668
Put 16.541666666666668 in (13, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.56 ± 0.145 (3) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 2.833 ± 14.69 (2) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 0.799 ± 4.52 (4) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: We don't set a property here to guard against adding a token to the
Synth origin doc: Use an argument of length 0 with this a specific set for a new local location
Synth refact doc: execute this with different locations in this job in an applet for every other given
Rouge score before refactoring: 0.6264880952380952
Rouge score after refactoring: 0.08035714285714286
Relative difference: 6.796296296296295
Put 6.796296296296295 in (13, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.56 ± 0.145 (3) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 2.833 ± 14.69 (2) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Captures just the cluster configuration, topology specific configuration
Synth origin doc: These settings and its optional other configurations are
Synth refact doc: these options will in the next future turn be
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void prepare(Map stormClusterConfiguration) { | public void prepare(Map stormClusterConfiguration) { |
| // ~Captures~ ~just~ ~the~ ~cluster~ ~configuration,~ ~topology~ ~specific~ ~configuration~ | // **These** **settings** **and** **its** **optional** **other** **configurations** **are** |
| // will be passed in via method parameters later as needed | // will be passed in via method parameters later as needed |
| LOG.debug("Receiving cluster configuration"); | LOG.debug("Receiving cluster configuration"); |
| clusterSettings = new StormSettings(stormClusterConfiguration); | clusterSettings = new StormSettings(stormClusterConfiguration); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void prepare(Map stormClusterConfiguration) { | public void prepare(Map stormClusterConfiguration) { |
| // ~Captures~ ~just~ ~the~ ~cluster~ ~configuration,~ ~topology~ ~specific~ ~configuration~ | // **these** **options** **will** **in** **the** **next** **future** **turn be** |
| // will be passed in via method parameters later as needed | // will be passed in via method parameters later as needed |
| LOG.debug("Receiving cluster ~configuration"~); | LOG.debug("Receiving cluster **shape"**); |
| clusterSettings = new StormSettings(stormClusterConfiguration); | clusterSettings = new StormSettings(stormClusterConfiguration); |
| } | } |
Rouge score before refactoring: 0.23163841807909605
Rouge score after refactoring: 0.10734463276836158
Relative difference: 1.1578947368421053
Put 1.1578947368421053 in (8, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 2.833 ± 14.69 (2) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Captures just the cluster configuration, topology specific configuration
Synth origin doc: These settings and its optional other configurations are
Synth refact doc: these options will in all instances and other config
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void prepare(Map stormClusterConfiguration) { | public void prepare(Map stormClusterConfiguration) { |
| // ~Captures~ ~just~ ~the~ ~cluster~ ~configuration,~ ~topology~ ~specific~ ~configuration~ | // **These** **settings** **and** **its** **optional** **other** **configurations** **are** |
| // will be passed in via method parameters later as needed | // will be passed in via method parameters later as needed |
| LOG.debug("Receiving cluster configuration"); | LOG.debug("Receiving cluster configuration"); |
| clusterSettings = new StormSettings(stormClusterConfiguration); | clusterSettings = new StormSettings(stormClusterConfiguration); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void prepare(Map stormClusterConfiguration) { | public void prepare(Map stormClusterConfiguration) { |
| // ~Captures~ ~just~ ~the~ ~cluster~ ~configuration,~ ~topology~ ~specific~ ~configuration~ | // **these** **options** **will** **in** **all** **instances** **and** **other config** |
| // will be passed in via method parameters later as needed | // will be passed in via method parameters later as needed |
| LOG.debug("Receiving cluster configuration"); | LOG.debug("Receiving cluster configuration"); |
| | ** System.out.println("debug");** |
| clusterSettings = new StormSettings(stormClusterConfiguration); | clusterSettings = new StormSettings(stormClusterConfiguration); |
| } | } |
Rouge score before refactoring: 0.23163841807909605
Rouge score after refactoring: 0.03389830508474576
Relative difference: 5.833333333333334
Put 5.833333333333334 in (8, addExtraLogging)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 2.833 ± 14.69 (2) & 1.439 ± 11.49 (6) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: ignore permission
Synth origin doc: try catch
Synth refact doc: return default
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public boolean mkdirs(Path f, FsPermission permission) throws IOException { | public boolean mkdirs(Path f, FsPermission permission) throws IOException { |
| // ~ignore~ ~permission~ | // **try** **catch** |
| //return super.mkdirs(f, WIN_PERMS); | //return super.mkdirs(f, WIN_PERMS); |
| return super.mkdirs(f); | return super.mkdirs(f); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public boolean mkdirs(~Path~ ~f, ~FsPermission permission) throws IOException { | public boolean mkdirs( FsPermission permission**,Path f**) throws IOException { |
| // ~ignore~ ~permission~ | // **return** **default** |
| //return super.mkdirs(~f,~ WIN_PERMS); | //return super.mkdirs( WIN_PERMS**,f**); |
| return super.mkdirs(f); | return super.mkdirs(f); |
| } | } |
Rouge score before refactoring: 0.02631578947368421
Rouge score after refactoring: 0.05263157894736842
Relative difference: -0.5
Put -0.5 in (11, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & 0.016 ± 0.0 (1) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 2.833 ± 14.69 (2) & 1.162 ± 10.31 (7) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: set job jar
Synth origin doc: Setup jobconf
Synth refact doc: defaulting here
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public static JobConf provision(JobConf conf) { | public static JobConf provision(JobConf conf) { |
| // ~set~ ~job jar~ | // **Setup** **jobconf** |
| conf.set("mapred.jar", ESHADOOP_TESTING_JAR); | conf.set("mapred.jar", ESHADOOP_TESTING_JAR); |
| return conf; | return conf; |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public static JobConf ~provision~(JobConf conf) { | public static JobConf **premeditation**(JobConf conf) { |
| // ~set~ ~job jar~ | // **defaulting** **here** |
| conf.set("mapred.jar", ESHADOOP_TESTING_JAR); | conf.set("mapred.jar", ESHADOOP_TESTING_JAR); |
| return conf; | return conf; |
| } | } |
Rouge score before refactoring: 0.002074688796680498
Rouge score after refactoring: 0.004149377593360996
Relative difference: -0.5
Put -0.5 in (7, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & NaN ± NaN (0) & -0.24 ± 0.066 (2) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 2.833 ± 14.69 (2) & 1.162 ± 10.31 (7) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: set job jar
Synth origin doc: Setup jobconf
Synth refact doc: Setup Configuration file
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public static JobConf provision(JobConf conf) { | public static JobConf provision(JobConf conf) { |
| // ~set~ ~job jar~ | // **Setup** **jobconf** |
| conf.set("mapred.jar", ESHADOOP_TESTING_JAR); | conf.set("mapred.jar", ESHADOOP_TESTING_JAR); |
| return conf; | return conf; |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public static JobConf provision(JobConf conf) { | public static JobConf provision(JobConf conf) { |
| // ~set~ ~job~ ~jar~ | // **Setup** **Configuration** **file** |
| conf.set("mapred.jar"~, ESHADOOP_TESTING_JAR~); | conf.set(** ESHADOOP_TESTING_JAR,**"mapred.jar"); |
| return conf; | return conf; |
| } | } |
Rouge score before refactoring: 0.002074688796680498
Rouge score after refactoring: 0.006224066390041493
Relative difference: -0.6666666666666665
Put -0.6666666666666665 in (7, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.24 ± 0.066 (2) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 2.833 ± 14.69 (2) & 1.162 ± 10.31 (7) & 3.738 ± 50.60 (5) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Need to consume the token too
Synth origin doc: finish the tokenization of current
Synth refact doc: finish the deal before next one
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public T nextValue() throws IOException { | public T nextValue() throws IOException { |
| T result = _deserializer.deserialize(_parser, _context); | T result = _deserializer.deserialize(_parser, _context); |
| // ~Need~ ~to consume ~the ~token~ ~too~ | // **finish** the **tokenization** **of current** |
| _parser.clearCurrentToken(); | _parser.clearCurrentToken(); |
| return result; | return result; |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public T nextValue() throws IOException { | public T nextValue() throws IOException { |
| T ~result~ = _deserializer.deserialize(_parser, _context); | T **deal** = _deserializer.deserialize(_parser, _context); |
| // ~Need~ ~to~ ~consume~ ~the~ ~token~ ~too~ | // **finish** **the** **deal** **before** **next** **one** |
| _parser.clearCurrentToken(); | _parser.clearCurrentToken(); |
| return ~result;~ | return **deal;** |
| } | } |
| } | } |
Rouge score before refactoring: 0.06766917293233082
Rouge score after refactoring: 0.08270676691729323
Relative difference: -0.18181818181818182
Put -0.18181818181818182 in (11, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.24 ± 0.066 (2) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 2.833 ± 14.69 (2) & 1.162 ± 10.31 (7) & 3.084 ± 44.30 (6) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Need to consume the token too
Synth origin doc: finish the tokenization of current
Synth refact doc: debug info here is only printed
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public T nextValue() throws IOException { | public T nextValue() throws IOException { |
| T result = _deserializer.deserialize(_parser, _context); | T result = _deserializer.deserialize(_parser, _context); |
| // ~Need~ ~to consume ~the ~token~ ~too~ | // **finish** the **tokenization** **of current** |
| _parser.clearCurrentToken(); | _parser.clearCurrentToken(); |
| return result; | return result; |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public T nextValue() throws IOException { | public T nextValue() throws IOException { |
| T result = _deserializer.deserialize(_parser, _context); | T result = _deserializer.deserialize(_parser, _context); |
| // ~Need~ ~to~ ~consume~ ~the~ ~token~ ~too~ | // **debug** **info** **here** **is** **only** **printed** |
| _parser.clearCurrentToken(); | _parser.clearCurrentToken(); |
| | ** System.out.println("debug");** |
| return result; | return result; |
| } | } |
| } | } |
Rouge score before refactoring: 0.06766917293233082
Rouge score after refactoring: 0.09022556390977443
Relative difference: -0.25
Put -0.25 in (11, addExtraLogging)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.24 ± 0.066 (2) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 3.084 ± 44.30 (6) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: product-2 扣库存时模拟了一个业务异常,
Synth origin doc: call service before transaction rolls
Synth refact doc: call service call before calling
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Boolean placeOrderRollback() { | public Boolean placeOrderRollback() { |
| // ~product-2~ ~扣库存时模拟了一个业务异常,~ | // **call** **service before transaction rolls** |
| orderService.placeOrder("1", "product-2", 1); | orderService.placeOrder("1", "product-2", 1); |
| return true; | return true; |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Boolean placeOrderRollback() { | public Boolean placeOrderRollback() { |
| // ~product-2~ ~扣库存时模拟了一个业务异常,~ | // **call** **service** **call before calling |
| orderService.placeOrder("1", ~"product~-2", 1); | **orderService.placeOrder("1", **"book**-2", 1); |
| return true; | return true; |
| } | } |
Rouge score before refactoring: 0.028985507246376812
Rouge score after refactoring: 0.043478260869565216
Relative difference: -0.3333333333333333
Put -0.3333333333333333 in (7, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.263 ± 18.62 (5) & NaN ± NaN (0) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 3.084 ± 44.30 (6) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Make sure to use TestBucket buckets in UI tests
Synth origin doc: use the bucket if any exists in current scope
Synth refact doc: initialize bucket for TestBundle requests as B
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| fun setup() { | fun setup() { |
| application = ApplicationProvider.getApplicationContext() as SimplenoteTest | application = ApplicationProvider.getApplicationContext() as SimplenoteTest |
| // ~Make~ ~sure~ ~to~ ~use~ ~TestBucket~ ~buckets~ in ~UI~ ~tests~ | // **use** **the** **bucket** **if** **any** **exists** in **current** **scope** |
| application.useTestBucket = true | application.useTestBucket = true |
| | |
| tagsBucket = application.tagsBucket as TestBucket<Tag> | tagsBucket = application.tagsBucket as TestBucket<Tag> |
| tagsBucket.clear() | tagsBucket.clear() |
| tagsBucket.newObjectShouldFail = false | tagsBucket.newObjectShouldFail = false |
| | |
| notesBucket = application.notesBucket as TestBucket<Note> | notesBucket = application.notesBucket as TestBucket<Note> |
| notesBucket.clear() | notesBucket.clear() |
| notesBucket.newObjectShouldFail = false | notesBucket.newObjectShouldFail = false |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| fun setup() { | fun setup() { |
| ~application~ = ApplicationProvider.getApplicationContext() as SimplenoteTest | **request** = ApplicationProvider.getApplicationContext() as SimplenoteTest |
| // ~Make~ ~sure~ ~to~ ~use~ ~TestBucket~ ~buckets~ ~in~ ~UI tests | // **initialize** **bucket** **for** **TestBundle** **requests** **as** **B** |
| application~.useTestBucket = true | **request**.useTestBucket = true |
| | |
| tagsBucket = ~application~.tagsBucket as TestBucket<Tag> | tagsBucket = **request**.tagsBucket as TestBucket<Tag> |
| tagsBucket.clear() | tagsBucket.clear() |
| tagsBucket.newObjectShouldFail = false | tagsBucket.newObjectShouldFail = false |
| | |
| notesBucket = ~application~.notesBucket as TestBucket<Note> | notesBucket = **request**.notesBucket as TestBucket<Note> |
| notesBucket.clear() | notesBucket.clear() |
| notesBucket.newObjectShouldFail = false | notesBucket.newObjectShouldFail = false |
| } | } |
Rouge score before refactoring: 0.2979094076655052
Rouge score after refactoring: 0.13414634146341464
Relative difference: 1.2207792207792205
Put 1.2207792207792205 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.089 ± 15.67 (6) & NaN ± NaN (0) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 3.084 ± 44.30 (6) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Make sure to use TestBucket buckets in UI tests
Synth origin doc: use the bucket if any exists in current scope
Synth refact doc: testbuckest is used here instead as normal
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| fun setup() { | fun setup() { |
| application = ApplicationProvider.getApplicationContext() as SimplenoteTest | application = ApplicationProvider.getApplicationContext() as SimplenoteTest |
| // ~Make~ ~sure~ ~to~ ~use~ ~TestBucket~ ~buckets~ in ~UI~ ~tests~ | // **use** **the** **bucket** **if** **any** **exists** in **current** **scope** |
| application.useTestBucket = true | application.useTestBucket = true |
| | |
| tagsBucket = application.tagsBucket as TestBucket<Tag> | tagsBucket = application.tagsBucket as TestBucket<Tag> |
| tagsBucket.clear() | tagsBucket.clear() |
| tagsBucket.newObjectShouldFail = false | tagsBucket.newObjectShouldFail = false |
| | |
| notesBucket = application.notesBucket as TestBucket<Note> | notesBucket = application.notesBucket as TestBucket<Note> |
| notesBucket.clear() | notesBucket.clear() |
| notesBucket.newObjectShouldFail = false | notesBucket.newObjectShouldFail = false |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| fun setup() { | fun setup() { |
| application = ApplicationProvider.getApplicationContext() as SimplenoteTest | application = ApplicationProvider.getApplicationContext() as SimplenoteTest |
| ~ // Make sure to use TestBucket buckets in UI tests~ | |
| application.useTestBucket = true | application.useTestBucket = true |
| | ** // testbuckest is used here instead as normal** |
| | |
| tagsBucket = application.tagsBucket as TestBucket<Tag> | tagsBucket = application.tagsBucket as TestBucket<Tag> |
| tagsBucket.clear() | tagsBucket.clear() |
| tagsBucket.newObjectShouldFail = false | tagsBucket.newObjectShouldFail = false |
| | |
| notesBucket = application.notesBucket as TestBucket<Note> | notesBucket = application.notesBucket as TestBucket<Note> |
| notesBucket.clear() | notesBucket.clear() |
| notesBucket.newObjectShouldFail = false | notesBucket.newObjectShouldFail = false |
| } | } |
Rouge score before refactoring: 0.2979094076655052
Rouge score after refactoring: 0.1602787456445993
Relative difference: 0.8586956521739132
Put 0.8586956521739132 in (10, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.089 ± 15.67 (6) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 3.084 ± 44.30 (6) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & NaN ± NaN (0) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Clear account-specific data
Synth origin doc: Call this from the activity
Synth refact doc: Call this manually before registering
Rouge score before refactoring: 0.015151515151515152
Rouge score after refactoring: 0.01818181818181818
Relative difference: -0.1666666666666666
Put -0.1666666666666666 in (14, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.089 ± 15.67 (6) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 3.084 ± 44.30 (6) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.413 ± 0.0 (1) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Clear account-specific data
Synth origin doc: Call this from the activity
Synth refact doc: Debug mode on Login request
Rouge score before refactoring: 0.015151515151515152
Rouge score after refactoring: 0.00909090909090909
Relative difference: 0.6666666666666667
Put 0.6666666666666667 in (14, addExtraLogging)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -1.0 ± 0.0 (2) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.089 ± 15.67 (6) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 3.084 ± 44.30 (6) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Show keyboard at startup
Synth origin doc: begin if start is
Synth refact doc: starting state for all
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| fun start() { | fun start() { |
| // ~Show~ ~keyboard~ ~at~ ~startup~ | // **begin** **if** **start** **is** |
| _uiState.value = UiState("") | _uiState.value = UiState("") |
| _event.postValue(Event.START) | _event.postValue(Event.START) |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| fun start() { | fun start() { |
| // ~Show~ ~keyboard~ ~at~ ~startup~ | // **starting** **state** **for** **all** |
| ~ _uiState.value = UiState("")~ | |
| _event.postValue(Event.START) | _event.postValue(Event.START) |
| | ** _uiState.value = UiState("")** |
| } | } |
Rouge score before refactoring: 0.12080536912751678
Rouge score after refactoring: 0.0738255033557047
Relative difference: 0.6363636363636364
Put 0.6363636363636364 in (8, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.089 ± 15.67 (6) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 3.084 ± 44.30 (6) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: In Spring Boot 1.2 the /health endpoint is not open by default, but does allow
Synth origin doc: allow only READABLE AND ALLOWS WITH NON PUBLIC or ALL WITH nonpublic OR ONLY with NON
Synth refact doc: allow only Boots forBoot or just Admin or simply User with the Allow Grant and therefore grant us
Rouge score before refactoring: 0.0959079283887468
Rouge score after refactoring: 0.1265984654731458
Relative difference: -0.24242424242424251
Put -0.24242424242424251 in (11, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.089 ± 15.67 (6) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.609 ± 39.33 (7) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: In Spring Boot 1.2 the /health endpoint is not open by default, but does allow
Synth origin doc: allow only READABLE AND ALLOWS WITH NON PUBLIC or ALL WITH nonpublic OR ONLY with NON
Synth refact doc: allow forBoot Bootless server for allowing for User Access without authorizing to use the User to have
Rouge score before refactoring: 0.0959079283887468
Rouge score after refactoring: 0.16112531969309463
Relative difference: -0.40476190476190477
Put -0.40476190476190477 in (11, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 11.02 ± 264.0 (3) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.089 ± 15.67 (6) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: taken from the blog post comments - this results in an errror if the
Synth origin doc: note that o s underlying value is the receiver so its bounding type
Synth refact doc: note that o has an extra field and this type's optional parameter but
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public int compareTo(TypeReference<T> o) { | public int compareTo(TypeReference<T> o) { |
| // ~taken~ ~from~ ~the~ ~blog~ ~post~ ~comments~ ~-~ ~this~ ~results~ ~in~ ~an~ ~errror~ ~if the~ | // **note** **that** **o** **s** **underlying** **value** **is** **the** **receiver** **so** **its** **bounding** **type** |
| // type parameter is left out. | // type parameter is left out. |
| return 0; | return 0; |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public int ~compareTo~(TypeReference<T> o) { | public int **canvassTo**(TypeReference<T> o) { |
| // ~taken~ ~from~ ~the~ ~blog~ ~post~ ~comments~ ~-~ this ~results~ ~in~ ~an~ ~errror if the~ | // **note** **that** **o** **has** **an** **extra** **field** **and **this **type's** **optional** **parameter** **but** |
| // type parameter is left out. | // type parameter is left out. |
| return 0; | return 0; |
| } | } |
Rouge score before refactoring: 0.08300395256916997
Rouge score after refactoring: 0.12384716732542819
Relative difference: -0.3297872340425531
Put -0.3297872340425531 in (6, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 8.189 ± 222.2 (4) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 2.089 ± 15.67 (6) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: We use a scheduler to ensure this Flowable runs asynchronously for users to be
Synth origin doc: make order here for execution Order will always remain stable but should always become
Synth refact doc: make order by address range backwards backwards backwards and forward order is also always
Rouge score before refactoring: 0.15053763440860216
Rouge score after refactoring: 0.48566308243727596
Relative difference: -0.6900369003690037
Put -0.6900369003690037 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 8.189 ± 222.2 (4) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.451 ± 1.125 (4) & 1.692 ± 14.37 (7) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: We use a scheduler to ensure this Flowable runs asynchronously for users to be
Synth origin doc: make order here for execution Order will always remain stable but should always become
Synth refact doc: make order here be preserved for the flowlet being exposed but be consistent
Rouge score before refactoring: 0.15053763440860216
Rouge score after refactoring: 0.4874551971326165
Relative difference: -0.6911764705882352
Put -0.6911764705882352 in (10, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 8.189 ± 222.2 (4) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.223 ± 1.109 (5) & 1.692 ± 14.37 (7) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: We use a scheduler to ensure this Flowable runs asynchronously for users to be
Synth origin doc: internal usage is kept backwards for future references are more stable but more strictly
Synth refact doc: internal state machine for keeping this instance in the state of states being considered
Rouge score before refactoring: 0.4551971326164875
Rouge score after refactoring: 0.44623655913978494
Relative difference: 0.020080321285140628
Put 0.020080321285140628 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 8.189 ± 222.2 (4) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.223 ± 1.109 (5) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: We use a scheduler to ensure this Flowable runs asynchronously for users to be
Synth origin doc: internal usage is kept backwards for future references are more stable but more strictly
Synth refact doc: internal usage is kept backwards for future references are backwards compatible while making them
Rouge score before refactoring: 0.4551971326164875
Rouge score after refactoring: 0.4910394265232975
Relative difference: -0.07299270072992702
Put -0.07299270072992702 in (10, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 8.189 ± 222.2 (4) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.13 ± 0.665 (4) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: Clean up local cache
Synth origin doc: remove local file cache
Synth refact doc: remove cached Image before
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void setUp() { | public void setUp() { |
| // ~Clean~ ~up ~local cache | // **remove** local **file **cache |
| removeImage(); | removeImage(); |
| | |
| LocalImagesCache.INSTANCE.cache.remove(imageName); | LocalImagesCache.INSTANCE.cache.remove(imageName); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void setUp() { | public void setUp() { |
| // ~Clean~ ~up~ ~local~ ~cache~ | // **remove** **cached** **Image** **before** |
| removeImage(); | removeImage(); |
| | |
| LocalImagesCache.INSTANCE.~cache~.remove(imageName); | LocalImagesCache.INSTANCE.**save**.remove(imageName); |
| } | } |
Rouge score before refactoring: 0.11285266457680251
Rouge score after refactoring: 0.05329153605015674
Relative difference: 1.1176470588235294
Put 1.1176470588235294 in (8, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & 0.490 ± 0.0 (1) & 8.189 ± 222.2 (4) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & 0.116 ± 0.783 (5) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: TODO Auto-generated constructor stub
Synth origin doc: throw e2f1e
Synth refact doc: return exceptionInstanceOfType0
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public ValidationException(String arg0, Throwable arg1) { | public ValidationException(String arg0, Throwable arg1) { |
| super(arg0, arg1); | super(arg0, arg1); |
| // ~TODO~ ~Auto-generated constructor stub~ | // **throw** **e2f1e** |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public ValidationException(~String~ ~arg0, ~Throwable arg1) { | public ValidationException( Throwable arg1**,String arg0**) { |
| super(arg0, arg1); | super(arg0, arg1); |
| // ~TODO~ ~Auto-generated constructor stub~ | // **return** **exceptionInstanceOfType0** |
| } | } |
Rouge score before refactoring: 0.04395604395604396
Rouge score after refactoring: 0.10989010989010989
Relative difference: -0.5999999999999999
Put -0.5999999999999999 in (6, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 8.189 ± 222.2 (4) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & 0.116 ± 0.783 (5) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: TODO Auto-generated method stub
Synth origin doc: Getter implementation for the current
Synth refact doc: original original version before this method
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Long getValue() { | public Long getValue() { |
| // ~TODO~ ~Auto-generated~ ~method~ ~stub~ | // **Getter** **implementation** **for** **the current** |
| return get(); | return get(); |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Long ~getValue~() { | public Long **engenderStandardize**() { |
| // ~TODO~ ~Auto-generated~ ~method~ ~stub~ | // **original** **original** **version** **before this method** |
| return get(); | return get(); |
| } | } |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.15625
Relative difference: -1.0
Put -1.0 in (8, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 8.189 ± 222.2 (4) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & -0.27 ± 0.046 (3) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.06 ± 0.825 (6) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: do nothing
Synth origin doc: cache result
Synth refact doc: condition boolean
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public ColumnFamilyQuery<K, C> withCaching(boolean condition) { | public ColumnFamilyQuery<K, C> withCaching(boolean condition) { |
| // ~do~ ~nothing~ | // **cache** **result** |
| return this; | return this; |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public ColumnFamilyQuery<K, C> ~withCaching~(boolean condition) { | public ColumnFamilyQuery<K, C> **withHoard**(boolean condition) { |
| // ~do~ ~nothing~ | // **condition** **boolean** |
| return this; | return this; |
| } | } |
| } | } |
Rouge score before refactoring: 0.04487179487179487
Rouge score after refactoring: 0.01282051282051282
Relative difference: 2.5
Put 2.5 in (7, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 8.189 ± 222.2 (4) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.06 ± 0.825 (6) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: TODO Auto-generated method stub
Synth origin doc: TODOS support this error handling
Synth refact doc: Construct this class without generic args
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void validate(Object entity) throws Exception { | public void validate(Object entity) throws Exception { |
| // ~TODO~ ~Auto-generated~ ~method~ ~stub~ | // **TODOS** **support** **this** **error handling** |
| | |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~validate~(Object entity) throws Exception { | public void **substantiate**(Object entity) throws Exception { |
| // ~TODO~ ~Auto-generated~ ~method~ ~stub~ | // **Construct** **this** **class** **without generic args** |
| | |
| } | } |
| } | } |
Rouge score before refactoring: 0.020833333333333332
Rouge score after refactoring: 0.041666666666666664
Relative difference: -0.5
Put -0.5 in (6, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.48 ± 0.0 (1) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.06 ± 0.825 (6) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: TODO Auto-generated method stub
Synth origin doc: nullable result returned instead of
Synth refact doc: return thisResultImplImplImpl
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public OperationResult<SchemaChangeResult> updateKeyspace(Properties props) | public OperationResult<SchemaChangeResult> updateKeyspace(Properties props) |
| throws ConnectionException { | throws ConnectionException { |
| // ~TODO~ ~Auto-generated~ ~method~ ~stub~ | // **nullable** **result** **returned** **instead of** |
| return null; | return null; |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public OperationResult<SchemaChangeResult> updateKeyspace(Properties props) | public OperationResult<SchemaChangeResult> updateKeyspace(Properties props) |
| throws ConnectionException { | throws ConnectionException { |
| ~ // TODO Auto-generated method stub~ | |
| return null; | return null; |
| | ** // return thisResultImplImplImpl** |
| } | } |
Rouge score before refactoring: 0.09375
Rouge score after refactoring: 0.10416666666666667
Relative difference: -0.10000000000000003
Put -0.10000000000000003 in (6, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.06 ± 0.825 (6) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: TODO Auto-generated method stub
Synth origin doc: ignore if missing key return null
Synth refact doc: exit information if it has any
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public boolean hasMetadata(String key) { | public boolean hasMetadata(String key) { |
| // ~TODO~ ~Auto-generated~ ~method~ ~stub~ | // **ignore** **if** **missing** **key return null** |
| return false; | return false; |
| } | } |
| }; | }; |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public boolean ~hasMetadata~(String key) { | public boolean **leaveInformation**(String key) { |
| // ~TODO~ ~Auto-generated~ ~method~ ~stub~ | // **exit** **information** **if** **it has any** |
| return false; | return false; |
| } | } |
| }; | }; |
| } | } |
| } | } |
Rouge score before refactoring: 0.10416666666666667
Rouge score after refactoring: 0.08333333333333333
Relative difference: 0.2500000000000001
Put 0.2500000000000001 in (8, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & NaN ± NaN (0) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: TODO Auto-generated method stub
Synth origin doc: nullable token string representation of
Synth refact doc: return Token value instead of token
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public String getTokenMinusOne(String token) { | public String getTokenMinusOne(String token) { |
| // ~TODO~ ~Auto-generated~ ~method~ ~stub~ | // **nullable** **token** **string** **representation of** |
| return null; | return null; |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public String ~getTokenMinusOne~(String token) { | public String **returnStripped-downSubtractionLxviii**(String token) { |
| // ~TODO~ ~Auto-generated~ ~method~ ~stub~ | // **return** **Token** **value** **instead of token** |
| return null; | return null; |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.09375
Relative difference: -1.0
Put -1.0 in (5, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.197 ± 1.031 (4) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: generateSmallPatchedDexInfoFile is blocked by issue we found in ART environment
Synth origin doc: Note that here an extra file will appear later in
Synth refact doc: Note that here an additional flag gets passed to dex
Rouge score before refactoring: 0.11441144114411442
Rouge score after refactoring: 0.09350935093509351
Relative difference: 0.22352941176470598
Put 0.22352941176470598 in (14, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.202 ± 0.825 (5) & -0.30 ± 0.247 (4)
\end{tabular}
\end{table}
Ground truth doc: generateSmallPatchedDexInfoFile is blocked by issue we found in ART environment
Synth origin doc: Note that here an extra file will appear later in
Synth refact doc: Possible additional debug errors that indicate something serious exception like
Rouge score before refactoring: 0.11441144114411442
Rouge score after refactoring: 0.013201320132013201
Relative difference: 7.666666666666668
Put 7.666666666666668 in (14, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 18.15 ± 0.0 (1) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.202 ± 0.825 (5) & 1.285 ± 10.37 (5)
\end{tabular}
\end{table}
Ground truth doc: Ignored.
Synth origin doc: returnthis
Synth refact doc: return default
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public DefaultLoadReporter(Context context) { | public DefaultLoadReporter(Context context) { |
| this.context = context; | this.context = context; |
| // ~Ignored.~ | // **returnthis** |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public DefaultLoadReporter(Context ~context~) { | public DefaultLoadReporter(Context **setting**) { |
| this.~context~ = ~context;~ | this.**setting** = **setting;** |
| // ~Ignored.~ | // **return default** |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.03333333333333333
Relative difference: -1.0
Put -1.0 in (4, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.202 ± 0.825 (5) & 1.285 ± 10.37 (5)
\end{tabular}
\end{table}
Ground truth doc: pass attachment
Synth origin doc: set the
Synth refact doc: bind Request
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Response filter(Caller<?> caller, Request request) { | public Response filter(Caller<?> caller, Request request) { |
| // ~pass~ ~attachment~ | // **set** **the** |
| request.setAttachment("testName", "testName"); | request.setAttachment("testName", "testName"); |
| | |
| Response response = caller.call(request); | Response response = caller.call(request); |
| | |
| assert response instanceof RestfulClientResponse; | assert response instanceof RestfulClientResponse; |
| | |
| RestfulClientResponse rfr = (RestfulClientResponse) response; | RestfulClientResponse rfr = (RestfulClientResponse) response; |
| // obtain httpResponse 、 responseStatus、responseHeader and so on | // obtain httpResponse 、 responseStatus、responseHeader and so on |
| rfr.getHttpResponse(); | rfr.getHttpResponse(); |
| | |
| return response; | return response; |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Response filter(Caller<?> caller, Request request) { | public Response filter(Caller<?> caller, Request request) { |
| // ~pass~ ~attachment~ | // **bind** **Request** |
| request.setAttachment("testName", "testName"); | request.setAttachment("testName", "testName"); |
| | |
| Response response = caller.call(request); | Response response = caller.call(request); |
| | |
| assert response instanceof RestfulClientResponse; | assert response instanceof RestfulClientResponse; |
| | |
| ~ RestfulClientResponse rfr = (RestfulClientResponse) response;~ | |
| // obtain httpResponse 、 responseStatus、responseHeader and so on | // obtain httpResponse 、 responseStatus、responseHeader and so on |
| | ** RestfulClientResponse rfr = (RestfulClientResponse) response;** |
| rfr.getHttpResponse(); | rfr.getHttpResponse(); |
| | |
| return response; | return response; |
| } | } |
Rouge score before refactoring: 0.045317220543806644
Rouge score after refactoring: 0.027190332326283987
Relative difference: 0.6666666666666666
Put 0.6666666666666666 in (14, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.16 ± 0.0 (1) & 0.202 ± 0.825 (5) & 1.182 ± 8.700 (6)
\end{tabular}
\end{table}
Ground truth doc: start client and curl 'http://localhost:8080/' ,
Synth origin doc: example application where you will listen to the API server while then a Hello Controller
Synth refact doc: The demo of registering an API call which by itself is done in order that
Rouge score before refactoring: 0.022222222222222223
Rouge score after refactoring: 0.12222222222222222
Relative difference: -0.8181818181818181
Put -0.8181818181818181 in (14, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.202 ± 0.825 (5) & 1.182 ± 8.700 (6)
\end{tabular}
\end{table}
Ground truth doc: close listen socket
Synth origin doc: stopServerNow
Synth refact doc: Coordinator channel management
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void cleanup() { | public void cleanup() { |
| // ~close listen socket~ | // **stopServerNow** |
| serverChannel.close(); | serverChannel.close(); |
| // close all clients's channel | // close all clients's channel |
| channelManage.close(); | channelManage.close(); |
| // shutdown the threadPool | // shutdown the threadPool |
| standardThreadExecutor.shutdownNow(); | standardThreadExecutor.shutdownNow(); |
| // 取消统计回调的注册 | // 取消统计回调的注册 |
| StatsUtil.unRegistryStatisticCallback(nettyChannelHandler); | StatsUtil.unRegistryStatisticCallback(nettyChannelHandler); |
| StatsUtil.unRegistryStatisticCallback(this); | StatsUtil.unRegistryStatisticCallback(this); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void cleanup() { | public void cleanup() { |
| // ~close~ ~listen~ ~socket~ | // **Coordinator** **channel** **management** |
| serverChannel.~close~(); | serverChannel.**coordinate**(); |
| // ~close~ all clients's channel | // **coordinate** all clients's channel |
| channelManage.~close~(); | channelManage.**coordinate**(); |
| // shutdown the threadPool | // shutdown the threadPool |
| standardThreadExecutor.shutdownNow(); | standardThreadExecutor.shutdownNow(); |
| // 取消统计回调的注册 | // 取消统计回调的注册 |
| StatsUtil.unRegistryStatisticCallback(nettyChannelHandler); | StatsUtil.unRegistryStatisticCallback(nettyChannelHandler); |
| StatsUtil.unRegistryStatisticCallback(this); | StatsUtil.unRegistryStatisticCallback(this); |
| } | } |
Rouge score before refactoring: 0.058419243986254296
Rouge score after refactoring: 0.010309278350515464
Relative difference: 4.666666666666667
Put 4.666666666666667 in (14, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 1.182 ± 8.700 (6)
\end{tabular}
\end{table}
Ground truth doc: close listen socket
Synth origin doc: stopServerNow
Synth refact doc: disconnect server side
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void cleanup() { | public void cleanup() { |
| // ~close listen socket~ | // **stopServerNow** |
| serverChannel.close(); | serverChannel.close(); |
| // close all clients's channel | // close all clients's channel |
| channelManage.close(); | channelManage.close(); |
| // shutdown the threadPool | // shutdown the threadPool |
| standardThreadExecutor.shutdownNow(); | standardThreadExecutor.shutdownNow(); |
| // 取消统计回调的注册 | // 取消统计回调的注册 |
| StatsUtil.unRegistryStatisticCallback(nettyChannelHandler); | StatsUtil.unRegistryStatisticCallback(nettyChannelHandler); |
| StatsUtil.unRegistryStatisticCallback(this); | StatsUtil.unRegistryStatisticCallback(this); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void cleanup() { | public void cleanup() { |
| // ~close~ ~listen~ ~socket~ | // **disconnect** **server** **side** |
| serverChannel.close(); | serverChannel.close(); |
| // close all clients's channel | // close all clients's channel |
| ~ channelManage.close();~ | |
| // shutdown the threadPool | // shutdown the threadPool |
| ~standardThreadExecutor~.~shutdownNow~(); | **channelManage**.**close**(); |
| // 取消统计回调的注册 | // 取消统计回调的注册 |
| | ** standardThreadExecutor.shutdownNow();** |
| StatsUtil.unRegistryStatisticCallback(nettyChannelHandler); | StatsUtil.unRegistryStatisticCallback(nettyChannelHandler); |
| StatsUtil.unRegistryStatisticCallback(this); | StatsUtil.unRegistryStatisticCallback(this); |
| } | } |
Rouge score before refactoring: 0.058419243986254296
Rouge score after refactoring: 0.003436426116838488
Relative difference: 16.0
Put 16.0 in (14, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.483 ± 12.88 (8) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: TODO 根据不同request 返回指定repsonse
Synth origin doc: internal use cases
Synth refact doc: no further tracking
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Response request(Request request) throws TransportException { | public Response request(Request request) throws TransportException { |
| urlMap.get(url).incrementAndGet(); | urlMap.get(url).incrementAndGet(); |
| // ~TODO~ ~根据不同request~ ~返回指定repsonse~ | // **internal** **use** **cases** |
| return mockResponse; | return mockResponse; |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Response ~request~(Request ~request~) throws TransportException { | public Response **charge**(Request **charge**) throws TransportException { |
| urlMap.get(url).incrementAndGet(); | urlMap.get(url).incrementAndGet(); |
| // ~TODO~ ~根据不同request~ ~返回指定repsonse~ | // **no** **further** **tracking** |
| return mockResponse; | return mockResponse; |
| } | } |
Rouge score before refactoring: 0.06779661016949153
Rouge score after refactoring: 0.03389830508474576
Relative difference: 1.0
Put 1.0 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & 0.858 ± 0.0 (1) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: TODO 根据不同request 返回指定repsonse
Synth origin doc: internal use cases
Synth refact doc: return undefinedResponse
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Response request(Request request) throws TransportException { | public Response request(Request request) throws TransportException { |
| urlMap.get(url).incrementAndGet(); | urlMap.get(url).incrementAndGet(); |
| // ~TODO~ ~根据不同request~ ~返回指定repsonse~ | // **internal** **use** **cases** |
| return mockResponse; | return mockResponse; |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Response request(Request request) throws TransportException { | public Response request(Request request) throws TransportException { |
| urlMap.get(url).incrementAndGet(); | urlMap.get(url).incrementAndGet(); |
| ~ // TODO 根据不同request 返回指定repsonse~ | |
| return mockResponse; | return mockResponse; |
| | ** // return undefinedResponse** |
| } | } |
Rouge score before refactoring: 0.06779661016949153
Rouge score after refactoring: 0.05084745762711865
Relative difference: 0.33333333333333326
Put 0.33333333333333326 in (10, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -1.0 ± 0.0 (1) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & 0.596 ± 0.069 (2) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: do nothing
Synth origin doc: return null
Synth refact doc: return true
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void setHasStableIds(boolean hasStableIds) { | public void setHasStableIds(boolean hasStableIds) { |
| // ~do~ ~nothing~ | // **return** **null** |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~setHasStableIds~(boolean hasStableIds) { | public void **quintetteBristleSoundId**(boolean hasStableIds) { |
| // ~do~ ~nothing~ | // **return** **true** |
| } | } |
Rouge score before refactoring: 0.16025641025641027
Rouge score after refactoring: 0.07051282051282051
Relative difference: 1.272727272727273
Put 1.272727272727273 in (5, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.420 ± 1.475 (4) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & 0.596 ± 0.069 (2) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: "left join " +
Synth origin doc: or try to do this
Synth refact doc: select on from select from
Rouge score before refactoring: 0.06547619047619048
Rouge score after refactoring: 0.011904761904761904
Relative difference: 4.500000000000001
Put 4.500000000000001 in (7, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 1.236 ± 3.843 (5) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & 0.596 ± 0.069 (2) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Creat
Synth refact doc: Construct
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void test_shouldOmitInputPositiveOutputFalse3() { | public void test_shouldOmitInputPositiveOutputFalse3() { |
| | |
| // ~Arrange~ | // **Creat** |
| final ZeroLong objectUnderTest = new ZeroLong(); | final ZeroLong objectUnderTest = new ZeroLong(); |
| final Object val = 1L; | final Object val = 1L; |
| | |
| // Act | // Act |
| final boolean retval = objectUnderTest.shouldOmit(val); | final boolean retval = objectUnderTest.shouldOmit(val); |
| | |
| // Assert result | // Assert result |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| ~public void test_shouldOmitInputPositiveOutputFalse3() {~ | |
| | |
| ~//~ ~Arrange~ | **public** **void** **test_shouldOmitInputPositiveOutputFalse3() {** |
| final ZeroLong objectUnderTest = new ZeroLong(); | final ZeroLong objectUnderTest = new ZeroLong(); |
| | ** // Construct** |
| final Object val = 1L; | final Object val = 1L; |
| | |
| ~ // Act~ | |
| final boolean retval = objectUnderTest.shouldOmit(val); | final boolean retval = objectUnderTest.shouldOmit(val); |
| | ** // Act** |
| | |
| // Assert result | // Assert result |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.011904761904761904
Relative difference: -1.0
Put -1.0 in (10, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 1.236 ± 3.843 (5) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & 0.064 ± 0.612 (3) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Creat
Synth refact doc: Construct
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void test_shouldOmitInputZeroOutputTrue() { | public void test_shouldOmitInputZeroOutputTrue() { |
| | |
| // ~Arrange~ | // **Creat** |
| final ZeroLong objectUnderTest = new ZeroLong(); | final ZeroLong objectUnderTest = new ZeroLong(); |
| final Object val = 0L; | final Object val = 0L; |
| | |
| // Act | // Act |
| final boolean retval = objectUnderTest.shouldOmit(val); | final boolean retval = objectUnderTest.shouldOmit(val); |
| | |
| // Assert result | // Assert result |
| assertEquals(true, retval); | assertEquals(true, retval); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| ~public void test_shouldOmitInputZeroOutputTrue() {~ | |
| | |
| ~//~ ~Arrange~ | **public** **void** **test_shouldOmitInputZeroOutputTrue() {** |
| final ZeroLong objectUnderTest = new ZeroLong(); | final ZeroLong objectUnderTest = new ZeroLong(); |
| | ** // Construct** |
| final Object val = 0L; | final Object val = 0L; |
| | |
| ~ // Act~ | |
| final boolean retval = objectUnderTest.shouldOmit(val); | final boolean retval = objectUnderTest.shouldOmit(val); |
| | ** // Act** |
| | |
| // Assert result | // Assert result |
| assertEquals(true, retval); | assertEquals(true, retval); |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.011904761904761904
Relative difference: -1.0
Put -1.0 in (10, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 1.236 ± 3.843 (5) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & -0.20 ± 0.671 (4) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Creat
Synth refact doc: Create
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void test_shouldOmitInputTrueOutputFalse() { | public void test_shouldOmitInputTrueOutputFalse() { |
| | |
| // ~Arrange~ | // **Creat** |
| final False objectUnderTest = new False(); | final False objectUnderTest = new False(); |
| final Object val = true; | final Object val = true; |
| | |
| // Act | // Act |
| final boolean retval = objectUnderTest.shouldOmit(val); | final boolean retval = objectUnderTest.shouldOmit(val); |
| | |
| // Assert result | // Assert result |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| ~public void test_shouldOmitInputTrueOutputFalse() {~ | |
| | |
| ~//~ ~Arrange~ | **public** **void** **test_shouldOmitInputTrueOutputFalse() {** |
| final False objectUnderTest = new False(); | final False objectUnderTest = new False(); |
| | ** // Create** |
| final Object val = true; | final Object val = true; |
| | |
| ~ // Act~ | |
| final boolean retval = objectUnderTest.shouldOmit(val); | final boolean retval = objectUnderTest.shouldOmit(val); |
| | ** // Act** |
| | |
| // Assert result | // Assert result |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.08333333333333333
Relative difference: -1.0
Put -1.0 in (10, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 1.236 ± 3.843 (5) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & -0.36 ± 0.638 (5) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Initial
Synth refact doc: Create
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void test_shouldOmitInputNotNullOutputFalse() { | public void test_shouldOmitInputNotNullOutputFalse() { |
| | |
| // ~Arrange~ | // **Initial** |
| final ZeroChar objectUnderTest = new ZeroChar(); | final ZeroChar objectUnderTest = new ZeroChar(); |
| final Object val = '\u0001'; | final Object val = '\u0001'; |
| | |
| // Act | // Act |
| final boolean retval = objectUnderTest.shouldOmit(val); | final boolean retval = objectUnderTest.shouldOmit(val); |
| | |
| // Assert result | // Assert result |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| ~public void test_shouldOmitInputNotNullOutputFalse() {~ | |
| | |
| ~//~ ~Arrange~ | **public** **void** **test_shouldOmitInputNotNullOutputFalse() {** |
| final ZeroChar objectUnderTest = new ZeroChar(); | final ZeroChar objectUnderTest = new ZeroChar(); |
| | ** // Create** |
| final Object val = '\u0001'; | final Object val = '\u0001'; |
| | |
| ~ // Act~ | |
| final boolean retval = objectUnderTest.shouldOmit(val); | final boolean retval = objectUnderTest.shouldOmit(val); |
| | ** // Act** |
| | |
| // Assert result | // Assert result |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.08333333333333333
Relative difference: -1.0
Put -1.0 in (10, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 1.236 ± 3.843 (5) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & -0.46 ± 0.589 (6) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Initial
Synth refact doc: Construct
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void test_shouldOmitInputZeroOutputTrue2() { | public void test_shouldOmitInputZeroOutputTrue2() { |
| | |
| // ~Arrange~ | // **Initial** |
| final ZeroDouble objectUnderTest = new ZeroDouble(); | final ZeroDouble objectUnderTest = new ZeroDouble(); |
| final Object val = 0.0; | final Object val = 0.0; |
| | |
| // Act | // Act |
| final boolean retval = objectUnderTest.shouldOmit(val); | final boolean retval = objectUnderTest.shouldOmit(val); |
| | |
| // Assert result | // Assert result |
| assertEquals(true, retval); | assertEquals(true, retval); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| ~public void test_shouldOmitInputZeroOutputTrue2() {~ | |
| | |
| ~//~ ~Arrange~ | **public** **void** **test_shouldOmitInputZeroOutputTrue2() {** |
| final ZeroDouble objectUnderTest = new ZeroDouble(); | final ZeroDouble objectUnderTest = new ZeroDouble(); |
| | ** // Construct** |
| final Object val = 0.0; | final Object val = 0.0; |
| | |
| ~ // Act~ | |
| final boolean retval = objectUnderTest.shouldOmit(val); | final boolean retval = objectUnderTest.shouldOmit(val); |
| | ** // Act** |
| | |
| // Assert result | // Assert result |
| assertEquals(true, retval); | assertEquals(true, retval); |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.011904761904761904
Relative difference: -1.0
Put -1.0 in (10, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 1.236 ± 3.843 (5) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & -0.54 ± 0.539 (7) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.999 ± 9.368 (5) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: Arrange
Synth origin doc: Init
Synth refact doc: Create
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void test_equalsInputNotNullOutputFalse() { | public void test_equalsInputNotNullOutputFalse() { |
| | |
| // ~Arrange~ | // **Init** |
| final Slice objectUnderTest = new Slice(null, 0, -2147483646); | final Slice objectUnderTest = new Slice(null, 0, -2147483646); |
| final Slice o = new Slice(null, 0, 2); | final Slice o = new Slice(null, 0, 2); |
| | |
| // Act | // Act |
| final boolean retval = objectUnderTest.equals(o); | final boolean retval = objectUnderTest.equals(o); |
| | |
| // Assert result | // Assert result |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void test_equalsInputNotNullOutputFalse() { | public void test_equalsInputNotNullOutputFalse() { |
| | |
| ~ // Arrange~ | |
| final Slice objectUnderTest = new Slice(null, 0, -2147483646); | final Slice objectUnderTest = new Slice(null, 0, -2147483646); |
| | ** // Create** |
| final Slice o = new Slice(null, 0, 2); | final Slice o = new Slice(null, 0, 2); |
| | |
| ~ // Act~ | |
| final boolean retval = objectUnderTest.equals(o); | final boolean retval = objectUnderTest.equals(o); |
| | ** // Act** |
| | |
| // Assert result | // Assert result |
| assertEquals(false, retval); | assertEquals(false, retval); |
| } | } |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.08333333333333333
Relative difference: -1.0
Put -1.0 in (13, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 1.236 ± 3.843 (5) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & -0.54 ± 0.539 (7) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.131 ± 1.280 (2) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.499 ± 9.056 (6) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: Context of the app under test.
Synth origin doc: internal implementation for use by the outside
Synth refact doc: use Application's Package Context instead of
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void useAppContext() throws Exception { | public void useAppContext() throws Exception { |
| // ~Context~ ~of~ ~the~ ~app~ ~under~ ~test.~ | // **internal** **implementation** **for** **use** **by** **the outside** |
| Context appContext = InstrumentationRegistry.getTargetContext(); | Context appContext = InstrumentationRegistry.getTargetContext(); |
| | |
| assertEquals("com.example.myapplication", appContext.getPackageName()); | assertEquals("com.example.myapplication", appContext.getPackageName()); |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void useAppContext() throws Exception { | public void useAppContext() throws Exception { |
| // ~Context~ ~of~ ~the~ ~app~ ~under~ ~test.~ | // **use** **Application's** **Package** **Context** **instead** **of** |
| Context appContext = InstrumentationRegistry.getTargetContext(); | Context appContext = InstrumentationRegistry.getTargetContext(); |
| | |
| assertEquals(~"com.example.myapplication",~ appContext.getPackageName()); | assertEquals( appContext.getPackageName()**,"com.example.myapplication"**); |
| } | } |
| } | } |
Rouge score before refactoring: 0.01282051282051282
Rouge score after refactoring: 0.11538461538461539
Relative difference: -0.888888888888889
Put -0.888888888888889 in (12, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 1.236 ± 3.843 (5) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & -0.54 ± 0.539 (7) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.499 ± 9.056 (6) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: create context
Synth origin doc: internal usage
Synth refact doc: new Object
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public RealSense2FrameGrabber(int deviceNumber) throws Exception { | public RealSense2FrameGrabber(int deviceNumber) throws Exception { |
| this.deviceNumber = deviceNumber; | this.deviceNumber = deviceNumber; |
| | |
| // ~create~ ~context~ | // **internal** **usage** |
| this.context = createContext(); | this.context = createContext(); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public RealSense2FrameGrabber(int ~deviceNumber~) throws Exception { | public RealSense2FrameGrabber(int **stabiliserPIN**) throws Exception { |
| this.~deviceNumber~ = ~deviceNumber;~ | this.**stabiliserPIN** = **stabiliserPIN;** |
| | |
| // ~create~ ~context~ | // **new** **Object** |
| this.context = createContext(); | this.context = createContext(); |
| } | } |
Rouge score before refactoring: 0.007575757575757576
Rouge score after refactoring: 0.015151515151515152
Relative difference: -0.5
Put -0.5 in (7, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & -0.54 ± 0.539 (7) \\
110-120 & 1.805 ± 11.90 (3) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.499 ± 9.056 (6) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: release previous frame
Synth origin doc: delete previousFrame
Synth refact doc: Release the previous
Rouge score before refactoring: 0.5682539682539682
Rouge score after refactoring: 0.6476190476190476
Relative difference: -0.12254901960784322
Put -0.12254901960784322 in (11, addExtraLogging)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.429 ± 11.47 (9) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.499 ± 9.056 (6) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: set trigger load flag
Synth origin doc: check state first and
Synth refact doc: setup initial Spark context
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void trigger() throws Exception { | public void trigger() throws Exception { |
| // ~set~ ~trigger~ ~load~ ~flag~ | // **check** **state** **first** **and** |
| if (!triggerMode) | if (!triggerMode) |
| triggerMode = true; | triggerMode = true; |
| | |
| // read frames | // read frames |
| readNextFrameSet(); | readNextFrameSet(); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~trigger~() throws Exception { | public void **spark**() throws Exception { |
| // ~set~ ~trigger~ ~load~ ~flag~ | // **setup** **initial** **Spark** **context** |
| if (~!triggerMode~) | if (**!sparkMode**) |
| ~triggerMode~ = true; | **sparkMode** = true; |
| | |
| // read frames | // read frames |
| readNextFrameSet(); | readNextFrameSet(); |
| } | } |
Rouge score before refactoring: 0.06274509803921569
Rouge score after refactoring: 0.0196078431372549
Relative difference: 2.2
Put 2.2 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 5.075 ± 47.08 (4) & 1.085 ± 5.203 (7) & 1.499 ± 9.056 (6) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: Read from the line... non-blocking
Synth origin doc: read from output line buffer and write into file stream
Synth refact doc: read from output line buffer and start decoding Audio bytes
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void run() | public void run() |
| { | { |
| try | try |
| { | { |
| // ~Read~ from ~the~ line~...~ ~non-blocking~ | // **read** from **output** line **buffer and write into file stream** |
| int nBytesRead = 0; | int nBytesRead = 0; |
| while (nBytesRead == 0) { | while (nBytesRead == 0) { |
| nBytesRead = line.read(audioBytes, 0, line.available()); | nBytesRead = line.read(audioBytes, 0, line.available()); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void run() | public void run() |
| { | { |
| try | try |
| { | { |
| // ~Read~ from ~the~ line~...~ ~non-blocking~ | // **read** from **output** line **buffer and start decoding Audio bytes** |
| int nBytesRead = 0; | int nBytesRead = 0; |
| while (nBytesRead == 0) { | while (nBytesRead == 0) { |
| nBytesRead = line.read(audioBytes, ~0, ~line.available()); | nBytesRead = line.read(audioBytes, line.available()**, 0**); |
| } | } |
Rouge score before refactoring: 0.8153034300791556
Rouge score after refactoring: 0.8126649076517151
Relative difference: 0.003246753246753156
Put 0.003246753246753156 in (13, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 4.060 ± 41.78 (5) & 1.085 ± 5.203 (7) & 1.499 ± 9.056 (6) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: Read from the line... non-blocking
Synth origin doc: read from output line buffer and write into file stream
Synth refact doc: audioData is ready for streaming data from remote server
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void run() | public void run() |
| { | { |
| try | try |
| { | { |
| // ~Read~ from ~the~ line~...~ ~non-blocking~ | // **read** from **output** line **buffer and write into file stream** |
| int nBytesRead = 0; | int nBytesRead = 0; |
| while (nBytesRead == 0) { | while (nBytesRead == 0) { |
| nBytesRead = line.read(audioBytes, 0, line.available()); | nBytesRead = line.read(audioBytes, 0, line.available()); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| | **{** |
| public void run() | public void run() |
| { | { |
| try | try |
| ~ {~ | |
| ~ // Read from the line... non-blocking~ | |
| int nBytesRead = 0; | int nBytesRead = 0; |
| | ** // audioData is ready for streaming data from remote server** |
| while (nBytesRead == 0) { | while (nBytesRead == 0) { |
| nBytesRead = line.read(audioBytes, 0, line.available()); | nBytesRead = line.read(audioBytes, 0, line.available()); |
| } | } |
Rouge score before refactoring: 0.8153034300791556
Rouge score after refactoring: 0.06860158311345646
Relative difference: 10.884615384615385
Put 10.884615384615385 in (13, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 4.060 ± 41.78 (5) & 1.085 ± 5.203 (7) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: Before authenticating successfully, call request.authenticate twice which
Synth origin doc: authentication failure scenarios above are not recommended when login requests
Synth refact doc: authentication attempt failure times 2 or 1 and then again
Rouge score before refactoring: 0.26359832635983266
Rouge score after refactoring: 0.02510460251046025
Relative difference: 9.5
Put 9.5 in (13, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 6.451 ± 189.8 (5) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 4.060 ± 41.78 (5) & 2.137 ± 12.29 (8) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: Nothing to do
Synth origin doc: no value for
Synth refact doc: nothing was lost
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void destroy() { | public void destroy() { |
| // ~Nothing~ ~to~ ~do~ | // **no** **value** **for** |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~destroy~() { | public void **wreck**() { |
| // ~Nothing~ ~to~ ~do~ | // **nothing** **was** **lost** |
| } | } |
| } | } |
Rouge score before refactoring: 0.019230769230769232
Rouge score after refactoring: 0.17307692307692307
Relative difference: -0.888888888888889
Put -0.888888888888889 in (6, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 4.060 ± 41.78 (5) & 2.137 ± 12.29 (8) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: given
Synth origin doc: before
Synth refact doc: case
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void shouldWithdrawGivenAmount() { | public void shouldWithdrawGivenAmount() { |
| // ~given~ | // **before** |
| final float amount = 5.0F; | final float amount = 5.0F; |
| | |
| // when | // when |
| final String actual = sut.withdraw(amount); | final String actual = sut.withdraw(amount); |
| | |
| // then | // then |
| assertThat(actual, is(equalTo("Withdrawn: " + amount))); | assertThat(actual, is(equalTo("Withdrawn: " + amount))); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void shouldWithdrawGivenAmount() { | public void shouldWithdrawGivenAmount() { |
| // ~given~ | // **case** |
| final float amount = 5.0F; | final float amount = 5.0F; |
| | |
| // when | // when |
| final String actual = sut.withdraw(amount); | final String actual = sut.withdraw(amount); |
| | |
| // then | // then |
| assertThat(~actual,~ is(equalTo("Withdrawn: " + amount))); | assertThat( is(equalTo("Withdrawn: " + amount))**,actual**); |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.004739336492890996
Relative difference: -1.0
Put -1.0 in (13, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 2.137 ± 12.29 (8) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.946 ± 3.455 (6) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: given
Synth origin doc: when
Synth refact doc: try
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void shouldDepositGivenAmount() { | public void shouldDepositGivenAmount() { |
| // ~given~ | // **when** |
| final float amount = 10.0F; | final float amount = 10.0F; |
| | |
| // when | // when |
| final String actual = sut.deposit(amount); | final String actual = sut.deposit(amount); |
| | |
| // then | // then |
| assertThat(actual, is(equalTo("Deposited: " + amount))); | assertThat(actual, is(equalTo("Deposited: " + amount))); |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void shouldDepositGivenAmount() { | public void shouldDepositGivenAmount() { |
| // ~given~ | // **try** |
| final float ~amount~ = 10.0F; | final float **be** = 10.0F; |
| | |
| // when | // when |
| final String actual = sut.deposit(~amount~); | final String actual = sut.deposit(**be**); |
| | |
| // then | // then |
| assertThat(actual, is(equalTo("Deposited: " + ~amount~))); | assertThat(actual, is(equalTo("Deposited: " + **be**))); |
| } | } |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.02843601895734597
Relative difference: -1.0
Put -1.0 in (14, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 2.137 ± 12.29 (8) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 3.299 ± 34.34 (7)
\end{tabular}
\end{table}
Ground truth doc: given
Synth origin doc: when
Synth refact doc: try
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void shouldDepositGivenAmount() { | public void shouldDepositGivenAmount() { |
| // ~given~ | // **when** |
| final float amount = 10.0F; | final float amount = 10.0F; |
| | |
| // when | // when |
| final String actual = sut.deposit(amount); | final String actual = sut.deposit(amount); |
| | |
| // then | // then |
| assertThat(actual, is(equalTo("Deposited: " + amount))); | assertThat(actual, is(equalTo("Deposited: " + amount))); |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void shouldDepositGivenAmount() { | public void shouldDepositGivenAmount() { |
| // ~given~ | // **try** |
| final float amount = 10.0F; | final float amount = 10.0F; |
| | |
| ~ // when~ | |
| final String actual = sut.deposit(amount); | final String actual = sut.deposit(amount); |
| | ** // when** |
| | |
| // then | // then |
| assertThat(actual, is(equalTo("Deposited: " + amount))); | assertThat(actual, is(equalTo("Deposited: " + amount))); |
| } | } |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.02843601895734597
Relative difference: -1.0
Put -1.0 in (14, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 2.137 ± 12.29 (8) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.762 ± 32.07 (8)
\end{tabular}
\end{table}
Ground truth doc: given
Synth origin doc: before
Synth refact doc: case
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void shouldWithdrawGivenAmount() { | public void shouldWithdrawGivenAmount() { |
| // ~given~ | // **before** |
| final float amount = 5.0F; | final float amount = 5.0F; |
| | |
| // when | // when |
| final String actual = sut.withdraw(amount); | final String actual = sut.withdraw(amount); |
| | |
| // then | // then |
| assertThat(actual, is(equalTo("Withdrawn: " + amount))); | assertThat(actual, is(equalTo("Withdrawn: " + amount))); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void shouldWithdrawGivenAmount() { | public void shouldWithdrawGivenAmount() { |
| // ~given~ | // **case** |
| final float ~amount~ = 5.0F; | final float **deficiency** = 5.0F; |
| | |
| // when | // when |
| final String actual = sut.withdraw(~amount~); | final String actual = sut.withdraw(**deficiency**); |
| | |
| // then | // then |
| assertThat(actual, is(equalTo("Withdrawn: " + ~amount~))); | assertThat(actual, is(equalTo("Withdrawn: " + **deficiency**))); |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.004739336492890996
Relative difference: -1.0
Put -1.0 in (13, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.762 ± 32.07 (8)
\end{tabular}
\end{table}
Ground truth doc: given
Synth origin doc: when
Synth refact doc: try
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void shouldDepositGivenAmount() { | public void shouldDepositGivenAmount() { |
| // ~given~ | // **when** |
| final float amount = 10.0F; | final float amount = 10.0F; |
| | |
| // when | // when |
| final String actual = sut.deposit(amount); | final String actual = sut.deposit(amount); |
| | |
| // then | // then |
| assertThat(actual, is(equalTo("Deposited: " + amount))); | assertThat(actual, is(equalTo("Deposited: " + amount))); |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void shouldDepositGivenAmount() { | public void shouldDepositGivenAmount() { |
| // ~given~ | // **try** |
| final float amount = 10.0F; | final float amount = 10.0F; |
| | |
| ~ // when~ | |
| final String actual = sut.deposit(amount); | final String actual = sut.deposit(amount); |
| | ** // when** |
| | |
| // then | // then |
| assertThat(actual, is(equalTo("Deposited: " + amount))); | assertThat(actual, is(equalTo("Deposited: " + amount))); |
| } | } |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.02843601895734597
Relative difference: -1.0
Put -1.0 in (14, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.332 ± 15.28 (9) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: As of JAX-RS 2.0, the method has been deprecated and the
Synth origin doc: Note the value for an ignored value is ignored since any actual Java class representation in
Synth refact doc: A negative number as in this implementation's result of converting an error type from to
Rouge score before refactoring: 0.5989717223650386
Rouge score after refactoring: 0.10025706940874037
Relative difference: 4.9743589743589745
Put 4.9743589743589745 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 2.931 ± 24.99 (5) & 4.396 ± 13.79 (10) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: As of JAX-RS 2.0, the method has been deprecated and the
Synth origin doc: Note the value for an ignored value is ignored since any actual Java class representation in
Synth refact doc: Note the value for this property the actual number or other value or an empty number
Rouge score before refactoring: 0.5989717223650386
Rouge score after refactoring: 0.06940874035989718
Relative difference: 7.629629629629629
Put 7.629629629629629 in (9, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.714 ± 23.89 (6) & 4.396 ± 13.79 (10) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: As of JAX-RS 2.0, the method has been deprecated and the
Synth origin doc: Note the value for an ignored value is ignored since any actual Java class representation in
Synth refact doc: Note the size of an unspecified value for an empty body is ignored because a default
Rouge score before refactoring: 0.5989717223650386
Rouge score after refactoring: 0.6066838046272494
Relative difference: -0.012711864406779603
Put -0.012711864406779603 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.714 ± 23.89 (6) & 3.995 ± 14.14 (11) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: As of JAX-RS 2.0, the method has been deprecated and the
Synth origin doc: Note the value for an ignored value is ignored since any actual Java class representation in
Synth refact doc: Note the value for an ignored value is ignored since any actual Java value as in
Rouge score before refactoring: 0.5989717223650386
Rouge score after refactoring: 0.6195372750642674
Relative difference: -0.03319502074688793
Put -0.03319502074688793 in (9, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.995 ± 14.14 (11) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.506 ± 10.38 (10) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: SimpleGreeting bean is vetoed
Synth origin doc: internal testing purposes only
Synth refact doc: test for example here
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void should_bean_be_fancy() throws Exception { | public void should_bean_be_fancy() throws Exception { |
| // ~SimpleGreeting~ ~bean~ ~is~ ~vetoed~ | // **internal** **testing** **purposes** **only** |
| assertThat(bean, instanceOf(FancyGreeting.class)); | assertThat(bean, instanceOf(FancyGreeting.class)); |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~should_bean_be_fancy~() throws Exception { | public void **should_soy_broil_ideate**() throws Exception { |
| // ~SimpleGreeting~ ~bean~ ~is~ ~vetoed~ | // **test** **for** **example** **here** |
| assertThat(bean, instanceOf(FancyGreeting.class)); | assertThat(bean, instanceOf(FancyGreeting.class)); |
| } | } |
| } | } |
Rouge score before refactoring: 0.0125
Rouge score after refactoring: 0.016666666666666666
Relative difference: -0.24999999999999994
Put -0.24999999999999994 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.995 ± 14.14 (11) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.173 ± 0.936 (6) & 1.347 ± 9.695 (11) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: SimpleGreeting bean is vetoed
Synth origin doc: internal testing purposes only
Synth refact doc: Test for Fancy Green
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void should_bean_be_fancy() throws Exception { | public void should_bean_be_fancy() throws Exception { |
| // ~SimpleGreeting~ ~bean~ ~is~ ~vetoed~ | // **internal** **testing** **purposes** **only** |
| assertThat(bean, instanceOf(FancyGreeting.class)); | assertThat(bean, instanceOf(FancyGreeting.class)); |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void should_bean_be_fancy() throws Exception { | public void should_bean_be_fancy() throws Exception { |
| // ~SimpleGreeting~ ~bean~ ~is~ ~vetoed~ | // **Test** **for** **Fancy** **Green** |
| assertThat(~bean,~ instanceOf(FancyGreeting.class)); | assertThat( instanceOf(FancyGreeting.class)**,bean**); |
| } | } |
| } | } |
Rouge score before refactoring: 0.0125
Rouge score after refactoring: 0.052083333333333336
Relative difference: -0.7599999999999999
Put -0.7599999999999999 in (10, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.995 ± 14.14 (11) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.347 ± 9.695 (11) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & -0.20 ± 1.085 (3) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: because SimpleGreeting is annotated (scope)
Synth origin doc: test bean for a single example greet
Synth refact doc: internal methods for backward API compatibility only
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void should_bean_be_simple() throws Exception { | public void should_bean_be_simple() throws Exception { |
| // ~because~ ~SimpleGreeting~ ~is~ ~annotated~ ~(scope)~ | // **test** **bean** **for** **a** **single example greet** |
| assertThat(bean, instanceOf(SimpleGreeting.class)); | assertThat(bean, instanceOf(SimpleGreeting.class)); |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void should_bean_be_simple() throws Exception { | public void should_bean_be_simple() throws Exception { |
| // ~because~ ~SimpleGreeting~ ~is~ ~annotated~ ~(scope)~ | // **internal** **methods** **for** **backward** **API** **compatibility only |
| assertThat(~bean,~ instanceOf(SimpleGreeting.class)); | **assertThat( instanceOf(SimpleGreeting.class)**,bean**); |
| } | } |
| } | } |
Rouge score before refactoring: 0.061052631578947365
Rouge score after refactoring: 0.029473684210526315
Relative difference: 1.0714285714285714
Put 1.0714285714285714 in (12, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.995 ± 14.14 (11) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.347 ± 9.695 (11) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 3.217 ± 38.38 (6) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: COMMIT_MESSAGE message
Synth origin doc: RUN command message message
Synth refact doc: HELPERS message message
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void run(String... args) throws Exception { | public void run(String... args) throws Exception { |
| // ~COMMIT_MESSAGE~ message | // **RUN** **command **message** message** |
| senderService.sendTransactionalMsg("transactional-msg1", 1); | senderService.sendTransactionalMsg("transactional-msg1", 1); |
| // ROLLBACK_MESSAGE message | // ROLLBACK_MESSAGE message |
| senderService.sendTransactionalMsg("transactional-msg2", 2); | senderService.sendTransactionalMsg("transactional-msg2", 2); |
| // ROLLBACK_MESSAGE message | // ROLLBACK_MESSAGE message |
| senderService.sendTransactionalMsg("transactional-msg3", 3); | senderService.sendTransactionalMsg("transactional-msg3", 3); |
| // ~COMMIT_MESSAGE message~ | // |
| senderService.sendTransactionalMsg("transactional-msg4", 4); | senderService.sendTransactionalMsg("transactional-msg4", 4); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void run(String... args) throws Exception { | public void run(String... args) throws Exception { |
| // ~COMMIT_MESSAGE~ message | // **HELPERS** message **message |
| senderService.sendTransactionalMsg("transactional-msg1"~, 1~); | **senderService.sendTransactionalMsg(** 1,**"transactional-msg1"); |
| // ROLLBACK_MESSAGE message | // ROLLBACK_MESSAGE message |
| senderService.sendTransactionalMsg("transactional-msg2"~, 2~); | senderService.sendTransactionalMsg(** 2,**"transactional-msg2"); |
| // ROLLBACK_MESSAGE message | // ROLLBACK_MESSAGE message |
| senderService.sendTransactionalMsg("transactional-msg3", 3); | senderService.sendTransactionalMsg("transactional-msg3", 3); |
| // ~COMMIT_MESSAGE message~ | // |
| senderService.sendTransactionalMsg("transactional-msg4", 4); | senderService.sendTransactionalMsg("transactional-msg4", 4); |
| } | } |
Rouge score before refactoring: 0.6716417910447762
Rouge score after refactoring: 0.6417910447761194
Relative difference: 0.04651162790697688
Put 0.04651162790697688 in (13, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.136 ± 1.291 (2) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.995 ± 14.14 (11) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.347 ± 9.695 (11) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: nothing do
Synth origin doc: return true
Synth refact doc: return null
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void close() { | public void close() { |
| // ~nothing~ ~do~ | // **return** **true** |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~close~() { | public void **tight**() { |
| // ~nothing~ ~do~ | // **return** **null** |
| } | } |
Rouge score before refactoring: 0.07051282051282051
Rouge score after refactoring: 0.16025641025641027
Relative difference: -0.56
Put -0.56 in (5, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -0.09 ± 0.968 (3) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.995 ± 14.14 (11) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.347 ± 9.695 (11) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & -0.91 ± 0.007 (2) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: Required Properties
Synth origin doc: default settings
Synth refact doc: Default configuration
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| private void configureDefaultProperties(Map<String, Object> source) { | private void configureDefaultProperties(Map<String, Object> source) { |
| // ~Required~ ~Properties~ | // **default** **settings** |
| String groupBindingPropertyName = createBindingPropertyName(INPUT, "group"); | String groupBindingPropertyName = createBindingPropertyName(INPUT, "group"); |
| String broadcastingPropertyName = createRocketMQPropertyName(INPUT, | String broadcastingPropertyName = createRocketMQPropertyName(INPUT, |
| "broadcasting"); | "broadcasting"); |
| source.put(groupBindingPropertyName, "rocketmq-bus-group"); | source.put(groupBindingPropertyName, "rocketmq-bus-group"); |
| source.put(broadcastingPropertyName, "true"); | source.put(broadcastingPropertyName, "true"); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| private void configureDefaultProperties(Map<String, Object> ~source~) { | private void configureDefaultProperties(Map<String, Object> **cradle**) { |
| // ~Required~ ~Properties~ | // **Default** **configuration** |
| String groupBindingPropertyName = createBindingPropertyName(INPUT, "group"); | String groupBindingPropertyName = createBindingPropertyName(INPUT, "group"); |
| String broadcastingPropertyName = createRocketMQPropertyName(INPUT, | String broadcastingPropertyName = createRocketMQPropertyName(INPUT, |
| "broadcasting"); | "broadcasting"); |
| ~source~.put(groupBindingPropertyName, "rocketmq-bus-group"); | **cradle**.put(groupBindingPropertyName, "rocketmq-bus-group"); |
| ~source~.put(broadcastingPropertyName, "true"); | **cradle**.put(broadcastingPropertyName, "true"); |
| } | } |
Rouge score before refactoring: 0.019736842105263157
Rouge score after refactoring: 0.006578947368421052
Relative difference: 2.0
Put 2.0 in (12, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -0.09 ± 0.968 (3) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.995 ± 14.14 (11) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.347 ± 9.695 (11) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & 0.057 ± 1.892 (3) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.788 ± 11.90 (9) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: Get the solver status before loading the solution
Synth origin doc: Helpers for creating the slots in slots
Synth refact doc: We do two copies now here and the
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public TimeTable getTimeTable() { | public TimeTable getTimeTable() { |
| // ~Get~ ~the~ ~solver~ ~status~ ~before~ ~loading~ ~the solution~ | // **Helpers** **for** **creating** **the** **slots** **in** **slots** |
| // to avoid the race condition that the solver terminates between them | // to avoid the race condition that the solver terminates between them |
| SolverStatus solverStatus = getSolverStatus(); | SolverStatus solverStatus = getSolverStatus(); |
| TimeTable solution = findById(SINGLETON_TIME_TABLE_ID); | TimeTable solution = findById(SINGLETON_TIME_TABLE_ID); |
| scoreManager.updateScore(solution); // Sets the score | scoreManager.updateScore(solution); // Sets the score |
| solution.setSolverStatus(solverStatus); | solution.setSolverStatus(solverStatus); |
| return solution; | return solution; |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public TimeTable getTimeTable() { | public TimeTable getTimeTable() { |
| // ~Get~ ~the~ ~solver~ ~status~ ~before~ ~loading~ ~the~ ~solution~ | // **We** **do** **two** **copies** **now** **here** **and** **the** |
| // to avoid the race condition that the solver terminates between them | // to avoid the race condition that the solver terminates between them |
| SolverStatus solverStatus = getSolverStatus(); | SolverStatus solverStatus = getSolverStatus(); |
| TimeTable ~solution~ = findById(SINGLETON_TIME_TABLE_ID); | TimeTable **answer** = findById(SINGLETON_TIME_TABLE_ID); |
| scoreManager.updateScore(~solution~); // Sets the score | scoreManager.updateScore(**answer**); // Sets the score |
| ~solution~.setSolverStatus(solverStatus); | **answer**.setSolverStatus(solverStatus); |
| return ~solution;~ | return **answer;** |
| } | } |
Rouge score before refactoring: 0.06223175965665236
Rouge score after refactoring: 0.034334763948497854
Relative difference: 0.8125
Put 0.8125 in (13, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -0.09 ± 0.968 (3) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.995 ± 14.14 (11) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.347 ± 9.695 (11) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & 0.057 ± 1.892 (3) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.690 ± 10.79 (10) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: noinspection ConstantConditions
Synth origin doc: HELPER
Synth refact doc: Press the
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void onMonthChanged(MaterialCalendarView widget, CalendarDay date) { | public void onMonthChanged(MaterialCalendarView widget, CalendarDay date) { |
| //~noinspection~ ~ConstantConditions~ | // **HELPER** |
| getSupportActionBar().setTitle(FORMATTER.format(date.getDate())); | getSupportActionBar().setTitle(FORMATTER.format(date.getDate())); |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~onMonthChanged~(MaterialCalendarView widget, CalendarDay date) { | public void **connectedMonthMatt-up**(MaterialCalendarView widget, CalendarDay date) { |
| //~noinspection~ ~ConstantConditions~ | // **Press the** |
| getSupportActionBar().setTitle(FORMATTER.format(date.getDate())); | getSupportActionBar().setTitle(FORMATTER.format(date.getDate())); |
| } | } |
| } | } |
Rouge score before refactoring: 0.0
Rouge score after refactoring: 0.012658227848101266
Relative difference: -1.0
Put -1.0 in (13, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -0.09 ± 0.968 (3) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.995 ± 14.14 (11) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.347 ± 9.695 (11) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & 0.057 ± 1.892 (3) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: do nothing
Synth origin doc: default implementation
Synth refact doc: ignore it
Rouge score before refactoring: 0.01282051282051282
Rouge score after refactoring: 0.00641025641025641
Relative difference: 1.0
Put 1.0 in (9, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -0.09 ± 0.968 (3) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.347 ± 9.695 (11) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & 0.057 ± 1.892 (3) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: when we callback with the data we want to do the work
Synth origin doc: start async call execution of a responseType object with callback method
Synth refact doc: start up service now and call it on that channel or even
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Observable<ResponseType> toObservable() { | public Observable<ResponseType> toObservable() { |
| // ~when~ ~we~ ~callback~ ~with~ ~the~ ~data~ ~we~ ~want~ ~to~ ~do~ ~the work~ | // **start** **async** **call** **execution** **of** **a** **responseType** **object** **with** **callback** **method** |
| // on a separate thread than the one giving us the callback | // on a separate thread than the one giving us the callback |
| return toObservable(Schedulers.computation()); | return toObservable(Schedulers.computation()); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public Observable<ResponseType> ~toObservable~() { | public Observable<ResponseType> **toNoticeable**() { |
| // ~when~ ~we~ ~callback~ ~with~ ~the~ ~data~ ~we~ ~want~ ~to~ ~do~ ~the~ ~work~ | // **start** **up** **service** **now** **and** **call** **it** **on** **that** **channel** **or** **even** |
| // on a separate thread than the one giving us the callback | // on a separate thread than the one giving us the callback |
| return ~toObservable~(Schedulers.computation()); | return **toNoticeable**(Schedulers.computation()); |
| } | } |
Rouge score before refactoring: 0.0673469387755102
Rouge score after refactoring: 0.08979591836734693
Relative difference: -0.24999999999999992
Put -0.24999999999999992 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -0.09 ± 0.968 (3) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.05 ± 0.297 (2) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.214 ± 9.082 (12) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & 0.057 ± 1.892 (3) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: Reset parameters
Synth origin doc: end of
Synth refact doc: update values
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void setCaldroidData(Map<String, Object> caldroidData) { | public void setCaldroidData(Map<String, Object> caldroidData) { |
| this.caldroidData = caldroidData; | this.caldroidData = caldroidData; |
| | |
| // ~Reset~ ~parameters~ | // **end** **of** |
| populateFromCaldroidData(); | populateFromCaldroidData(); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void setCaldroidData(~Map<String,~ Object> caldroidData) { | public void setCaldroidData( Object> caldroidData**,Map<String**) { |
| this.caldroidData = caldroidData; | this.caldroidData = caldroidData; |
| | |
| // ~Reset~ ~parameters~ | // **update** **values** |
| populateFromCaldroidData(); | populateFromCaldroidData(); |
| } | } |
Rouge score before refactoring: 0.05
Rouge score after refactoring: 0.15
Relative difference: -0.6666666666666666
Put -0.6666666666666666 in (6, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & -0.09 ± 0.968 (3) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.214 ± 9.082 (12) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & 0.057 ± 1.892 (3) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: Do nothing
Synth origin doc: default behavior
Synth refact doc: ignore it
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void onCaldroidViewCreated() { | public void onCaldroidViewCreated() { |
| // ~Do~ ~nothing~ | // **default** **behavior** |
| } | } |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~onCaldroidViewCreated~() { | public void **connectedCaldroidVisualizeIncorporate**() { |
| // ~Do~ ~nothing~ | // **ignore** **it** |
| } | } |
| } | } |
Rouge score before refactoring: 0.01282051282051282
Rouge score after refactoring: 0.00641025641025641
Relative difference: 1.0
Put 1.0 in (5, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.178 ± 0.951 (4) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.214 ± 9.082 (12) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & 0.057 ± 1.892 (3) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: We need to re-register ParseCurrentInstallationController otherwise it is still offline
Synth origin doc: core controller methods and functions and the plugin of each other's
Synth refact doc: global variables and methods reset before entering to new scope of a
Rouge score before refactoring: 0.09090909090909091
Rouge score after refactoring: 0.061895551257253385
Relative difference: 0.46875000000000006
Put 0.46875000000000006 in (10, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.178 ± 0.951 (4) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.156 ± 8.423 (13) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & 0.057 ± 1.892 (3) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: do nothing
Synth origin doc: return this
Synth refact doc: return null
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void setMaxCacheSizeBytes(int bytes) { | public void setMaxCacheSizeBytes(int bytes) { |
| // ~do~ ~nothing~ | // **return** **this** |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~setMaxCacheSizeBytes~(int bytes) { | public void **localizeMaxStoreTurkey-sizedByte**(int bytes) { |
| // ~do~ ~nothing~ | // **return** **null** |
| } | } |
Rouge score before refactoring: 0.07051282051282051
Rouge score after refactoring: 0.16025641025641027
Relative difference: -0.56
Put -0.56 in (5, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.030 ± 0.848 (5) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 5.228 ± 165.6 (6) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.156 ± 8.423 (13) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & 0.057 ± 1.892 (3) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: do nothing
Synth origin doc: return true
Synth refact doc: return false
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| void validateSaveEventually() throws ParseException { | void validateSaveEventually() throws ParseException { |
| // ~do~ ~nothing~ | // **return** **true** |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| void ~validateSaveEventually~() throws ParseException { | void **sustainConserveFinally**() throws ParseException { |
| // ~do~ ~nothing~ | // **return** **false** |
| } | } |
Rouge score before refactoring: 0.07051282051282051
Rouge score after refactoring: 0.07692307692307693
Relative difference: -0.0833333333333334
Put -0.0833333333333334 in (6, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.030 ± 0.848 (5) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 4.469 ± 145.4 (7) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.156 ± 8.423 (13) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & 0.057 ± 1.892 (3) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: do nothing
Synth origin doc: return false
Synth refact doc: return 0
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void write(int arg0) throws IOException { | public void write(int arg0) throws IOException { |
| // ~do~ ~nothing~ | // **return** **false** |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void ~write~(int arg0) throws IOException { | public void **overwrite**(int arg0) throws IOException { |
| // ~do~ ~nothing~ | // **return** **0** |
| } | } |
Rouge score before refactoring: 0.07692307692307693
Rouge score after refactoring: 0.07051282051282051
Relative difference: 0.09090909090909098
Put 0.09090909090909098 in (6, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.030 ± 0.848 (5) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 3.922 ± 129.3 (8) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.156 ± 8.423 (13) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & 0.057 ± 1.892 (3) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: Start the retrieval process for a server auth code. If requested, ask for a refresh
Synth origin doc: Getting your last issued token is your preferred retrieving this previously acquired access and an outdated previous
Synth refact doc: Getting current grant's new authentication authorization codes from its last obtained token Refresh Token refresh or
Rouge score before refactoring: 0.13157894736842105
Rouge score after refactoring: 0.19078947368421054
Relative difference: -0.31034482758620696
Put -0.31034482758620696 in (12, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.030 ± 0.848 (5) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 3.922 ± 129.3 (8) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.156 ± 8.423 (13) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & -0.03 ± 1.444 (4) & -0.81 ± 0.0 (1) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: Start the retrieval process for a server auth code. If requested, ask for a refresh
Synth origin doc: Getting your last issued token is your preferred retrieving this previously acquired access and an outdated previous
Synth refact doc: Getting your application access code gets its first active refresh grant and a previously generated token the
Rouge score before refactoring: 0.13157894736842105
Rouge score after refactoring: 0.25219298245614036
Relative difference: -0.47826086956521746
Put -0.47826086956521746 in (12, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.030 ± 0.848 (5) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 3.922 ± 129.3 (8) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.156 ± 8.423 (13) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & NaN ± NaN (0) & 0.111 ± 1.120 (4) & -0.03 ± 1.444 (4) & -0.64 ± 0.028 (2) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: Start the retrieval process for a server auth code. If requested, ask for a refresh
Synth origin doc: Getting your last issued token is your preferred retrieving this previously acquired access and an outdated previous
Synth refact doc: Getting your last issued authorization or token obtained the previous previously acquired and authorized OATH grant
Rouge score before refactoring: 0.13157894736842105
Rouge score after refactoring: 0.09649122807017543
Relative difference: 0.36363636363636365
Put 0.36363636363636365 in (12, addExtraLogging)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.030 ± 0.848 (5) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 3.922 ± 129.3 (8) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.156 ± 8.423 (13) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & 0.363 ± 0.0 (1) & 0.111 ± 1.120 (4) & -0.03 ± 1.444 (4) & -0.64 ± 0.028 (2) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.49 ± 0.106 (2) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: If we don't need to restart the loader, and there's a desired position to restore
Synth origin doc: scrollTo position and move from 0 and 1 and to next location if position was scrollable or
Synth refact doc: for any items that need a position for a visual animation in their lists that have something you can
Rouge score before refactoring: 0.696917808219178
Rouge score after refactoring: 0.7671232876712328
Relative difference: -0.09151785714285715
Put -0.09151785714285715 in (14, permuteArgumentOrder)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.030 ± 0.848 (5) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 3.922 ± 129.3 (8) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.156 ± 8.423 (13) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & 0.363 ± 0.0 (1) & 0.111 ± 1.120 (4) & -0.03 ± 1.444 (4) & -0.64 ± 0.028 (2) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.35 ± 0.106 (3) & 0.668 ± 3.425 (7) & 2.344 ± 29.90 (9)
\end{tabular}
\end{table}
Ground truth doc: This should fail
Synth origin doc: test transformation function
Synth refact doc: test for chain
| original doc | synthetic doc before refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void testBadSpecs( Object chainrSpecObj ) { | public void testBadSpecs( Object chainrSpecObj ) { |
| ChainrSpec chainrSpec = new ChainrSpec( chainrSpecObj ); | ChainrSpec chainrSpec = new ChainrSpec( chainrSpecObj ); |
| ChainrEntry chainrEntry = chainrSpec.getChainrEntries().get( 0 ); | ChainrEntry chainrEntry = chainrSpec.getChainrEntries().get( 0 ); |
| DefaultChainrInstantiator instantiator = new DefaultChainrInstantiator(); | DefaultChainrInstantiator instantiator = new DefaultChainrInstantiator(); |
| | |
| // ~This~ ~should~ ~fail~ | // **test** **transformation** **function** |
| instantiator.hydrateTransform( chainrEntry ); | instantiator.hydrateTransform( chainrEntry ); |
| } | } |
| original doc | synthetic doc after refactoring |
|----------------------------------------------------------------------------------|----------------------------------------------------------------------------------|
| public void testBadSpecs( Object chainrSpecObj ) { | public void testBadSpecs( Object chainrSpecObj ) { |
| ChainrSpec chainrSpec = new ChainrSpec( chainrSpecObj ); | ChainrSpec chainrSpec = new ChainrSpec( chainrSpecObj ); |
| ~ ChainrEntry chainrEntry = chainrSpec.getChainrEntries().get( 0 );~ | |
| DefaultChainrInstantiator instantiator = new DefaultChainrInstantiator(); | DefaultChainrInstantiator instantiator = new DefaultChainrInstantiator(); |
| | ** ChainrEntry chainrEntry = chainrSpec.getChainrEntries().get( 0 );** |
| | |
| // ~This~ ~should~ ~fail~ | // **test** **for** **chain** |
| instantiator.hydrateTransform( chainrEntry ); | instantiator.hydrateTransform( chainrEntry ); |
| } | } |
Rouge score before refactoring: 0.0975609756097561
Rouge score after refactoring: 0.04878048780487805
Relative difference: 1.0
Put 1.0 in (14, swapMultilineNoDeps)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.030 ± 0.848 (5) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 3.922 ± 129.3 (8) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.156 ± 8.423 (13) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & 0.363 ± 0.0 (1) & 0.111 ± 1.120 (4) & -0.03 ± 1.444 (4) & -0.64 ± 0.028 (2) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.35 ± 0.106 (3) & 0.668 ± 3.425 (7) & 2.209 ± 27.07 (10)
\end{tabular}
\end{table}
Ground truth doc: Should throw exception
Synth origin doc: call the Transform
Synth refact doc: call transformer with
Rouge score before refactoring: 0.033783783783783786
Rouge score after refactoring: 0.02027027027027027
Relative difference: 0.6666666666666666
Put 0.6666666666666666 in (12, renameTokens)
\begin{table}[H]
\begin{tabular}{l|cccc}
Complexity & renameTokens & swapMultilineNo & permuteArgument & addExtraLogging \\\hline\\
40-50 & 6.365 ± 0.0 (1) & 1.697 ± 0.0 (1) & 8.575 ± 91.68 (2) & NaN ± NaN (0) \\
50-60 & NaN ± NaN (0) & NaN ± NaN (0) & 0.030 ± 0.848 (5) & -0.70 ± 0.0 (1) \\
60-70 & NaN ± NaN (0) & -0.25 ± 0.281 (3) & 3.922 ± 129.3 (8) & -0.29 ± 0.036 (2) \\
70-80 & NaN ± NaN (0) & -0.66 ± 0.0 (1) & 0.947 ± 3.621 (6) & 3.689 ± 17.37 (3) \\
80-90 & 5.833 ± 0.0 (1) & -0.66 ± 0.0 (1) & -0.02 ± 0.720 (7) & -0.45 ± 0.595 (3) \\
90-100 & 5.417 ± 0.0 (1) & 3.179 ± 22.20 (7) & 3.746 ± 13.65 (12) & 2.551 ± 0.0 (1) \\
100-110 & NaN ± NaN (0) & 0.040 ± 0.909 (7) & 1.156 ± 8.423 (13) & -0.54 ± 0.539 (7) \\
110-120 & 1.323 ± 9.628 (4) & 1.162 ± 10.31 (7) & 2.232 ± 35.40 (8) & -0.62 ± 0.429 (4) \\
120-130 & 0.363 ± 0.0 (1) & 0.111 ± 1.120 (4) & 0.105 ± 1.234 (5) & -0.64 ± 0.028 (2) \\
130-140 & -1.0 ± 0.0 (1) & 2.764 ± 34.12 (7) & 1.446 ± 10.41 (11) & 2.840 ± 18.54 (7) \\
140-150 & 1.039 ± 0.139 (2) & -0.35 ± 0.106 (3) & 0.668 ± 3.425 (7) & 2.209 ± 27.07 (10)
\end{tabular}
\end{table}
Server went down!
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment