Skip to content

Instantly share code, notes, and snippets.

@jjb
Created October 12, 2013 16:44
Show Gist options
  • Save jjb/6952117 to your computer and use it in GitHub Desktop.
Save jjb/6952117 to your computer and use it in GitHub Desktop.
running wrong's test suite
➔ g clone [email protected]:sconover/wrong.git
Cloning into 'wrong'...
remote: Counting objects: 1838, done.
remote: Compressing objects: 100% (1044/1044), done.
remote: Total 1838 (delta 795), reused 1793 (delta 754)
Receiving objects: 100% (1838/1838), 8.53 MiB | 2.15 MiB/s, done.
Resolving deltas: 100% (795/795), done.
Checking connectivity... done
➔ cd wrong
➔ rbenv shell 1.9.3-p385-perf
➔ bundle
The source :rubygems is deprecated because HTTP requests are insecure.
Please change your source to 'https://rubygems.org' if possible, or 'http://rubygems.org' if not.
Fetching gem metadata from http://rubygems.org/.........
Resolving dependencies...
Using rake (10.1.0)
Using bundler (1.3.5)
Using diff-lcs (1.2.4)
Using minitest (1.7.2)
Using predicated (0.2.6)
Using sexp_processor (4.3.0)
Using ruby_parser (3.2.2)
Using ruby2ruby (2.0.6)
Using rvm (1.11.3.8)
Using test-unit (2.1.2)
Using wrong (0.7.0) from source at /Users/john/tmp/wrong
Your bundle is complete!
Use `bundle show [gemname]` to see where a bundled gem is installed.
➔ bundle exec rake test
The source :rubygems is deprecated because HTTP requests are insecure.
Please change your source to 'https://rubygems.org' if possible, or 'http://rubygems.org' if not.
>> Separately running ./test/adapters/minitest_test.rb under ...
$ ruby ./test/adapters/minitest_test.rb
ruby 1.9.3p385 (2013-02-06 revision 39114) [x86_64-darwin12.2.0]
Run options: --seed 13492
# Running tests:
........
Finished tests in 0.021789s, 367.1577 tests/s, 688.4208 assertions/s.
8 tests, 15 assertions, 0 failures, 0 errors, 0 skips
>> Separately running ./test/adapters/rspec_rails_test.rb under ...
$ ruby ./test/adapters/rspec_rails_test.rb
ruby 1.9.3p385 (2013-02-06 revision 39114) [x86_64-darwin12.2.0]
Run options: --seed 3028
# Running tests:
sh ./railsapp-gen.sh (15.72 sec)
bundle checkbundle install --gemfile=/Users/john/tmp/wrong/test/adapters/railsapp/Gemfile (1.49 sec)
(2.75 sec)
bundle list (1.29 sec)
rspec spec/wrong_spec.rb (2.68 sec)
F
Finished tests in 22.449099s, 0.0445 tests/s, 0.4455 assertions/s.
1) Failure:
test_0001_in_rspec_version_2(testing rspec-rails) [./test/adapters/rspec_rails_test.rb:54]:
Expected spec_output.include?("Expected ((1 + 1) == 3), but"), but
spec_output is "F\n\nFailures:\n\n 1) wrong in rspec in rails calls the wrong assert\n Failure/Error: assert { 1 + 1 == 3}\n ArgumentError:\n wrong number of arg
uments (0 for 1)\n # ./spec/wrong_spec.rb:5:in `block (2 levels) in <top (required)>'\n\nFinished in 0.00166 seconds\n1 example, 1 failure\n\nFailed examples:\n\nrspec ./
spec/wrong_spec.rb:4 # wrong in rspec in rails calls the wrong assert\n\nRandomized with seed 52178\n\n"
1 tests, 10 assertions, 1 failures, 0 errors, 0 skips
>> Separately running ./test/adapters/rspec_test.rb under ...
$ ruby ./test/adapters/rspec_test.rb
ruby 1.9.3p385 (2013-02-06 revision 39114) [x86_64-darwin12.2.0]
Run options: --seed 17087
# Running tests:
bundle checkbundle install --gemfile=/Users/john/tmp/wrong/test/adapters/rspec1/Gemfile --local (1.53 sec)
(2.72 sec)
Fbundle checkbundle install --gemfile=/Users/john/tmp/wrong/test/adapters/rspec2/Gemfile --local (1.48 sec)
(2.67 sec)
bundle list (1.39 sec)
ruby /Users/john/tmp/wrong/test/adapters/rspec2/failing_spec.rb (1.39 sec)
.
Finished tests in 8.158951s, 0.2451 tests/s, 1.2256 assertions/s.
1) Failure:
test_0001_version_1(testing rspec) [/Users/john/tmp/wrong/test/test_helper.rb:41]:
bundle install --gemfile=/Users/john/tmp/wrong/test/adapters/rspec1/Gemfile --local: Expected cmd and (output and (exit_status == expected_status)), but
cmd is "bundle install --gemfile=/Users/john/tmp/wrong/test/adapters/rspec1/Gemfile --local"
output and (exit_status == expected_status) is false
output is "The source :rubygems is deprecated because HTTP requests are insecure.\nPlease change your source to 'https://rubygems.org' if possible, or 'http://rubygems.org' if
not.\nResolving dependencies...\nCould not find gem 'rspec (~> 1.3) ruby' in the gems available on this machine.\n"
(exit_status == expected_status) is false
exit_status is 7
expected_status is 0
2 tests, 10 assertions, 1 failures, 0 errors, 0 skips
>> Separately running ./test/adapters/test_unit_test.rb under ...
$ ruby ./test/adapters/test_unit_test.rb
Loaded suite ./test/adapters/test_unit_test
Started
.....
Finished in 0.019211 seconds.
5 tests, 17 assertions, 0 failures, 0 errors, 0 pendings, 0 omissions, 0 notifications
100% passed
>> Separately running ./test/message/test_context_test.rb under ...
$ ruby ./test/message/test_context_test.rb
ruby 1.9.3p385 (2013-02-06 revision 39114) [x86_64-darwin12.2.0]
x'd out describe "showing the lines just above where the failure occurs, so you have some context"
Run options: --seed 7122
# Running tests:
Finished tests in 0.000241s, 0.0000 tests/s, 0.0000 assertions/s.
0 tests, 0 assertions, 0 failures, 0 errors, 0 skips
>> Separately running ./test/assert_advanced_test.rb under ...
$ ruby ./test/assert_advanced_test.rb
ruby 1.9.3p385 (2013-02-06 revision 39114) [x86_64-darwin12.2.0]
Run options: --seed 41544
# Running tests:
.....
Finished tests in 0.025339s, 197.3243 tests/s, 315.7189 assertions/s.
5 tests, 8 assertions, 0 failures, 0 errors, 0 skips
>> Running most tests under ...
ruby 1.9.3p385 (2013-02-06 revision 39114) [x86_64-darwin12.2.0]
/Users/john/tmp/wrong/test/string_comparison_test.rb:8: warning: already initialized constant StringComparison
Test run options: --seed 20764
Loaded suite /Users/john/.rbenv/versions/1.9.3-p385-perf/bin/rake
Started
.............................................SS....S................................F.....................................................................................
Finished in 37.000000 seconds.
1) Skipped:
test_0001_works_even_if_the_assertion_is_based_on_stuff_set_previously_in_the_block(FailuresSpec) [/Users/john/.rbenv/versions/1.9.3-p385-perf/lib/ruby/gems/1.9.1/gems/minitest-1.7.2/lib/minitest/spec.rb:156]:
(no tests defined)
2) Skipped:
test_0001_works_even_if_the_assertion_is_based_on_stuff_set_previously_in_the_block(FailuresSpec::AccessingAndPrintingValuesSetOutsideOfTheAssertSpec) [/Users/john/.rbenv/versions/1.9.3-p385-perf/lib/ruby/gems/1.9.1/gems/minitest-1.7.2/lib/minitest/spec.rb:156]:
(no tests defined)
3) Skipped:
test_0001_works_even_if_the_assertion_is_based_on_stuff_set_previously_in_the_block(FailuresSpec::SimpleSpec) [/Users/john/.rbenv/versions/1.9.3-p385-perf/lib/ruby/gems/1.9.1/gems/minitest-1.7.2/lib/minitest/spec.rb:156]:
(no tests defined)
4) Failure:
test_0005_2d_array_just_inspects_the_inner_array_like_it_would_any_other_element(WhenYouReComparingStringsAndTheyDonTMatchShowMeTheDiffMessageSpec) [/Users/john/tmp/wrong/test/message/array_diff_test.rb:75]:
Expected e.message.include?(expected_error_message.strip), but
e.message is "Invalid change array format provided."
e is #<RuntimeError: Invalid change array format provided.>
expected_error_message.strip is "[1, [2] ]\n[1, [2, 3]]\n ^"
expected_error_message is "\n[1, [2] ]\n[1, [2, 3]]\n ^\n"
170 tests, 311 assertions, 1 failures, 0 errors, 3 skips
Test run options: --seed 20764
@alexch
Copy link

alexch commented Nov 7, 2013

That's from the bump in lcs-diff... working on it now. The fix will be released as 0.7.1 soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment