Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove overlapping generated tests, closes #535 #726

Merged
merged 26 commits into from
May 7, 2019

Conversation

andrewbwogi
Copy link
Contributor

No description provided.

@coveralls
Copy link

coveralls commented Mar 1, 2019

Pull Request Test Coverage Report for Build 1964

  • 23 of 26 (88.46%) changed or added relevant lines in 4 files are covered.
  • 19 unchanged lines in 4 files lost coverage.
  • Overall coverage decreased (-0.06%) to 85.501%

Changes Missing Coverage Covered Lines Changed/Added Lines %
dspot/src/main/java/eu/stamp_project/utils/pit/PitCSVResult.java 0 1 0.0%
dspot/src/main/java/eu/stamp_project/dspot/selector/PitMutantScoreSelector.java 17 19 89.47%
Files with Coverage Reduction New Missed Lines %
dspot/src/main/java/eu/stamp_project/test_framework/implementations/AssertJTestFramework.java 1 42.86%
dspot/src/main/java/eu/stamp_project/dspot/amplifier/TestDataMutator.java 1 90.44%
dspot/src/main/java/eu/stamp_project/dspot/assertgenerator/AssertionRemover.java 1 96.72%
dspot/src/main/java/eu/stamp_project/dspot/budget/SimpleBudgetizer.java 16 73.53%
Totals Coverage Status
Change from base Build 1955: -0.06%
Covered Lines: 4629
Relevant Lines: 5414

💛 - Coveralls

@danglotb danglotb mentioned this pull request Apr 9, 2019
@danglotb
Copy link
Member

Hello @andrewbwogi

Could resolve the conflicts in order to merge this pull request and make the announced release #758.

@andrewbwogi
Copy link
Contributor Author

andrewbwogi commented Apr 26, 2019

I've created test cases that produce overlapping tests and the selectors remove the redundant tests. I'm currently abstracting common features of the new test classes and organizing them in the style of earlier selector tests. I'll update this pull request shortly.

@andrewbwogi
Copy link
Contributor Author

Hi @danglotb, how can I see and reproduce what is failing in the CI build?

@danglotb
Copy link
Member

danglotb commented May 3, 2019

Hello @andrewbwogi

The details of the build are available here. (click on the detail button next to the line of travis)

There are 3 builds that fail, but it is probably the same errors since it uses different jdk or computes the coverage.

The errors are:

Failed tests:   testExample(eu.stamp_project.MainTest): expected:<...cation results with [22] amplified tests.(..)

Tests in error: 
  testRemoveOverlappingTests(eu.stamp_project.dspot.selector.PitScoreMutantSelectorTest): java.lang.RuntimeException: java.io.FileNotFoundException: src/test/resources/regression/test-projects_2/test-projects.properties (No such file or directory)
  testRemoveOverlappingTests(eu.stamp_project.dspot.selector.JacocoCoverageSelectorTest): java.lang.RuntimeException: java.io.FileNotFoundException: src/test/resources/regression/test-projects_2/test-projects.properties (No such file or directory)

Tests run: 191, Failures: 1, Errors: 2, Skipped: 6

I let you investigate.

@danglotb
Copy link
Member

danglotb commented May 7, 2019

Changes seem good to me, ready to merge?

@andrewbwogi
Copy link
Contributor Author

Yes, you can merge.

@danglotb danglotb merged commit 8b5968b into STAMP-project:master May 7, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants