Skip to content

Avoid failing the test for a given threshold but yet generating the difference image #63

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 27, 2020
Merged

Conversation

jonatask
Copy link
Contributor

@jonatask jonatask commented Apr 25, 2020

There are scenarios where we want to see the differences but we do not want the pipeline fails with this threshold, e.g. the test with threshold 1 should not fail the pipeline but we want to see the differences anyway.

This branch adds a new option called "skipFailure". If "true" then the system generates the diff file but does not fail the test.

Jonatas Kirsch added 2 commits April 26, 2020 00:10
@jonatask
Copy link
Contributor Author

@puneet0191 could you please review this and deliver in the next release too?
This feature is important for my project and may be useful for others too.
Thank you very much.

@puneet0191
Copy link
Member

puneet0191 commented Apr 27, 2020

Yes for sure, I will include it in 1.9.1 release

@puneet0191 puneet0191 changed the base branch from master to 1.9.1 April 27, 2020 10:24
@puneet0191 puneet0191 merged commit 3732670 into codeceptjs:1.9.1 Apr 27, 2020
@jonatask jonatask deleted the optional-failure branch April 27, 2020 17:08
puneet0191 added a commit that referenced this pull request May 16, 2020
* Issue #60 - Prepare all baselines of test by setting parameter in config (#65)

Co-authored-by: Jonatas Kirsch <[email protected]>

* Update Dependecies, Fix Fatal Error with mkdirp and Mac (#66)

* Update Dependencies

* Fix Error on Mac

* Avoid failing the test for a given threshold but yet generating the difference image (#63)

* Option bypassFailure allowing the user to avoid failing the test for a given threshold but yet generating the difference image

* Renamed option to skipFailure

Co-authored-by: Jonatas Kirsch <[email protected]>

* feat(testcafe): add the support for testcafe (#62)

* passing through output settings to resemble.js (#59)

Co-authored-by: JANK Michael <[email protected]>

* Issue 48 - Add custom assert message (#64)

Co-authored-by: Jonatas Kirsch <[email protected]>

Co-authored-by: Jonatas Kirsch <[email protected]>
Co-authored-by: Jonatas Kirsch <[email protected]>
Co-authored-by: Guillaume Camus <[email protected]>
Co-authored-by: yankydoo <[email protected]>
Co-authored-by: JANK Michael <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants