CSC/ECE 517 Fall 2017/M1754 Mutation Testing - Revision history

Sdhegde: /* Subsequent steps */

2017-12-07T02:07:46Z

Subsequent steps

← Older revision		Revision as of 02:07, 7 December 2017
Line 53:		Line 53:

	python etc/ci/mutation_test.py		python etc/ci/mutation_test.py

	~~===Subsequent steps===~~

	* implement mutations like replacing if statements by if true/if false, duplicating statements, reordering statements, changing arithmetic & atomic string constant.
	* improving the performance of the testing, for example randomizing the test order, fast-failing, running tests with faster builds (e.g. ./mach build -d).
	* find heuristics for identifying false positives, that is mutations which are expected to have no effect, for example removing logging.
	* find search heuristics for identifying mutations that cause no test failures.

	===Existing Mutation Strategy===		===Existing Mutation Strategy===

Sdhegde: /* Mutation Strategy Examples */

2017-12-07T02:06:26Z

Mutation Strategy Examples

@@ Line 145: / Line 145: @@
+     {
          c = a * 10;
+     }

Sdhegde: /* Mutation Strategy Examples */

2017-12-07T02:04:34Z

Mutation Strategy Examples

@@ Line 129: / Line 129: @@
+     {
          c = 1;
+     }

Sdhegde: /* Mutation Strategies */

2017-12-07T02:02:43Z

Mutation Strategies

← Older revision		Revision as of 02:02, 7 December 2017
Line 91:		Line 91:
	* Duplicate statements		* Duplicate statements
	* Change arithmetic operations.		* Change arithmetic operations.


	As the build and WPT test run take a lot of time to run. Mutation Test Strategies are implemented with these key features		As the build and WPT test run take a lot of time to run. Mutation Test Strategies are implemented with these key features

Sdhegde: /* Mutation Strategies */

2017-12-07T02:02:28Z

Mutation Strategies

← Older revision		Revision as of 02:02, 7 December 2017
Line 91:		Line 91:
	* Duplicate statements		* Duplicate statements
	* Change arithmetic operations.		* Change arithmetic operations.


	As the build and WPT test run take a lot of time to run. Mutation Test Strategies are implemented with these key features		As the build and WPT test run take a lot of time to run. Mutation Test Strategies are implemented with these key features

Sdhegde: /* Mutation Strategies */

2017-12-07T02:01:54Z

Mutation Strategies

← Older revision		Revision as of 02:01, 7 December 2017
Line 91:		Line 91:
	* Duplicate statements		* Duplicate statements
	* Change arithmetic operations.		* Change arithmetic operations.

			As the build and WPT test run take a lot of time to run. Mutation Test Strategies are implemented with these key features
			* The mutants produces only run-time bugs.
			* The mutants do not cause any compilation failure.
			* The mutants do not produce False Positives.

	===Mutation Strategy Examples===		===Mutation Strategy Examples===

Sdhegde: /* Project description */

2017-12-07T01:55:22Z

Project description

← Older revision		Revision as of 01:55, 7 December 2017
Line 160:		Line 160:
	x=x-y;		x=x-y;
	}		}

			===Other Enhancements===
			* Randomized the test order to increase the performance of testing.
			* Introduced logging instead of print statements.
			* Added Retry Mechanism when mutation cannot be performed on a file by a strategy.

	===Excecution Flow===		===Excecution Flow===

Sdhegde: /* Introduction */

2017-12-07T01:40:46Z

Introduction

← Older revision		Revision as of 01:40, 7 December 2017
Line 8:		Line 8:

	Servo is a modern, high-performance browser engine designed for both application and embedded use. [https://servo.org Servo] is a web browser layout engine written in [https://github.com/rust-lang/rust Rust]and is currently being developed by [https://en.wikipedia.org/wiki/Mozilla Mozilla]. The aim of the project is not to create a full browser but is rather to create a highly parallel environment that allows for many components be handled by fine-grained, isolated tasks. [https://en.wikipedia.org/wiki/Servo_(layout_engine)]		Servo is a modern, high-performance browser engine designed for both application and embedded use. [https://servo.org Servo] is a web browser layout engine written in [https://github.com/rust-lang/rust Rust]and is currently being developed by [https://en.wikipedia.org/wiki/Mozilla Mozilla]. The aim of the project is not to create a full browser but is rather to create a highly parallel environment that allows for many components be handled by fine-grained, isolated tasks. [https://en.wikipedia.org/wiki/Servo_(layout_engine)]

	~~===Rust===~~

	[https://doc.rust-lang.org/book/second-edition/ Rust] is an open source, systems programming language sponsored by Mozilla Research. Rust performs the majority of its safety checks and memory management decisions at compile time, so that program’s runtime performance is not impacted. Making it useful in programs with predictable space and time requirements, embedding in other languages, and writing low-level code, like device drivers and operating systems.

	===Web-platform-tests===		===Web-platform-tests===

Sdhegde: /* Mutation Strategy Examples */

2017-12-07T01:38:53Z

Mutation Strategy Examples

@@ Line 129: / Line 129: @@
          c = 1;
+     }
 * Duplicate statements

Sdhegde: /* Mutation Strategies */

2017-12-07T01:38:28Z

Mutation Strategies

← Older revision		Revision as of 01:38, 7 December 2017
Line 91:		Line 91:
	* Make 'if condition' to 'if true'		* Make 'if condition' to 'if true'
	* Make 'if condition' to 'if false'		* Make 'if condition' to 'if false'
	* ~~Re-order statements~~		* Change String literals
			* Change Comparision operators
	* Duplicate statements		* Duplicate statements
	* Change arithmetic operations.		* Change arithmetic operations.