Package de.rwth.swc.coffee4j.algorithmic.sequential.report

Interface GenerationReporter

All Superinterfaces:

Reporter

All Known Implementing Classes:

EmptySequentialGenerationReporter, SequentialExecutionReporterToGenerationReporterAdapter

public interface GenerationReporter
extends Reporter

An interface defining a reporter listening for events during the generation of combinatorial test inputs. All methods are implemented as empty default methods to that any implementing class must only overwrite methods it needs.

Method Summary

Modifier and Type	Method	Description
default void	faultCharacterizationFinished(TestInputGroup testInputGroup, Map<int[],Class<? extends Throwable>> exceptionInducingCombinations, Set<int[]> failureInducingCombinations)	Called after all fault characterization has been finished.
default void	faultCharacterizationStarted(TestInputGroup testInputGroup, FaultCharacterizationAlgorithm algorithm)	Called if fault characterization for the given group has started.
default void	faultCharacterizationTestInputsGenerated(TestInputGroup testInputGroup, List<int[]> testInputs)	Called if new test inputs have been generated by the FaultCharacterizationAlgorithm provided to faultCharacterizationStarted(TestInputGroup, FaultCharacterizationAlgorithm).
default void	testInputGroupFinished(TestInputGroup testInputGroup)	Called if all operations for a TestInputGroup are finished.
default void	testInputGroupGenerated(TestInputGroup testInputGroup, TestInputGroupGenerator generator)	Called if a new TestInputGroup has been generated by a TestInputGroupGenerator.

Methods inherited from interface de.rwth.swc.coffee4j.algorithmic.report.Reporter

report, report, reportAssumptionSatisfaction, reportAssumptionViolation, reportDebug, reportDebug, reportError, reportError, reportFatal, reportFatal, reportInfo, reportInfo, reportTrace, reportTrace, reportWarn, reportWarn

Method Detail

testInputGroupGenerated

default void testInputGroupGenerated(TestInputGroup testInputGroup,
                                     TestInputGroupGenerator generator)

Called if a new TestInputGroup has been generated by a TestInputGroupGenerator. This is only called once per TestInputGroup, and the identifier can be used in all other methods to connect calls for the same group.

Parameters:

testInputGroup - the group which was generated

generator - the generator which generated the given group

testInputGroupFinished

default void testInputGroupFinished(TestInputGroup testInputGroup)

Called if all operations for a TestInputGroup are finished. After this has been called it is guaranteed that no further test inputs are generated for the group, so no other methods will be called for the same group. This is needed additionally to faultCharacterizationFinished(TestInputGroup, Map, Set) since some groups may disable fault characterization and a reporter still needs to be notified after the group is finished. If fault characterization is used for the group, faultCharacterizationFinished(TestInputGroup, Map, Set) has the same meaning.

Parameters:

testInputGroup - the group which has been finished

faultCharacterizationStarted

default void faultCharacterizationStarted(TestInputGroup testInputGroup,
                                          FaultCharacterizationAlgorithm algorithm)

Called if fault characterization for the given group has started. Consequently, this method is only called once per TestInputGroup, and never if fault characterization is not enabled.

Parameters:

testInputGroup - the group for which the characterization process started

algorithm - the algorithm which will be used to perform fault characterization. Since this is the same instance as used in the test, implementing classes could theoretically modify it, but is is strongly advised not to modify this algorithm because many unintended side effects could happen.

faultCharacterizationFinished

default void faultCharacterizationFinished(TestInputGroup testInputGroup,
                                           Map<int[],Class<? extends Throwable>> exceptionInducingCombinations,
                                           Set<int[]> failureInducingCombinations)

Called after all fault characterization has been finished. Directly after this method testInputGroupFinished(TestInputGroup) will be called.

Parameters:

testInputGroup - the group for which fault characterization has been finished

exceptionInducingCombinations - all exception-inducing combinations found.

failureInducingCombinations - all failure inducing combinations found. These may or may not be ordered depending of the algorithm used. They also do not necessarily contain combinations guaranteed to be failure-inducing but rather those "most probably failure-inducing"

faultCharacterizationTestInputsGenerated

default void faultCharacterizationTestInputsGenerated(TestInputGroup testInputGroup,
                                                      List<int[]> testInputs)

Called if new test inputs have been generated by the FaultCharacterizationAlgorithm provided to faultCharacterizationStarted(TestInputGroup, FaultCharacterizationAlgorithm). This method may be called multiple times or never depending on the definition of a combinatorial test. It will only ever be called between calls to faultCharacterizationStarted(TestInputGroup, FaultCharacterizationAlgorithm) and faultCharacterizationFinished(TestInputGroup, Map, Set).

Parameters:

testInputGroup - the group for which further test inputs were generated for fault characterization

testInputs - all generated test inputs