Reports for Flutter test_driver execution - flutter

Question

I need to generate a report about how much tests was executed, how much failed, why test was failed. Is there some option to do it with test_driver?
We can generate json report for flutter unit tests with command flutter test --machine. Is there something same for flutter drive?

Answer 1

Although flutter driver doesn't generate a full-fledged test summary report out-of-box, there's an alternative way to do it using flutter_gherkin plugin. This plugin makes use of ATDD style of writing integration tests leveraging flutter driver and its methods.
Checkout the example from plugin's repo.
This plugin has a configuration file (just like instrumentation file in Google Espresso) which has a reporter parameter to specify json reporter that generates report in json format.
Below is the content of generated json report:
[{
"keyword": "Feature",
"uri": "./test_driver/features/custom_parameter_example.feature",
"id": "custom parameter example",
"name": "Custom Parameter Example",
"description": "",
"line": 0,
"elements": [{
"keyword": "Scenario",
"type": "scenario",
"id": "custom parameter example;custom colour parameter",
"name": "Custom colour parameter",
"description": "",
"line": 3,
"steps": [{
"keyword": "Given ",
"name": "I pick the colour red",
"line": 4,
"result": {
"status": "passed",
"duration": 6000000
}
}, {
"keyword": "Given ",
This report can then be converted into html report using cucumber-html-reporter per your requirement.
This approach sounds a bit tedious and the format may or may not be the way you want, because you might need to re-write your tests in Given When Then format in order for json report to be generated, but you may give this approach a try to see if this works for you.

Answer 2

Yes, reports can be generated by setting paths in the test driver class, where the report path is initialized.
import 'package:integration_test/integration_test_driver.dart'
as integration_test_driver;
Future<void> main() async {
/// Repports are generated on given path, once all tested passed,
integration_test_driver.testOutputsDirectory =
'integration_test/reports';
await integration_test_driver.integrationDriver(
timeout: const Duration(minutes: 60));
}
Note: This will work using the flutter drive command.