00:00: This tutorial explains how to analyze test executions in Amikoo to identify and address
00:04: failing tests.
00:06: You'll learn how to interpret test results, review fixes, and distinguish between
00:10: product issues and test issues.
00:13: This tutorial covers what your test executions in Amikoo
00:16: can tell you and how to act on that information.
00:19: Start by asking Amikoo which tests fail most often. In this example, Amikoo identifies two
00:25: tests with a 100% failure rate.
00:30: You can ask AmikooChat to create a fix for the failing tests and open a pull request with
00:34: the changes.
00:36: Navigate to your Pull Requests on GitHub to see the actions Amikoo has taken.
00:41: The most recent pull request reflects the fix that was just requested.
00:46: The pull request includes a full breakdown of the fix — which sections were
00:50: changed, which lines were affected, and a description of what was updated.
00:56: Amikoo makes targeted edits, leaving
00:58: all unrelated tests unchanged. Only the code that needs to be fixed is touched.
01:05: Back in AmikooChat, ask: "Is there any suspicion of a product failure based on my failed executions?"
01:10: Amikoo will
01:11: analyze the results before responding.
01:22: Based on the two failing tests, Amikoo identifies two scenarios worth investigating
01:26: as potential product issues.
01:34: Amikoo differentiates between the two issues
01:36: — in one case the application itself is the likely
01:40: cause, and in the other the test is the problem.
01:47: Amikoo describes what may be causing each failure.
01:49: For example, it may flag a mismatch with an expected header value.
01:55: When a failure is harder to attribute to the test alone, Amikoo will recommend manual
01:59: verification to rule out a genuine product issue.
02:06: These examples show just two of the ways you can use test executions in Amikoo to investigate
02:11: failures and take action.
02:13: This tutorial demonstrated how to analyze test executions in Amikoo, identify failing tests,
02:18: review
02:18: fixes via pull requests, and distinguish between product and test issues.
02:24: You can now use Amikoo to confidently investigate test failures and determine when
02:28: manual checks are needed.
This tutorial explains how to analyze test executions in Amikoo to identify and address failing tests. You'll learn how to interpret test results, review fixes, and distinguish between product issues and test issues.
1. Understanding Executions in Amikoo
This tutorial covers what your test executions in Amikoo can tell you and how to act on that information.
2. Identify Failing Tests
Start by asking Amikoo which tests fail most often. In this example, Amikoo identifies two tests with a 100% failure rate.
3. Request Test Fix and Pull Request
You can ask AmikooChat to create a fix for the failing tests and open a pull request with the changes.
4. View Pull Requests on GitHub
Navigate to your Pull Requests on GitHub to see the actions Amikoo has taken. The most recent pull request reflects the fix that was just requested.
5. Review Pull Request Fix Details
The pull request includes a full breakdown of the fix — which sections were changed, which lines were affected, and a description of what was updated.
6. Understand Selective Test Changes
Amikoo makes targeted edits, leaving all unrelated tests unchanged. Only the code that needs to be fixed is touched.
7. Formulate Question
Back in AmikooChat, ask: "Is there any suspicion of a product failure based on my failed executions?" Amikoo will analyze the results before responding.
8. Identify Product Issue Scenarios
Based on the two failing tests, Amikoo identifies two scenarios worth investigating as potential product issues.
9. Distinguish Between App and Test Problems
Amikoo differentiates between the two issues — in one case the application itself is the likely cause, and in the other the test is the problem.
10. Review the Problem Descriptions
Amikoo describes what may be causing each failure. For example, it may flag a mismatch with an expected header value.
11. Know When to Verify Manually
When a failure is harder to attribute to the test alone, Amikoo will recommend manual verification to rule out a genuine product issue.
12. What You Can Do With Executions
These examples show just two of the ways you can use test executions in Amikoo to investigate failures and take action.
This tutorial demonstrated how to analyze test executions in Amikoo, identify failing tests, review fixes via pull requests, and distinguish between product and test issues. You can now use Amikoo to confidently investigate test failures and determine when manual checks are needed.
