Automation engineer
- Fix a broken locator once, not in 30 scripts
- Stop adding sleeps to get a green run
- Review healed locators instead of hunting for them
A UI change shouldn't break 30 tests. Katalon Studio matches a fix to each cause of flakiness, from broken locators to timing, and nothing changes in your tests until you approve it.
Most flaky tests aren't random. They come from a handful of causes, and rerunning the job fixes none of them.
A renamed ID or a moved button fails every test that touches it, and each one needs the same fix.
The element wasn't ready, the animation hadn't finished, and the test passes on the second run.
When the team can't tell a flaky failure from a real bug, they rerun until it's green and real bugs slip through.
Coverage stalls because the week goes to keeping yesterday's tests alive.
Match the fix to the cause.
| Cause | What you see | What Studio does | Plan |
|---|---|---|---|
| The UI changed | Element not found after a release | Locators live in the object repository, so one fix reaches every test. Classic self-healing tries your other locators in the order you set. If they all fail, AI self-healing looks at the page source, accessibility tree, and screenshots to find the element. | Object repository: FreeSelf-healing: Paid plans |
| Timing | Passes on rerun, fails at random | Smart Wait waits for page loading, visibility, animations, and editability on web before each step. | Free |
| Environment noise | Fails in CI, passes locally | Retry failed executions immediately or after the whole run, and run in the same setup every time with the Katalon Docker Image or Test Cloud. | Retries: Paid plans |
| Flaky or real? | Reruns hide real bugs | Screenshots and video at the point of failure. With Katalon True Platform, a flakiness score across your run history shows which tests are unstable. | Reports: FreeTrue Platform: separate product |
When a locator breaks, Studio tries the alternatives and finishes the run instead of failing on a renamed ID.
See the broken locator, the proposed one, how it was found, and a screenshot.
Approve saves the new locator as the default. Discard rejects it.
Self-healing handles locator changes. It won't fix a timing issue, bad test data, or a real bug, which is why the other fixes above exist.
Fix a locator once and every test that uses it picks up the fix.
FreeFewer timing failures on web, without hard-coded sleeps.
FreeFalls back to your other locators when the default breaks.
Paid plansFinds the element from the page source, accessibility tree, and screenshots when every locator fails.
Katalon AI featuresPaid plansReview each proposed fix and approve or discard it.
Separate one-off failures from real ones.
Paid plansDon't want AI in your runs? Classic self-healing and Smart Wait use no AI, and AI self-healing only runs with a model you configure.
Most flaky failures show up in the pipeline. Run the same tests, in the same environment, every time, and send the results where your team already looks.
Katalon Runtime Engine runs your suites from the command line, so any pipeline can trigger them, with retry rules applied on every run.
Most "fails in CI, passes locally" failures come from environment drift. Pin it with a container, or let Test Cloud supply the browsers.
Failures arrive with screenshots and video attached. With Katalon True Platform, a flakiness score shows which tests are unstable across runs.
| Situation | Rerun and hope | Katalon Studio |
|---|---|---|
| Broken locator | Edit it in every script that uses it | Fix it once in the object repository, or approve a healed locator |
| Timing failure | Add a sleep and move on | Smart Wait handles page timing on web |
| Intermittent CI failure | Rerun the job until it's green | Retry rules, and the same environment every run |
| Flaky or real? | Guess | Evidence at the point of failure, plus a flakiness score with True Platform |
| What changes in your tests | Whatever someone edited | Only what you approve |
Most flaky tests come from a few causes: locators that break when the UI changes, timing issues where an element isn't ready yet, test data or environment differences between runs, and shared state between tests. Each cause needs a different fix, which is why rerunning rarely solves the problem.
When a test's default locator fails, Studio tries your other locators (XPath, Attributes, CSS, Image, Smart Locator) in the order you set. If none of them work, AI self-healing can analyze the page source, accessibility tree, and screenshots to find the element. Proposed fixes appear in Self-healing Insights for you to review.
No. The run can continue on an alternative locator, but the permanent change waits in Self-healing Insights. You approve a fix to save it as the new default, or discard it.
Yes. Self-healing works for Web UI and Mobile tests, with separate settings for each.
No. Classic self-healing, Smart Wait, and the object repository don't use AI. AI self-healing uses the model set in your AI configuration, or your own API key.
Yes, with Katalon True Platform. It calculates a Probabilistic Flakiness Score from pass-to-fail patterns in your test history, so you can see which tests are unstable.
No, self-healing is on paid plans. Smart Wait, the object repository, and built-in reports are on the Free plan.