Understand Every Step of Your AI Agent

Why We Built This

Debugging test automation can be frustrating when you don't know why a test failed or how the AI agent reached its decision. With this update, we've made it incredibly easy to see what went wrong, step by step.

How It Works

• Step-by-Step Breakdown: Follow every action the AI agent takes in real time. See what elements it interacts with, what data it processes, and why it makes certain choices.
• Clear Error Insights: When a test fails, you'll get precise details on what went wrong—whether it's a missing element, an unexpected page state, or an incorrect output.
• Agent Thought Process: Understand not just what happened but why—see the AI's reasoning behind every interaction, making debugging much faster.
• Visual Logs & Reports: Quickly navigate logs with timestamps, screenshots, and structured explanations of the agent's actions.

Provide data that the AI agent will use when running all tests. This feature ensures the agent understands key aspects of your site, enabling more accurate and reliable test execution.

How it Works:

• Centralized Information: Define project-specific details that the AI agent should consider during testing.
• Context-Aware Testing: The agent uses this data to adapt its actions based on your website's behavior and requirements.

What Should You Add to Project Context?

Project Contexts should include information that helps the AI understand and interact with your application effectively. Examples include:

• Website Behavior Rules: Define interactions such as requiring hover actions before clicking menu items.
• Domain-Specific Constraints: Specify rules such as only using Swedish company data if your service handles Swedish businesses.
• Testing Guidelines: Ensure that tests fail on specific conditions, such as obvious typos or interactions with restricted UI elements.

Examples of Project Context Data:

• The service is a route planning tool for American railways.
• When creating users, always use Swedish names.
• Always fail tests when obvious typos are found.
• If a button is red, it should never be clicked.

You find the Project Context settings if you go to Project Settings - Configs

Quick Summaries for Failed Tests, making it much easier to diagnose and understand test failures at a glance.

How it Works:

• Hover to View Details: Quickly see why a test failed by hovering over the status in the test list.
• Concise Failure Summaries: Get an instant overview of errors without digging into logs.
• Run Overview: View a high-level summary of failures for an entire test run, helping you pinpoint patterns and common issues.

This feature speeds up debugging by providing essential failure insights right where you need them. No more clicking through multiple logs—just hover and analyze!

Test Plans allow you to organize and manage groups of test cases that can be executed together as a single unit.

Overview

Test Plans are collections of test cases that you want to run together regularly. This feature provides flexibility in running tests through multiple methods: API triggers, scheduled runs, or manual execution through the UI.

Benefits:

• Organizing related test cases into logical groups
• Enabling automated execution on schedules
• Supporting API-triggered test automation

We've enhanced file upload testing capabilities to support both default and custom files, making it easier to test different file import scenarios.

How it Works:

• Default Test Files: QA.tech provides built-in test files, including test.pdf and test.jpg, that are automatically available for use in tests.
• Custom File Uploads: Users can upload their own files for testing specific import features or custom requirements.
• File Selector Integration: The system captures file selector events and allows automated uploads from pre-configured test files.
• File Type Restrictions: The AI agent detects allowed file types from input elements and ensures only matching file types are used in tests.

This feature provides greater flexibility for file-related test cases, helping teams validate upload functionality with ease.

We've introduced the ability to define multiple configurations for test runs, allowing for more flexibility in how tests are executed. Now, you can create and manage different test setups based on user roles, file uploads, or other test-specific variations.

How it Works:

• Role-Based Configurations: Define different login credentials and permissions for various user roles within a test.
• Flexible File Handling: Set up different configurations to test with multiple file types, sizes, or formats.

This feature helps teams create more dynamic and comprehensive test cases, improving overall test coverage and reliability. Start using multiple configurations for enhanced test execution today!

Alongside Trello, we've also introduced Jira integration to simplify bug tracking. Now, you can send bug reports directly to Jira, ensuring a smoother workflow for teams using the platform.

How it Works:

• Direct Jira Reporting: Send bug reports to Jira without leaving the test environment.
• Customizable Issues: Select the appropriate Jira project, issue type, and priority to keep your bug tracking structured.
• Rich Bug Details: Automatically include relevant test data, steps to reproduce, and screenshots, reducing manual effort.

This integration helps teams efficiently track, prioritize, and resolve issues within Jira. Start streamlining your bug tracking with Jira integration today!

We've added an Mouse Event Tracing feature to give you deeper insights into test execution. Now, you can visually track how the mouse moves, where it clicks, and where text is typed during test runs. This is part of QA.tech visions to not just click on elements but actually act as a user.

How it Works:

• Live Mouse Tracking: See the exact path of the mouse during test execution.
• Click and Type Insights: Identify where clicks occur and where text is entered, helping diagnose UI interaction issues.
• Better Debugging: Quickly pinpoint potential issues by understanding how the test interacts with elements on the screen.

This feature enhances test analysis, making it easier to refine automated test cases and optimize interactions with your application. Start visualizing mouse activity in your tests today!

We've made it easier to track and manage bugs with our new Trello integration. Now, you can send bug reports directly to your Trello boards, streamlining collaboration and ensuring issues are addressed efficiently.

How it Works:

• Seamless Reporting: Send bug reports directly from the test environment to Trello without switching between tools.
• Customizable Workflow: Choose which Trello board and list the bug report should go to, making it easier to categorize and prioritize issues.
• Automatic Details: Reports include relevant test details and screenshots, reducing manual input and improving bug tracking accuracy.

This integration helps keep your team aligned and makes bug tracking more efficient. Start sending bug reports to Trello with ease!

We've introduced a new feature that enhances the test creation and editing experience by providing intelligent suggestions for writing test steps and selecting the best tools for execution. This helps streamline the process and ensures more efficient, effective test automation.

How it Works:

• Step Guidance: When creating or editing a test case, you'll receive suggestions on how to structure each step for better clarity and accuracy.
• Tool Recommendations: Based on the step's context, the system will suggest appropriate tools or actions the agent can use to complete the task effectively.
• Efficiency Boost: Reduce errors and enhance test reliability by leveraging AI-driven insights for test case optimization.

This feature simplifies test creation, reduces the need for trial-and-error, and improves overall test execution. Start creating better test cases with smart suggestions today!