Medinbox-QA's avatar
Medinbox-QA
Regular Visitor
21 hours ago
Status:
New Idea

Enhancement Request: Email / Microsoft Teams Notification After Automated Test Execution Completion

Add a notification capability in Zephyr Enterprise to automatically notify users when a batch of automated test executions has completed, particularly when executions are triggered through automation frameworks such as TestComplete/TestExecute.

The notification should be configurable to use either:

  • Email notification
  • Microsoft Teams channel notification

Current Situation

We execute automated test batches from our TestComplete automation framework, with the execution results being reported to Zephyr Enterprise.

Depending on the size of the regression suite, execution can run for an extended period. Currently, users need to manually check Zephyr Enterprise or the automation environment to determine whether the complete batch has finished.

There is no convenient notification indicating that the entire automated execution batch has reached a terminal state.

Requested Enhancement

Provide an option in Zephyr Enterprise to configure a notification that is triggered when all test executions belonging to a defined execution batch have completed.

The notification should be sent only when the overall batch reaches completion, regardless of whether individual tests have:

  • Passed
  • Failed
  • Been blocked
  • Been skipped
  • Ended with another configured final status

The feature should support notifications for automated executions submitted through integrations/APIs used by frameworks such as TestComplete.

Notification Channels

Email

Allow one or more email recipients or distribution lists to be configured for the execution batch.

Example notification:

Subject: Automated Test Execution Completed – [Project / Cycle / Batch Name]

Content:

  • Project
  • Test cycle / phase
  • Execution batch name or ID
  • Start time
  • Completion time
  • Total execution duration
  • Total test cases executed
  • Passed
  • Failed
  • Blocked / Skipped
  • Overall execution status
  • Link to the execution results in Zephyr Enterprise

Microsoft Teams

Provide support for sending the same summary to a configured Microsoft Teams channel, for example through a supported Teams integration, workflow, webhook mechanism, or equivalent Zephyr Enterprise notification connector.

Example:

Automation Execution Completed

Project: Medinbox Link

Test Cycle: Regression – vX.X.X

Total Tests: 180

Passed: 172

Failed: 6

Skipped: 2

Duration: 2h 15m

View results in Zephyr Enterprise

Configuration

Ideally, the notification should be configurable at one or more of the following levels:

  • Project
  • Test cycle
  • Test phase
  • Execution batch
  • Automation execution

Users should be able to:

  • Enable or disable completion notifications.
  • Select Email and/or Microsoft Teams.
  • Configure recipients or destination Teams channel.
  • Optionally notify only when failures are present.
  • Optionally send notifications for every completed batch.

Acceptance Criteria

  1. Zephyr Enterprise can identify when all executions belonging to an automated execution batch have reached a final status.
  2. A notification is generated only after the complete batch has finished.
  3. Email notifications can be configured for selected recipients.
  4. Microsoft Teams notifications can be configured for a selected channel.
  5. The notification contains a summarized execution result.
  6. The notification includes a direct link to the corresponding execution/cycle results in Zephyr Enterprise.
  7. The functionality works for test results submitted through automation integrations or APIs, including executions generated from TestComplete/TestExecute.
  8. Individual test completion should not trigger the batch-completion notification.
  9. Failed tests should not prevent the completion notification from being sent once the batch itself is complete.
  10. Notification configuration should be reusable for recurring automated regression executions.

Business Value

This feature would significantly improve automated testing workflows by removing the need for QA engineers to continuously monitor long-running executions.

For teams running scheduled or large regression suites, the notification would provide immediate visibility when testing is complete and allow developers, QA engineers, and release stakeholders to quickly review failures and make release decisions.

It would also make Zephyr Enterprise more suitable as the central reporting and monitoring location for CI/CD and external automation frameworks such as TestComplete.

No CommentsBe the first to comment