First Orion Cuts QA Bottlenecks by Replacing Selenium Scripts with Amazon Nova Act Agents

The Problem: QA Couldn't Keep Pace With Shipping Velocity

First Orion, a branded communications company whose call-identification and anti-spam solutions reach hundreds of millions of phone calls across carriers in the US, Canada, UK, and Germany, has adopted Amazon Nova Act to automate quality assurance testing across its web applications, according to a joint post from AWS and First Orion.

The company, founded in 2008 and now employing over 300 people across offices in North Little Rock, Seattle, London, and Dubai, serves major carriers including T-Mobile, Verizon, AT&T, Vodafone, and Deutsche Telekom. As First Orion expanded from a monolithic web portal into a decentralized, cell-based architecture — and pushed further into the small and medium-business market — the number of web applications and device/browser combinations requiring testing multiplied faster than its QA team could handle.

Three specific failures compounded: regression testing wasn't self-service due to dependency-heavy test cases; new features couldn't be tested until they were fully built and deployed, since automation engineers needed DOM selectors that didn't exist yet; and existing Selenium/Playwright scripts broke constantly as element IDs and classes changed between sprints. Adding headcount didn't fix the underlying fragility of selector-based automation.

The Shift to Natural-Language Test Automation

First Orion became a pre-release adopter of Amazon Nova Act in March 2025, after its AWS account team introduced the tool, and reported value ahead of the product's general availability. Nova Act lets QA analysts describe test steps in plain English — for example, "Log into the portal, navigate to billing, and verify the invoice total" — rather than writing and maintaining selector-based code.

According to First Orion, the agent reasons about the current UI state using visible labels, layout, and context rather than fixed CSS selectors, meaning instructions like "click the Submit button" continue to work even after developers rename underlying classes. The company says Nova Act also handles dynamic content, dismisses pop-ups, and recovers from errors autonomously, and that developers can interleave Python code, assertions, and parallelization directly with Nova Act commands.

First Orion built a custom system around the Nova Act SDK: a React-based Test Case Authoring UI lets QA analysts write and validate test cases in plain English, with a templating engine generating realistic dynamic data (phone numbers, emails, business names) for each run. Test collections are stored as JSON in Amazon S3, and execution runs on Amazon Bedrock AgentCore Browser, which the company says removed the need to manage its own browser infrastructure for provisioning, session recording, and parallel test execution.

Reported Outcomes

According to First Orion, the switch eliminated three structural bottlenecks: QA analysts can now author tests directly without waiting for automation engineers to translate requirements into code; tests survive UI changes since they don't depend on fixed selectors; and the company no longer needs to maintain its own browser test infrastructure. The source post does not disclose quantified metrics such as reduction in regression time, defect escape rate, or release-cycle acceleration — these are described qualitatively rather than with hard figures.

What This Means

This is a customer case study, not a new model or product launch — Amazon Nova Act itself was previously announced as an AI agent for browser automation. The significance here is architectural: it demonstrates a live production use case where natural-language, vision-based UI agents replace selector-dependent test frameworks like Selenium and Playwright, a pain point familiar to nearly every engineering org running continuous deployment. The claimed benefit — QA analysts writing executable tests directly, without an intermediate coding step — could meaningfully compress the last-mile bottleneck between feature completion and release if the resilience-to-UI-change claims hold up at scale beyond this one deployment. Enterprises evaluating agentic QA tools should note that this account comes from a company co-authoring the promotional post with AWS, and independent benchmarking of Nova Act's reliability against traditional frameworks is not yet publicly available.