RemoteLeads Logo
Sign Up Sign In

Senior QA Automation Engineer

1 month ago
Mexico, Bolivia, Chile, Colombia, Costa Rica, Ecuador, Guatemala, Panama, Paraguay, Peru, Uruguay
Contract
Senior
SDET (Software Development Engineer in Test)
Quality Assurance and Testing
CI/CD Cybersecurity GitHub Actions Grafana JavaScript Jenkins JIRA Playwright Pytest Python Scrum WebRTC
Apply Now
IDT

IDT

IDT Corporation provides innovative communications and payment services, connecting families, friends, and businesses globally with pioneering technologies and solutions.

Diversified Telecommunication Services
1K-5K
Founded 1990
View All Jobs 4

Description

  • Own the end-to-end test strategy across LLM, speech, and telephony layers.
  • Design scenarios for multi-turn conversations, interruptions, ambiguous input, escalation, and failure recovery.
  • Build evaluation frameworks using golden datasets, semantic assertions, and automated regression detection.
  • Adversarially test hallucinations, prompt injections, guardrail bypasses, grounding errors, and data disclosure risks.
  • Provision SIP devices and endpoints and automate end-to-end call origination.
  • Diagnose issues across LLM, ASR, TTS, media, codec, and call-routing layers.
  • Expand automated coverage and integrate tests into CI/CD release gates.
  • Define and track quality metrics including task completion, containment, intent and transcription accuracy, latency, and escalation correctness.
  • Maintain traceable test coverage in the TMS and communicate data-backed quality risks.
  • Participate fully in Scrum ceremonies and maintain related artifacts.

Requirements

  • 5+ years of QA experience, including ownership of a complex integrated product.
  • Practical SIP/VoIP testing experience with call flows, signaling, media handling, softphones, or SIP trunking.
  • Ability to troubleshoot SIP traces or packet captures.
  • Strong creativity and scenario-design ability for complex conversational systems.
  • Proficiency in Python for building and maintaining automation frameworks.
  • Experience testing non-deterministic or probabilistic systems and designing assertions for variable outputs.
  • Strong analytical skills and experience defining quality metrics for release decisions.
  • Hands-on experience with formal TMS tools and Jira.
  • Professional fluency in spoken and written English, with reliable overlap with US Eastern business hours.
  • LATAM-based candidate; English CV and advanced spoken English required.
  • Preferred: LLM/conversational AI, speech technology, RAG, WebRTC/media-layer, IVR/contact-center, multilingual, or prompt-engineering experience.
  • Relevant tools include pytest, Playwright, JsSIP/WebRTC, Allure TestOps, Jenkins, GitHub Actions, and Grafana.

Benefits

  • Remote work opportunity.
  • B2B employment with competitive salary and annual performance review.
  • Stable role with long-term growth prospects.
  • Company-provided hardware.
  • Continuous learning and career growth opportunities.
  • Compensation for professional training, seminars, and conferences.
  • Company-supported English classes and employee referral rewards.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Metova

Automation Test Engineer

Metova 51-250 Internet Software & Services

Senior Automation Test Engineer responsible for building quality engineering practices and automated testing strategies for web applications, REST APIs, and AI-powered solutions.

Argentina Bolivia Chile Colombia Peru Venezuela Contract Senior SDET (Software Development Engineer in Test)
Azure CI/CD Gatling Git Java JavaScript Playwright Python REST API Selenium TypeScript
1 day, 13 hours ago
Planner 5D

QA Automation engineer

Planner 5D 51-250 Internet Software & Services

Planner 5D is hiring a QA Automation Engineer to improve product quality across its cross-platform home design applications.

Estonia Latvia Poland Portugal Serbia Spain Armenia Georgia Contract Mid Level SDET (Software Development Engineer in Test)
Android Appium GraphQL gRPC IntelliJ IDEA iOS Java JavaScript JUnit Kotlin macOS REST API Selenium TestNG
2 days, 13 hours ago
Margo Bank

Senior Tester

Margo Bank Professional Services

Rola testera oprogramowania w dynamicznym środowisku, obejmująca testowanie aplikacji webowych, mobilnych i backendowych oraz rozwój architektury automatyzacji w celu poprawy jakości oprogramowania.

Poland Contract Senior SDET (Software Development Engineer in Test)
$44k-$49k
2 weeks, 6 days ago
Alex Staff Agency

Senior QA Engineer with Automation

Alex Staff Agency 11-50 Professional Services

A Senior QA Engineer will test complex web applications across UI and API layers for a global education-technology company, helping improve product quality through strong manual testing and targeted automation.

Austria Germany Hungary Netherlands Slovakia Slovenia Contract Senior SDET (Software Development Engineer in Test)
Up to $54k
Agile AJAX CI/CD Cypress Git HTML HTTP JIRA JSON Linux Playwright REST API Selenium SQL Ubuntu
3 weeks ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers