RemoteLeads Logo
Sign Up Sign In

Senior QA Automation Engineer

2 weeks, 1 day ago
Mexico, Bolivia, Chile, Colombia, Costa Rica, Ecuador, Guatemala, Panama, Paraguay, Peru, Uruguay
Contract
Senior
SDET (Software Development Engineer in Test)
Quality Assurance and Testing
CI/CD Cybersecurity GitHub Actions Grafana JavaScript Jenkins JIRA Playwright Pytest Python Scrum WebRTC
Apply Now
IDT

IDT

IDT Corporation provides innovative communications and payment services, connecting families, friends, and businesses globally with pioneering technologies and solutions.

Diversified Telecommunication Services
1K-5K
Founded 1990
View All Jobs 5

Description

  • Own the end-to-end test strategy across LLM, speech, and telephony layers.
  • Design scenarios for multi-turn conversations, interruptions, ambiguous input, escalation, and failure recovery.
  • Build evaluation frameworks using golden datasets, semantic assertions, and automated regression detection.
  • Adversarially test hallucinations, prompt injections, guardrail bypasses, grounding errors, and data disclosure risks.
  • Provision SIP devices and endpoints and automate end-to-end call origination.
  • Diagnose issues across LLM, ASR, TTS, media, codec, and call-routing layers.
  • Expand automated coverage and integrate tests into CI/CD release gates.
  • Define and track quality metrics including task completion, containment, intent and transcription accuracy, latency, and escalation correctness.
  • Maintain traceable test coverage in the TMS and communicate data-backed quality risks.
  • Participate fully in Scrum ceremonies and maintain related artifacts.

Requirements

  • 5+ years of QA experience, including ownership of a complex integrated product.
  • Practical SIP/VoIP testing experience with call flows, signaling, media handling, softphones, or SIP trunking.
  • Ability to troubleshoot SIP traces or packet captures.
  • Strong creativity and scenario-design ability for complex conversational systems.
  • Proficiency in Python for building and maintaining automation frameworks.
  • Experience testing non-deterministic or probabilistic systems and designing assertions for variable outputs.
  • Strong analytical skills and experience defining quality metrics for release decisions.
  • Hands-on experience with formal TMS tools and Jira.
  • Professional fluency in spoken and written English, with reliable overlap with US Eastern business hours.
  • LATAM-based candidate; English CV and advanced spoken English required.
  • Preferred: LLM/conversational AI, speech technology, RAG, WebRTC/media-layer, IVR/contact-center, multilingual, or prompt-engineering experience.
  • Relevant tools include pytest, Playwright, JsSIP/WebRTC, Allure TestOps, Jenkins, GitHub Actions, and Grafana.

Benefits

  • Remote work opportunity.
  • B2B employment with competitive salary and annual performance review.
  • Stable role with long-term growth prospects.
  • Company-provided hardware.
  • Continuous learning and career growth opportunities.
  • Compensation for professional training, seminars, and conferences.
  • Company-supported English classes and employee referral rewards.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Margo Bank

Senior Tester

Margo Bank Professional Services

Rola testera oprogramowania w dynamicznym środowisku, obejmująca testowanie aplikacji webowych, mobilnych i backendowych oraz rozwój architektury automatyzacji w celu poprawy jakości oprogramowania.

Poland Contract Senior SDET (Software Development Engineer in Test)
$44k-$49k
2 days, 21 hours ago
Alex Staff Agency

Senior QA Engineer with Automation

Alex Staff Agency 11-50 Professional Services

A Senior QA Engineer will test complex web applications across UI and API layers for a global education-technology company, helping improve product quality through strong manual testing and targeted automation.

Austria Germany Hungary Netherlands Slovakia Slovenia Contract Senior SDET (Software Development Engineer in Test)
Up to $54k
Agile AJAX CI/CD Cypress Git HTML HTTP JIRA JSON Linux Playwright REST API Selenium SQL Ubuntu
3 days, 21 hours ago
DEPT®

QA Automation & Manual Engineer, Contract

DEPT® 1K-5K Media

DEPT® is seeking a Principal Engineer to establish agency-wide quality standards, lead scalable QA and performance testing practices, and provide technical oversight across client transformations.

United States Contract Lead SDET (Software Development Engineer in Test)
$166k-$208k
Cypress JIRA JMeter Postman Python SQL TypeScript
5 days, 20 hours ago
Dev.Pro

Junior Test Engineer Automation (Python) - OP02251-00

Dev.Pro 251-1K Internet Software & Services

Dev.Pro, a US-based remote-first software development company, is hiring a Junior Test Automation Engineer in Europe to support automated and performance testing for complex cloud-based systems.

Bulgaria Poland Portugal Spain Contract Junior SDET (Software Development Engineer in Test)
AWS Gatling Git JMeter Locust Python Scala
5 days, 21 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers