RemoteLeads Logo
Sign Up Sign In

Senior QA Automation Engineer

1 week, 1 day ago
Mexico, Bolivia, Chile, Colombia, Costa Rica, Ecuador, Guatemala, Panama, Paraguay, Peru, Uruguay
Contract
Senior
SDET (Software Development Engineer in Test)
Quality Assurance and Testing
CI/CD Cybersecurity GitHub Actions Grafana JavaScript Jenkins JIRA Playwright Pytest Python Scrum WebRTC
Apply Now
IDT

IDT

IDT Corporation provides innovative communications and payment services, connecting families, friends, and businesses globally with pioneering technologies and solutions.

Diversified Telecommunication Services
1K-5K
Founded 1990
View All Jobs 5

Description

  • Own the end-to-end test strategy across LLM, speech, and telephony layers.
  • Design scenarios for multi-turn conversations, interruptions, ambiguous input, escalation, and failure recovery.
  • Build evaluation frameworks using golden datasets, semantic assertions, and automated regression detection.
  • Adversarially test hallucinations, prompt injections, guardrail bypasses, grounding errors, and data disclosure risks.
  • Provision SIP devices and endpoints and automate end-to-end call origination.
  • Diagnose issues across LLM, ASR, TTS, media, codec, and call-routing layers.
  • Expand automated coverage and integrate tests into CI/CD release gates.
  • Define and track quality metrics including task completion, containment, intent and transcription accuracy, latency, and escalation correctness.
  • Maintain traceable test coverage in the TMS and communicate data-backed quality risks.
  • Participate fully in Scrum ceremonies and maintain related artifacts.

Requirements

  • 5+ years of QA experience, including ownership of a complex integrated product.
  • Practical SIP/VoIP testing experience with call flows, signaling, media handling, softphones, or SIP trunking.
  • Ability to troubleshoot SIP traces or packet captures.
  • Strong creativity and scenario-design ability for complex conversational systems.
  • Proficiency in Python for building and maintaining automation frameworks.
  • Experience testing non-deterministic or probabilistic systems and designing assertions for variable outputs.
  • Strong analytical skills and experience defining quality metrics for release decisions.
  • Hands-on experience with formal TMS tools and Jira.
  • Professional fluency in spoken and written English, with reliable overlap with US Eastern business hours.
  • LATAM-based candidate; English CV and advanced spoken English required.
  • Preferred: LLM/conversational AI, speech technology, RAG, WebRTC/media-layer, IVR/contact-center, multilingual, or prompt-engineering experience.
  • Relevant tools include pytest, Playwright, JsSIP/WebRTC, Allure TestOps, Jenkins, GitHub Actions, and Grafana.

Benefits

  • Remote work opportunity.
  • B2B employment with competitive salary and annual performance review.
  • Stable role with long-term growth prospects.
  • Company-provided hardware.
  • Continuous learning and career growth opportunities.
  • Compensation for professional training, seminars, and conferences.
  • Company-supported English classes and employee referral rewards.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Newsela

Contractor: Senior Quality Engineer

Newsela 251-1K Diversified Consumer Services

Newsela is hiring a Senior Full-Stack Quality Engineer to ensure reliable, high-quality software for its AI-powered K–12 education products.

Argentina Brazil Chile Costa Rica Contract Senior QA Engineer SDET (Software Development Engineer in Test)
Agile AWS CI/CD CircleCI Datadog GCP Git GitHub Actions JavaScript Jest JIRA JMeter K6 LLM Locust Mocha New Relic Playwright Python Scrum Selenium TypeScript
1 month, 1 week ago
Jumio

SDE II - QA, (Fixed term Contract)

Jumio 251-1K IT Services

Jumio is hiring a Software Engineer II (QA) in Bangalore to help ensure the quality, reliability, and scalability of its identity verification products through automated testing across web, backend, and API systems.

India Contract Mid Level SDET (Software Development Engineer in Test) Software Engineer
Agile CI/CD Java JavaScript Machine Learning Playwright Postman REST API Selenium
1 month, 1 week ago
Resilient Co

SDET (Cards)

Resilient Co 11-50 Professional Services

Senior SDET focused on cards at a client organization, responsible for building and maintaining automated testing and validation for card-related systems across modern and legacy service environments.

Argentina Brazil Colombia Costa Rica Peru Contract Senior SDET (Software Development Engineer in Test)
Agile AWS Azure C# CI/CD Cypress Datadog Docker Gatling GCP GitHub Actions GitLab CI JMeter Kubernetes Microservices .NET OpenAPI Playwright Postman REST API Scrum Selenium SOAP Splunk TDD
1 month, 1 week ago
Oddin.gg

Sr QA Automation Engineer

Oddin.gg 51-250 Hotels, Restaurants & Leisure

Oddin.gg is hiring a QA Automation Lead Engineer to lead automation testing for its esports betting software platform and ensure high product quality across releases.

Czech Republic Contract Lead SDET (Software Development Engineer in Test)
Agile CI/CD Gatling Git Java Jenkins JMeter JUnit Playwright Python Scala Scrum Selenium TestNG
1 month, 2 weeks ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers