About CertifyOS
CertifyOS is building the data infrastructure that powers modern healthcare.
Today, healthcare organizations rely on fragmented and outdated provider data. This creates unnecessary administrative work, regulatory risk, and higher costs across the system. We’re solving that problem.
Our API-first platform automates provider licensing, enrollment, credentialing, and network monitoring by connecting directly to hundreds of primary data sources. We help healthcare organizations maintain accurate, compliant, and reliable provider networks at scale.
Our vision is simple: One API. One provider ID. Frictionless provider data.
We’re backed by leading investors and built by a team with deep experience in provider data systems. At CertifyOS, we value authenticity, accountability, collaboration, results, and openness to feedback. We’re building a high-ownership team focused on solving real infrastructure problems that impact millions of patients.
About the RoleWe are looking for an AI-first Software Development Engineer in Test (SDET) to help us build reliable, scalable, and high-quality software.
This role goes beyond traditional QA and test automation. You will leverage AI-assisted engineering and agentic workflows to accelerate test development, improve test coverage, automate quality checks, and identify performance and scalability issues.
You will work closely with developers, product managers, and engineering leaders to embed quality throughout the software development lifecycle.
We expect you to think like a software engineer, automate like an SDET, and use AI as a force multiplier.
Key Responsibilities1. AI-First Quality EngineeringAdopt AI-assisted and agentic approaches across the testing lifecycle.
Use AI coding agents to generate, execute, debug, and maintain automated tests.
Build AI-assisted workflows for test case generation from product specifications and acceptance criteria.
Explore agentic testing approaches that can independently execute workflows, identify failures, and report defects.
Use AI to analyse test failures, identify patterns, and suggest potential root causes.
Continuously identify opportunities to reduce manual effort through AI and automation.
Build and maintain scalable automation frameworks for UI, API, integration, and end-to-end testing.
Develop reusable test components and automation libraries.
Automate critical business workflows and regression suites.
Integrate automated testing into CI/CD pipelines.
Use Playwright, Cypress, Selenium, or equivalent frameworks.
Design and execute load, stress, spike, and endurance tests.
Simulate real-world traffic, concurrent users, and high-volume API requests.
Establish performance benchmarks and service-level objectives.
Identify bottlenecks across APIs, databases, microservices, and infrastructure.
Use tools such as k6, JMeter, Locust, or Gatling.
Analyse latency, throughput, resource utilisation, and error rates.
Work with developers to identify and resolve performance bottlenecks.
Validate application behaviour as traffic, data volume, and workloads increase.
Identify scalability limitations across distributed systems.
Test asynchronous workflows, queues, event processing, retries, and failure recovery.
Evaluate database performance and query efficiency under load.
Identify resource constraints and potential points of failure.
Contribute to capacity planning and reliability improvements.
Work with developers and product managers to identify quality risks early.
Participate in technical design and code reviews.
Define quality gates and automation standards.
Build a culture where quality is everyone’s responsibility.
3–6 years of experience in software testing and automation engineering.
Strong programming skills in Python, Java, or JavaScript/TypeScript.
Hands-on experience with Playwright, Cypress, or Selenium.
Strong API automation and backend testing experience.
Experience with performance testing tools such as k6, JMeter, or Locust.
Understanding of microservices and distributed systems.
Good knowledge of SQL and database testing.
Experience integrating automated tests into CI/CD pipelines.
Practical experience using AI coding assistants and AI agents.
Ability to analyse logs, metrics, and performance bottlenecks.
We expect candidates to:
Be comfortable working with AI coding agents such as Claude Code, Cursor, or GitHub Copilot.
Use AI to generate test scenarios, automation scripts, and test data.
Understand how to validate AI-generated code and prevent unreliable tests.
Explore agentic workflows for autonomous test execution and failure analysis.
Build reusable AI-powered testing workflows rather than relying only on manual prompting.
Experience with AWS or GCP.
Familiarity with Docker and Kubernetes.
Experience with Kafka or other messaging systems.
Exposure to Grafana, Prometheus, Datadog, or similar observability tools.
Knowledge of chaos engineering and resilience testing.
Experience with database performance tuning.
AI-assisted automation across critical product workflows.
Reduced manual testing and regression effort.
Faster feedback through automated quality gates.
Reliable performance benchmarks for critical APIs and workflows.
Early detection of performance and scalability bottlenecks.
Improved release confidence as product traffic and data volumes grow.
Continuous improvement in engineering productivity through AI adoption.
Benefits of Working at Certify
At Certify, we’re building with intention and taking care of the people doing the work.
Your well-being matters to us. We provide 100% coverage of health, dental, and vision insurance premiums for employees. Our US-based team benefits from unlimited PTO, with at least two weeks off each year to recharge. In India, employees are supported with health insurance, statutory leave benefits, and additional wellness (menstrual) leave for women.
We are an equal opportunity employer committed to building an inclusive environment where everyone feels valued and empowered to do their best work, and we welcome applicants from all backgrounds and experiences.
If you require reasonable accommodations during the application process, please contact [email protected].
We are also committed to pay transparency and foster an open culture where compensation conversations are encouraged and respected.
