Pramana Labs Logo

Pramana Labs

QA Engineer, AI Verification Systems

Posted 12 Days Ago
Be an Early Applicant
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Mid level
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Mid level
Test a rules-to-proof AI product across rule inputs, formal specifications, prover outputs, proof artifacts, APIs, and proof viewers. Identify functional defects, edge cases, security risks, malformed inputs, conflicting rules, and data-handling issues. Create reproducible bug reports, verify fixes, and progressively automate testing using Python, pytest or similar frameworks, and CI/CD tools.
The summary above was generated by AI
Company

Pramaana Labs is a frontier AI lab building the verification layer for AI. Founded in 2025 and headquartered in Palo Alto, we turn complex human knowledge, including tax codes, legal rules, clinical guidelines and security protocols, into a formal representation, so every AI answer can be traced, challenged, and proved. Pramaana's architecture pairs foundation models trained to formalize and reason with a symbolic world model encoded in Lean 4. Pramaana was founded by a team out of Google, DeepMind, and Glean, combining frontier AI researchers and formal methods experts.

The Role

QA/SDET (Software Development Engineer in Test) for a rules-to-proof product. You test every stage of the pipeline, from rule input through formal specs, prover output and proof artifacts to the customer-facing APIs and proof viewers. You raise clear, reproducible defects and verify fixes.

Focus areas: Corner cases and security risks, including exceptions, thresholds, conflicting rules, unsatisfiable inputs, malformed or malicious input, and access and data-handling issues.

Long-term goal: Automate these tests so problems are flagged without manual intervention.

What You'll Do
  • Test the different parts of the product for functionality, from rule input through formal specs, prover output and proof artifacts to the customer-facing APIs and proof viewers. Raise clear, reproducible defects and verify fixes.

  • Cover corner cases and potential security issues, including exceptions, thresholds, conflicting rules, unsatisfiable inputs, malformed or malicious input, and access and data-handling risks.

  • As time goes on, work on automating these tests so that these are flagged without manual intervention.

You Will Thrive in This Role If You Have
  • 3+ years in QA, SDET or ML/LLM evaluation, hands-on test automation experience (Python preferred)

  • Experience testing non-deterministic or data-heavy systems (LLMs, ML pipelines, rules engines).

  • Automation and CI/CD experience (pytest or similar, GitHub Actions or Jenkins).

  • Logical rigor: edge cases, constraints, counterexamples.

  • Ability to turn dense rule-based text into precise test cases, and to write clear bug reports.

Especially Strong Candidates May Also Have
  • LLM eval and benchmark design.

  • Tax, law or compliance background.

  • Property-based testing and API testing.

Similar Jobs

59 Minutes Ago
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Fintech • Financial Services
Leads software engineering initiatives focused on generative AI. Designs, codes, tests, debugs, documents, and deploys complex technology solutions while guiding less experienced engineers. Develops AI and machine learning applications, including RAG pipelines, model training, tuning, microservices, cloud infrastructure, integrations, CI/CD, observability, and DevOps practices. Collaborates with technical stakeholders, resolves complex issues, supports enterprise risk and compliance requirements, and evaluates emerging technologies through proofs of concept.
Top Skills: AjaxAngularAnsibleSparkAWSAzureDatadogDevOpsElk StackGoogle Cloud Platform (Gcp)GrafanaHadoopHarnessInfrastructure As CodeJavaScriptJenkinsJqueryLangchainLanggraphLarge Language Models (Llms)MicroservicesPrometheusPythonPyTorchReactRestRetrieval-Augmented Generation (Rag)ServicenowSoapTensorFlowTest-Driven DevelopmentVector Databases
59 Minutes Ago
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Fintech • Financial Services
Supports institutional investment operations through trade processing, transaction reconciliation, inquiry research, exception resolution, documentation review, and operational issue management. Maintains risk, audit, compliance, and control requirements; recommends process improvements; participates in initiatives; and guides less experienced team members. Collaborates with internal and external stakeholders to deliver accurate, timely services. Requires at least two years of institutional investment operations experience and availability for a 5:30 PM to 2:30 AM shift.
59 Minutes Ago
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
Junior
Junior
Fintech • Financial Services
Develop, test, debug, document, upgrade, and deploy Java full-stack applications and microservices. Improve service quality and availability, evaluate technology solutions, resolve technical issues, and support security and compliance requirements. The role requires strong experience with Java, microservices architecture, APIs, cloud and distributed systems, Angular front-end development, testing frameworks, observability tools, and modern architectural patterns. Candidates may also lead a small technical team and contribute to Scrum-based development.
Top Skills: Ai ToolsAngularAngularjsApigeeAppdynamicsAWSBootstrapCucumberDistributed LoggingDistributed TracingDomain-Driven DesignElk StackFongoGitGradleJ2EeJavaJunitKafkaMicroservicesMockitoMongoDBPcfPrimengRdbmsService DiscoveryService MeshSplunkSpring Cloud GatewayTestng

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account