Prodigal Logo

Prodigal

Data Engineer

Posted 24 Days Ago
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Junior
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Junior
Build and manage scalable data pipelines in Databricks, transform raw data with SQL and dbt, and produce reliable data assets. Collaborate across teams to deliver insights for products, AI, and business decisions. Support machine learning research by validating model performance, optimize data processing and reporting, and work with AWS services, Airflow, visualization tools, and databases.
The summary above was generated by AI
About Prodigal

Prodigal is the connected AI platform leading financial institutions use to run their operations.

We work with banks, lenders, credit unions, and other financial companies that lend money to people and manage those relationships over time.

These institutions make millions of high-stakes decisions every day. Who should they reach? When should they reach them? What should they say or offer? When should a case move to a human? How should that change based on the borrower, the account, previous interactions, and the regulations involved?

Getting those decisions right requires a deep understanding of the people, processes, rules, and edge cases behind them.

Prodigal has spent the last eight years building that understanding. More than a billion interactions between financial institutions and their customers have shaped the intelligence, guardrails, and AI agents we now run in production across North America.

Today, our AI agents analyze conversations, capture context, guide human agents, decide the next action, conduct customer conversations, orchestrate outreach, and help people complete payments and resolutions. They are connected, so what is learned in one interaction can inform what happens next.

We are expanding this swarm of AI agents across more of the work financial institutions do: originations, document processing, back-office workflows, servicing, and other critical operations where money, identity, people, and regulation intersect.

We are backed by Y Combinator, Accel, and Menlo Ventures, and work with 100+ financial institutions across North America. Listen directly from our CTO, Cofounder - Sangram Raje

About the role - 

We are looking for a passionate and driven Data Engineer to join our team. You will be instrumental in building scalable data pipelines, generating powerful insights, and supporting our AI/ML initiatives. If you enjoy working across data engineering and analytics and want to help shape the future of Agentic AI, we'd love to hear from you!

🏆 Responsibilities
  • Design, build and manage robust data pipelines for collecting, transforming and modeling data within our Databricks data lake - dbt is your primary tool, not an afterthought
  • Own the dbt layer end to end - models, sources, tests, macros, incremental strategies and documentation. If it touches transformation, it goes through dbt and you're accountable for it being clean, tested and re-runnable
  • Turn raw, messy data into reliable, well-modeled assets that downstream teams can actually trust - no untested models, no undocumented logic, no shortcuts
  • Collaborate closely with cross-functional teams to deliver actionable insights that drive product, AI and business decisions - translating business logic into dbt models that are built to last
  • Support AI and ML initiatives by ensuring clean, validated and well-structured data is always available when the models need it
  • Identify and fix performance bottlenecks in dbt models, Databricks queries and downstream reporting pipelines
✅ Requirements 
  • 2-3 years of hands-on experience in data engineering - you've built things in production, not just in notebooks
  • Strong SQL - you can write and reason about complex joins, aggregations and window functions, and you know why a query is slow before you tune it
  • Python for data engineering with production-grade PySpark or Spark SQL experience. Databricks strongly preferred
  • Dimensional modeling - star schemas, fact vs dimension grain, SCD Type 2, and incremental loads you can confidently re-run without breaking things
  • dbt as your transformation framework of choice - models, tests, sources and incremental strategies are second nature to you
  • AWS hands-on experience across Lambda, S3, CloudFront, SQS and beyond
  • AI-native workflow - we ship with Claude Code and Cursor and we expect you to use them well, not just know they exist
  • Sharp problem solving - you find the right balance between getting it right and getting it done, and communicate clearly when tradeoffs are being made
  • Self-driven and curious - you thrive in fast paced environments, pick things up quickly and keep an eye on what's emerging in the data ecosystem
  • Bonus - Foundational knowledge in ML/AI fundamentals


Mode of Work - In-Office (Koramangala,Bengaluru)

⚙️ Our Tech Stack
  • Products built using Python, Cursor, Claude, dbt, Airflow
  • Databases such as MongoDB, PostgreSQL, Redis, Databricks, 
  • Deployments on EKS, EC2, Lambda and other AWS services
🎁 What we offerTop Tier Benefits 

Health insurance for you and your family, meals at office on us, travel reimbursement, unlimited leaves, subsidized gym membership, unlimited learning & development, flexible work schedule and a world-class team to learn and grow with! 

From day 1, Prodigal has been defined by talented, humble, and hungry leaders and we want this mindset and culture to continue to blossom from top to bottom in the company. If you have an entrepreneurial spirit and want to work in a fast-paced, intellectually-stimulating environment where you will be pushed to grow, then please reach out because we are looking to build a transformational company that reinvents one of the biggest industries in the US.

To learn more about us - please visit the following:

Our Story - https://www.prodigaltech.com/our-story

What shapes our thinking - https://link.prodigaltech.com/our-thesis

Our website - https://www.prodigaltech.com/ 

Similar Jobs

2 Days Ago
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Expert/Leader
Expert/Leader
Artificial Intelligence • Cloud • Information Technology • Consulting
Leads complex supply chain planning and operations, including inventory, demand and supply matching, import/export, sales and operations planning, and trade compliance. Drives process improvements, performance metrics, cross-functional planning, demand signals, and strategic projects across global business units and supply bases. Manages regulatory trade compliance programs, mentors junior staff, and applies analytics, financial modeling, MRP, ATP, and master scheduling expertise.
Top Skills: Available-To-Promise (Atp)Material Requirements Planning (Mrp)ExcelMS OfficeMicrosoft Powerpoint
2 Days Ago
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Information Technology • Machine Learning • Software • Conversational AI • Generative AI • Manufacturing
Designs and owns production ETL/ELT pipelines, medallion architectures, data transformations, validation, monitoring, lineage, and orchestration. Builds GenAI and RAG services, REST APIs, and scalable backend capabilities using Spark and Databricks. Improves retrieval quality, system reliability, observability, data modeling, and performance while contributing to architecture decisions and frontend integrations.
Top Skills: AngularSparkApi GatewaysCi/CdDatabricksDelta LakeDockerFastapiGitLlm ApisLoggingMicroservicesMonitoringPysparkPythonReactRest ApisSQLVector Search
4 Days Ago
Remote or Hybrid
India
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design and build data services and pipelines supporting machine learning products. Develop automation tools for model deployment, maintain production data systems, improve infrastructure, participate in code reviews, and collaborate across engineering, data science, and product teams. The role requires expertise in distributed systems, large-scale data processing, CI/CD, container orchestration, and AI-enabled workflow improvements.
Top Skills: AirflowAWSAws BatchCi/CdDockerEmrGlueGoKafkaKubernetesKv StoresLinuxPythonRelational DatabasesSagemakerSparkSpinnaker

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account