Senior Data Engineer - Pyspark + AWS

Posted 15 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka
5-7 Years Experience
Artificial Intelligence • Big Data • Machine Learning
The Role
Senior Data Engineer role at Quantiphi. Responsibilities include building cloud-native solutions, working on data pipelines, SQL optimization, mentoring junior engineers, and more. Good to have skills include ML model migration and data governance.
Summary Generated by Built In

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Role: Data Engineer (Senior/Associate)

Experience: 4+ Years

Work location: Mumbai/ Bangalore/Trivandrum (Hybrid)

Responsibilities:

  • Experience: 6+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions.
  • AWS (Redshift, S3, Glue, Lambda, Airflow), Pyspark, Python, Data pipelines using Glue/Airflow/Sagemaker.
  • Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases Exposure to ETL tools and Data warehouse.
  • Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB,SQL Server etc.)
  • Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.
  • Experience building and supporting large-scale systems in a production environment.
  • Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads.
  • Experience using Github/codecommit for developmental activities

Good to have skills:

  • Experience in leading enterprise grade ML model migration workloads from on-premise/GCP to AWS.
  • Experience in designing relational, multidimensional , and Master data management systems.
  • Ability to collaborate with cross-functional teams such as Developers, QA, Project Managers, and other stakeholders to understand their requirements and implement solutions.
  • Ability to clearly communicate technical roadmap, challenges and mitigation.
  • Established data governance policies, procedures, and standards.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Top Skills

Pyspark
Python
SQL
The Company
HQ: Marlborough, MA
3,494 Employees
On-site Workplace
Year Founded: 2013

What We Do

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business.
Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.

Jobs at Similar Companies

Alliant Credit Union Logo Alliant Credit Union

Data Analyst - Hybrid

Fintech • Financial Services
Hybrid
Chicago, IL, USA
843 Employees
Easy Apply
Remote
United States
985 Employees
Hybrid
Chicago, IL, USA
843 Employees

AffiniPay Logo AffiniPay

Sales Operations Manager

Fintech • Legal Tech • Payments • Sales • Software
Remote
United States
519 Employees

Similar Companies Hiring

Motive Thumbnail
Transportation • Software • Sales • Information Technology • Hardware • Fintech • Artificial Intelligence
San Francisco, CA
4000 Employees
TransUnion Thumbnail
Information Technology • Fintech • Financial Services • Cybersecurity • Business Intelligence • Big Data Analytics • Big Data
Chicago, IL
15000 Employees
Schrödinger, Inc. Thumbnail
Software • Pharmaceutical • Machine Learning • Healthtech • Biotech • Big Data • Artificial Intelligence
New York, NY
896 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account