Senior Data Engineer - Databricks

Posted 3 Hours Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka
3-5 Years Experience
Artificial Intelligence • Big Data • Machine Learning
The Role
Senior Data Engineer role at Quantiphi focusing on delivering big data solutions using Pyspark, SQL, and various AWS services. Must have experience in cloud-based solutions, SQL optimization, and Databricks. Good to have skills include data migration and Redshift optimization.
Summary Generated by Built In

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Must have skills:

  • 3+ years’ of hands-on experience in delivering big data solutions

  • Experience with AWS - EMR, Redshift, Lambda, DynamoDB, S3, RDS, SQS, Glue

  • Experienced in using Airflow or Step Functions for orchestration 

  • Experience using Pyspark APIs and Inbuild functions

  • Experience building and deploying cloud-based solutions at scale

  • Experience in SQL and Query optimisation

Good to have skills : 

  • Prior experience in migrating (on-prem to cloud) and processing large amounts of data

  • Experience in implementing transactional data lake on the cloud using Hudi, Iceberg, or Delta Lake tables

  • Experience in Redshift optimization and implementing the industry's best practices

  • Experience in data loading to Redshift, heavy upserts, and WLM expertise 

  • Experience in Databricks

  • Experience with Snowflake Data Warehouse

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Top Skills

Pyspark
SQL
The Company
HQ: Marlborough, MA
3,494 Employees
On-site Workplace
Year Founded: 2013

What We Do

Quantiphi is an award-winning AI-first digital engineering company driven by the desire to solve transformational problems at the heart of business.
Quantiphi solves the toughest and complex business problems by combining deep industry experience, disciplined cloud, and data-engineering practices, and cutting-edge artificial intelligence research to achieve quantifiable business impact at unprecedented speed.

Jobs at Similar Companies

Fusion92 Logo Fusion92

Account Executive

AdTech • Agency • Digital Media • Enterprise Web • Marketing Tech • Analytics • Web3
IL, USA
263 Employees

ForeFlight Logo ForeFlight

Product Designer II

Aerospace • Software • App development
Remote
Austin, TX, USA
466 Employees

IonQ Logo IonQ

Lead Ion Trap Design Engineer

Artificial Intelligence • Hardware • Information Technology • Internet of Things • Software
Easy Apply
Seattle, WA, USA
305 Employees

Snap Inc. Logo Snap Inc.

Application Engineer, Salesforce UI

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
New York, NY, USA
5000 Employees

Similar Companies Hiring

Motive Thumbnail
Transportation • Software • Sales • Information Technology • Hardware • Fintech • Artificial Intelligence
San Francisco, CA
4000 Employees
TransUnion Thumbnail
Information Technology • Fintech • Financial Services • Cybersecurity • Business Intelligence • Big Data Analytics • Big Data
Chicago, IL
15000 Employees
Schrödinger, Inc. Thumbnail
Software • Pharmaceutical • Machine Learning • Healthtech • Biotech • Big Data • Artificial Intelligence
New York, NY
896 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account