Lead the design and implementation of data engineering solutions on AWS, focusing on scalable data pipelines, data lakes, and warehouses, while mentoring teams and ensuring data quality.
Senior Lead Data Engineer
Primary Skills
- ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures
Specialization
- Databricks Engineering: Principal Data Engineer
Job requirements
- verall 8+ years of experience in Lead the design, development, and implementation of data engineering solutions on AWS cloud. Architect and build scalable data pipelines using Spark, PySpark, and Python. Design and implement data lakes and data warehouse solutions to support analytics and reporting needs. Develop optimized SQL queries and transformations for large-scale data processing. Create and maintain data models (dimensional and normalized) to support business intelligence and analytics use cases. Ensure data quality, integrity, and performance optimization across data pipelines. Collaborate with data architects, BI teams, and business stakeholders to translate requirements into scalable data solutions. Provide technical leadership and mentorship to data engineers. Drive best practices in coding standards, data governance, and performance tuning. Participate in architecture discussions, design reviews, and project planning. Ensure timely delivery of data engineering solutions an
Top Skills
AWS
Data Modelling
Data Warehousing
Databricks
ETL
Plsql
Pyspark
Python
Spark
SQL
T-Sql
Similar Jobs
Information Technology
Lead Data Engineer responsible for advanced AWS Data Engineering focusing on various tools and technologies, including Athena, Spark, DynamoDB, and more.
Top Skills:
Amazon Api GatewayAthenaCloudFormationCloudwatchDmsDynamoDBEmrKinesisMacieOozieOpen SearchRedshiftScalaSctSparkSqs
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
As a Sr. Analyst in Data Science and Analytics, you'll utilize tools like SQL and R to drive analytics and insights. You will need to manage projects independently, possess strong communication skills, and be open to travel as required.
Top Skills:
HiveRSparkSQLTableau
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
The role requires analyzing data using various tools, requiring 3+ years of experience and strong communication skills.
Top Skills:
HiveRSparkSQLTableau
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
