Lead the design and development of data pipelines for structured and unstructured data in Azure using services like Synapse and Data Factory. Collaborate with business stakeholders and ensure data modeling and ETL fundamentals are implemented effectively.
Lead Data Engineer
Expereince:6 to 9 yrs
Location: Bangalore,Hyderabad
JD:
Design, develop, document, and test data pipelines that ingest and store data from structured and unstructured sources in Azure using cloud services like Azure Synapse, Azure Data Factory.
o Experience Developing complex data pipelines
o Azure Synapse knowledge working experience
o Azure Data factory Experience
o SQL and Python (Pyspark desirable) Experience
o Databricks or Synapse notebooks Experience
o Source control knowledge
o Very good communication and ability to work directly with business
Primary Skills
- Data Modelling Fundamentals, Data Warehousing, ETL Fundamentals, Modern Data Platform Fundamentals, PLSQL, T-SQL, Stored Procedures, Python, SQL, SQL (Basic + Advanced)
Specialization
- Databricks Engineering: Data Engineer
Job requirements
- o Design, develop, document, and test data pipelines that ingest and store data from structured and unstructured sources in Azure using cloud services like Azure Synapse, Azure Data Factory. o Experience Developing complex data pipelines o Azure Synapse knowledge working experience o Azure Data factory Experience o SQL and Python (Pyspark desirable) Experience o Databricks or Synapse notebooks Experience o Source control knowledge o Very good communication and ability to work directly with business
Top Skills
Azure Data Factory
Azure Synapse
Databricks
Plsql
Pyspark
Python
SQL
T-Sql
Similar Jobs
Software
As a Senior Data Engineer, you will design and maintain scalable data pipelines, optimize ETL processes, and collaborate with data teams to enhance data analytics capabilities.
Top Skills:
AirflowSparkAWSAzureCi/CdDockerFlinkGCPGitKafkaKubernetesPysparkScalaSparkSQLTfxVertex Ai
Digital Media • Information Technology • Analytics
The Senior Data Engineer leads complex data analysis projects, builds scalable ETL pipelines, manages client relationships, and provides technical solutions using SQL and Python in AWS environment.
Top Skills:
AirflowAWSAws AthenaGitGlueLambdaPysparkPythonS3SQLYaml
Consulting • PropTech
The Senior Data Engineer will design and build scalable data pipelines, collaborate with data scientists, optimize ETL processes, and ensure high-quality software solutions.
Top Skills:
Apache AirflowSparkAWSAzureGCPPysparkPythonSQL
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
