Role : Azure Data Engineer - Lead
Exp: 8+ yrs
Loc: Bangalore / Noida (Hybrid)
Job Description :
- Data Engineering with Databricks:
- Design, implement, and optimize data pipelines in Databricks to process large-scale structured and unstructured data.
- Develop ETL workflows for data ingestion, transformation, and integration using Databricks and other cloud-based tools.
- Implement Delta Lake for efficient data management and real-time data processing.
- Collaborate with data architects and stakeholders to build scalable and reusable data solutions.
- Leverage Databricks' MLflow for managing and deploying machine learning workflows, if required.
- Ensure data quality, integrity, and compliance with organizational standards and governance policies.
Required Skills & Qualifications:
- Education: Bachelor’s or master’s degree in computer science, Data Analytics, Information Technology, or a related field.
- Technical Proficiency:
- Hands-on experience with Databricks: Spark, Pyspark, Scala, or SQL
- Strong understanding of database concepts and working experience with SQL/NoSQL databases.
- Analytical Skills: Strong ability to analyse, interpret, and visualize large datasets.
- Problem Solving: Demonstrated ability to troubleshoot complex data workflows and reporting challenges.
- Soft Skills: Strong written and verbal communication, collaboration, and stakeholder management.
Similar Jobs
Be an Early Applicant
As a Senior Azure Data Engineer, you'll develop software and systems for large-scale data engineering projects, work across all phases of the SDLC, and innovate technology services for Fortune clients, focusing on Azure tools and enterprise data solutions.
Be an Early Applicant
As an Azure Data Engineer, you will design and implement data solutions, collaborate on large-scale projects, and utilize cloud technology to solve business problems. You will take part in the software development lifecycle and integrate various technologies for enterprise-level applications, ensuring high-quality delivery and performance.
Be an Early Applicant
As an Azure Data Engineer, you will innovate and build technology services to deliver large-scale data engineering solutions for Fortune clients. Responsibilities include software development across all phases of the SDLC, system integration, and enabling analytics using cloud technologies. You will also be engaging with global consulting teams and helping architect advanced cloud solutions.
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
