Design, develop, and maintain scalable data pipelines and platforms using Microsoft Fabric and Azure, implementing ETL solutions and managing data integration.
Note: Only CV which are as per JD will be contacted.
Job Title: Data Engineer / Senior Data Engineer
Location : UAE - Onsite
Role Purpose
Job Title: Data Engineer / Senior Data Engineer
Location : UAE - Onsite
Role Purpose
Design, develop, and maintain scalable data pipelines and modern data platforms using Microsoft Fabric and Azure ecosystem. The role involves building efficient data solutions that support analytics, reporting, and advanced data use cases across the organization.
Key Responsibilities- Design, build, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF) and Microsoft Fabric
- Develop and optimize data workflows using PySpark and SQL
- Implement and manage Lakehouse architecture using Medallion (Bronze, Silver, Gold) layers
- Work with Azure Data Lake Storage (ADLS) and Delta Lake for efficient data storage and processing
- Integrate data from multiple sources ensuring data quality, consistency, and reliability
- Collaborate with BI developers and analysts to enable data models and reporting solutions
- Monitor, troubleshoot, and optimize data pipelines and performance issues
- Ensure data governance, security, and compliance best practices
- Lead the design and architecture of scalable data platforms and solutions
- Define data engineering standards, best practices, and frameworks
- Mentor junior data engineers and review code for quality and performance
- Optimize large-scale data processing and improve system efficiency
- Collaborate with stakeholders to translate business requirements into technical solutions
- Drive adoption of Microsoft Fabric and modern data engineering practices across teams
- Hands-on experience with Azure Data Factory (ADF) and ADLS
- Strong programming skills in PySpark and SQL
- Experience in building ETL pipelines and working with structured/unstructured data
- Basic understanding of Lakehouse and Medallion architecture
- Familiarity with Delta Lake concepts
- Good problem-solving and debugging skills
- Extensive experience in Azure data ecosystem and Microsoft Fabric
- Strong expertise in designing end-to-end data architectures
- Deep understanding of Lakehouse, Medallion architecture, and Delta Lake
- Proven experience in handling large-scale distributed data processing
- Strong performance tuning and optimization skills
- Experience leading projects and mentoring teams
- Experience in Azure Databricks
- Knowledge of data modeling and data warehousing concepts
- Exposure to data governance and data quality frameworks
- Experience working in Agile environments
- Strong communication and stakeholder management skills
- Analytical thinking and problem-solving mindset
- Ability to work independently and in a collaborative team environment
Top Skills
Azure Data Factory
Azure Data Lake Storage
Delta Lake
Lakehouse Architecture
Microsoft Fabric
Pyspark
SQL
Similar Jobs
Artificial Intelligence • Hardware • Information Technology • Security • Software • Cybersecurity • Big Data Analytics
The Senior Software Engineer will analyze, develop, design, and maintain software, focusing on VoIP solutions and mobile applications. Experience in C, multithreading, and telecom protocols is required, along with strong communication skills.
Top Skills:
CH264RtcpRtpSipTcp/UdpVoip
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
As a Senior Data Engineer II, you will lead the design and implementation of data solutions, manage large-scale data pipelines, and mentor junior engineers, ensuring data quality and collaboration across teams.
Top Skills:
AWSAzureDatabricksDbtDeltaFeature StoresGCPMlflowPythonSparkSQLVector Databases
.png)
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
The Sr. Data Engineer will design, build, and maintain scalable data pipelines, optimize processes, and ensure data integration using GCP and various data engineering tools.
Top Skills:
Apache AirflowBigQueryDataflowDataprocDbtETLGCPGitGoogle Cloud PlatformPythonSQL
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
