Designs, builds, and maintains scalable Azure data platforms and end-to-end pipelines. Develops streaming solutions with Airflow, Kafka, and Azure Functions; manages Cosmos DB and Blob Storage; implements governance and lineage through Azure Purview; collaborates on technical specifications; and monitors and optimizes pipeline performance.
Data Engineer (Azure Data Platforms)
Summary
We are seeking a skilled Data Engineer to design, build, and maintain robust data solutions within the IT Services sector. In this pivotal role, you will leverage advanced Azure technologies to architect scalable data pipelines and ensure the integrity and accessibility of critical business information. Your expertise will drive the optimization of data workflows, enabling seamless integration across diverse platforms and supporting strategic decision-making through reliable data infrastructure.
Responsibilities
- Architect and develop end-to-end data solutions utilizing the Azure ecosystem, including Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
- Implement real-time data streaming and processing capabilities using Apache Airflow, Kafka, and Azure Functions.
- Manage and optimize data storage strategies across Cosmos DB and Blob Storage to ensure high availability and performance.
- Establish comprehensive data governance and lineage tracking frameworks using Azure Purview to maintain compliance and data quality.
- Collaborate with cross-functional teams to translate business requirements into technical data specifications and scalable architectures.
- Monitor data pipeline performance, troubleshoot issues, and implement continuous improvements to enhance system efficiency.
Requirements
Requirements:
- Possess 3-6 years of hands-on professional experience in data engineering within the IT Services industry.
- Demonstrate proven proficiency with Azure data services, specifically Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Functions.
- Exhibit strong expertise in managing NoSQL databases (Cosmos DB) and object storage solutions (Blob Storage).
- Have practical experience implementing streaming data architectures using Apache Airflow and Kafka.
- Understand and apply data governance principles using tools like Azure Purview.
- Hold a competitive salary expectation aligned with the market rate of ₹10 LPA for the specified experience level.
Similar Jobs
.jpg)
Fintech • Analytics
Principal Engineer responsible for architecting and implementing large-scale data platforms, batch and streaming pipelines, data models, microservices, APIs, and resilient cloud systems across on-premises and Azure environments. The role establishes data quality, observability, CI/CD, and DevOps standards while contributing hands-on code. It also drives responsible Generative and Agentic AI adoption, mentors engineers, influences senior stakeholders, and advances engineering innovation without direct people management.
Top Skills:
Agentic AiAzureAzure OpenaiBatch ProcessingCi/CdData WarehousingDevOpsEltETLGenerative AiJavaLarge Language ModelsMicroservicesPrompt EngineeringPythonRag PipelinesRelational DatabasesRest ApisSQLStreaming Data Pipelines
Fintech • Financial Services
Provides enterprise technical leadership for complex engineering challenges across networking, application delivery, information security, databases, operating systems, and web technologies. Defines architecture and engineering standards, leads hybrid-cloud modernization, and designs highly available, scalable, secure infrastructure using F5 BIG-IP and AVI load balancers. Drives automation, Infrastructure as Code, DevOps, resiliency, production support, and incident resolution while advising leadership, influencing strategy, and mentoring engineers.
Top Skills:
AnsibleAvi Load BalancerAWSAzureCi/CdCiscoDnsF5 Big-IpGCPGtmKubernetesLtmOpenshiftPythonSite Reliability EngineeringSsl/TlsTcp/IpTerraformVMwareWafZero Trust
Fintech • Financial Services
Owns product demand, roadmaps, backlogs, requirements, Agile delivery, testing, release readiness, governance, and executive reporting across market maker and options clearing. Coordinates Product, Technology, Operations, Risk, Compliance, Finance, and Control stakeholders while managing dependencies, risks, controls, regulatory initiatives, and process improvements. Supports automation, analytics, AI enablement, production governance, and operational readiness for clearing and post-trade capabilities.
Top Skills:
Agile Delivery MethodologiesAi-Enabled ToolsAnalyticsJIRALow-Code PlatformsExcelMS OfficeMicrosoft PowerpointMicrosoft WordWorkflow Automation
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
