Designs and maintains enterprise Azure data solutions using Synapse Analytics and Databricks. Develops scalable pipelines, data models, SQL optimizations, and PySpark/Python transformations. Creates Power BI dashboards, implements data governance with Unity Catalog, and explores Generative AI through Databricks Genie. Collaborates with cross-functional teams to define requirements and deliver high-quality analytics engineering solutions.
Summary
We are seeking a highly skilled Azure Data Engineer to join our IT Services team. In this pivotal role, you will design, build, and maintain robust data solutions that drive business intelligence and analytics. You will be responsible for architecting scalable data pipelines and leveraging advanced technologies to transform raw data into actionable insights, ensuring our organization stays at the forefront of data innovation.
Responsibilities
- Design and implement enterprise-grade data solutions using Azure Synapse Analytics and Azure Databricks.
- Develop sophisticated data models and optimize database performance through advanced SQL scripting and data modeling techniques.
- Create interactive dashboards and reports using Power BI to support strategic decision-making across the organization.
- Engineer scalable data processing workflows utilizing PySpark and Python for complex data transformations and analysis.
- Implement and manage data governance frameworks, including the use of Unity Catalog within the Azure Databricks ecosystem.
- Explore and integrate Generative AI capabilities, specifically leveraging tools like Databricks Genie, to enhance data processing and analytics.
- Collaborate with cross-functional teams to define data requirements and deliver high-quality engineering solutions.
Requirements
Requirements:
- Possess 8 to 12 years of professional experience in data engineering and related technical fields.
- Demonstrate deep expertise in Azure Synapse, Azure Databricks, and Unity Catalog environments.
- Show proficiency in Generative AI applications, including experience with Databricks Genie.
- Be highly skilled in PySpark and Python for coding, scripting, and data manipulation tasks.
- Exhibit strong command of SQL and SQL scripting for complex query optimization and data extraction.
- Have a proven track record in data modeling and architecture design.
- Display the ability to create compelling visualizations and reports using Power BI.
- Hold a competitive salary expectation aligned with the market range of ₹22-24 LPA.
Similar Jobs
.jpg)
Fintech • Analytics
Principal Engineer responsible for architecting and implementing large-scale data platforms, batch and streaming pipelines, data models, microservices, APIs, and resilient cloud systems across on-premises and Azure environments. The role establishes data quality, observability, CI/CD, and DevOps standards while contributing hands-on code. It also drives responsible Generative and Agentic AI adoption, mentors engineers, influences senior stakeholders, and advances engineering innovation without direct people management.
Top Skills:
Agentic AiAzureAzure OpenaiBatch ProcessingCi/CdData WarehousingDevOpsEltETLGenerative AiJavaLarge Language ModelsMicroservicesPrompt EngineeringPythonRag PipelinesRelational DatabasesRest ApisSQLStreaming Data Pipelines
Artificial Intelligence • Cloud • Fintech • Information Technology • Analytics • Financial Services • Cybersecurity
Designs and maintains scalable Azure data pipelines, ETL processes, integrations, and data models supporting Procurement modernization. Uses Azure Data Factory, Data Lake, Azure SQL, Functions, Terraform, SQL, and Python. Collaborates with technical and business stakeholders, optimizes performance and cost, implements security controls, troubleshoots production issues, documents architecture, and contributes to testing, deployments, and code reviews.
Top Skills:
Azure Data FactoryAzure Data LakeAzure DatabricksAzure FunctionsAzure SqlAzure StorageCi/CdPythonReactSQLTerraform
Edtech • HR Tech • Information Technology • Professional Services
Designs, builds, and maintains scalable Azure data platforms and end-to-end pipelines. Develops streaming solutions with Airflow, Kafka, and Azure Functions; manages Cosmos DB and Blob Storage; implements governance and lineage through Azure Purview; collaborates on technical specifications; and monitors and optimizes pipeline performance.
Top Skills:
Apache AirflowApache KafkaAzure Blob StorageAzure Data FactoryAzure DatabricksAzure FunctionsAzure PurviewAzure Synapse AnalyticsCosmos DbNoSQL
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
