Designs, builds, and maintains Azure-based data solutions and ETL pipelines using Azure Data Factory and Databricks. Manages SQL and MySQL databases, develops data models, optimizes queries, supports data governance and quality, and documents architectures and pipelines. Collaborates with data scientists, analysts, and business stakeholders to deliver reliable data for analysis and reporting. The role also involves security compliance and may include real-time processing, multi-cloud technologies, and machine learning concepts.
Job Title: Senior Azure Data Engineer
Location: Hyderabad
Job Type: Full-Time
Job Summary: As an Azure Data Engineer, you will design, build, and maintain data solutions on Microsoft Azure, leveraging your expertise in SQL and MySQL to ensure high-quality data availability for analysis and reporting. You will collaborate closely with cross-functional teams to meet data needs and enhance decision-making capabilities.
Key Responsibilities:
Data Pipeline Development: Design and implement ETL processes using Azure Data Factory and Azure Databricks, ensuring data integration from various sources.
Database Management: Develop and maintain relational databases using SQL and MySQL, ensuring optimal performance and reliability.
Data Modelling: Create and maintain data models to support analytical needs, ensuring data is structured for efficient querying and reporting.
Query Optimization: Write and optimize complex SQL queries for data retrieval and reporting, improving performance and efficiency.
Collaboration: Work with data scientists, analysts, and business stakeholders to understand data requirements and ensure data quality.
Security and Compliance: Implement data governance practices and ensure compliance with data protection regulations.
Documentation: Create and maintain comprehensive documentation for data pipelines, databases, and architectural designs.
Qualifications:
Bachelor’s degree
4+ years of experience in data engineering or related roles.
Strong proficiency in Microsoft Azure services, particularly Azure Data Factory, Azure Databricks, Azure SQL Database.
Familiarity with AWS services will be advantageous in our multi-cloud environment.
Extensive experience with SQL and MySQL, including database design, optimization, and data manipulation.
Familiarity with programming languages such as Python or spark for data processing and analysis.
Understanding of data warehousing concepts and big data technologies (e.g., Hadoop, Spark) is a plus.
Experience with data governance and data quality best practices.
Excellent problem-solving skills and attention to detail.
Strong communication skills and ability to work collaboratively in a team environment.
Preferred Qualifications:
Microsoft Azure Data Engineer certification.
Experience with real-time data processing and stream analytics.
Knowledge of machine learning concepts and tools.
Similar Jobs
Financial Services
Reviews marketing, sales, and promotional communications for accuracy, regulatory compliance, clarity, balance, and risk. Applies EMEA requirements, including ESMA, CSSF, and FCA expectations, while partnering with Marketing, Sales, Legal, Compliance, Audit, and Controls teams. Manages reviews and escalations, educates colleagues on communications standards, and improves control processes and efficiency across markets.
Top Skills:
CssfEsmaFca
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Oversee private equity fund accounting, NAV calculations, capital accounts, waterfalls, carried interest, fees, expenses, transactions, valuations, and financial reporting. Review statements and investor packages, manage audits, ensure LPA and accounting-standard compliance, coordinate with auditors and tax advisors, and lead a fund accounting team. Drive controls, process standardization, automation, and system enhancements while supporting clients, GPs, and internal stakeholders.
Top Skills:
GenevaIfrsInvestranLux GaapExcelUs Gaap
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Develop advanced avionics features for Honeywell’s ANTHEM cockpit platform. Responsibilities include analyzing customer and operational requirements, defining system architecture, managing requirements, integrating and testing systems, troubleshooting interfaces, conducting design reviews, and supporting SRR, PDR, and CDR milestones. The role requires collaboration across global teams, avionics certification knowledge, Agile development experience, and strong systems engineering expertise.
Top Skills:
AgileArp4754AAtlassian JiraAvionics ArchitectureAvionics SoftwareAvionics SystemsDisplay SystemsEpic/ApexIbm Rational Doors NgSystems EngineeringSystems Safety Analysis
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
