Leads enterprise data engineering strategy and designs scalable cloud and hybrid data architectures. Responsibilities include building high-volume ETL/ELT pipelines, modernizing data platforms, implementing governance and security, supporting streaming analytics and machine learning workloads, and establishing DataOps practices. The role provides technical leadership and mentorship, partners with data science and product teams, translates business requirements into technical solutions, and develops REST APIs and Azure PaaS solutions.
Job Title: Data Engineer - Lead
Experience Required: 8+ Years
Location: Hyderabad/Ahmedabad
Employment Type: Full-time
Position Overview
We are seeking an experienced Data Engineer with over 8 years of experience in designing, developing, and optimizing enterprise-scale data solutions. The ideal candidate will lead our data engineering strategy, architect cloud-based data platforms, and mentor engineering teams to deliver scalable and reliable data systems that power business intelligence, AI, and analytics.
Roles & Responsibilities
· Design and implement modern data architectures across cloud and hybrid environments.
- Develop and optimize data pipelines and ETL/ELT processes for high-volume, high-velocity data.
- Lead data platform modernization initiatives using cutting-edge tools and frameworks.
- Define and enforce data governance, security, and compliance standards.
- Partner with Data Science, BI, and Product teams to ensure data availability, accuracy, and performance.
- Provide technical leadership and mentorship to data engineers and developers.
- Implement DevOps/Data Ops practices for automated testing, deployment, and monitoring.
- Continuously evaluate and introduce innovative data technologies that enhance efficiency and scalability.
- Translate business requirements into robust and scalable technical data solutions.
- Support real-time and streaming data architectures for analytics and ML workloads.
- Designing and developing REST APIs / Azure App Services and implementing Azure PaaS solutions.
Required Skills & Qualifications
- Bachelor’s or master’s in computer science, Engineering, or related field.
- 8+ years in Data Engineering or Data Architecture roles.
- Expertise in Python, SQL, Spark, Kafka, and Airflow.
- Proven experience with cloud platforms (AWS, Azure, or GCP).
- Hands-on experience with Snowflake, Databricks, or Delta Lake.
- Strong understanding of data modelling, governance, and lineage tools.
- Excellent problem-solving, leadership, and communication skills.
Good to Have Skills:
· C#, .NET Core, Azure PaaS, Problem-Solving, REST API Development, EF Core, Leadership, Agile Practices.
· Blazor UI, Azure IPaaS (Azure Integration Services), Design Patterns, and Cloud Security best practices.
Similar Jobs
Events • Food • Travel • Hospitality • Hotels & Resorts
Manage hotel HR operations across recruitment, training, compensation, benefits, employee and labor relations, compliance, safety, and performance management. Coordinate engagement and recognition initiatives, maintain employee records and HR systems, track employment changes, document training and corrective actions, produce HR metrics reports, and supervise, coach, and develop HR team members while ensuring policy and regulatory compliance.
Top Skills:
Microsoft Office Suite
Events • Food • Travel • Hospitality • Hotels & Resorts
Assists with hotel reservations operations, room inventory, group bookings, rooming lists, rate strategies, revenue optimization, reporting, and administrative support. Provides reservation assistance to customers and team members while supervising, coaching, and developing reservations staff. Coordinates with meeting planners, housing bureaus, and internal departments to ensure accurate billing, special requests, and guest service.
Top Skills:
DelphiIdeas Gro V3MS OfficeOnq PmR&I
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Reviews liquidity risk reports, validates data and reconciliations, analyzes requirements gaps, and supports regulatory finance transformation initiatives. Coordinates with global Finance, IT, Design, and business teams to resolve data quality issues, manage requirements workstreams, improve reporting controls, and deliver sourcing and process changes. Facilitates governance, issue resolution, stakeholder communication, and operational risk management across multiple regions.
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
