Design, build, and maintain scalable ETL/ELT pipelines and data warehouses using Snowflake, AWS Glue, Python, and SQL. Optimize performance, implement CI/CD with Azure DevOps, ensure data quality and governance, collaborate with analytics teams, and troubleshoot pipeline issues.
Job Description - Sr Data Engineer
Experience: 5 to 7 years
Preferred Locations: Delhi NCR, Gurgaon, Noida, Bangalore, Jaipur, Indore, Ahmedabad (please avoid Pune and Hyderabad)
Mandatory Skills: Strong hands-on experience in Snowflake, Python, SQL, and AWS Glue
Job Summary
We are looking for a highly skilled Data Engineer with strong expertise in Snowflake, Python, SQL, AWS Glue, and modern data engineering practices. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, ensuring data quality, and supporting business intelligence and analytics initiatives.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for processing large volumes of data.
- Build and optimize data models, data warehouses, and data lake solutions.
- Develop robust data integration workflows using AWS Glue and orchestration tools such as Apache Airflow.
- Manage and optimize Snowflake environments, including performance tuning, query optimization, and cost management.
- Write efficient and scalable SQL queries and Python scripts for data transformation and automation.
- Implement CI/CD practices and deployment automation using Azure DevOps.
- Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Business Stakeholders.
- Ensure data quality, governance, security, and compliance across data platforms.
- Participate in Agile/Scrum ceremonies and contribute to continuous improvement initiatives.
- Troubleshoot and resolve data pipeline and performance-related issues.
Required Skills & Qualifications
- 5+ years of experience in Data Engineering or related roles.
- Strong proficiency in SQL and Python.
- Hands-on experience with Snowflake Data Warehouse architecture, administration, and performance optimization.
- Proven experience with AWS Glue for data integration and transformation.
- Experience with workflow orchestration tools such as Apache Airflow.
- Strong understanding of data modeling, data warehousing, and data lake concepts.
- Experience with Azure DevOps, including version control, CI/CD pipelines, and deployment automation.
- Familiarity with cloud-based data solutions and best practices.
- Experience working in Agile/Scrum environments.
- Excellent problem-solving, analytical, and communication skills.
Preferred Qualifications
- Experience with large-scale data migration and modernization projects.
- Exposure to AWS cloud services and ecosystem.
- Knowledge of data governance and security best practices.
- Relevant cloud or Snowflake certifications are a plus.
Similar Jobs
Database • Analytics
The Senior Data Engineer will enhance the data warehouse platform, develop reusable components, optimize data models, and contribute to team efforts in a fast-paced startup environment.
Top Skills:
AirflowAWSClickhouseDbtGithub ActionsPython
Blockchain • Hardware • Software • Energy • Cryptocurrency • Big Data Analytics
The Data Engineer will build and manage scalable data pipelines and databases, collaborate on architecture, and drive data systems towards real-time capabilities in a fast-paced, innovative environment.
Top Skills:
AirflowClickhouseDockerKafkaKubernetesPl/PgsqlPostgresPythonRedpandaTrino
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a POD Lead, you'll oversee data migration projects, utilizing Agile and Scrum methodologies, while leveraging your data expertise to drive transformation in financial services.
Top Skills:
PysparkPython
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
