The Senior Software Engineer will focus on designing and implementing scalable data solutions using AWS, Databricks, and Snowflake, while optimizing data pipelines and developing ETL processes. The role requires strong skills in SQL and data architecture, as well as experience with CI/CD tools for automating deployments.
Position : Sr Data Engineer.
Location : Bangalore/Hyderabad/Noida.
Immediate joiners preferred.
Required:
- Extensive experience in data engineering with a strong focus on designing and implementing complex and scalable data solutions using AWS services like MWAA and Lambda, RDS (7+ years).
- Proficient in Databricks (5+ years) using pyspark, Delta tables, Unity catalog, SQL Warehouse for optimizing data pipelines, ensuring high performance, managing big data processing tasks in an optimized manner, and writing reusable framework.
- Proficient in Snowflake (4+ years) and Snowpark for optimizing queries, schemas, and implementing security layers.
- Strong architectural knowledge coupled with RBAC concepts
- Strong SQL skills with the ability to write, optimize, and troubleshoot complex queries.
- Demonstrated problem-solving skills with the ability to analyze, diagnose, and resolve technical issues efficiently.
- Experience in developing and maintaining ETL/ELT processes to ensure data is accurately and efficiently loaded into data warehouses and data lakes.
- Knowledge of data quality frameworks, exception handling and adherence to common standards and compliance.
- Experience using CI/CD tools such as CDK, CloudFormation, and Terraform to automate deployments both IaaC and DAGs across environments.
Top Skills
AWS
Pyspark
SQL
Similar Jobs
Be an Early Applicant
As a Senior Lead Software Engineer at Capital One, you'll design innovative solutions, advocate for tech standards, enhance engineering culture, guide stakeholders in technology choices, and collaborate effectively with teams across the organization.
Be an Early Applicant
As a Staff Engineer at Samsara, you will lead technical direction and architecture for the Platform & Infrastructure organization. Responsibilities include developing scalable software solutions, driving technology choices, and mentoring engineers. You’ll work on impactful projects for physical operations across diverse industries, contributing to Samsara’s engineering excellence.
Be an Early Applicant
As a Senior Lead Software Engineer, you will enhance and deliver technology products, providing technical guidance and contributing significantly to product design and application functionality. You will also serve as a subject matter expert and advocate for engineering best practices while influencing project decisions and fostering a culture of diversity and inclusion.
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
