emids
Sr. Data Engineer(Python+Pyspark+Databricks) || 6+ yrs ||RR/1162/2024
Job Posted 6 Days Ago
Be an Early Applicant
The Sr. Data Engineer will build and optimize ETL processes, manage data pipelines and warehouses, and utilize various Azure cloud services.
Exp : 3-8 yrs
Loc : Bangalore / Noida / Hyderabad (Hybrid)
Job Description :
- Technical Skills: Proficiency in Azure cloud services (Azure Data Factory, Azure Databricks, Azure SQL Database, Azure Blob Storage, etc.) and strong programming skills in Python for data manipulation and automation.
- Data Engineering: Experience in building and optimizing ETL processes, data pipelines, and data warehouses/lakes.
- Database Technologies: Familiarity with SQL and NoSQL databases, and experience in database design, optimization, and management.
- Problem-Solving Abilities: Ability to troubleshoot complex technical issues and propose effective solutions.
- Teamwork and Communication: Excellent teamwork, communication, and interpersonal skills to collaborate effectively with diverse teams and stakeholders.
- Education and Experience: Bachelor’s degree in computer science, Engineering, or a related field. Previous experience as a software engineer or data engineer, especially in a cloud-based environment, is preferred.
Top Skills
Azure Blob Storage
Azure Data Factory
Azure Databricks
Azure Sql Database
NoSQL
Python
SQL
Similar Jobs
Information Technology • Machine Learning • Software • Conversational AI • Generative AI • Manufacturing
The Data Transformation Analyst will analyze and capture data from manufacturer datasheets, ensure quality targets are met, and identify alternate components for customers.
Top Skills:
Office 365
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The role involves designing and executing analytics solutions, applying optimization techniques to supply chain and manufacturing datasets, and leading project teams.
Top Skills:
CplexGurobiPythonR
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
The Staff Data Engineer will enhance the Enterprise Data Platform by designing data models, optimizing ETL processes, and collaborating with teams to ensure effective data-driven decision-making.
Top Skills:
AirflowAWSBigQueryCloud Data FusionEltEmrETLGCPInformaticaLookerMatillionPower BIPythonRdbmsRdsRedshiftSQLSsisTableauTalend
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
