ProArch is hiring a skilled Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data processing systems using Azure technologies. Additionally, you will collaborate with cross-functional teams to understand business requirements, identify opportunities for data-driven improvements, and deliver high-quality solutions. If you have a strong background in Azure data tools and technologies, excellent problem-solving skills, and a passion for data engineering, we want to hear from you!
Responsibilities:
- Design, develop, and implement data engineering solutions on the Azure platform
- Create and maintain data pipelines and ETL processes
- Optimize data storage and retrieval for performance and scalability
- Collaborate with data scientists and analysts to build data models and enable data-driven insights
- Ensure data quality and integrity through data validation and cleansing
- Monitor and troubleshoot data pipelines and resolve any issues
- Stay up-to-date with the latest Azure data engineering best practices and technologies
- Excellent communication skills
- Strong experience in Python/Pyspark
- The ability to understand businesses concepts and work with customers to process data accurately.
- A solid of understanding Azure Data Lake, Spark for Synapse (or Azure Databricks), Synapse Pipelines (or Azure Data Factory), Mapping Data Flows, SQL Server, Synapse Serverless/Pools (or SQL Data Warehouse).
- Experience with source control, version control and moving data artifacts from Dev to Test to Prod.
- A proactive self-starter, who likes deliver value, solves challenges and make progress.
- Comfortable working in a team or as an individual contributor
- Good data modelling skills (e.g., relationships, entities, facts, and dimensions)
ProArch Bengaluru, Karnataka, IND Office
Subramanyapura Post, Bengaluru, Karnataka , India, 560061
Similar Jobs
Sharing Economy
The role involves designing, building, and maintaining data infrastructure, focusing on data integration, storage, and processing within Azure and Databricks environments while mentoring junior staff and participating in Agile development.
Top Skills:
AzureAzure Data LakeDatabricksDevOpsPysparkPythonSQLSynapse
Information Technology
The Senior Azure Data Engineer will develop Azure data solutions, conduct data profiling, and engage in Proof of Concepts. Requires 5+ years of Azure experience.
Top Skills:
Azure AnalyticsAzure Data BricksAzure Data FactoryAzure DevopsAzure SynapseDelta TablesPysparkPythonSQLUnity Catalog
Professional Services
The Senior Azure Data Engineer is responsible for designing, implementing, and maintaining data solutions on the Azure platform, developing data pipelines, optimizing data storage, ensuring data quality, and collaborating with data scientists while monitoring the processes.
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.