Data Engineer

Responsibilities 

• A problem-solving mindset with the ability to understand business challenges and how to apply analytics expertise to solve them. 

• Build compelling, clear, and powerful visualizations of data. 

• Design, architect and implement Azure Data Factory V2 Pipelines. 

• Should have worked on Team Foundation Server / GIT as part of ADF Implementation. 

• Experience in migration projects like moving/implementing code from other ETL tool to ADF. 

• Develop solution to implement error logging, alerting mechanism using various available azure services. 

• A team mentality empowered by the ability to work with a diverse set of individuals. 

• Tell a clear story, highlight insights we had not previously seen and do it all faster than we’ve been able to previously. 

• Create, maintain, and document a robust set of metrics to monitor day-to-day bug detection and long-term performance tracking/tuning. 

• Have strong understanding of best practices, standards and guidelines in each technology/product and apply same to produce high quality deliverables  

• Should be able to take responsibility for the software life cycle - set up all environment, design, code, test, repository mgmt. and deployments as applicable and as required 

Required Qualifications 

• Minimum 4-7 years of Development experience in ADF. 

• At least 3-5 years of experience in T-SQL, creating complex store procedures, triggers etc. 

• Should have used Azure DevOps extensively as part of projects 

• Should have worked on SQL Database, Azure SQL Database, Azure Datawarehouse, salesforce connectors, snowflake connectors and should be comfortable with data warehousing concepts. 

• Should have worked on Azure Logic Apps, Azure Functions for not less than 3 years. 

• 4+ Years professional experience in a data Engineer/analyst role or similar. 

• Knowledge in creating Power BI Reports & Dashboards [Optional] 

• Should have worked on Service Bus, Event Hub. 

Preferred Qualifications 

• Experience working on Data Migration / Code implementation from other ETL tools using ADF will be an advantage. 

• Experience with Azure Data Factory, SSIS package, managed identity, service principles and other deployment activities 

• Experience with building CI/CD pipelines in Data environments and different patterns of deployment activities 

• Experience working on Azure Analysis Service with intermediate expertise in writing DAX. 

• Exposer to NOSQL databases Cosmos DB, Kusto DB. 

• Preferred Azure Cloud Shell, PowerShell, Azure CLI and Work with other Azure stack modules like Azure Data Lakes, SQL, Data warehouse, SF connectors, etc. 

• Excellent communication, organizational transformation, and leadership skills 

• Eager to continuously learn and grow.