Data Engineer

Job Summary

As a Senior Data Engineer , you will be a key member of our data engineering team, responsible for designing, developing, and maintaining data pipelines and infrastructure. You will collaborate with cross-functional teams to support data-driven decision-making and contribute to the growth and success of our data-driven initiatives.

Responsibilities and Duties

• Design, develop, and maintain scalable and efficient data pipelines
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and translate them into robust data solutions
• Implement data integration processes to ingest, transform, and load data from various sources into data warehouses or data lakes
• Optimize data pipelines for performance, reliability, and scalability
• Monitor and troubleshoot data pipelines to ensure data quality and reliability
• Work with cloud-based data platforms and technologies to support data engineering operation
• Acquire data from primary and secondary sources and maintain databases/systems
• Interpret data, analyze results using statistical techniques, and provide ongoing reports
• Develop and implement databases, data collection systems, data analysis, and other strategies that optimize data quality and statistical efficiency
• Utilize data to answer key business questions promptly and effectively
• Own and maintain dashboards, reports, and ad-hoc requests for the organization
• Collaborate with management to prioritize business needs and insights
• Serve as the go-to person for any ad-hoc data-related inquiries

Qualifications and Skills

• Bachelor's degree or equivalent in computer science, systems engineering, or related fields
• Experience in data management involving the design, construction, and maintenance of operational and analytical data models
• Experience with programming languages and environments for data analysis
• Proactive problem detection and resolution

Role-specific Requirements

• This role is for an experienced Software Engineer to contribute to developing a secure, highly available, fault-tolerant, and globally efficient microservices-based platform. This platform, deployed on AWS, utilizes the latest technology stack. 

  Key Responsibilities:

  • Design and build scalable and robust data pipelines.
  • Develop and optimize data models to support business processes.
  • Implement data storage solutions using Microsoft SQL Server or AWS database services.
  • Integrate complex datasets using REST APIs and other data ingestion techniques.
  • Collaborate with cross-functional teams to gather requirements and deliver data-driven solutions.
  • Ensure data quality and integrity through rigorous testing and validation.

  Qualifications:

  • At least five years of experience as a Data Engineer or in a similar role.
  • Expertise in Microsoft technologies and programming languages such as C# and Python.
  • Strong knowledge of AWS cloud services, particularly in data-related offerings.
  • Proficiency in REST API development and integration.
  • Experience with Microsoft SQL Server and familiarity with other AWS relational and non-relational databases.
  • Excellent problem-solving skills and attention to detail.

  Preferred Skills:

  • Microsoft and AWS technologies.
  • Experience with big data tools and frameworks.
  • Familiarity with data visualization and reporting tools.

  Nice to have:

  • Certifications in Microsoft and AWS technologies.

About Encora

Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering. 

At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.