Data Engineering Manager

The Role: 

Carrot is seeking a Data Engineering Manager to join our Business Intelligence function as it scales to meet - and anticipate - the needs of the organization and its clients. As a Data Engineering Manager at Carrot, you will primarily be in a coaching/leadership role, but you should also be prepared to get in the weeds and work on technical projects given the small-but-mighty nature of the team. You will be tasked with defining and driving the development of the BI department’s data engineering function. Data Engineering Managers help the engineers on their team to develop, maintain, and support enterprise data solutions from ETL/ELT pipeline development to data warehouse administration and workflow orchestration. The reliability of these systems is essential for the accuracy and recency of data that is used by the organization to inform data-driven decision-making. This position requires a confident leader who is passionate about supporting career advancement and professional development for all data engineers, overseeing scalable data pipelines, and increasing efficiency and maturity in a fast-paced environment. The ideal candidate is a communicative, collaborative and thoughtful engineer who wants to have an impact on the organization by empowering the Data Engineering function of the BI team to be as effective and innovative as possible.

Core responsibilities for the role include:

• Management and mentorship of team members with different skill sets, levels of expertise, and technical areas of focus
• Clear, concise, and consistent upward communication to both technical and non-technical stakeholders
• Overseeing the design and execution of Business Intelligence data infrastructure, including but not limited to identifying opportunities for data acquisition, and exploring ways to enhance data quality and reliability
• Leading day-to-day operations of the team and the regular delivery of data engineering initiatives and projects
• Continuously seeking improved efficiencies, including potentially challenging existing processes and having difficult conversations to drive the team forward
• Leading strategic conversations with BI, engineering, and product leadership in order to gather, interpret, and document business requirements and translate them into engineering roadmap items
• Creating detailed documents using Atlassian tools to describe the solution and build architecture diagrams that adhere to standards to socialize the solution to leadership
• Overseeing and contributing to the development of software systems that enable advanced data analytics capabilities, for example, complex data visualization and advanced algorithms
• Facilitating team partnership with backend product engineers to optimize production database schemas with data use cases in mind
• Facilitating inter-departmental partnerships with stakeholder teams to improve their data infrastructure through automation support, data education, and strategic support
• Facilitating cross-team communication to minimize redundancies and keep teammates moving in step
• Mentoring and developing junior teammates through pairing, architecture discussions, PR reviews, and big-picture/strategic support

The Team:

The Business Intelligence team at Carrot is a highly cross-functional team that is central to Carrot’s long-term success.  The growing team is led by our Senior Director of Analytics and Business Intelligence and includes data engineers, data scientists, and business intelligence analysts.

Minimum Qualifications: 

• Minimum of 5-7 years in data engineering or related field, with advanced knowledge in SQL (4+ years of practical application) and Python development, including unit and integration testing (4+ years of practical application).
• Strong proficiency in cloud-based data technologies (e.g., Snowflake, AWS), database relational modeling, version control systems (Git preferred), and modern data ingestion/transformation tools (e.g., Fivetran, dbt).
• Demonstrated ability to build end-to-end ETL/ELT pipelines, orchestrate workflow (e.g., Prefect, Airflow), and automate tasks for efficiency.
• Excellent communication skills, capable of empathetic interactions and clear, concise dialogue with both technical and non-technical stakeholders.
• Proven experience in strategic planning, with a preference for skills in whiteboarding tools (Figma), presentations, and project management (JIRA).
• Adaptability to change, resilience in ambiguous situations, and dependability in balancing various priorities alongside a strong, technical capability.
• Comfort in providing constructive feedback to all levels of the organization with tact and a strong sense of empathy, including the ability to effectively gauge the mood of virtual meetings.
• Proficient in data governance and compliance protocols, with a thorough understanding of security best practices, including secure file transfer protocols (sFTP), to ensure data integrity and confidentiality.
• Skilled in developing and implementing data security policies and procedures, pairing with Information Security & Legal team partners, aligning with industry standards and regulations to safeguard information and comply with data protection laws.

Preferred Qualifications: 

• Direct experience with existing tech stack including but not limited to Snowflake, Fivetran, dbt, Prefect, AWS etc.
• Direct experience with best-in-class and enterprise business intelligence platforms
• Experience with event streaming; knowledgeable on integrating batch and real-time data ingestion processes
• Experience with Engineering People Management
• Previous experience with a startup or similar fast-paced growth environment  [ plus + ]
• Healthcare industry working experience with an understanding of healthcare data standards (HL7, FHIR, etc.), privacy laws and data regulations (HIPAA, GDPR, etc.), and healthcare data exchange (HIEs, EDI, etc.)  [ plus + ]

Compensation: 

Carrot offers a holistic Total Rewards package designed to support our employees in all aspects of their life inside and outside of work, including health and wellness benefits, retirement savings plans, short- and long-term incentives, parental leave, family-forming assistance, and a competitive compensation package. The starting base salary for this position will range from $160,000.00 - $170,000.00. Actual compensation may vary from posted base salary depending on your confirmed job-related skills and experience. 

Fraud and Security Notice: Please note that all communication regarding job opportunities at Carrot will come exclusively from an @get-carrot.com email address. If you receive messages from any other domain, please disregard them and report the incident to: [email protected]