Senior Databricks Engineer, Data Platform & Data Science Tooling

Job descriptions may display in multiple languages based on your language selection.
What we offer:
At Magna, you can expect an engaging and dynamic environment where you can help to develop industry-leading automotive technologies. We invest in our employees, providing them with the support and resources they need to succeed. As a member of our global team, you can expect exciting, varied responsibilities as well as a wide range of development prospects. Because we believe that your career path should be as unique as you are.
Group Summary:
Magna is more than one of the world's largest suppliers in the automotive space. We are a mobility technology company built to innovate, with a global, entrepreneurial-minded team. With 65+ years of expertise, our ecosystem of interconnected products combined with our complete vehicle expertise uniquely positions us to advance mobility in an expanded transportation landscape.
Job Responsibilities:
We are looking for a highly experienced and motivated Senior Engineer to join our Enterprise Data Platform team. This role is pivotal in designing, building, and maintaining scalable, secure, and high-performance data infrastructure across Azure, AWS, and Databricks. The ideal candidate will have strong hands-on experience in cloud administration, CI/CD automation, and should be innovative in building ingestion patterns, re-usable components, reference architecture and hyper-automation for platform.
Key Responsibilities:
Platform Engineering & Administration - Must Have

• Administer and optimize Azure and AWS cloud environments, including resource provisioning, access control, monitoring, and cost management.
• Manage and maintain Databricks workspaces, clusters, jobs, notebooks, and user roles.
• Ensure platform security, compliance, and performance through proactive monitoring and automation.

Data Engineering & Development- Must Have

• Design and develop modular, reusable Python-based batch jobs and data pipelines using frameworks like PySpark, pandas, and Delta Lake.
• Build scalable ETL/ELT processes to ingest, transform, and load data from diverse sources into cloud data lakes and warehouses.
• Optimize data workflows for performance, reliability, and maintainability.

DevOps & CI/CD Automation

• Implement and manage CI/CD pipelines using GitHub Actions, Azure DevOps, or similar tools to automate deployment and testing of data solutions. -Must Have.
• Integrate infrastructure-as-code (IaC) practices using tools like Terraform or ARM templates. -Good to have.
• Collaborate with DevOps and platform teams to streamline release cycles and ensure consistent environments.

Collaboration & Governance:

• Work closely with data architects, analysts, and business stakeholders to understand requirements and deliver robust data solutions.
• Promote best practices in data governance, metadata management, and data quality.
• Document technical designs, operational procedures, and troubleshooting guides.

Required Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• 8-10 years of experience in data engineering or platform engineering roles.
• Proven hands-on expertise in Azure, AWS, and Databricks administration.
• Strong programming skills in Python, with experience in building production-grade data pipelines.
• Deep understanding of CI/CD principles, Git workflows, and automation tools.
• Experience with monitoring, logging, and alerting tools (e.g., Azure Monitor, CloudWatch, Datadog).

Preferred Skills:

• Experience with Terraform, Docker, or Kubernetes.
• Familiarity with data lakehouse architectures, Delta Lake, and Apache Spark.
• Knowledge of data security, compliance frameworks, role-based & attribute based access control.
• Exposure to Agile/Scrum methodologies and tools like JIRA or Confluence.

What We Offer:

• Opportunity to work on cutting-edge cloud-native data platforms.
• Collaborative and inclusive work culture.
• Competitive compensation and benefits.
• Continuous learning and career development support.

Awareness, Unity, Empowerment:
At Magna, we believe that a diverse workforce is critical to our success. That's why we are proud to be an equal opportunity employer. We hire on the basis of experience and qualifications, and in consideration of job requirements, regardless of, in particular, color, ancestry, religion, gender, origin, sexual orientation, age, citizenship, marital status, disability or gender identity. Magna takes the privacy of your personal information seriously. We discourage you from sending applications via email or traditional mail to comply with GDPR requirements and your local Data Privacy Law.
Worker Type:
Regular / Permanent
Group:
Magna Corporate