McAfee Logo

McAfee

Senior Machine Learning Data Engineer

Posted 11 Days Ago
Be an Early Applicant
In-Office
Bengaluru, Bengaluru Urban, Karnataka
Senior level
In-Office
Bengaluru, Bengaluru Urban, Karnataka
Senior level
The Senior Machine Learning Data Engineer will create and manage ETL pipelines on Databricks, support ML models, ensure data compliance, and collaborate with teams.
The summary above was generated by AI

Role Overview:

We are seeking a Senior Machine Learning Data Engineer to architect and build scalable feature engineering and ETL pipelines on Databricks that power our machine learning initiatives.
This is a Hybrid position based in Bangalore. You must be within a commutable distance from the location. You will be required to be onsite on an as-needed basis; when not working onsite, you will work remotely from your home location.

About the role:

  • Develop and maintain feature-engineering pipelines in Databricks to support ML models effectively. 
  • Integrate diverse data sources (e.g., clickstreams, user behavior, demographic data) to create user behavior features/profiles for complex ML tasks. 
  • Design and implement ETL / ELT pipelines aligned with the bronze, silver, and gold layers of the medallion architecture. 
  • Build data pipelines to support ML model training, calibration, and deployment, leveraging ML flow for experiment tracking and performance monitoring. 
  • Design low-latency, production-ready data pipelines to support real-time and batch model inference. 
  • Apply CI/CD principles for seamless pipeline deployment.  
  • Ensure pipelines comply with security and regulatory standards, particularly for handling PII, and maintain metadata and master data across the data catalogue. 
  •  Work closely with ML scientists, engineers and other stakeholders to align data transformation with business objectives. 

About You:

  • 7 to 9 years in data engineering and at least 4 plus years focusing on ML feature engineering, ETL pipeline development, and data preparation for ML. 
  • Proven experience managing pipelines on Databricks using Apache Spark, with a strong understanding of the medallion architecture. 
  • Familiarity with ML lifecycle management, with ML flow experience as a strong plus and advanced skills in Apache Spark (PySpark) for big data processing and analytics. 
  • Proficient in Python for data manipulation and SQL for query optimization 
  • Experience building pipelines for real-time and batch model serving in production environments, and knowledge of CI/CD practices for ETL/ELT pipeline development. 
  • Expertise in metadata and master data management within technical data catalogues. 
  • Understanding data security and compliance, especially for sensitive data such as PII.

#LI- Hybrid


Company Overview

McAfee is a leader in personal security for consumers. Focused on protecting people, not just devices, McAfee consumer solutions adapt to users’ needs in an always online world, empowering them to live securely through integrated, intuitive solutions that protects their families and communities with the right security at the right moment.

Company Benefits and Perks:

We work hard to embrace diversity and inclusion and encourage everyone at McAfee to bring their authentic selves to work every day. We’re proud to be Great Place to Work® Certified in 10 countries, a reflection of the supportive, empowering environment we’ve built where people feel seen, valued, and energized to reach their full potential and thrive.

We offer a variety of social programs, flexible work hours and family-friendly benefits to all of our employees.

  • Bonus Program
  • Pension and Retirement Plans
  • Medical, Dental and Vision Coverage
  • Paid Time Off
  • Paid Parental Leave
  • Support for Community Involvement

We're serious about our commitment to diversity which is why McAfee prohibits discrimination based on race, color, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender expression or identity, sexual orientation or any other legally protected status.

Top Skills

Spark
Ci/Cd
Databricks
Ml Flow
Pyspark
Python
SQL

Similar Jobs

4 Days Ago
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Agency • Software • Consulting
As a Senior Data Quality Engineer for ML, you will evaluate outputs from large language models using Python and SQL, implement quality metrics, and automate evaluation pipelines, while collaborating with multidisciplinary teams to ensure software quality.
Top Skills: GCPPythonSQL
2 Days Ago
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
This role involves designing, building, and scaling a Data+ML platform, collaborating on machine learning pipelines, and incorporating cloud services for deployment and execution.
Top Skills: AirflowSparkFlinkFluxcdJavaJupyter NotebooksKubernetesMlflowPythonRayTerraformVertex Ai
2 Days Ago
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Sr. Engineer on the Data + ML Platform team, you will design and build scalable ML pipelines and ensure best practices in development and deployment, shaping critical business decisions in modern cybersecurity.
Top Skills: AirflowSparkCi/Cd FrameworksFlinkFluxcdGithub ActionsJavaJupyter NotebooksKubernetesMlflowNvidia WorkbenchPythonRayScalaTerraformVertex Ai

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account