Prudential plc Logo

Prudential plc

Manager – Data Engineering

Reposted Yesterday
Be an Early Applicant
In-Office
Bangalore, Bengaluru Urban, Karnataka
Senior level
In-Office
Bangalore, Bengaluru Urban, Karnataka
Senior level
The Manager of Data Engineering will design and maintain data pipelines, ensure compliance with data governance, implement quality rules, and provide guidance to teams. Responsibilities include debugging, optimizing data jobs, and collaborating with data teams across regions.
The summary above was generated by AI

Prudential’s purpose is to be partners for every life and protectors for every future. Our purpose encourages everything we do by creating a culture in which diversity is celebrated and inclusion assured, for our people, customers, and partners. We provide a platform for our people to do their best work and make an impact to the business, and we support our people’s career ambitions. We pledge to make Prudential a place where you can Connect, Grow, and Succeed.

  • Design, build, and maintain data pipelines to ingest data from multiple sources into our cloud data platform.
  • Ensure pipelines are built using defined standards and maintain comprehensive documentation.
  • Adhere to and enforce data governance standards to maintain data integrity and compliance.
  • Implement data quality rules to ensure the accuracy and reliability of data.
  • Implement data security and protection control’s around Databricks Unity Catalog
  • Utilize Azure Data Factory, Azure Databricks, and other Azure services to build and optimize data pipelines.
  • Leverage SQL, Python/ PySpark and other programming languages for data processing and transformation.
  • Stay updated with the latest Azure technologies and best practices.
  • Provide technical guidance and support to team members and stakeholders.
  • Maintain detailed documentation of data pipelines, processes, and data quality rules.
  • Debug, fine tune and optimize large scale data processing jobs
  • Generate reports and dashboards to monitor data pipeline performance and data quality metrics.
  • Work collaboratively with data teams across Asia and Africa to understand data requirements and deliver solutions.

 

Prudential is an equal opportunity employer. We provide equality of opportunity of benefits for all who apply and who perform work for our organisation irrespective of sex, race, age, ethnic origin, educational, social and cultural background, marital status, pregnancy and maternity, religion or belief, disability or part-time / fixed-term work, or any other status protected by applicable law. We encourage the same standards from our recruitment and third-party suppliers taking into account the context of grade, job and location. We also allow for reasonable adjustments to support people with individual physical or mental health requirements.

Top Skills

Azure Data Factory
Azure Databricks
Pyspark
Python
SQL

Similar Jobs

3 Days Ago
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Lead the Data Threat Analytics team, focusing on road-mapping, team development, and high-quality software delivery in a dynamic environment.
Top Skills: AWSAzureGCPSaaS
10 Hours Ago
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software
The IT Manager will lead the Data Analytics team, focusing on analytics solutions, team mentoring, and collaboration with enterprise functions to drive business decisions.
Top Skills: AWSBi ToolsConfluenceDatabricksJIRALookerPower BIPythonQuicksightSnowflakeSQLTableau
13 Days Ago
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
News + Entertainment
Manage and grow the engineering team, build distributed systems for data processing, and communicate with stakeholders to influence project direction.
Top Skills: AirflowJavaPythonRelational DatabasesScalaSpark

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account