Diligent Logo

Diligent

Software Engineer II - Data Engineer

Reposted 12 Days Ago
Easy Apply
In-Office
Bengaluru, Bengaluru Urban, Karnataka
Mid level
Easy Apply
In-Office
Bengaluru, Bengaluru Urban, Karnataka
Mid level
The Data Engineer will design, build, and optimize data pipelines, integrate diverse data sources, and ensure data quality in collaboration with senior engineers.
The summary above was generated by AI

About Us

Diligent is the AI leader in governance, risk and compliance (GRC) SaaS solutions, helping more than 1 million users and 700,000 board members to clarify risk and elevate governance. The Diligent One Platform gives practitioners, the C-Suite and the board a consolidated view of their entire GRC practice so they can more effectively manage risk, build greater resilience and make better decisions, faster. 

At Diligent, we're building the future with people who think boldly and move fast.  Whether you're designing systems that leverage large language models or part of a team reimaging workflows with AI, you'll help us unlock entirely new ways of working and thinking.  Curiosity is in our DNA, we look for individuals willing to ask the big questions and experiment fearlessly - those who embrace change not as a challenge, but as an opportunity.  The future belongs to those who keep learning, and we are building it together.  At Diligent, you’re not just building the future - you’re an agent of positive change, joining a global community on a mission to make an impact.

Learn more at diligent.com or follow us on LinkedIn and Facebook

Position Overview 

We are seeking a Data Engineer to help design, build, and optimize data pipelines and platforms that support our growing data needs. In this role, you will work closely with senior engineers and cross-functional teams to integrate diverse data sources, ensure data quality, and contribute to the development of scalable, secure, and reliable data infrastructure. 

Responsibilities 

  • Build and maintain reliable, high-performance data pipelines for batch and streaming use cases.
  • Integrate data from multiple sources including enterprise systems, cloud-native services, APIs, and unstructured datasets.
  • Collaborate with senior engineers to implement best practices in data modeling, pipeline design, and performance optimization.
  • Contribute to building self-service data platforms for data discovery, access, and lifecycle management.
  • Support implementation of governance, compliance, and security policies across data systems.
  • Develop automation scripts for deployment and monitoring of data infrastructure.
  • Work with team members to resolve issues, improve processes, and ensure data availability and accuracy.

Core Qualifications 

  • Bachelor’s degree in Computer Science, Engineering, or related field.
  • 2–4 years of experience in data engineering or backend software development.
  • Proficiency in Python and SQL for data processing and pipeline development.
  • Experience with distributed computing frameworks like Spark, Kafka, or similar.
  • Familiarity with AWS services and Infrastructure as Code (IaC) tools such as Terraform or AWS CDK.
  • Knowledge of data storage systems (e.g., S3, Redshift, Snowflake, or similar).
  • Basic understanding of data governance and compliance requirements.

Preferred Skills 

  • Exposure to data catalog/discovery tools such as DataHub or Collibra.
  • Familiarity with containerized applications (Docker, Kubernetes).
  • Understanding of real-time data pipelines and streaming technologies.
  • Awareness of privacy and regulatory standards (e.g., GDPR, CCPA).

What Diligent Offers You 

  • Creativity is ingrained in our culture. We are innovative collaborators by nature. We thrive in exploring how things can be differently both in our internal processes and to help our clients
  • We care about our people. Diligent offers a flexible work environment, global days of service, comprehensive health benefits, meeting free days, generous time off policy and wellness programs to name a few
  • We have teams all over the world. We may be headquartered in New York City, but we have office hubs in Washington D.C., Vancouver, London, Galway, Budapest, Munich, Bengaluru, Singapore, and Sydney.
  • Diversity is important to us. Growing, maintaining and promoting a diverse team is a top priority for us. We foster and encourage diversity through our Employee Resource Groups and provide access to resources and education to support the education of our team, facilitate dialogue, and foster understanding.

Diligent created the modern governance movement. Our world-changing idea is to empower leaders with the technology, insights and connections they need to drive greater impact and accountability – to lead with purpose. Our employees are passionate, smart, and creative people who not only want to help build the software company of the future, but who want to make the world a more sustainable, equitable and better place. 

Headquartered in New York, Diligent has offices in Washington D.C.,  London, Galway, Budapest, Vancouver, Bengaluru, Munich, Singapore and Sydney.   To foster strong collaboration and connection, this role will follow a hybrid work model. If you are within a commuting distance to one of our Diligent office locations, you will be expected to work onsite at least 50% of the time. We believe that in-person engagement helps drive innovation, teamwork, and a strong sense of community.


We are a drug free workplace. Diligent is proud to be an equal opportunity employer. We do not discriminate based on race, color, religious creed, sex, national origin, ancestry, citizenship status, pregnancy, childbirth, physical disability, mental disability, age, military status, protected veteran status, marital status, registered domestic partner or civil union status, gender (including sex stereotyping and gender identity or expression), medical condition (including, but not limited to, cancer related or HIV/AIDS related), genetic information, or sexual orientation in accordance with applicable federal, state and local laws. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Diligent's EEO Policy and Know Your Rights. We are committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at [email protected].

To all recruitment agencies: Diligent does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, Diligent employees or any other organization location. Diligent is not responsible for any fees related to unsolicited resumes.

Top Skills

AWS
Aws Cdk
Docker
Kafka
Kubernetes
Python
Redshift
S3
Snowflake
Spark
SQL
Terraform

Similar Jobs

11 Days Ago
In-Office
Bengaluru, Karnataka, IND
Mid level
Mid level
Consumer Web • Digital Media • News + Entertainment
As a Software Development Engineer II, you'll build and maintain data infrastructure, develop data pipelines for AI initiatives, and optimize data processing systems.
Top Skills: Apache AirflowApache FlinkApache KafkaSparkAWSAzureBigQueryCassandraCloudFormationDelta LakeDynamoDBGCPKinesisMySQLPostgresRedshiftSnowflakeTerraform
9 Days Ago
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
AdTech • Digital Media
The Senior Software Engineer II will design scalable data solutions, lead cross-functional teams, and oversee data governance while mentoring staff and optimizing platform performance.
Top Skills: Apache AirflowApache KafkaSparkGithub ActionsJenkinsPulumiPysparkPythonScalaTerraform
2 Hours Ago
In-Office
Bangalore, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Edtech • Software
Join Curriculum Associates as a Senior Software Engineer focused on developing and optimizing scalable software solutions using Scala and Big Data technologies while collaborating in an Agile environment.
Top Skills: SparkAurora MysqlAWSBig DataDynamoDBEmrJavaKafkaScalaSnowflakeSpring BootSQL

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account