.png)
.png){kind=logo}
Designs, develops, and maintains scalable batch and real-time data pipelines, ETL/ELT workflows, data models, and cloud data platforms. Ensures data quality, governance, security, observability, and performance while supporting cloud modernization. Collaborates with product owners, architects, business stakeholders, and data scientists, and maintains technical documentation, lineage, monitoring, and operational runbooks.
Job Purpose and Impact
We are seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and platforms that enable reliable data ingestion, transformation, storage, and analytics. The ideal candidate will have strong expertise in cloud-based data engineering, ETL/ELT frameworks, data warehousing, and modern big data technologies
Key Accountabilities
Qualifications
We are seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and platforms that enable reliable data ingestion, transformation, storage, and analytics. The ideal candidate will have strong expertise in cloud-based data engineering, ETL/ELT frameworks, data warehousing, and modern big data technologies
Key Accountabilities
- Design and develop scalable data ingestion and processing pipelines.
- Build and maintain batch and real-time data integration solutions.
- Develop ETL/ELT workflows to transform and load data from various source systems.
- Design and optimize data models for analytics and reporting.
- Ensure data quality, integrity, governance, and security standards are maintained.
- Monitor, troubleshoot, and optimize data pipelines and workloads.
- Collaborate with product owners, business stakeholders, architects, and data scientists to deliver data solutions.
- Implement data observability, monitoring, and alerting mechanisms.
- Support cloud migration and modernization initiatives.
- Create and maintain technical documentation, data lineage, and operational runbooks.
Qualifications
- Have a Bachelor's degree with minimum 4 years of professional experience.
- Experience with Snowflake, Databricks, Redshift, BigQuery, or Synapse.
- Knowledge of Apache Kafka or other streaming technologies.
- Experience with dbt and modern data stack tools.
- Familiarity with DataOps and MLOps practices.
- Understanding of data governance, metadata management, and data quality frameworks.
- Cloud certifications (AWS, Azure, or GCP) are preferred
- Technical Skills
- Programming: Python, SQL, Scala, Java
- Data Processing: Spark, Hive, Airflow
- Cloud: AWS (S3, Glue, Lambda, EMR), Azure, GCP
- Databases: SQL Server, Oracle, PostgreSQL, Snowflake
- Streaming: Kafka, Kinesis
- DevOps: Git, Jenkins, CI/CD
- Data Modeling: Star Schema, Snowflake Schema, Data Vault
Cargill Bengaluru, Karnataka, IND Office
Cargill’s office is part of a major IT hub in Bengaluru, offering top-tier amenities, including a vibrant cafeteria, sports facilities, and digitalized services. Convenient housing and dining options, and robust transportation make the location a convenient place to live and work.
Similar Jobs at Cargill
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Develops and maintains software applications using Java, Spring, Spring Boot, microservices, databases, and APIs. Responsibilities include automating deployments, collaborating with cross-functional teams, writing unit and integration tests, debugging complex issues, improving development processes, documenting systems, and providing technical support. Requires a computer science degree, 1–3 years of relevant experience, and knowledge of software design, data structures, algorithms, and system design.
Top Skills:
AlgorithmsAPIsCachingData StructuresDatabase ScalingJavaMicroservicesSpringSpring BootSQLSystem Design
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Designs, develops, and maintains trading software and ETL/ELT ingestion pipelines. Integrates market data feeds, ensures production readiness, implements CI/CD and monitoring, debugs high-volume time-sensitive processing, and builds resilient idempotent ingestion frameworks on AWS.
Top Skills:
Acid-Compliant IngestionAmazon AuroraAws DmsAws GlueAws LambdaAws Step FunctionsChange Data Capture (Cdc)Etl/EltKafkaPostgresPythonSap OdpSchema EvolutionSQL
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Develops and maintains software applications using Java, Spring, Spring Boot, microservices, databases, and APIs. Responsibilities include automating deployments, collaborating with cross-functional teams, writing unit and integration tests, debugging complex issues, improving development processes, documenting systems, and providing technical support. Requires a computer science degree, 1–3 years of relevant experience, and knowledge of software design, data structures, algorithms, and system design.
Top Skills:
AlgorithmsAPIsCachingData StructuresDatabase ScalingJavaMicroservicesSpringSpring BootSQLSystem Design
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
