The Software Engineer will design and maintain large-scale data pipelines, optimize workflows, and ensure data quality for Ads reporting and analytics.
We are looking for a highly skilled Data Engineer. The ideal candidate will have hands-on expertise in Big Data technologies, with a strong foundation in distributed data processing, real-time pipelines, and large-scale data systems. You will design, build, and optimize data solutions that power insights, reporting, and decision-making for our advertising ecosystem.
Key Responsibilities- Design, develop, and maintain large-scale data pipelines to support Ads reporting, attribution, and analytics use cases.
- Work extensively with Hive, Spark, SQL, Scala, and Kafka to process and manage petabyte-scale datasets.
- Optimize data workflows for performance, scalability, and cost efficiency.
- Partner with data scientists, product managers, and platform engineers to deliver high-quality, reliable datasets and APIs.
- Ensure data quality, integrity, and consistency across multiple data sources.
Troubleshoot and resolve issues in real-time streaming pipelines and batch data jobs.
- Continuously evaluate new technologies to enhance the Ads Data platform.
Requirements
- Strong programming experience in Scala (preferred), Java, or Python.
- Hands-on experience with Apache Spark (batch & streaming) for large-scale data processing.
- Proficiency in Hive, SQL, and data modeling for analytical workloads.
- Experience working with Kafka for real-time event streaming.
- Solid understanding of Big Data ecosystems (S4, Hive, Presto, Delta etc.).
- Strong debugging, performance tuning, and problem-solving skills.
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
- Experience in AdTech, Attribution, or Campaign Analytics.
- Familiarity with cloud-based big data solutions (AWS EMR, GCP BigQuery, Databricks, etc.).
- Familiarity with scheduling services like AirFlow
- Knowledge of data governance, security, and compliance best practices.
Benefits
- Best in class salary: We hire only the best, and we pay accordingly.
- Proximity Talks: Meet other designers, engineers, and product geeks — and learn from experts in the field.
- Keep on learning with a world-class team: Work with the best in the field, challenge yourself constantly, and learn something new every day.
Top Skills
Airflow
Spark
Aws Emr
Databricks
Gcp Bigquery
Hive
Java
Kafka
Python
Scala
SQL
Similar Jobs
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The role involves supporting data ingestion and curation processes, building data pipelines, and collaborating on analytics solutions using various big data tools under guidance.
Top Skills:
AdlsAzureAzure Data FactoryCosmos DbDatabricksDelta LakeEvent HubFlumeHdfsHiveJavaKafkaPythonScalaSpark
.png)
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
As a Senior Software Engineer on the Data Platform team, you'll design and build foundational data services, maintain data pipelines, and ensure security and observability across data systems.
Top Skills:
AirflowCloud Data WarehouseData LakeGoJavaKafkaPythonSparkSQL
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
As a Business Intelligence Data Engineer, you'll develop scalable data architectures and models, manage data pipelines, and enhance analytics using AI tools.
Top Skills:
AirbyteAirflowAWSBigQueryDatabricksDbtFivetranPythonRedshiftRetoolSnowflakeSQLTableau
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
