NextHire Consulting Logo

NextHire Consulting

StatusNeo - Data Engineer

Reposted 6 Days Ago
Be an Early Applicant
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Design, build, and maintain large-scale data pipelines and ETL/ELT workflows using Spark and Scala. Implement data models and warehousing on Snowflake and cloud (AWS/GCP). Ensure data quality, governance, security, and performance optimization while collaborating with data scientists, analysts, DevOps, and stakeholders.
The summary above was generated by AI

Job Title: Data Engineer/ Sr. Data Engineer

Experience Level: 3-6 Years 

Work Mode- Hybrid ( 2 PM to 11 PM )

Location: Bangalore/Gurgaon

Job Type: Full-Time

Company- StatusNeo

About the RoleWe’re looking for a Data Engineer who thrives on solving complex data challenges, building scalable pipelines, and delivering reliable insights that drive business decisions. The ideal candidate will bring hands-on expertise in cloud data platforms (AWS, GCP), Snowflake, Big Data ecosystems, and distributed computing using Spark and Scala. Key Responsibilities
  • Design, build, and maintain data pipelines for large-scale ingestion, transformation, and integration from multiple data sources.

  • Develop and optimize ETL/ELT workflows leveraging tools such as Spark, Scala, and SQL.

  • Implement data models and data warehousing solutions on Snowflake and cloud environments (AWS/GCP).

  • Work closely with data scientists, analysts, and business stakeholders to deliver high-quality, production-ready data solutions.

  • Manage data quality, governance, and security across environments.

  • Optimize performance of data pipelines, focusing on scalability, efficiency, and cost optimization in cloud setups.

  • Collaborate with DevOps teams for CI/CD deployment and monitoring of data solutions.

  • Technical Skill Set (Must Have)

    • Programming Languages: Scala, SQL

    • Big Data Frameworks: Apache Spark, Hadoop ecosystem

    • Cloud Platforms: AWS (S3, EMR, Glue, Redshift, Lambda) and/or GCP (BigQuery, Dataflow, Dataproc, Composer)

    • Data Warehouse: Snowflake (data modeling, performance tuning, query optimization)

    • ETL Tools: Spark-based ETL or Airflow/Glue/Composer

    • Version Control & CI/CD: Git, Jenkins, or equivalent

    • Data Formats: Parquet, Avro, ORC, JSON, CSV

      Good to Have
      • Knowledge of Python for data scripting and automation.

      • Familiarity with containerization (Docker, Kubernetes).

      • Experience with data cataloging and metadata management tools.

      • Exposure to streaming frameworks (Kafka, Pub/Sub).

Similar Jobs

6 Days Ago
In-Office
Mid level
Mid level
Artificial Intelligence • HR Tech • Professional Services • Software
Design, build, and maintain scalable data pipelines on GCP using BigQuery, Dataflow, Cloud Functions and SQL/Python. Optimize ETL/ELT workflows, ensure data quality and performance, monitor pipelines, and collaborate with analysts and stakeholders. Support hybrid GCP/Azure architectures when needed.
Top Skills: Azure Data FactoryBigQueryCi/CdCloud FunctionsCloud StorageData WarehousingDataflowDevOpsEtl/EltGoogle Cloud PlatformPythonSQLSynapse
3 Hours Ago
Easy Apply
Remote or Hybrid
India
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Information Technology • Machine Learning • Software
The Senior Sales Engineer at LogicMonitor partners with Sales to provide technical solutions, deliver presentations, mentor peers, and promote the use of AI tools, ensuring technical excellence and collaboration within the team.
Top Skills: AIAutomation ConceptsCloudGptGroovyIt InfrastructureMonitoringPowershellPython
3 Hours Ago
In-Office
Senior level
Senior level
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
As a DevOps Architect, you will lead architecture and automation strategies for 4G/5G networks, enhance CI/CD pipelines, and drive cloud-native solutions while collaborating with various engineering teams.
Top Skills: AnsibleAnsibleAWSAzureAzure DevopsBashChefDockerGCPGitGithub CiGitlabJSONKubernetesLinuxPuppetPythonSonarqubeYaml

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account