The role involves leading a team of engineers in delivering Big Data solutions, requiring expertise in Spark, Scala/Java, and AWS. Responsibilities include system scope finalization, collaboration with software teams, and staff training on data management.
Big Data Engineer Responsibilities:
- Big Data Engineer with 5+ years of experience
- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation
- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.
- Finalizing the scope of the system and delivering Big Data solutions.
- Collaborating with the software research and development teams.
- Training staff on data resource management.
- Engineering/Master’s degree in computer engineering or computer science.
- In-depth knowledge of Hadoop, Spark, and similar frameworks.
- Excellent Interpersonal and communication skills.
- Ability to solve complex networking, data, and software issues.
Top Skills
Java
Scala
Similar Jobs
Be an Early Applicant
As a NOC Analyst, you will monitor and support the Afilias India/Identity Digital registry network systems, provide technical support to the Customer Support Team, troubleshoot issues, conduct root cause analysis, and escalate issues to relevant teams. You are expected to communicate effectively with both technical and business teams while performing various reporting duties.
Be an Early Applicant
The Data Engineer at NucleusTeq is responsible for data engineering, modeling, warehousing, and analytics, including building a config-driven framework using Python and Spark. The role requires problem-solving, analytical skills, and collaboration.
Be an Early Applicant
The Data Engineer will focus on data engineering, modeling, ETL processes, and data warehousing to support business objectives and drive innovation. Responsibilities include building analytical data assets using the modern data stack.
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
