Design, develop, and maintain Java-based backend services and data pipelines using Apache NiFi and Apache Spark; implement real-time processing, expose REST APIs, monitor workflows, and collaborate across teams.
Key Responsibilities
RequirementsRequired Skills & Qualifications
Benefits
- Design, develop, and maintain backend services leveraging Java along with Apache NiFi and Apache Spark for data integration and processing.
- Build and optimize data pipelines to facilitate the flow of data between systems efficiently.
- Implement business logic for real-time data processing and analytics using Spark.
- Develop and expose RESTful APIs to support data access and retrieval.
- Collaborate with cross-functional teams including data engineers, data scientists, and frontend developers.
- Monitor and troubleshoot data workflows and backend applications, ensuring high availability and performance.
- Participate in code reviews, and ensure adherence to coding standards and best practices.
- Stay updated with the latest trends in Java and big data technologies, contributing to continuous improvement.
RequirementsRequired Skills & Qualifications
- Strong proficiency in Java with 3+ years of development experience.
- Hands-on experience with Apache NiFi for data flow automation.
- Proven experience in Apache Spark for large-scale data processing and analytics.
- Familiarity with RESTful APIs and microservices architecture.
- Experience with both SQL and NoSQL databases (e.g., MySQL, MongoDB).
- Solid understanding of data structures, algorithms, and software design principles.
- Familiarity with version control systems (e.g., Git).
- Excellent problem-solving skills and ability to work collaboratively in a team environment.
Benefits
Salary
Medical Insurance
Top Skills
Apache Nifi
Spark
Git
Java
Microservices
MongoDB
MySQL
NoSQL
Restful Apis
SQL
Similar Jobs
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
The Senior Engineer will verify ASIC designs, implement UVM test environments, develop and run test cases, and collaborate across teams to enhance verification methodologies.
Top Skills:
AmbaAxiCadenceChiJenkinsJIRASimscopeSynopsysSystemverilogUvm
Cloud • Information Technology • Security • Software • Cybersecurity
The role involves overseeing identity and access control infrastructure, leading a team in Zero Trust technology, managing development, and collaborating with various stakeholders to ensure efficient project delivery.
Top Skills:
AWSAzureCassandraDynamoDBGCPGoogle SpannerKafkaKubernetesLdapMemcachedOauthRabbitMQRedisSAMLScim
Cloud • Information Technology • Security • Software • Cybersecurity
As a Staff Software Development Engineer, you will lead the development of identity management products, design core functionalities, and collaborate with teams to ensure excellence in software delivery.
Top Skills:
Ci/CdDockerHibernateJavaKubernetesPostgresRestful ApisSpringSQL
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
