The RTS Kafka Engineer will design and maintain scalable real-time streaming platforms, optimizing Kafka-based solutions, and collaborate with teams for efficient data processing in cloud environments.
Job Summary
We are looking for a highly skilled RTS Kafka Engineer to design, build, and maintain scalable real-time streaming platforms. The ideal candidate will have strong hands-on experience with Apache Kafka, cloud-native architectures, and event-driven systems operating in high-throughput environments. This role involves building reliable streaming pipelines, enabling real-time data processing, and supporting cloud-based distributed systems.
Key Responsibilities- Design, implement, and manage Kafka-based real-time streaming solutions in high-throughput environments.
- Perform Kafka setup, configuration, tuning, and performance optimization.
- Develop and maintain scalable event-driven and streaming architectures.
- Build and manage streaming data pipelines processing large-scale datasets.
- Implement CI/CD pipelines using tools such as Git, Jenkins, ArgoCD, or similar platforms.
- Work with cloud-native applications deployed across AWS, Azure, or OCI environments.
- Automate infrastructure and deployment using cloud automation toolsets.
- Apply GitOps practices for deployment and environment management.
- Ensure system reliability, scalability, and high availability.
- Implement automated unit testing and integration testing for streaming applications.
- Collaborate with DevOps, platform engineering, and application teams to deliver end-to-end real-time solutions.
- Apply software design patterns and best practices in distributed systems development.
- Strong hands-on experience with Apache Kafka setup, configuration, and administration.
- Experience working with high-volume streaming data platforms.
- Solid understanding of event-driven architecture and distributed systems.
- Experience with source control systems (Git).
- Hands-on exposure to CI/CD pipelines (Jenkins, ArgoCD, or similar).
- Experience with at least one public cloud platform:
- AWS
- Microsoft Azure
- Oracle Cloud Infrastructure (OCI)
- Knowledge of cloud automation tools and infrastructure automation.
- Understanding of GitOps methodology.
- Strong knowledge of software design patterns and implementation practices.
- Experience implementing automated testing (unit & integration testing).
- Experience with Kafka ecosystem tools (Kafka Connect, Schema Registry, ksqlDB).
- Exposure to containerization and orchestration platforms (Docker, Kubernetes, OpenShift).
- Experience with monitoring and observability tools (Prometheus, Grafana, ELK, etc.).
- Background in real-time systems (RTS) or financial transaction platforms is a plus.
Top Skills
Apache Kafka
Argocd
AWS
Docker
Elk
Git
Grafana
Jenkins
Kubernetes
Azure
Oracle Cloud Infrastructure (Oci)
Prometheus
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead development teams in software solutions, focusing on Facets delivery, automation using AI tools, and managing EDI transactions while ensuring compliance with healthcare standards.
Top Skills:
Ai ToolsAngularC#Ci/CdDot NetEdiFacetsGitMs Office SuiteMs ProjectSharepointSQLVisio
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead product transformation efforts, align initiatives with strategic goals, coach product teams in best practices, and enhance client experience and productivity.
Top Skills:
Agile MethodologiesCross-Functional TeamsHypothesis-Driven DevelopmentOkrsProduct ManagementRapid Prototyping
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Seeking an experienced Full Stack Developer with 8+ years expertise in backend and React UI, overseeing high-quality development, collaborating on modern web solutions, and driving performance optimization.
Top Skills:
Context ApiDockerGitGraphQLHTML5JavaJavaScriptJestKubernetesMochaNode.jsPythonReactReduxRestful ApisShellTypescript
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
