The RTS Kafka Engineer will design and maintain scalable real-time streaming platforms, optimizing Kafka-based solutions, and collaborate with teams for efficient data processing in cloud environments.
Job Summary
We are looking for a highly skilled RTS Kafka Engineer to design, build, and maintain scalable real-time streaming platforms. The ideal candidate will have strong hands-on experience with Apache Kafka, cloud-native architectures, and event-driven systems operating in high-throughput environments. This role involves building reliable streaming pipelines, enabling real-time data processing, and supporting cloud-based distributed systems.
Key Responsibilities- Design, implement, and manage Kafka-based real-time streaming solutions in high-throughput environments.
- Perform Kafka setup, configuration, tuning, and performance optimization.
- Develop and maintain scalable event-driven and streaming architectures.
- Build and manage streaming data pipelines processing large-scale datasets.
- Implement CI/CD pipelines using tools such as Git, Jenkins, ArgoCD, or similar platforms.
- Work with cloud-native applications deployed across AWS, Azure, or OCI environments.
- Automate infrastructure and deployment using cloud automation toolsets.
- Apply GitOps practices for deployment and environment management.
- Ensure system reliability, scalability, and high availability.
- Implement automated unit testing and integration testing for streaming applications.
- Collaborate with DevOps, platform engineering, and application teams to deliver end-to-end real-time solutions.
- Apply software design patterns and best practices in distributed systems development.
- Strong hands-on experience with Apache Kafka setup, configuration, and administration.
- Experience working with high-volume streaming data platforms.
- Solid understanding of event-driven architecture and distributed systems.
- Experience with source control systems (Git).
- Hands-on exposure to CI/CD pipelines (Jenkins, ArgoCD, or similar).
- Experience with at least one public cloud platform:
- AWS
- Microsoft Azure
- Oracle Cloud Infrastructure (OCI)
- Knowledge of cloud automation tools and infrastructure automation.
- Understanding of GitOps methodology.
- Strong knowledge of software design patterns and implementation practices.
- Experience implementing automated testing (unit & integration testing).
- Experience with Kafka ecosystem tools (Kafka Connect, Schema Registry, ksqlDB).
- Exposure to containerization and orchestration platforms (Docker, Kubernetes, OpenShift).
- Experience with monitoring and observability tools (Prometheus, Grafana, ELK, etc.).
- Background in real-time systems (RTS) or financial transaction platforms is a plus.
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design, build, and operate scalable, cloud-native data pipelines, platforms, and production backend services. Implement data models, orchestration (e.g., Airflow), CI/CD, and IaC practices. Ensure reliability, performance, monitoring, and mentor junior engineers while collaborating on architecture and deployments.
Top Skills:
AirflowAWSAzureCi/CdData WarehousesDockerEtl/EltGCPGitPythonRelational DatabasesSQL
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Apply advanced statistical models and analytics to solve client business problems; design analyses in R/SAS/Tableau/VBA/Excel; synthesize and present results; build client relationships; create deliverables, mentor associates, and provide project updates.
Top Skills:
Database SystemsExcelHadoopJavaPythonRSASTableauVBAVisual Basic
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Support GWE R&D budget/forecast tracking and P2P processes across EMEA and India. Manage purchase orders, resolve invoice/payment issues, input budgets using Mosaic, analyze budget vs. actuals, provide variance commentary, track PO performance metrics, support system migrations, and drive process improvements to meet budget targets and reduce operating costs.
Top Skills:
AribaExcelMosaicOutlookPowerPointSAPWord
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
