As a Senior Data Engineer, you will design data pipelines, implement backend support, and collaborate with cross-functional teams on cybersecurity tasks.
ABOUT THIS ROLE
As a senior data engineer you will work on complex data pipelines dealing with petabytes of data. Balbix platform is used as one of the critical security tools by the CIOs, CISOs, and the sec-ops teams of small, medium and large sized enterprises including Fortune 10 companies around the world. You will solve problems related to massive cybersecurity and IT data sets. You will collaborate closely with our data scientists, threat researchers and network experts to solve real-world problems plaguing cybersecurity. This role requires excellent algorithm, programming and testing skills as well as experience in large-scale data engineering projects.
You will:
- Design and implement the features and own the modules for ingesting, storing and manipulating large data sets for a variety of cybersecurity use-cases
- Write code to provide backend support for data-driven UI widgets, web dashboards, workflows, search and API connectors
- Design and implement web services, rest APIs, and microservices
- Build production quality solutions that balance complexity and meet acceptance criteria of functional requirements
- Work with multiple-interfacing teams, including ML, UI, backend and data engineering
You are:
- Driven to experience and learn more about design, architecture, and take on progressive roles
- Collaborative and comfortable working with across teams including data engineering, front end, product management, and DevOps
- Responsible and like to take ownership of challenging problems
- An effective communicator, including good documentation practices and articulating thought processes in a team setting
- Comfortable with working in an agile environment
- Curious about technology and the industry, and a constant learner
You have:
- MS/BS +3 years in Computer Science or a related field
- Expert programming experience with Python, Java, or Scala
- Good working knowledge of SQL databases such as Postgres and NoSQL databases such as MongoDB, Cassandra, Redis
- Experience with search engine database such as ElasticSearch is preferred
- Time-series databases such as InfluxDB, Druid, Prometheus
- Strong computer science fundamentals: data structures, algorithms, and distributed systems
Top Skills
Cassandra
Druid
Elasticsearch
Influxdb
Java
MongoDB
Postgres
Prometheus
Python
Redis
Scala
SQL
Similar Jobs
Consumer Web • Real Estate
The Senior Data Engineer will analyze complex data sets, curate data sources, design reports, and collaborate to ensure data quality and insights delivery.
Top Skills:
AWSExcelGCPLookerPower BIPythonSQLTableau
Security
Collaborate with teams to design, develop, and deploy high-scale backend systems, mentor junior developers, and optimize applications for performance and scalability.
Top Skills:
Apache FlinkSparkAWSAzureCassandraDockerGoogle Cloud PlatformJavaKubernetesPythonScala
Information Technology
Lead front-end engineering initiatives, mentor a team, and drive architectural decisions while ensuring high-quality user experiences using modern technologies.
Top Skills:
AlgoliaCi/Cd PipelinesCloudinaryContentfulGithub ActionsGoogle Cloud PlatformGraphQLNext.JsPlaywrightReactRestSegmentStorybookTailwind CssTalon.OneTypescript
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
