Atomicwork is on a mission to transform the digital workplace experience by uniting people, processes, and platforms through AI automation. Our team is building a modern service management platform that enables growing businesses to reduce operational complexity and drive business success.
We are seeking a skilled and motivated Data Pipeline Engineer to join our team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines that support our enterprise search capabilities. Your work will ensure that data from various sources is efficiently ingested, processed, and indexed, enabling seamless and secure search experiences across the organisation. This position is based out of our Bengaluru office. We offer competitive pay to employees and practical benefits for their whole family. If this sounds interesting to you, read on.
What We’re Looking For (Qualifications)
We value hands-on skills and a proactive mindset. Formal qualifications are
less important than your ability to deliver results and collaborate effectively.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong experience with data pipeline frameworks and tools (e.g., Apache Airflow, Apache NiFi).
• Experience with search platforms like Elasticsearch or OpenSearch.
• Familiarity with data ingestion, transformation, and indexing processes.
• Understanding of enterprise search concepts, including crawling,indexing, and query processing.
• Knowledge of data security and access control best practices.
• Experience with cloud platforms (AWS, GCP, or Azure) and related - Backend Engineer - Search/Integrations services.
• Familiarity with Model Context Protocol (MCP) is a strong plus
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration
What You’ll Do (Responsibilities)
• Design, develop, and maintain data pipelines for enterprise search applications.
• Implement data ingestion processes from various sources, including databases, file systems, and APIs.
• Develop data transformation and enrichment processes to prepare data for indexing.
• Integrate with search platforms to index and update data efficiently.
• Ensure data quality, consistency, and integrity throughout the pipeline.
• Monitor pipeline performance and troubleshoot issues as they arise.
• Collaborate with cross-functional teams, including data scientists, engineers, and product managers.
• Implement security measures to protect sensitive data during processing and storage.
• Document pipeline architecture, processes, and best practices.
• Stay updated with industry trends and advancements in data engineering and enterprise search.
Why we are different (culture)
As a part of Atomicwork, you can shape our company and business from idea to production. Our cultural values also set the bar high, helping us create a better workplace for everyone.
- Agency: Be self-directed. Take initiative and solve problems creatively.
- Taste: Hold a high bar. Sweat the details. Build with care and discernment.
- Ownership: We demonstrate unwavering commitment to our mission and goals, taking full responsibility for triumphs and setbacks.
- Mastery: We relentlessly pursue continuous self-improvement as individuals and teams, dedicating ourselves to constant learning and growth.
- Impatience: We recognize that our world moves swiftly and is driven by an unyielding desire to progress with every endeavor.
- Customer Obsession: We place our customers at the heart of everything we do, relentlessly seeking to understand their needs and exceed their expectations.
What we offer (compensation and benefits)
We are big on benefits that make sense to you and your family.
- Fantastic team —the #1 reason why everybody joins us.
- Convenient offices — well-located offices spread over five different cities.
- Paid time off — Unlimited sick leaves and 15 days off every year.
- Health insurance — comprehensive health coverage upto 75% premium covered.
- Flexible allowances — with hassle-free reimbursements across spends.
- Annual outings — for everyone to have fun together.
What next (applying for this role)
- Click on the apply button to get started with your application.
- Answer a few questions about yourself and your work.
- Wait to hear from us about the next steps.
Do you have anything else to tell us? Email [email protected] and let us know what’s on your mind.
