Designs, builds, and maintains scalable data pipelines and cloud-based data solutions using Python, SQL, Snowflake, PySpark, and AWS. Develops data ingestion, transformation, analytics, and integration frameworks for large datasets while improving performance, reliability, and data quality. Collaborates with product, business, and QA teams and applies AI-native tools and workflows for coding, testing, reviews, documentation, and productivity.
Shuru is a self-managed technology team specializing in accelerating visions through product, technology, and AI leadership. With a focus on bespoke execution, we deliver impactful solutions that are scalable and designed for success. At Shuru, we deliver mobile solutions that meet and exceed customer expectations. Our collaborative and fast-paced environment encourages creativity and innovation.
We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions using Python, SQL, Snowflake, PySpark, and AWS.
Key Responsibilities
- Design and maintain scalable data pipelines using Python, SQL, Snowflake, and AWS.
- Build data ingestion, transformation, and analytics solutions for large-scale datasets.
- Work with product, business, and QA teams to deliver reliable data solutions.
- Improve data processing performance, reliability, and overall data quality.
- Use AI-native development practices and AI tools for coding, reviews, testing, documentation, and productivity.
Requirements
- Strong experience in Python development, particularly for ETL, data processing, and automation.
- Strong expertise in SQL and Snowflake is required, including data modeling and performance optimization.
- Hands-on experience with PySpark and Big Data technologies is required for building and processing large-scale data pipelines.
- Experience with AWS services such as S3, SNS, and Glue, along with cloud-based data engineering solutions.
- Experience building scalable data pipelines, integration frameworks, and AI-assisted development workflows is essential.
Benefits
- Work on international projects: Be part of a global team working with clients from across the world.
- Regular team outings: Even with remote work, we believe in building strong team bonds through regular social and team-building events.
- Collaborative & growth-oriented: Learn from senior engineers, work in a collaborative environment, and grow professionally with opportunities for career development.
- Competitive Salary and Benefits
Similar Jobs
Artificial Intelligence • Cloud • Information Technology • Consulting
Leads production AI and data engineering across agentic AI, LLMs, RAG, machine learning, MLOps, data architecture, governance, and automation. Designs scalable AI solutions, defines engineering standards, oversees Databricks, Fabric, and Collibra platforms, mentors engineers, and partners with cross-functional teams. Responsibilities include LLM evaluation and fine-tuning, ML lifecycle management, data quality, responsible AI, reporting integration, technical architecture, and innovation.
Top Skills:
AksAnthropic Claude ApiAutogenAzure Api ManagementAzure FunctionsAzure MlAzure Openai ServiceCollibraCrewaiDatabricksDaxDpoFastapiHugging Face TransformersJavaScriptLangchainLanggraphLightgbmLimeLoraMicrosoft CopilotMicrosoft FabricMlopsOpenai Gpt ApiPeftPower BIPythonPyTorchRagRest ApisRlhfScikit-LearnSemantic KernelShapSQLTypescriptVector DatabasesXgboost
Information Technology • Software • Consulting
Build and ship internal tools, backend services, APIs, frontend interfaces, data integrations, automation, and AI-powered features. Integrate LLM, RAG, and agent capabilities into usable software, collaborate with teams across the business, and own solutions through production. The role requires adaptable full-stack engineering, data fluency, AI integration experience, autonomy, and reliable end-to-end delivery.
Top Skills:
Ai ApisAPIsCi/CdContainersData PipelinesDatabasesInfrastructure-As-CodeLlmPythonRagTypescript
Cloud • Database
Build and deploy production-ready AI applications and data pipelines on Azure Databricks. Responsibilities include PySpark and SQL ETL/ELT, CI/CD, Azure integrations, ML and generative AI deployment, RAG and vector search, LLM fine-tuning, monitoring, optimization, governance, and responsible AI. The role also involves Databricks Apps, Unity Catalog, prompt engineering, FastAPI and React applications, testing, guardrails, and collaboration with data science and platform teams.
Top Skills:
Adls Gen2AirflowArmAzureAzure Cognitive SearchAzure Data FactoryAzure DatabricksAzure DevopsAzure FunctionsAzure Key VaultAzure Machine LearningAzure OpenaiBicepClaude ApisDatabricks Asset BundlesFaissFastapiHugging FaceLangchainLoraMlflowPysparkPythonQloraReactSQLTerraformUnity CatalogVisual Studio Code
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
