Design, build, and maintain scalable batch and real-time data pipelines, ETL/ELT workflows, data models, warehouses, and lakes. Ensure data quality, reliability, security, and performance while integrating APIs, databases, cloud platforms, and third-party systems. Collaborate with data science, machine learning, engineering, and product teams to provide datasets for analytics and machine learning. Monitor pipelines, troubleshoot infrastructure issues, implement testing and validation frameworks, and contribute to data platform architecture.
Hypersonix.ai is disrupting the e-commerce space with AI, ML and advanced decision capabilities to drive real-time business insights. Hypersonix.ai has been built ground up with new age technology to simplify the consumption of data for our customers in various industry verticals.
We are looking for a skilled and motivated Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure. You will work closely with Data Science, Engineering, and Product teams to ensure high-quality, reliable, and accessible data for analytics, machine learning, and business applications.
Roles and Responsibilities
We are looking for a skilled and motivated Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure. You will work closely with Data Science, Engineering, and Product teams to ensure high-quality, reliable, and accessible data for analytics, machine learning, and business applications.
Roles and Responsibilities
- Design, develop, and maintain scalable data pipelines for batch and real-time data processing.
- Build and optimize ETL/ELT workflows to collect, transform, and load data from multiple sources.
- Develop and maintain data models, data warehouses, and data lakes.
- Ensure data quality, consistency, accuracy, and reliability across data pipelines.
- Optimize data processing workflows for performance, scalability, and cost efficiency.
- Work with large and complex datasets from multiple sources.
- Collaborate with Data Scientists and ML Engineers to prepare and deliver high-quality datasets for machine learning models.
- Develop data integrations with APIs, databases, cloud platforms, and third-party systems.
- Monitor data pipelines and troubleshoot data processing and infrastructure issues.
- Implement data validation, monitoring, and testing frameworks.
- Maintain clear documentation of data pipelines, data models, and technical processes.
- Follow best practices for data security, governance, and access control.
- Contribute to the design and evolution of Hypersonix's data platform and architecture.
- 5–7 years of experience in Data Engineering or a similar role.
- Strong programming skills in Python or another programming language.
- Strong experience with SQL and relational databases.
- Hands-on experience building ETL/ELT pipelines and data workflows.
- Experience with data processing technologies such as Spark/PySpark.
- Experience working with cloud platforms such as AWS, Azure, or GCP.
- Good understanding of data warehousing and data lake concepts.
- Experience with workflow orchestration tools such as Airflow, Dagster, or similar.
- Experience working with distributed systems and large-scale datasets.
- Strong understanding of data modeling, database design, and performance optimization.
- Familiarity with Git and CI/CD practices.
- Good understanding of software engineering principles and coding best practices
Hypersonix Inc. Bengaluru, Karnataka, IND Office
Bengaluru, India
Similar Jobs
.png)
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Designs, builds, operationalizes, and maintains scalable GCP data pipelines and warehouses. Responsibilities include ETL optimization, data modeling, governance, lineage, quality checks, monitoring, alerting, documentation, and troubleshooting. The role uses Python, SQL, BigQuery, dbt, Airflow, Dataflow, and related tools to integrate data from multiple sources and support analytics and reporting. It also requires collaboration with stakeholders, reusable software components, and ownership of production data pipelines.
Top Skills:
Apache AirflowBigQueryCeligoCloud ComposerDataflowDataprocDbtFivetranGitGoogle Cloud Platform (Gcp)JSONPythonSQLTalendXML
Cloud • Healthtech • Professional Services • Software • Pharmaceutical
Leads data engineering and technical consulting for clinical systems, including platform configuration, ETL, data warehouse development, custom analytics, reporting, integrations, validation, quality control, and SOP development. Provides technical escalation, solution design, project oversight, mentoring, training, process improvement, and client support while ensuring compliance with eClinical and industry standards.
Top Skills:
.NetAWSAzureBusiness ObjectsC#CognosDb2HTMLIbm DatastageInformInformaticaJavaJreviewExcelMS OfficeMicrosoft ProjectMicrostrategyOracleOracle ClinicalPl/SqlPythonQliksenseQlikviewRRaveRest ApisSASSparkSpotfireSQLSQL ServerSsrsT-SqlTableauTeradataTrial Master
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead data engineering architecture and execution for large-scale, low-latency analytics. Own technical direction, ensure operational data quality, design streaming and batch pipelines, mentor engineers, coordinate cross-functional teams, and deliver scalable solutions using Spark, Airflow, and AWS or equivalent data platforms.
Top Skills:
AirflowAthenaColumn StoresDatabricksDatabricks ApisEmrFlinkHiveKafkaKappa ArchitectureLambda ArchitectureMaster Data Management (Mdm)Microservices ArchitectureRedshiftSparkSQLStreaming Pipelines
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
