Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead the technical evolution of Atlassian’s data engineering capabilities by architecting scalable batch and streaming data solutions. Direct complex engineering efforts, improve data quality and productivity, establish technical direction, and coordinate implementation across teams. Mentor and coach data engineers while partnering cross-functionally to support data-driven business decisions and long-term platform scalability.
Top Skills:
Apache AirflowApache FlinkApache HiveApache KafkaSparkAws AthenaAws EmrAws RedshiftDatabricksKappa ArchitectureLambda ArchitectureMaster Data ManagementMicroservicesSQL
Software
Own end-to-end AI data engineering solutions, including architecture, ingestion, transformation, processing, metadata, quality, lineage, observability, and production operations. Build scalable pipelines and AI-ready data assets using Python, Kubernetes, Spark, PostgreSQL, Elasticsearch, and Microsoft Fabric. Develop semantic ingestion, retrieval, and LLM-assisted processing capabilities while enabling AI and agentic applications. Collaborate with researchers, standards experts, and patenting stakeholders, and provide technical guidance while remaining hands-on.
Top Skills:
SparkApache SupersetBigQueryCi/CdElasticsearchEmbeddingsKnowledge GraphsKubernetesLlmsAzureMicrosoft FabricOlapPostgresPower BIPythonSemantic RetrievalVector Search
Information Technology • Consulting
Develop and support scalable data operations, ETL pipelines, SQL integrations, Azure services, Power Platform automations, and Power BI reporting. Responsibilities include Azure Data Factory pipeline development, Logic Apps and Power Automate workflows, Power BI modeling and publishing, Azure resource administration, governance, monitoring, troubleshooting, security controls, documentation, and performance optimization.
Top Skills:
Application InsightsAzure Data FactoryAzure Logic AppsAzure RbacAzure Storage AccountsDaxETLLog AnalyticsAzureMicrosoft Entra IdExcelMicrosoft FabricMicrosoft Power PlatformPower AutomatePower BIPower Bi Row-Level SecurityPower QuerySQL
Thank you for considering the Data Engineer position at Reveal Health Tech. We are an early-stage IT startup based in the US and India, focused on leveraging technology to deliver transformative solutions for companies within healthcare and lifesciences.
ABOUT THE ROLE
We are seeking a skilled Data Engineer proficient in python with experience in Django framework, PostgreSQL database management, and AWS/Azure to join our dynamic team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines to support our growing data processing needs. The ideal candidate is independent, detail-oriented, and capable of performing data validation and debugging to ensure high data quality and reliability.
Find out more about our mission and why we started Reveal Health Tech on our website.
- Designing and implementing scalable, robust, and maintainable data pipelines using AWS/Azure services.
- Implementing data quality checks and validation processes to ensure accuracy, completeness, and integrity of data.
- Designing effective data models and architectures to optimize data processing and facilitate downstream Data Science and Machine Learning workflows.
- Utilizing data quality validation tools to automate and streamline validation processes.
- Work closely with Product Managers, Quality Assurance, and DevOps teams to deliver high-performance and reliable software solutions.
- Monitoring and optimizing the performance of data pipelines.
- Debugging issues and resolving data-related problems in a timely manner.
- Documenting data pipeline architectures, processes, and procedures.
- Stay up-to-date with new technologies, tools, and best practices in the data engineering field.
Key Skills & Qualifications:
- Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent work experience).
- Minimum 3+ years of experience in Data Engineering.
- Proficiency in data modeling and architecture, leveraging AWS/Azure services to architect scalable and efficient data solutions.
- Experience designing and building data pipelines from diverse source systems.
- Solid understanding of data lake and warehousing concepts and best practices.
- Proficiency in programming languages used for data manipulation and transformation (e.g., Python, SQL).
- Extensive knowledge and hands-on experience with the Django framework.
- Experience with relational databases like PostgreSQL (PSQL).
- Knowledge of RESTful Web Services and API development.
- Understanding of database systems, including schema design, SQL querying, and performance optimization.
- Experience implementing data quality checks and validation processes.
- Experience using CloudFormation and CI/CD for deployment.
- Proficiency in version control systems, particularly Git.
- Ability to work independently and as part of a team in a fast-paced environment.
- Excellent problem-solving skills and attention to detail.
Preferred Skills:
- AWS certification (e.g., AWS Certified Solutions Architect, AWS Certified Data Analytics Specialty).
- Familiarity with serverless computing (e.g., AWS Lambda) and containerization (e.g., Docker).
- Experience with LLMs and machine learning is highly preferred.
How you will enrich us?
- Energetic and enthusiastic
- Autonomous and self-motivated
- Growth mindset
- Embraces challenges
- Building new things gets your blood pumping!
- Curiosity and deep interest in the world
- Challenges the status quo constructively
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
