Designs and operates Azure-based data platforms, including infrastructure as code, Snowflake, Astronomer/Airflow, dbt CI/CD, secure data ingestion, secrets management, and observability. Leads platform reliability, security, automation, documentation, and collaboration with data engineering and architecture teams. Builds production-grade deployment pipelines and establishes operational standards, SLAs, and reliability targets.
ROLE OVERVIEW
We are seeking an experienced DevOps Engineer with strong data platform and SRE expertise to drive the
design, implementation, and operational excellence of a modern client Data Platform.
In this high-impact position, you will bridge the gap between infrastructure automation and modern data
architecture. You will lead technical initiatives covering automated provisioning on Microsoft Azure,
orchestrating scalable enterprise data workflows via Astronomer and dbt, and establishing robust
continuous integration/continuous delivery (CI/CD) practices for all data engineering workloads.
PRIMARY RESPONSIBILITIES
Infrastructure as Code: Design, implement, and deploy ARM templates for automated Azure infrastructure
provisioning and environment lifecycle management.
Azure Service Provisioning: Configure and maintain scalable Azure services, including Azure Functions, Event Bus,
and Event Grid for event-driven data flows.
Snowflake Architecture & Security: Create and manage enterprise Snowflake accounts. Maintain role-based
access control (RBAC), virtual warehouses, security policies, and performance tuning.
Workflow Orchestration: Deploy, configure, and operate Astronomer (Apache Airflow) for production-grade
orchestration and scheduling of data pipelines.
dbt Pipeline Automation: Automate deployment pipelines for dbt projects, ensuring strict code quality standards,
modularity, test coverage, and continuous delivery.
Secrets & Security Governance: Centralize and secure credential management using Azure Key Vault (AKV) for
safe DevOps automation and runtime access across environments.
Secure File Transport: Architect and set up SFTP ingestion workflows utilizing a Bastion Host, ensuring secure
landing into Azure Blob Storage containers.
CI/CD Engineering: Build, maintain, and optimize robust CI/CD deployment pipelines (e.g., Azure Repos /
Pipelines) tailored for data engineering workloads.
Platform Observability: Monitor overall system health, data pipeline reliability, and platform performance using
enterprise observability tooling (e.g., Prometheus, Grafana).
Integration Management: Establish seamlessly integrated ecosystems connecting Snowflake with upstream and
downstream systems, specifically dbt and Astronomer.
Architectural Collaboration: Partner closely with Data Engineers, Data Architects, and enterprise stakeholders to
define infrastructure deployment standards, operational SLAs, and reliability targets.
Technical Documentation: Author and maintain comprehensive technical documentation covering infrastructure
designs, CI/CD procedures, runbooks, and DevOps best practices.
Requirements
- 8+ years in a DevOps, SRE, or Data Infrastructure
role within a data-centric enterprise environment.
- Azure Expertise: Strong practical experience with
ARM templates, Azure Resource Manager, Azure
Functions, Event Bus, and Event Grid.
- Airflow / Astronomer: Hands-on experience
deploying and operating Astronomer or Apache
Airflow in production.
- Data CI/CD: Proven track record building CI/CD
pipelines specifically for data workloads (dbt,
Airflow, schema migrations).
- Snowflake Mastery: Deep understanding of
Snowflake RBAC, performance tuning, warehouse
management, and ecosystem integrations.
- Containerization: Solid hands-on experience with
Docker and managing containerized services in
production environments.
- Secrets Security: Demonstrated experience
managing secrets, keys, and certificates securely
via Azure Key Vault (AKV).
- Data Ingestion Architecture: Practical exposure
to secure SFTP-to-Blob integrations using
Bastion host routing.
- Observability: Proficiency with monitoring and
alerting tools such as Prometheus, Grafana, or
cloud-native telemetry.
Nice to Have
- Exposure to dbt Cloud or advanced dbt Core
deployment patterns.
- Familiarity with GitOps workflows and declarative
infrastructure tools.
- Experience working in agile, cross-functional
engineering teams.
- In-depth understanding of enterprise data
governance and security frameworks.
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead the design, development, deployment, and operation of secure cloud-native applications on Azure. Manage containerized workloads on AKS, Azure SQL data layers, CI/CD pipelines, infrastructure as code, monitoring, security, compliance, cost optimization, and production troubleshooting. Partner with product and business stakeholders, make architectural decisions, support testing, and mentor junior and mid-level engineers while adopting Azure and AI technologies.
Top Skills:
Ai BuilderArm TemplatesAzure Kubernetes Service (Aks)Azure Openai ServicesAzure PaasAzure SqlBicepDockerGitGithub ActionsJavaKubernetesAzurePythonRestful ApisSQLTerraform
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Design and build scalable web applications on AWS using React, TypeScript, Python, and DevOps practices. Ensure code quality through Agile/Scrum delivery, unit and integration testing, code reviews, documentation, and engineering design specifications. Optimize application performance, database queries, caching, response times, logging, and troubleshooting while applying security fundamentals and enabling CI/CD.
Top Skills:
AgileAuthenticationAuthorizationAWSCachingCi/CdDatabase OptimizationDevOpsEncryptionHashingHTTPIntegration TestingPythonReactRest ApiScrumTypescriptUnit TestingWeb Security
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Lead a team delivering DevOps automation and solutions for Ericsson’s 4G and 5G customer environments. Responsibilities include performance monitoring, troubleshooting, platform management, system design, CI/CD automation, infrastructure and service lifecycle management, reliability improvements, customer deployments, and operational support. The role requires building scalable cloud-native systems, maintaining DevOps platforms, automating deployment of numerous services, and collaborating with development teams on testing, releases, security, and compliance.
Top Skills:
AgileAnsibleArtifactoryAWSAzureAzure DevopsChefCloudflareDevOpsDockerGCPGitGitGitlabJSONKubernetesPuppetPythonRhelSastScrumShell ScriptingSonarqubeUbuntuYaml
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
