Lead modernization of production data pipelines in Stockholm, designing architecture and migrating systems while preserving existing outputs. Build hands-on solutions with Airflow, Spark, dbt, BigQuery, and Python; establish testing, code review, incident management, and release processes; and mentor a data engineer. The role also addresses encryption, data retention, deletion compliance, reliability, and long-term pipeline ownership.
Senior Data Engineer / Data Pipeline Architect
Location: Stockholm, Sweden (Hybrid – Travel Required)
Experience Required: 5 to 10 years
Duration: 6 months (Extendable)
Employment Type: FTE
Working Mode: Hybrid (Travel Required)
Language: English
Start: November 9, 2026 – April 30, 2027
We are looking for an experienced Senior Data Engineer / Data Pipeline Architect for an assignment in Stockholm focusing on data pipeline modernization, data security, and technical architecture.
The assignment involves leading the technical migration of existing data pipelines to meet stricter requirements for encryption, data retention, and deletion of user data, including historical and derived datasets.
Key Responsibilities- Design and drive the architecture, migrating pipelines incrementally while ensuring existing outputs remain unchanged.
- Establish sustainable engineering processes for testing, code reviews, incident management, and releases.
- Combine architectural leadership with hands-on engineering using Airflow, Spark, dbt, BigQuery, and Python.
- Collaborate closely with and mentor a Data Engineer within the team, ensuring long-term ownership, reliability, and independent maintenance of the migrated pipelines.
- Minimum 5 years of relevant professional experience (5–10 years overall).
- Deep hands-on experience with Airflow, Spark, dbt, BigQuery, and Python.
- Proven experience technically leading at least one complete data pipeline migration from start to finish.
- Experience refactoring production data pipelines while verifying that their outputs remain unchanged.
- Experience establishing and implementing engineering processes for testing, code reviews, and incident management.
- Demonstrated mentoring experience with measurable outcomes.
- Minimum Bachelor's degree (or equivalent).
- Experience with encryption at rest, data retention, or data deletion compliance (e.g., GDPR).
- Experience with envelope encryption and key management solutions (e.g., GCP KMS, AEAD functions, or Tink).
- Knowledge of BigQuery column-level security, policy tags, and Data Catalog.
- Experience with Config Connector (KCC) for managing GCP resources through Kubernetes.
- Experience with event-driven architectures using Kafka.
Similar Jobs
Fintech • Financial Services
Provides enterprise technical leadership for complex engineering challenges across networking, application delivery, information security, databases, operating systems, and web technologies. Defines architecture and engineering standards, leads hybrid-cloud modernization, and designs highly available, scalable, secure infrastructure using F5 BIG-IP and AVI load balancers. Drives automation, Infrastructure as Code, DevOps, resiliency, production support, and incident resolution while advising leadership, influencing strategy, and mentoring engineers.
Top Skills:
AnsibleAvi Load BalancerAWSAzureCi/CdCiscoDnsF5 Big-IpGCPGtmKubernetesLtmOpenshiftPythonSite Reliability EngineeringSsl/TlsTcp/IpTerraformVMwareWafZero Trust
Fintech • Financial Services
Owns product demand, roadmaps, backlogs, requirements, Agile delivery, testing, release readiness, governance, and executive reporting across market maker and options clearing. Coordinates Product, Technology, Operations, Risk, Compliance, Finance, and Control stakeholders while managing dependencies, risks, controls, regulatory initiatives, and process improvements. Supports automation, analytics, AI enablement, production governance, and operational readiness for clearing and post-trade capabilities.
Top Skills:
Agile Delivery MethodologiesAi-Enabled ToolsAnalyticsJIRALow-Code PlatformsExcelMS OfficeMicrosoft PowerpointMicrosoft WordWorkflow Automation
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Principal Software Engineer focused on encryption, working remotely within Atlassian’s distributed-first engineering organization. The provided description contains limited role-specific responsibilities.
Top Skills:
Encryption
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
