Designs, develops, deploys, and monitors Databricks data pipelines on AWS using PySpark and SQL. Builds scalable data solutions, quality dashboards, lineage and monitoring tools, and supports legacy data migration. Ensures data security, retention, privacy, governance, and auditability while optimizing processes through automation and code improvements.
GoTymeX is building some of world's fastest growing digital banks and the data team plays a key role in driving the bank’s vision of creating a platform that stimulates economic participation and facilitates broader financial inclusion by implementing creative best in class data and analytic solutions to achieve success in providing quality services and products to our customers and optimising the business.
As a Senior Data Engineer you will contribute to the mission by creating solutions that will directly support informed decision-making and innovation by providing clean, protected, quality and auditable data from various sources into fit for purpose data products.
In this role, you can expect to:
- Design, develop, test, deploy and monitor data pipelines in Databricks on AWS from a wide variety of data sources.
- Design, develop, test, deploy and monitor scalable code with PySpark and SQL in Databricks.
- Identify opportunities to improve internal process through code optimisation and automation.
- Build data quality dashboards, lineage flows / and or monitoring tools to utilize the data pipeline, providing active monitoring and actionable insight into overall data quality and data governance.
- Assist in migrating data from legacy systems onto newly developed solutions.
- Follow and lead best practices on all data security, retention, and privacy policies.
Requirements
- Bachelor’s degree.
- 3+ years’ experience of building ETL/ELT pipelines.
- Proven competency in solution design, development, implementation, reporting and analysis.
- Proficiency in Apache-Spark, Python and SQL languages.
- Proficiency in working with Text, Delta, Parquet, JSON, CSV, and XML data formats.
- Working knowledge of Spark structured streaming.
- AWS infrastructure experience, specifically working with S3.
- Solid understanding of git-based version control, DevOps, and CI/CD. Experience of working on Atlassian stack a plus.
- Knowledge of common web API frameworks and web services.
- Strong teamwork, relationship, and client management skills, and the ability to influence peers and senior management to accomplish team goals.
- Willingness to embrace modern technology, best practice, and ways of work.
Similar Jobs
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Manages strategic relationships with banks and financial institutions, develops account growth plans, identifies new business and revenue opportunities, and aligns Mastercard payment solutions with customer priorities. Leads customer engagements, commercial proposals, negotiations, go-to-market initiatives, and cross-functional delivery across payments, cards, digital banking, and value-added services. Tracks account performance, pipeline, revenue contribution, and strategic project execution while influencing senior stakeholders and driving portfolio expansion.
Top Skills:
Card AcquiringCard IssuanceCommercial Payment SolutionsDigital PaymentsEmerging Payment TechnologiesPayment Acceptance
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Build, design, test, deploy, maintain, and improve software for SaaS and cloud environments. Apply distributed systems and cloud expertise while managing project priorities, deadlines, and deliverables. Collaborate independently and with teams on complex, time-sensitive projects, using software engineering principles, design patterns, and SDLC methodologies. The role involves developing scalable software with programming languages such as Go, Java, C/C++, Scala, or Python, with cloud, containerization, and Kubernetes experience preferred.
Top Skills:
AWSAzureCC++ContainersDockerGoGoogle Cloud PlatformJavaKubernetesMicroservicesPythonScalaSdlc
Fintech • Machine Learning • Payments • Software • Financial Services
Manage accounting, budgeting, statutory compliance and audits; coordinate direct and indirect tax assessments; lead process-improvement projects and advanced initiatives (APAs, ESOPs, digitization); partner with global stakeholders to implement enterprise projects at the India entity level.
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
