Cloud Data Platform Engineer

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Visa is seeking a highly skilled and experienced Cloud Data Platform Engineer to join our dynamic team. The successful candidate will be responsible for designing, implementing, and managing cloud-based data platforms to support our data-driven initiatives. This role requires a deep understanding of cloud infrastructure, data engineering, and data management best practices.

Key Responsibilities:

• Design, develop, and maintain scalable and reliable cloud-based data platforms.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide solutions.
• Help and guide to implement data integration pipelines to ingest, process, and store large volumes of data from various sources.
• Ensure data quality, integrity, and security by implementing appropriate data governance practices.
• Monitor and optimize the performance, scalability, and cost-efficiency of the data platform.
• Automate infrastructure provisioning and deployment processes using Infrastructure as Code (IaC) tools.
• Stay up to date with the latest cloud technologies, data engineering practices, and industry trends.
• Provide technical guidance and mentorship to junior engineers and team members.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Basic Qualifications
7+ years of relevant work experience with a Bachelor’s Degree or Advanced degree (e.g. Masters, MBA, JD, MD) OR 8+ years of relevant work experience.
7+ years of experience in cloud data platform engineering, on-prem big-data platform engineering.
Hands-on experience with IaC tools such as Terraform or CloudFormation.
Proficiency in programming languages such as Python, Java, or Scala.
Strong expertise in cloud platforms such as AWS & Azure.
Experience with data integration tools and technologies.
Architecting and building platforms
Experience on AWS Athena, Glue, Azure Fabric, EMR, Databricks.
Excellent problem-solving, communication, and collaboration skills.
Strong understanding of data governance, security, and compliance best practices.
Strong knowledge on Hadoop Big data eco systems.
Bachelor's degree in Computer Science, or related technical discipline. With 1+ years of software development experience
Proficiency in engineering practices and writing high quality code, with expertise in either one of Java or Python
Experience in building platforms on Public Cloud like AWS, Azure as well as top of Big Data open source platforms like Hadoop/Hive/Spark/Tez.
Contributions to one or more Big Data Open Source Technologies like Hadoop/Hive/Spark/Tez etc will be an added plus.