Yadimen Consulting Limited Jobs

Data Engineer — PySpark + AWS Glue

Yadimen Consulting Limited

Data Engineer — PySpark + AWS Glue

Posted One Month Ago

In-Office

Bangalore, Bengaluru Urban, Karnataka, IND

Senior level

In-Office

Bangalore, Bengaluru Urban, Karnataka, IND

Senior level

Design, develop, optimize, and maintain scalable ETL pipelines using PySpark and AWS Glue. Build data ingestion and transformation workflows, orchestrate processes with AWS Step Functions, and develop Python-based AWS Lambda functions. Support AWS data lake architectures, analytical use cases, monitoring, reliability, and performance optimization. The role also involves SQL and may include Java microservices, REST APIs, and backend integrations.

The summary above was generated by AI

Data Engineer — PySpark + AWS Glue

ETL & Data Pipelines | 2 Openings

Location: Remote (UK)

Employment Type: Contract / Permanent

Experience Level: 4–8 Years

Openings: 2

About the Role

We are looking for a skilled Data Engineer with solid hands-on experience in PySpark, AWS Glue, and ETL development to build and maintain scalable, production-grade data pipelines on AWS. You will be part of a delivery-focused team working on complex data engineering challenges, contributing to data lake architecture and end-to-end pipeline development.

Requirements

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines using PySpark and AWS Glue

• Build and optimise data ingestion, transformation, and loading workflows

• Orchestrate data workflows using AWS Step Functions

• Develop serverless functions using AWS Lambda (Python)

• Work with data lake architectures on AWS to support analytical use cases

• Ensure pipeline reliability, monitoring, and performance optimisation

Required Skills & Experience

• Strong hands-on experience with PySpark and AWS Glue

• Proven track record in ETL pipeline development and optimisation

• Experience orchestrating workflows with AWS Step Functions

• Proficiency in serverless development using AWS Lambda (Python)

• Good SQL skills and a solid understanding of data processing principles

Nice to Have

• Exposure to Java-based microservices

• Understanding of REST APIs and backend service integrations

• Experience working with AWS-based data lakes

Similar Jobs

Hilton

Front Office Associate-Airport Representative

2 Days Ago

In-Office

Entry level

Events • Food • Travel • Hospitality • Hotels & Resorts

Greets airport guests, assists with luggage and hotel transportation, coordinates arrival and departure schedules, provides VIP and special services, resolves travel-related issues, and communicates guest preferences across hotel departments. The role requires strong guest-service skills, organization, flexibility for varied hours, and a welcoming professional demeanor.

Hilton

Director of Culinary

2 Days Ago

In-Office

Expert/Leader

Events • Food • Travel • Hospitality • Hotels & Resorts

Directs all hotel culinary operations, including food production, menu development, guest satisfaction, financial performance, kitchen efficiency, team development, and regulatory compliance. The role manages quality, presentation, profitability, budgets, forecasting, workflows, and health and safety standards while creating memorable dining experiences.

Hilton

Beverage Manager

2 Days Ago

In-Office

Junior

Events • Food • Travel • Hospitality • Hotels & Resorts

Manages daily beverage outlet operations in a hotel or restaurant, including team supervision, guest service, inventory and cost control, sales support, compliance, hygiene, and coordination with other departments. Develops beverage offerings and resolves guest concerns while maintaining brand and food safety standards.

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.