McFadyen Digital Logo

McFadyen Digital

ETL/ELT Data Integration Engineer

Job Posted 5 Days Ago Posted 5 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in Bengaluru, Bengaluru Urban, Karnataka
Senior level
Remote
Hiring Remotely in Bengaluru, Bengaluru Urban, Karnataka
Senior level
The ETL Integration Engineer designs, builds, and optimizes data pipelines for eCommerce solutions, ensuring data integrity and improving performance. Responsibilities include data synchronization, API integration, and implementing ETL workflows.
The summary above was generated by AI

Company Description

McFadyen Digital is the leading advisor and implementer of eCommerce Marketplace solutions.  During 15 years of implementing marketplaces, we’ve built dozens of platforms that cumulatively generate billions of dollars of gross merchandise value (GMV).  We’re honored to have supported 10% of the Fortune 500 with their digital marketplace initiatives.  Over 250 global brands like ABB, AB InBev, ACCO, Albertsons, American Red Cross, American Eagle Outfitters, US Army, US Agriculture Dept, (and many more) have entrusted their digital transformations to McFadyen. We operate global offices across the US, Brazil, and India. McFadyen Digital has been a trusted employer for 35 years and believes that people are the most important part of our company.  We’re proud of our Great Place to Work certification.  

Learn more about us at our website: www.mcfadyen.com

Job Description

McFadyen Digital is seeking an experienced ETL Integration Engineer to design, build, and optimize data pipelines that support our eCommerce marketplace solutions. This role will be responsible for integrating multi-source data from ERP, CRM, PIM, and eCommerce platforms into cloud-based data warehouses and analytics tools. The ideal candidate will have expertise in ETL/ELT processes, data modeling, and cloud platforms such as AWS, Azure, Google Cloud, and Snowflake.

The ETL Integration Engineer will collaborate closely with data architects, engineers, and analysts to ensure data integrity, security, and efficiency in large-scale commerce-driven data environments.

Responsibilities

Top 5 Responsibilities:

  1. Data Pipeline Development & Maintenance
  2. System & API Integration:
  3. Data Synchronization & Orchestration
  4. Data Consistency & Integrity Assurance
  5. Performance Monitoring & Optimization

Additional Responsibilities:

Design, develop, test, and optimize ETL/ELT workflows for data ingestion, transformation, and delivery.

Implement real-time and batch processing pipelines for efficient data movement.

Integrate APIs and external vendor systems with TSN data services.

Support data exchange between ERP platforms (SAP, Oracle) and third-party applications.

Implement bi-directional data sync processes to ensure accurate data flow between interconnected systems.

Develop workflow automation for streamlined data orchestration.

Enforce data validation, error handling, and logging mechanisms.

Ensure compliance with data governance and quality standards.

Continuously monitor ETL pipelines to identify and resolve performance bottlenecks.

Improve system scalability and efficiency for high-volume data transactions.

Hands-on experience in ETL/ELT development, data integration, and pipeline monitoring.

 Proficiency in working with APIs, databases, and data transformation tools.

Strong knowledge of ERP systems (SAP, Oracle) and vendor platforms (e.g., AeroXchange).

Expertise in handling large-scale data sets while ensuring integrity and consistency.

Ability to troubleshoot and optimize integration workflows for performance and reliability.

Qualifications

  1. 6+ years of hands-on experience with ETL/ELT tools such as dbt, Apache Airflow, Informatica, Talend, or Fivetran in a cloud or hybrid environment.
  2. Expertise in SQL and database technologies (SQL, NoSQL, Graph databases) with experience in data modeling, schema design, and query optimization.
  3. Strong cloud experience with platforms like AWS Redshift, Snowflake, Google BigQuery, and Azure Synapse for large-scale data integration.
  4. Understanding of data security measures, including role-based access control (RBAC), row-level security (RLS), column-level security (CLS), and dynamic data masking (DDM).
  5. Experience integrating enterprise applications, including ERP, CRM, OMS, and PIM systems, into a centralized data ecosystem.

Additional Information

  • Knowledge of big data and streaming technologies such as Apache Kafka, Spark, or Hadoop is a plus.
  • Familiarity with BI and analytics tools (Power BI, Tableau, Looker, Google Analytics, Adobe Analytics).
  • Understanding of AI/ML-driven data pipelines for predictive analytics and personalized customer insights.
  • Experience with data governance, metadata management, and MDM frameworks.
  • Excellent problem-solving skills, communication, and stakeholder management to work across multiple teams.
  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
  • Certifications such as AWS Certified Data Analytics, Google Professional Data Engineer, or Snowflake Data Architect are a plus.

What We Can Offer You:

  • A career with thought leaders who literally wrote the book on Marketplace Best Practices.
  • A career in the fast-paced world of retail eCommerce, digital marketplaces, and platform businesses.
  • A career with first movers who are deploying new business models and strategies worldwide.
  • A career in a flat management structure without a rigid hierarchy and bureaucracy.
  • A career in a culture that rewards creativity and innovation, risk-taking, and teamwork.

 Our Core Values: Client Focus, Owning the Outcome, Adaptable, Caring     

McFadyen’s goal is to ensure that our clients are able to maximize the return on their technology investment by providing better service to their clients, partners and internal teams. At McFadyen we truly believe our employees are our most valuable asset. Across our locations in the US, Brazil, and India, we offer a world class work culture that enables top notch delivery for some of the world’s most influential companies.   

McFadyen Digital is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under federal, state, or local law, where applicable. 

Top Skills

Adobe Analytics
Apache Airflow
Apache Kafka
Aws Redshift
Azure Synapse
Dbt
Elt
ETL
Fivetran
Google Analytics
Google Bigquery
Graph Databases
Hadoop
Informatica
Looker
NoSQL
Power BI
Snowflake
Spark
SQL
Tableau
Talend

Similar Jobs

8 Hours Ago
Remote
Bengaluru, Karnataka, IND
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer, you'll manage a large data lake, build reliable data services, and transform vague requirements into solid solutions, emphasizing data quality and modern software practices.
Top Skills: AirflowAWSEmrHiveJavaKinesisPythonRdsS3ScalaSparkSQLSqs
3 Days Ago
Remote
Hybrid
2 Locations
Mid level
Mid level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
As a Senior Associate in Data Science, you will utilize data science and AI technologies to optimize manufacturing processes and drive innovation through collaboration and implementation of advanced solutions.
Top Skills: AWSMatplotlibNumpyPandasPlotlyPythonPyTorchScikit-LearnSeabornShapSQLTensorFlow
3 Days Ago
Remote
Bengaluru, Karnataka, IND
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Collaborate to build scalable data models and applications, design ETL processes, ensure data quality, mentor junior engineers, and implement governance procedures.
Top Skills: AirflowSparkBitbucketDatabricksDynamo DbGitMongo DbPostgresPythonRedshiftScalaSQL

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account