Associate Big Data Engineer (Airflow/Python/Spark)

Posted 7 Days Ago
Bangalore, Bengaluru, Karnataka
Hybrid
1-3 Years Experience
Digital Media • Information Technology • Analytics
The Role
Responsible for developing data pipelines for scheduled and real-time use cases, optimizing scalable pipelines, and contributing to the delivery of enterprise software. Must have a Bachelor's degree in Computer Science, MIS, or Engineering.
Summary Generated by Built In

At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future. 


About the role


As an Associate Data Engineer you will be responsible for data pipelines to work on both scheduled and real time use cases. Schedule pipelines run typically in Airflow and real time processing could be airflow or integrated querying in backend services.


Responsibilities

  • Work closely with team leads and backend developers to design and develop functional, robust pipelines to support internal and customer needs
  • Write both unit and integration tests, and develop automation tools for daily tasks
  • Develop high quality, well documented, and efficient code 
  • Manage and optimize scalable pipelines in the cloud
  • Optimize internal and external applications for performance and scalability
  • Develop automated tests to ensure business needs are met, and write unit, integration, or data quality tests
  • Communicate regularly with stakeholders, project managers, quality assurance teams, and other developers regarding progress on long-term technology roadmap
  • Recommend systems solutions by comparing advantages and disadvantages of custom development and purchased alternatives

Key Skills (Domain Expertise)

  • 0-2 years of experience as a software/data engineer 
  • Bachelor’s degree in Computer Science, MIS, or Engineering

Technical Skills Preferred

  • Experience with database systems, with knowledge of SQL and NoSQL stores (e.g. MySQL, Oracle, MongoDB, Couchbase, etc.)
  • Experience on a team developing sophisticated data driven software platforms
  • Experience with relational databases and/or analytical data stores (e.g., Spark, Presto, Pandas)
  • Contributing to delivery and support of enterprise software
  • Experience with cloud service technologies, ex: AWS
  • Experience with container technologies, ex: Docker
  • Experience with source control systems, ex: GIT
  • Information visualization
  • "Big data" systems and analysis
  • Experience with data warehouses or data lakes

Mindset and Attributes

  • Strong communication skills with ability to communicate complex technical concepts and align organization on decisions
  • Sound problem-solving skills with the ability to quickly process complex information and present it clearly and simply
  • Utilizes team collaboration to create innovative solutions efficiently


  • #LI-DD1

Top Skills

Airflow
Python
Spark
The Company
HQ: New York, NY
30,034 Employees
On-site Workplace

What We Do

Nielsen shapes the world’s media and content as a global leader in audience insights, data and analytics. Through our understanding of people and their behaviors across all channels and platforms, we empower our clients with independent and actionable intelligence so they can connect and engage with their audiences—now and into the future.

An S&P 500 company, Nielsen (NYSE: NLSN) operates around the world in more than 55 countries.

Jobs at Similar Companies

Alliant Credit Union Logo Alliant Credit Union

Data Analyst - Hybrid

Fintech • Financial Services
Hybrid
Chicago, IL, USA
843 Employees
Easy Apply
Remote
United States
985 Employees
Hybrid
Chicago, IL, USA
843 Employees

AffiniPay Logo AffiniPay

Sales Operations Manager

Fintech • Legal Tech • Payments • Sales • Software
Remote
United States
519 Employees

Similar Companies Hiring

Cisco Meraki Thumbnail
Software • Security • Information Technology • Hardware • Cybersecurity • Conversational AI
San Francisco , CA
3000 Employees
CrowdStrike Thumbnail
Security • Sales • Information Technology • Cybersecurity • Cloud
Austin, TX
10000 Employees
Arrow Electronics, Inc. Thumbnail
Semiconductor • Robotics • Internet of Things • Information Technology • Hardware • Enterprise Web • Cloud
Centennial, CO
22000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account