Data Engineer- Azure/ Data Bricks

Company Description

Resources is the backbone of Publicis Groupe, the world’s third-largest communications group. Formed in 1998 as a small team to service a few Publicis Groupe firms, Re:Sources has grown to 5,000+ people servicing a global network of prestigious advertising, public relations, media, healthcare and digital marketing agencies. We provide technology solutions and business services including finance, accounting, legal, benefits, procurement, tax, real estate, treasury, and risk management to help Publicis Groupe agencies do what they do best: create and innovate for their clients.

In addition to providing essential, everyday services to our agencies, Re:Sources develops and implements platforms, applications and tools to enhance productivity, encourage collaboration and enable professional and personal development. We continually transform to keep pace with our ever-changing communications industry and thrive on a spirit of innovation felt around the globe. With our support, Publicis Groupe agencies continue to create and deliver award-winning campaigns for their clients.

Job Description

Minimum Experience (relevant): 4

Maximum Experience (relevant): 7

Locations are- Bangalore, Gurgaon, Pune

Must have skills:

• Strong experience in Azure, ADF, PySpark, Scala, DataBricks, SQL.
• Experience with ETLs, JSON, Hop or ETL orchestration tools.
• Experience in working with EventHub, streaming data.
• Understanding of ML models and experience in building ML pipeline, MLflow, AirFlow.
• Experience with big data tools: Hadoop, Spark, Kafka, etc.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
• Experience with stream-processing systems: Storm, Spark-Streaming, etc.
• Understanding of Graph data, neo4j is a plus
• Strong knowledge Azure based services
• Strong understanding of RDBMS data structure, Azure Tables, Blob, and other data sources
• Experience with test driven development
• Experience in PowerBI or other tools
• Understanding of Jenkins, CI/CD processes using ADF, and DataBricks preferred.

Good to have skills:

• Bachelor's degree in engineering, computer science, information systems, or a related field from an accredited college or university; Master's degree from an accredited college or university is preferred
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing ADF and PySpark based data pipelines, architectures and data sets on Graph and Azure Datalake.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Working knowledge of message queuing, stream processing, and highly scalable Azure based data stores.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Understanding of Node.js is a plus, but not required.

Attributes/behaviours

• Ability to design, develop, implement complex requirement.
• Building reusable components and front-end libraries for future use
• Translating designs and wireframes into high quality code
• Pro-active support to the business is a key attribute for this role with a customer service focus to link both systems requirements with business outcomes.

Qualifications

The candidate should be graduate.

Additional Information

Publicis Groupe Commitment to Diversity & Equity Policy:

Publicis Groupe is deeply committed to diversity and inclusion in spirit and in action at every level of the organization. It reflects our core values and embodies our purpose of building a great company enabling human potential. We have a deep-rooted appreciation for how diversity of thought drives innovation, and we ground that value in a culture of collaboration and connected thinking.

• Diversity & inclusion are business imperatives on which Publicis Groupe will not negotiate. While fostering a work environment that is inclusive of all talent is a collective responsibility, it is leadership’s job to nurture the career aspirations and goals of all our talent. Promoting gender equality starts at the top and the Groupe will not tolerate anyone speaking for our organization who does not value the importance of inclusion. Publicis Groupe works very hard to champion diversity and will continue to insist that each agency’s leadership be champions of both diversity and inclusion.
• Our Core values “ VIVA LA DIFFERENC’E is based on the very aspect of celebrating differences 
• Our strategy focuses on bringing together teams with diverse perspectives, disciplines, and experiences, because diversity of thought best serves our clients and their customers who they aspire to impact

Equal Employment Commitment:

1. We provide equal opportunities to all our employees and to all eligible applicants for employment in our company. We do not unfairly discriminate on any ground, including race, caste, religion, color, ancestry, marital status, gender, sexual orientation, age, nationality, ethnic origin, disability or any other category protected by applicable law.
2. When recruiting, developing and promoting our employees, our decisions will be based solely on performance, merit, competence and potential.
3. We shall have fair, transparent and clear employee policies which promote diversity and equality, in accordance with applicable law and other provisions of this Code. These policies shall provide for clear terms of employment, training, development and performance management.