Anglian Water @one Alliance Logo

Anglian Water @one Alliance

IN - Data Engineer II (Python, SQL, Query Optimization, DBMS)

Job Posted 13 Days Ago Posted 13 Days Ago
Be an Early Applicant
2 Locations
Junior
2 Locations
Junior
The Data Engineer II will design, implement, and optimize machine learning platforms, collaborating with teams to enhance retail solutions and data processes.
The summary above was generated by AI

Scope:

The Execution Machine Learning team works closely with sales, product, and engineering teams to design and implement the next generation of retail solutions. Data Science team members are tasked with turning both small, sparse, and massive data into actionable insights with measurable improvements to the customer bottom line. They use rigorous analysis and repeatable processes to implement both black box and interpretable models.

Our machine learning platform ingests data in real time, processes information from millions of retail items to serve deep learning models, and produces billions of predictions on a daily basis

What you’ll do:

  • Design, architect, implement and help operate the Execution Machine Learning platform by
  • Observing inefficiencies, both in cost and reliability, of existing processes
  • Researching alternative solutions using custom or existing open-source technologies
  • Designing replacement processes and components
  • Implementing processes, extending, and configuring open-source components
  • Work with the DevOps and Support teams to operate platform by
  • Helping implement DevOps best practices of in-house and open-source components.
  • Ensuring smooth operation via monitoring and alerting facilities
  • Work with the data scientists to
  • Design scalable solutions for both model building and serving.

What we are looking for:

  • Bachelor’s degree in computer science is required, Masters is preferred
  • 2+ years of Python programming experience with understanding of Object-Oriented Design.
  • 1+ years working with SQL DBMS and Query Optimization; Big Query preferred.
  • 1+ years of experience working on at least one cloud environment, GCP/Azure/Snowflake.
  • Should have experience in Data Warehousing and ETL Tools.
  • 1+ Working Experience on Kafka and its integration with Cloud Services.
  • Some experience with streaming frameworks, preferably Beam on Samza/Flink/DataFlow
  • Familiarity with modern Big Data computing platforms such as Hadoop and Spark
  • Experience working with CI/CD and modern software engineering practices.
  • Some experience with Data Analysis and Visualization tools (Power BI/Tableau/Superset)
  • Good to have Supply Chain domain knowledge.

Our Values

If you want to know the heart of a company, take a look at their values. Ours unite us. They are what drive our success – and the success of our customers. Does your heart beat like ours? Find out here: Core Values

Diversity, Inclusion, Value & Equity (DIVE) is our strategy for fostering an inclusive environment we can be proud of. Check out Blue Yonder's inaugural Diversity Report which outlines our commitment to change, and our video celebrating the differences in all of us in the words of some of our associates from around the world.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.

Top Skills

Azure
Beam
Big Query
Ci/Cd
Dataflow
Flink
GCP
Hadoop
Kafka
Power BI
Python
Samza
Snowflake
Spark
SQL
Superset
Tableau

Similar Jobs

9 Hours Ago
Hybrid
Hyderabad, Telangana, IND
Junior
Junior
Financial Services
The Analyst will deliver data analytics solutions, transform raw data into insights, and develop reporting strategies for the Wholesale KYC Operations team.
Top Skills: AlteryxAWSOracle DatabasePythonQliksenseSQLTableauThoughtspot
2 Days Ago
Hybrid
Hyderabad, Telangana, IND
Senior level
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Senior Data Scientist will lead data science projects, collaborate with teams to develop algorithms, and translate statistical analyses into actionable insights in the insurance analytics field.
Top Skills: AWSAzureHadoopPythonRSpark
2 Days Ago
Easy Apply
Hybrid
Hyderabad, Telangana, IND
Easy Apply
Senior level
Senior level
HR Tech • Legal Tech • Software
As a Senior Manager, Data Engineering, you will lead a team to develop data platforms, manage data engineering pipelines, and ensure data quality and security. Your responsibilities include planning technical roadmaps, collaborating with analytics and data teams, and mentoring engineers while adhering to agile methodologies.

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account