Intellectsoft Logo

Intellectsoft

Senior Data Engineer with Python (IR-491)

Reposted Yesterday
Be an Early Applicant
In-Office
2 Locations
Senior level
In-Office
2 Locations
Senior level
The Senior Data Engineer will design and build scalable data pipelines, collaborate with data scientists, optimize ETL processes, and ensure high-quality software solutions.
The summary above was generated by AI

Intellectsoft is a software development company delivering innovative solutions since 2007. We operate across North America, Latin America, the Nordic region, the UK, and Europe.We specialize in industries like Fintech, Healthcare, EdTech, Construction, Hospitality, and more, partnering with startups, mid-sized businesses, and Fortune 500 companies to drive innovation and scalability. Our clients include Jaguar Motors, Universal Pictures, Harley-Davidson, and many more where our teams are making daily impactTogether, our team delivers solutions that make a difference. Learn more at www.intellectsoft.net

Our customer's product is an AI-powered platform that helps businesses make better decisions and work more efficiently. It uses advanced analytics and machine learning to analyze large amounts of data and provide useful insights and predictions. The platform is widely used in various industries, including healthcare, to optimize processes, improve customer experiences, and support innovation. It integrates easily with existing systems, making it easier for teams to make quick, data-driven decisions to deliver cutting-edge solutions.


Requirements
  • 4+ years of professional experience, including 2+ years of data engineering with Apache Spark and SQL.
  • Proficiency in Python for data processing and automation.
  • Knowledge of PySpark, distributed computing, analytical databases and other big data
  • technologies.
  • Expertise in designing and managing ETL pipelines and distributed data processing frameworks.
  • Strong knowledge of database systems, data modeling, and analytical databases.
  • Hands-on experience with workflow orchestration tools such as Apache Airflow.
  • Familiarity with cloud platforms like AWS, GCP, or Azure.
  • Solid understanding of software development lifecycles, including coding standards, version control, and testing.

Nice to have skills

  • Bachelor’s or master’s degree in Computer Science or a related field.
  • Familiarity with the data science and machine learning development process.
  • Understanding of Machine Learning pipelines or frameworks.
Responsibilities
  • Design and build highly reliable and scalable data pipelines using PySpark and big data technologies.
  • Collaborate with the data science team to develop new features that enhance model accuracy and performance.
  • Create standardized data models to improve consistency across various deployments.
  • Troubleshoot and resolve issues in existing ETL pipelines and optimize workflows.
  • Conduct POCs to evaluate new technologies and integrate additional data sources.
  • Follow and promote best practices for software development, ensuring high-quality solutions that meet requirements and deadlines.
  • Document development updates and maintain clear technical documentation.

Benefits
  • Employment-based cooperation
  • Awesome projects with an impact
  • Comprehensive insurance for you and your family (health, life, and accident)
  • Paid PTO policy (vacation, sick leaves, and public holidays)
  • Tech equipment provided
  • Udemy courses, workshops, trainings & expert knowledge-sharing
  • Flexible hours & work setup

Top Skills

Apache Airflow
Spark
AWS
Azure
GCP
Pyspark
Python
SQL

Similar Jobs

22 Hours Ago
Hybrid
Gurugram, Haryana, IND
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead analytics projects to build data models, dashboards, and advanced reporting. Analyze large datasets, validate and cleanse data, present insights to stakeholders, and mentor junior team members to drive business optimization.
Top Skills: Sql,Cloudera Hadoop,Big Data,Sql Server,Microsoft Bi Stack,Looker,Tableau,Powerbi,Python,R,Ssis,Ssas,Ssrs,Excel,Powerpoint
22 Hours Ago
In-Office
Gurugram, Haryana, IND
Mid level
Mid level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
The Six Sigma Consultant leads operational excellence initiatives, improves processes, manages projects, and collaborates with teams to enhance healthcare delivery and performance metrics.
Top Skills: Ai/MlLeanMinitabMs AccessExcelMs PowerpointSix SigmaVisio
22 Hours Ago
Easy Apply
Hybrid
Gurugram, Haryana, IND
Easy Apply
Mid level
Mid level
Big Data • Cloud • Software • Database
The Sales Support Associate manages sales operations tasks such as data maintenance, user administration, and general support for the sales team. Responsibilities include troubleshooting sales issues, analyzing data, and creating reports to support decision-making processes.
Top Skills: Advanced ExcelBiCrunchbaseData LoaderDemand ToolsGoogle SuiteInsideviewJIRALeadiqMS OfficeSalesforceSQLZendeskZoominfo

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account