The Senior Data Engineer will design and implement data processing pipelines, manage ETL processes, and ensure data quality while collaborating with stakeholders to meet business needs.
While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Role: Senior Data Engineer
Experience Level: 4 to 6 Years
Work location: Mumbai, Bangalore, Trivandrum (Hybrid Only)
Required Skills:
- Bachelor’s degree in Computer Science or similar field or equivalent work experience.
- 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.
- Expert with data warehousing concepts, strategies, and tools.
- Strong SQL background.
- Strong knowledge of relational databases like SQL Server, PostgreSQL, MySQL.
- Strong experience in GCP & Google BigQuery, Cloud SQL, Composer (Airflow), Dataflow, Dataproc, Cloud Function and GCS
- Good to have knowledge on SQL Server Reporting Services (SSRS), and SQL Server Integration Services (SSIS).
- Knowledge of AWS and Azure Cloud is a plus.
- Experience in Informatica Power exchange for Mainframe, Salesforce, and other new-age data sources.
- Experience in integration using APIs, XML, JSONs etc.
- In-depth understanding of database management systems, online analytical processing (OLAP) and ETL (Extract, transform, load) framework, data-warehousing and Data Lakes
- Good understanding of SDLC, Agile and Scrum processes.
- Strong problem-solving, multi-tasking, and organizational skills.
- Highly proficient in working with large volumes of business data and strong understanding of database design and implementation.
- Good written and verbal communication skills.
- Demonstrated experience of leading a team spread across multiple locations.
Role & Responsibilities:
- Work with business users and other stakeholders to understand business processes.
- Ability to design and implement Dimensional and Fact tables
- Identify and implement data transformation/cleansing requirements
- Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data Warehouse
- Develop conceptual, logical, and physical data models with associated metadata including data lineage and technical data definitions
- Design, develop and maintain ETL workflows and mappings using the appropriate data load technique
- Provide research, high-level design, and estimates for data transformation and data integration from source applications to end-user BI solutions.
- Provide production support of ETL processes to ensure timely completion and availability of data in the data warehouse for reporting use.
- Analyze and resolve problems and provide technical assistance as necessary. Partner with the BI team to evaluate, design, develop BI reports and dashboards according to functional specifications while maintaining data integrity and data quality.
- Work collaboratively with key stakeholders to translate business information needs into well-defined data requirements to implement the BI solutions.
- Leverage transactional information, data from ERP, CRM, HRIS applications to model, extract and transform into reporting & analytics.
- Define and document the use of BI through user experience/use cases, prototypes, test, and deploy BI solutions.
- Develop and support data governance processes, analyze data to identify and articulate trends, patterns, outliers, quality issues, and continuously validate reports, dashboards and suggest improvements.
- Train business end-users, IT analysts, and developers.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Top Skills
APIs
AWS
Azure
Cloud Function
Cloud Sql
Composer
Dataflow
Dataproc
GCP
Google Bigquery
JSON
MySQL
Postgres
SQL Server
Ssis
Ssrs
XML
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Senior Data Engineer designs and develops complex data pipelines, ensuring data reliability and performance in Big Data environments, while adhering to best practices.
Top Skills:
HadoopHiveJavaNetezzaOraclePythonScalaSpark
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
The role involves optimizing SAP and non-SAP systems, building data processing pipelines, and providing insights for the Cash Management function through collaboration and technical solutions.
Top Skills:
AirflowAlteryxDatabricksGcp Big QueryPysparkPythonRSAPSparkrSQLTableauTalend
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
The Data COE Sr. Data Engineer will design and build scalable data solutions, manage data pipelines, ensure data quality, and collaborate with stakeholders while leading a team of data engineers.
Top Skills:
Aecorsoft/DatasphereAirflowBigQueryDatabricksDbtErwinGcp Cloud ServicesPl/SqlPostgres SqlPower BIPythonSQLTableau
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.


