Design and implement Databricks solutions, develop data pipelines, optimize performance, ensure security, and lead technical initiatives.
Job Summary:
We're seeking an experienced Data Architect / Senior Data Architect/ Associate Data ArchitectExpertise in data engineering across major data platforms. The ideal candidate will have a
strong background in Python, SQL, ETL, and data modeling, with experience in tools like
Teradata, Informatica, Hadoop, Spark, PySpark, ADF, Snowflake, and Big Data. Cloud
knowledge (AWS, Azure, or GCP) is a plus. The role requires a willingness to transition and
upskill into Databricks & AI/ML projects.
Key Responsibilities:
● Design, develop, and maintain large-scale data systems
● Develop and implement ETL processes using various tools and technologies
● Collaborate with cross-functional teams to design and implement data models
● Work with big data tools like Hadoop, Spark, PySpark, and Kafka
● Develop scalable and efficient data pipelines
● Troubleshoot data-related issues and optimize data systems
● Transition and upskill into Databricks & AI/ML projects
Requirements:
● Relevent experience in data engineering
● Strong proficiency in Python, SQL, ETL, and data modeling
● Experience with one or more of the following:
○ Teradata
○ Informatica
○ Hadoop
○ Spark
○ PySpark
○ ADF
○ Snowflake
○ Big Data
○ Scala
○ Kafka
● Cloud knowledge (AWS, Azure, or GCP) is a plus
● Willingness to learn and adapt to new technologies, specifically Databricks & AI/ML
Nice to Have:
● Experience with Databricks
● Knowledge of AI/ML concepts and tools
● Certification in relevant technologies
What We Offer:
● Competitive salary and benefits
● Opportunity to work on cutting-edge projects
● Collaborative and dynamic work environment
● Professional growth and development opportunities
● Remote work opportunities & flexible hours
Similar Jobs
Cloud • Security • Software • Cybersecurity • Automation
As a Staff Program Manager at GitLab, you'll lead complex Enterprise Technology and AI programs, translating strategic objectives into detailed roadmaps, ensuring alignment across teams, managing risks, and communicating with stakeholders.
Top Skills:
AgileAIBusiness SystemsCsmDataEnterprise ArchitectureEnterprise ItInfrastructurePmpSafeScrumSecurity
Artificial Intelligence • Edtech • Mobile • Natural Language Processing • Productivity • Software
The IT Systems Engineer will design, automate, and manage IT infrastructure and cloud environments, focusing on automation, security, and collaboration.
Top Skills:
AnsibleAWSBashCloudFormationGCPGithub ActionsGitlabGrafanaJenkinsPowershellPrometheusPythonTerraform
Cloud • Security • Software • Cybersecurity
The Senior Business Systems Analyst will partner with stakeholders to analyze and document requirements, manage cross-functional projects, and recommend technology solutions, leveraging Agile methodologies and tools.
Top Skills:
AgileAzure DevopsConfluenceJIRAScrum
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.


.png)
