The Data Architect will design and implement scalable data architectures on AWS, develop data pipelines, optimize AWS services, and collaborate with teams to ensure data integrity and compliance.
Data Architect
Primary Skills
- Athena, SNS, SQS, CloudWatch, Macie, Spark - Scala, Kinesis, CloudFormation, EMR, Open Search, DynamoDB, Amazon API Gateway, SCT, Redshift, DMS, Oozie
Job requirements
- Experience Range: 7 - 10 years of experience in data architecture and AWS data engineering Key Responsibilities: 1. Design and implement scalable data architectures on AWS, leveraging services such as EMR, Redshift, DynamoDB, and Kinesis 2. Develop robust data pipelines using Spark (Scala), Oozie, and AWS Glue to support analytics and operational workloads 3. Configure and optimize AWS services including Athena, Open Search, CloudWatch, Macie, and CloudFormation for efficient data processing and monitoring 4. Manage and secure data flows with Amazon SNS, SQS, API Gateway, and DMS, ensuring data integrity and compliance 5. Collaborate with cross-functional teams to translate business requirements into technical solutions, focusing on performance, security, and reliability 6. Troubleshoot and resolve complex issues related to data ingestion, transformation, and storage within AWS environments 7. Implement best practices for data governance, security, and privacy, utilizing AWS Macie and related tools 8. Monitor system performance and proactively identify opportunities to improve data processing efficiency and reduce costs Required Skills: 1. Advanced proficiency with AWS services including Athena, SNS, SQS, CloudWatch, Macie, Kinesis, CloudFormation, EMR, Open Search, DynamoDB, Amazon API Gateway, SCT, Redshift, and DMS 2. Expertise in Spark with Scala for large-scale data processing 3. Hands-on experience with Oozie for workflow orchestration 4. Strong knowledge of data modeling and architecture in cloud environments 5. Proficiency in designing and optimizing ETL pipelines 6. Experience with real-time and batch data processing solutions 7. Ability to configure and manage AWS security and monitoring tools 8. Skilled in deploying infrastructure as code using AWS CloudFormation 9. Competence in integrating AWS services for end-to-end data solutions 10. Solid understanding of data governance and compliance in AWS Preferred Skills: 1. Experience with machine learning pipelines on AWS 2. Knowledge of advanced AWS analytics services such as AWS Glue and QuickSight 3. Familiarity with containerization technologies like Docker and Kubernetes 4. Expertise in automating data quality and validation processes 5. Background in implementing data cataloging and lineage solutions 6. Experience with migration tools and strategies for legacy data systems Desired Qualifications: 1. Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field 2. AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect certification preferred
Top Skills
Amazon Api Gateway
Athena
CloudFormation
Cloudwatch
Dms
DynamoDB
Emr
Kinesis
Macie
Oozie
Open Search
Redshift
Scala
Sct
Sns
Spark
Sqs
Similar Jobs
Big Data • Information Technology • Software • Analytics • Energy
The Business Analyst Intern will assist in data analysis, gather business requirements, support process improvements, and communicate findings to teams.
Top Skills:
ExcelPythonSQL
Big Data • Information Technology • Software • Analytics • Energy
The Account Manager for the solar/PV industry will drive sales, establish partnerships, and manage client relationships while supporting renewable energy initiatives.
Top Skills:
SaaS
Big Data • Information Technology • Software • Analytics • Energy
The Account Executive will manage the sales cycle, represent solar products, negotiate deals, and build customer relationships in the renewable energy sector.
Top Skills:
Generative AiPower And RenewablesSaaSSolar Energy
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
