The role involves building and maintaining automated pipelines for data collection and cleaning from public sources, integrating scrapers with backend systems, and ensuring data accuracy and compliance with platform rules.
Web Scraper / Data Engineer
Location: Remote
Job Type: Full-time
About STERRY
At STERRY, we’re not your average Growth Marketing Agency—we’re the rocket fuel behind crowdfunding and e-commerce success. Since day one, we’ve helped clients pull in over $100 million in trackable online revenue. We build strategies that go beyond brand and marketing—we deliver measurable results rooted in online performance
Role Overview
We’re looking for an experienced Web Scraper / Data Engineer to help us build and maintain automated pipelines that collect, clean, and enrich creator and campaign data from public sources. You’ll be responsible for designing reliable, scalable scrapers and integrating them with our backend.
Responsibilities
Requirements
What We Offer
Location: Remote
Job Type: Full-time
About STERRY
At STERRY, we’re not your average Growth Marketing Agency—we’re the rocket fuel behind crowdfunding and e-commerce success. Since day one, we’ve helped clients pull in over $100 million in trackable online revenue. We build strategies that go beyond brand and marketing—we deliver measurable results rooted in online performance
Role Overview
We’re looking for an experienced Web Scraper / Data Engineer to help us build and maintain automated pipelines that collect, clean, and enrich creator and campaign data from public sources. You’ll be responsible for designing reliable, scalable scrapers and integrating them with our backend.
Responsibilities
- Build scrapers and crawlers to collect creator profile data (followers, engagement, category, contact info, etc.) from social platforms (TikTok, Instagram, YouTube, etc.) and directories
- Parse and clean unstructured data into structured datasets (JSON, CSV, or direct to database)
- Integrate with APIs (YouTube, TikTok, Instagram, etc.) where possible
- Detect and handle rate limits, CAPTCHA, and anti-bot mechanisms
- Implement and monitor scraping tasks using proxy rotation and headless browsers (Puppeteer, Playwright, Selenium, etc.)
- Collaborate with the backend team to feed data into AI recommendation engine
- Maintain high data accuracy, freshness, and compliance with platform TOS and privacy rules
Requirements
- 2+ years experience building web scrapers, crawlers, or data extraction pipelines
- Strong Python or Node.js skills (BeautifulSoup, Playwright, Puppeteer, Scrapy, or similar)
- Experience with APIs, JSON, REST, and rate-limiting management
- Familiarity with databases (MongoDB, PostgreSQL, Firebase, etc.)
- Knowledge of proxies, headless browsers, and data scaling infrastructure
- Attention to detail and ability to deliver clean, well-documented code
- (Bonus) Experience with influencer data, social analytics, or SaaS platforms
What We Offer
- Flexible working hours (remote-first)
- Competitive pay (hourly or project-based)
- Long-term potential to transition into a data engineering role
- Opportunity to shape the foundation of a fast-growing AI SaaS startup
Top Skills
Beautifulsoup
Firebase
JSON
MongoDB
Node.js
Playwright
Postgres
Puppeteer
Python
Rest
Scrapy
Similar Jobs
Financial Services
As a Software Engineer III at JPMorgan Chase, you will design, develop, and troubleshoot software solutions within an agile team, focusing on high-quality production code and continuous improvement of technology products.
Top Skills:
AuroraBigtableCassandraCloud Pub/SubCloud SpannerCloud SqlDatadogDynamoDBDynatraceElasticsearchFluentdGrafanaJmsKafkaKibanaKinesisKubernetesMongoDBMqPrometheusRdsSlackSplunk
Financial Services
As a Principal Architect, you'll enhance architecture platforms, provide technology guidance, develop multi-year roadmaps, and champion diversity in a cloud-based environment.
Top Skills:
Artificial IntelligenceAWSAzureCloudGCPMachine Learning
Financial Services
As a Senior Associate in Fraud Risk Strategy, you'll analyze data to identify fraud trends, monitor risks, collaborate on strategies, and support fraud initiatives across channels.
Top Skills:
ExcelPowerPointPythonRSASSQL
What you need to know about the Bengaluru Tech Scene
Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.
