Karya Logo

Karya

Data Engineer

Posted One Month Ago
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Entry level
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Entry level
Run and monitor data jobs on Linux servers, recover failures, configure project workflows, and write PostgreSQL and ClickHouse queries. Develop Python, SQL, Bash, or TypeScript scripts for quality, completion, pay, and delivery checks. Package datasets in cloud storage, track client deliverables, interpret a TypeScript codebase, communicate findings to operations and clients, and identify recurring manual work for platform engineering.
The summary above was generated by AI

About Karya

Karya provides AI-enabled earning and learning opportunities to economically underserved communities, and high-quality, ethically sourced datasets to research labs and technology companies. Digital workers earn at least 20 times the local minimum wage. The platform has delivered over 40 million tasks.

About the role
This role runs live client projects on the Karya platform. The work is the execution layer above the core product:
project workflows, data jobs, checks, reports, and delivery.
You will work with Operations and client teams on questions of progress, quality, pay, and files, and with platform
engineers when a fix belongs in the product. Worker payouts and client deliverables depend on getting these checks
right.
Responsibilities
• Run and monitor data jobs on remote Linux servers, and recover failed jobs from logs and process state.
• Configure project workflows, including the handoff from automated processing to human tasks, and track what
is in progress, held, or ready to deliver.
• Write PostgreSQL and ClickHouse queries for throughput, completion, quality, pay, and delivery status.
• Apply completion and quality rules to access, pay, and delivery decisions, after a sample check.
• Write Python, SQL, or Bash scripts for those checks and decisions, and keep them in the repository.
• Package datasets to client specifications, move them through cloud object storage, and record what has shipped.
• Read the TypeScript / Node.js codebase to follow tasks, assignments, payments, and file storage.
• Reply to Operations and client teams with the finding, the change made, and what is still open.
• Report repeated manual work to platform engineering, with an example.
Requirements
• PostgreSQL, including joins, aggregates, and JSON fields.
• Scripts in Python, Bash, or TypeScript, checked into git.
• Ability to read a TypeScript codebase and a relational schema.
• Linux for running jobs: SSH, logs, long-running processes, and disk.
• Ability to write technical updates that give non-technical teammates a clear picture of the situation.
• Queries or scripts already run against real project or production data.
Good to have
• Cloud object storage (Google Cloud Storage, S3, or Azure Blob).
• Experience with collected datasets such as speech, text, or images.
• ClickHouse, Metabase, or a similar reporting tool.
Perks
• Flexible leave, with remote or hybrid work.
• Health insurance.
• Direct work on data collection that determines worker earnings and client deliverables.
Karya is an equal opportunity employer. Applicants are considered without regard to race, religion, gender identity, sexual orientation,
disability, or any other protected status. For accommodations, contact [email protected].

Karya Bengaluru, Karnataka, IND Office

Bengaluru, India

Similar Jobs

3 Days Ago
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
Entry level
Entry level
Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
Designs, develops, optimizes, and maintains scalable data architectures and ETL pipelines. Integrates large structured and unstructured datasets, supports data scientists, evaluates emerging engineering tools, and partners on enterprise architectures. The role also requires cloud deployment, troubleshooting, technical education, mentoring, and expertise in distributed data technologies, databases, DevOps, and R&D digital platforms.
Top Skills: Big DataC++Cloud PlatformsComputerized System ValidationContinuous IntegrationData ArchitectureData PipelinesDevOpsETLHadoopJavaKubernetesMongoDBPl/SqlPythonScalaSdlcSparkSQL
4 Days Ago
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
Expert/Leader
Expert/Leader
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads enterprise-scale data engineering and architecture initiatives, designing secure cloud data platforms, pipelines, governance frameworks, and data products. Drives modernization using Azure, Databricks, Snowflake, Spark, SQL, and Python; establishes DataOps, CI/CD, monitoring, and automation practices. Partners with stakeholders and technical teams to deliver analytics, reporting, and AI/ML solutions. Provides technical leadership, mentors engineers, reviews designs, evaluates emerging technologies, and develops strategic data roadmaps.
Top Skills: AWSAzureCi/CdDatabricksDataopsElt/EtlGCPPythonSnowflakeSparkSQL
5 Days Ago
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Financial Services
Designs, develops, and troubleshoots secure, scalable software and data solutions. Builds cloud-based data pipelines using AWS, Airflow, Databricks, and related technologies; develops optimized Python and PySpark code for large datasets; creates architecture and design artifacts; performs data analysis, visualization, profiling, modeling, and ETL; and contributes to engineering practices and emerging technology initiatives.
Top Skills: Apache AirflowApache NifiSparkAWSCi/CdData WarehousingDatabricksDatabricks WorkflowsDelta Live TablesETLHadoopInformaticaOraclePl/SqlPysparkPythonUnity Catalog

What you need to know about the Bengaluru Tech Scene

Dubbed the "Silicon Valley of India," Bengaluru has emerged as the nation's leading hub for information technology and a go-to destination for startups. Home to tech giants like ISRO, Infosys, Wipro and HAL, the city attracts and cultivates a rich pool of tech talent, supported by numerous educational and research institutions including the Indian Institute of Science, Bangalore Institute of Technology, and the International Institute of Information Technology.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account