Data Engineer

Posted 25 Days Ago
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Entry level
Artificial Intelligence • Information Technology
The Role
Run and monitor data jobs on Linux servers, recover failures, configure project workflows, and write PostgreSQL and ClickHouse queries. Develop Python, SQL, Bash, or TypeScript scripts for quality, completion, pay, and delivery checks. Package datasets in cloud storage, track client deliverables, interpret a TypeScript codebase, communicate findings to operations and clients, and identify recurring manual work for platform engineering.
Summary Generated by Built In

About Karya

Karya provides AI-enabled earning and learning opportunities to economically underserved communities, and high-quality, ethically sourced datasets to research labs and technology companies. Digital workers earn at least 20 times the local minimum wage. The platform has delivered over 40 million tasks.

About the role
This role runs live client projects on the Karya platform. The work is the execution layer above the core product:
project workflows, data jobs, checks, reports, and delivery.
You will work with Operations and client teams on questions of progress, quality, pay, and files, and with platform
engineers when a fix belongs in the product. Worker payouts and client deliverables depend on getting these checks
right.
Responsibilities
• Run and monitor data jobs on remote Linux servers, and recover failed jobs from logs and process state.
• Configure project workflows, including the handoff from automated processing to human tasks, and track what
is in progress, held, or ready to deliver.
• Write PostgreSQL and ClickHouse queries for throughput, completion, quality, pay, and delivery status.
• Apply completion and quality rules to access, pay, and delivery decisions, after a sample check.
• Write Python, SQL, or Bash scripts for those checks and decisions, and keep them in the repository.
• Package datasets to client specifications, move them through cloud object storage, and record what has shipped.
• Read the TypeScript / Node.js codebase to follow tasks, assignments, payments, and file storage.
• Reply to Operations and client teams with the finding, the change made, and what is still open.
• Report repeated manual work to platform engineering, with an example.
Requirements
• PostgreSQL, including joins, aggregates, and JSON fields.
• Scripts in Python, Bash, or TypeScript, checked into git.
• Ability to read a TypeScript codebase and a relational schema.
• Linux for running jobs: SSH, logs, long-running processes, and disk.
• Ability to write technical updates that give non-technical teammates a clear picture of the situation.
• Queries or scripts already run against real project or production data.
Good to have
• Cloud object storage (Google Cloud Storage, S3, or Azure Blob).
• Experience with collected datasets such as speech, text, or images.
• ClickHouse, Metabase, or a similar reporting tool.
Perks
• Flexible leave, with remote or hybrid work.
• Health insurance.
• Direct work on data collection that determines worker earnings and client deliverables.
Karya is an equal opportunity employer. Applicants are considered without regard to race, religion, gender identity, sexual orientation,
disability, or any other protected status. For accommodations, contact [email protected].

Skills Required

  • PostgreSQL experience, including joins, aggregates, and JSON fields
  • Ability to write Python, Bash, or TypeScript scripts and check them into Git
  • Ability to read a TypeScript codebase and relational schema
  • Linux experience with SSH, logs, long-running processes, and disk management
  • Ability to write clear technical updates for non-technical teammates
  • Experience running queries or scripts against real project or production data
  • Experience with cloud object storage such as Google Cloud Storage, Amazon S3, or Azure Blob Storage
  • Experience with collected speech, text, or image datasets
  • ClickHouse, Metabase, or similar reporting tool experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Bengaluru
92 Employees
Year Founded: 2022

What We Do

At Karya, we are on a mission to bring AI-based earning and learning opportunities to low-income communities. The AI revolution has created a massive amount of digital work surrounding data generation, labelling, and enrichment. From building multimodal Indic language datasets and human-in-the-loop tasks to mitigating bias and culturally-sensitive LLM evaluations, Karya’s workers in rural India enable cutting-edge, inclusive AI innovations. We have also built a one-of-a-kind digital work platform that divides AI-data tasks into microtasks and distributes them to individuals in need of supplementary income. So far, our platform has been used to distribute 40 million+ tasks to 40,000+ people in India. Our platform and model allows us to provide our workers some of the highest wages in the global data market - nearly 20 times the Indian minimum wage. We were on the cover of the Time Magazine and Bloomberg last year, and Microsoft CEO, Satya Nadella recently highlighted our work in his keynote. Karya has been supported by organisations like Microsoft, Google, Gates Foundation, ACT Grants, Fast Forward, 100X Accelerator, DRK Foundation, Mulago, Echoing Green, The/Nudge Institute among others

Similar Jobs

JPMorganChase Logo JPMorganChase

Data Engineer

Financial Services
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
289097 Employees

Cargill Logo Cargill

Data Engineer

Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
155000 Employees

Atlassian Logo Atlassian

Data Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
560071, Domlur, Karnataka, IND
11000 Employees

Hewlett Packard Enterprise Logo Hewlett Packard Enterprise

Cloud Engineer

Artificial Intelligence • Cloud • Information Technology • Consulting
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
85422 Employees

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account