Data Engineer

Posted 3 Days Ago
Hiring Remotely in India
Remote
2M-3M Annually
Mid level
Artificial Intelligence • HR Tech • Professional Services • Software
The Role
Design, build, and maintain scalable ETL pipelines, data warehouses, data lakes, and analytics platforms. Develop Streamlit dashboards, integrate PostHog behavioral data, create LangChain workflows, and use deepeval for model validation. Optimize SQL and database schemas, ensure data quality, governance, security, and privacy, monitor pipeline health, troubleshoot failures, and collaborate with data scientists and cross-functional teams.
Summary Generated by Built In

𝗧𝗵𝗶𝘀 𝗿𝗼𝗹𝗲 𝗶𝘀 𝗳𝗼𝗿 𝗼𝗻𝗲 𝗼𝗳 𝘁𝗵𝗲 𝗪𝗲𝗲𝗸𝗱𝗮𝘆'𝘀 𝗰𝗹𝗶𝗲𝗻𝘁𝘀

𝗦𝗮𝗹𝗮𝗿𝘆 𝗿𝗮𝗻𝗴𝗲: 𝗥𝘀 𝟮𝟬𝟬𝟬𝟬𝟬𝟬 - 𝗥𝘀 𝟯𝟬𝟬𝟬𝟬𝟬𝟬 (𝗶𝗲 𝗜𝗡𝗥 𝟮𝟬-𝟯𝟬 𝗟𝗣𝗔)

Experience: 3+ yrs

Location: Remote

As a Data Engineer, you will design, build, and maintain scalable data pipelines and analytics platforms that drive business insights and product innovations. Leveraging your expertise in Python and SQL, you will transform raw data into clean, structured datasets, enabling data scientists and product teams to accelerate experimentation. You will integrate Posthog for behavioral analytics, employ deepeval for model validation workflows, and use Streamlit and LangChain to create interactive data tools and prompt-based applications. Your role will ensure data quality, performance, and compliance across the organization while collaborating closely with cross-functional stakeholders to translate data needs into technical solutions.


Requirements

𝗞𝗲𝘆 𝗥𝗲𝘀𝗽𝗼𝗻𝘀𝗶𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀

• Design and implement robust ETL pipelines that ingest, transform, and store data from diverse sources into a unified data warehouse.

• Build and maintain dashboards and data visualizations using Streamlit to provide real‑time insights for product, marketing, and engineering teams.

• Integrate Posthog event data into the analytics pipeline and create segmented user funnels for product optimization.

• Develop and maintain LangChain workflows to power conversational AI features that interact with structured data.

• Employ deepeval to automate evaluation of machine learning models, ensuring model performance aligns with business KPIs.

• Optimize SQL queries and database schemas for speed, reliability, and scalability across large datasets.

• Collaborate with data scientists to provision and manage queryable data lakes and data marts.

• Implement data governance, security, and privacy controls to comply with industry regulations.

• Monitor pipeline health, troubleshoot failures, and iterate on performance enhancements.

• Document data architecture, pipeline logic, and best practices for internal and external stakeholders.

𝗪𝗵𝗮𝘁 𝗠𝗮𝗸𝗲𝘀 𝗬𝗼𝘂 𝗮 𝗚𝗿𝗲𝗮𝘁 𝗙𝗶𝘁

• 3+ years of professional experience building data pipelines and analytics platforms in a production environment.

• Strong programming skills in Python, with extensive experience in writing reusable, testable code.

• Deep knowledge of SQL and experience with modern database systems such as PostgreSQL, BigQuery, or Snowflake.

• Proven track record of integrating Posthog for behavioral data ingestion and analysis.

• Hands‑on experience with deepeval or similar model evaluation frameworks.

• Familiarity with LangChain for building LLM‑driven data workflows and prompt engineering.

• Solid understanding of Streamlit or comparable open‑source toolkits for building interactive dashboards.

• Ability to collaborate effectively with cross‑functional teams in a remote, agile environment.

• Strong problem‑solving mindset, with the capacity to troubleshoot complex data issues under tight deadlines.

• Commitment to code quality, documentation, and continuous learning in the fast‑moving data engineering landscape.

Skills Required

  • 3+ years of professional experience building data pipelines and analytics platforms in production environments
  • Strong Python programming skills, including reusable and testable code
  • Deep knowledge of SQL and experience with PostgreSQL, BigQuery, or Snowflake
  • Experience integrating PostHog for behavioral data ingestion and analysis
  • Hands-on experience with deepeval or similar model evaluation frameworks
  • Familiarity with LangChain for LLM-driven data workflows and prompt engineering
  • Experience with Streamlit or comparable tools for interactive dashboards
  • Ability to collaborate effectively in a remote, agile environment
  • Strong problem-solving skills and ability to troubleshoot complex data issues under tight deadlines
  • Commitment to code quality, documentation, and continuous learning
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Stockholm
Year Founded: 2021

What We Do

Weekday is an AI-powered recruitment platform that helps startups hire top-tier engineering and product talent. By leveraging a massive database of white-collar professionals and advanced outreach tools, the company streamlines the hiring process through automated sourcing, AI-driven resume screening, and white-glove contingency services. Their mission is to modernize recruitment by enabling companies to discover and engage passive candidates efficiently, ensuring high-quality hires for critical roles.

Similar Jobs

Atlassian Logo Atlassian

Principal Software Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
560071, Domlur, Karnataka, IND
11000 Employees

Akamai Technologies Logo Akamai Technologies

Data Engineer

Cloud • Security • Software • Cybersecurity
In-Office or Remote
2 Locations
10285 Employees

Atlassian Logo Atlassian

Platform Engineer

Cloud • Information Technology • Productivity • Security • Software • App development • Automation
In-Office or Remote
560071, Domlur, Karnataka, IND
11000 Employees
Remote
Shri Bhrigukshetra, BLR, Uttar Pradesh, IND
15967 Employees

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
VCA Animal Hospitals Thumbnail
Pet • Professional Services
Los Angeles, CA
35000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account