Sr. Full-Stack Engineer, Data Systems

Posted Yesterday
Be an Early Applicant
New York, NY, USA
In-Office
150K-170K Annually
Senior level
Real Estate • Software • Analytics • Business Intelligence
The Most Actionable Insight Platform ‍For Building Materials and Home Improvement Manufacturers
The Role
Own Datavations’ taxonomy and attribute systems end to end, including LLM extraction, dbt transformations, Dagster orchestration, full-stack applications, APIs, deployment, CI/CD, data quality, observability, and approval workflows. Build reliable AI systems with evaluation suites, versioned prompts, tool-calling, cost controls, and monitoring. Partner with the data platform team while establishing engineering standards, documentation, testing, runbooks, and scalable architecture.
Summary Generated by Built In

About Datavations  

Datavations is a leading New York-based data and AI software specializing in the $2.3 trillion dollar building materials industry. Datavations gives building materials and home improvement manufacturers real-time, store-level visibility into pricing, assortment, and inventory across major retailers, including Home Depot, Lowe’s, and Menards. Manufacturers use this data to make sharper decisions about pricing, distribution, and how they show up on the shelf. 

About the role

Product taxonomy and attributes form the foundation of every insight Datavations delivers to our customers. We are looking for an engineer to own this domain end-to-end—driving both the data systems that organize the market and the applications that enable our teams and customers to interact with them. This is a hands-on role with significant architectural latitude for someone who wants to take full ownership of a system that already powers the business.

WHAT YOU'LL OWN

  • The attribute extraction engine — LLM-based extraction at production scale, its configuration model, its quality gates, and its cost profile.
  • The transformation layer for this domain — the dbt models that turn extracted values into published attributes: standardization, and the override model that lets human judgment reliably beat the machine. Built on our ClickHouse warehouse alongside the data platform team.
  • Orchestration and reliability for these pipelines — the Dagster jobs, sensors, and schedules that run taxonomy and attribute processing, including run monitoring, retries, alerting, and recovery tooling. Reliability is not a separate team here; for this domain, it is this seat.
  • The applications — internal and customer-facing. You own the screens people actually use, not only the services behind them: the internal platform our teams run taxonomy and attributes from, and the customer-facing views of this data as they move onto it. React/Next.js front end, backend services and APIs, application architecture, deployment and CI/CD.
  • The write path — every change validated, logged, and visible before it ships, with approval where it matters.
  • Data quality and observability — automated testing on the data itself, plus statistical detection of what goes wrong quietly: outliers, drift, a retailer that stopped updating, a value that flips between runs.
  • Engineering standards for the domain — documentation, tests, runbooks, and review culture as the system and the team around it scale.

BUILDING WITH AI, SPECIFICALLY

  • A meaningful part of this platform is AI, and not bolted on the side: an LLM extraction engine already running at scale, a rules engine that produces a confidence score per item, and an in-app assistant that answers questions in natural language and proposes changes for review. We are looking for someone who has built this kind of system properly, not someone who has called a completion endpoint.
  • Evaluation before assertion — golden sets, regression suites that run when a prompt changes, and a defensible answer to “did that make it better?” Quality you can measure, not quality you claim.
  • Prompts and rules as versioned data — stored, diffable, testable, auditable, with a clear record of what changed and what it did. Not constants in a file that move on deploy.
  •  Tool-calling and MCP — exposing internal systems to agents safely: scoped, read-first, audited. It is how our teams will query and operate the platform, and how we already work internally.
  • Cost and latency as design constraints — model tiering, caching, batching, circuit breakers. Knowing what a run costs before it runs, and why a small model first is usually the right answer.

WHAT YOU'LL WALK INTO

  • A modernization already in motion, not a greenfield and not a rescue: a production system that has grown fast with the business, a detailed technical map of it, an engaged leadership team, a modern monorepo, and a new internal platform in its first release — with full air cover to do it properly. You own the taxonomy and attribute systems end to end; the warehouse, ingestion, and shared infrastructure are owned alongside you by the data platform team.

REQUIREMENTS

  • At least 5 years of experience in Cloud Infrastructure, Site Reliability Engineering (SRE), or Platform Engineering.
  • Strong expertise with Terraform and using infrastructure as code (IaC).
  • Experience with CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI/CD, ArgoCD).
  • Strong expertise in architecting solutions using AWS services.
  • Experience in Python, SQL, dbt, and modern orchestration tools (e.g., Dagster, Airflow, Prefect).
  • Proficiency with a columnar warehouse (e.g., ClickHouse, Snowflake, BigQuery).
  • Experience with full-stack development (TypeScript, Next.js or similar).
  • Experience building production data pipelines and maintaining observability/reliability.
  • Experience with AI/LLM-based systems, including evaluation and versioning of prompts.
  • Experience with data visualization tools (e.g., Tableau, Power BI) and project management tools (e.g., Jira).

YOU'RE A FIT IF

  • You think like a product person as well as an engineer — you form opinions about what the people using this should be able to do, and would rather understand the problem behind a request than build the ticket as written.
  • You build with AI daily — both in what you ship and in how you work. AI-assisted development is a habit, not a novelty.
  • You write things down by default, and can take ownership of an existing codebase without needing its original author in the room.
  • Bonus: retail, e-commerce, or point-of-sale data.

YOU'RE NOT A FIT IF

  • You want a greenfield with no history, or “it ran green” is your definition of done.

Preferred Location: NY, Chicago, Dallas, Cincinnati, Minneapolis


Why Join Datavations

  • Impact at Scale: Influence a $2.3 trillion industry by shaping how data science accelerates ROI for major manufacturers.
  • Autonomy & Growth: Enjoy the freedom to experiment with new technologies and see your ideas realized in production.
  • Collaborative Culture: Work alongside a supportive team that values positivity, proactive ownership, and continuous learning.

Our values 

  • Customer Obsession: We are integrated in the industry with a customer-first obsession.
  • Proactive Ownership: We have agency for our actions and embody an entrepreneurial mindset.
  • Bias for Action: We maintain momentum with a can-do attitude; we value progress over perfection.
  • Eager to Grow: We stay curious and hungry to learn, viewing every failure with humility as an opportunity to grow.
  • Foster Collaboration: We work across boundaries with quiet competence, welcoming diverse perspectives and offering help unselfishly.

Compensation 

The average range for this role is $150,000 - $170,000  depending on experience, skills, and alignment with the role’s responsibilities. This range reflects our current national expectations for qualified candidates. Exceptional candidates based in our NYC office may be considered for a higher range. Total compensation may also include equity, performance bonuses, and a comprehensive benefits package.

We’re committed to paying competitively and equitably, and we regularly review our compensation structures to ensure they align with the market and support our values

Skills Required

  • At least 5 years of experience in cloud infrastructure, Site Reliability Engineering, or platform engineering
  • Strong expertise with Terraform and infrastructure as code
  • Experience with CI/CD pipelines, including GitHub Actions, Jenkins, GitLab CI/CD, or ArgoCD
  • Strong expertise architecting solutions using AWS services
  • Experience with Python, SQL, dbt, and modern orchestration tools such as Dagster, Airflow, or Prefect
  • Proficiency with a columnar warehouse such as ClickHouse, Snowflake, or BigQuery
  • Experience with full-stack development using TypeScript and Next.js or similar technologies
  • Experience building production data pipelines and maintaining observability and reliability
  • Experience with AI or LLM-based systems, including evaluation and prompt versioning
  • Experience with data visualization tools such as Tableau or Power BI and project management tools such as Jira
  • Experience with retail, e-commerce, or point-of-sale data
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, New York
56 Employees
Year Founded: 2020

What We Do

Insights-Driven Analytics for Smarter Retail Decisions within the Home Improvement industry. Datavations delivers market intelligence built exclusively for the home improvement and building materials industry. Our proprietary data and insights-driven analytics help manufacturers respond faster to retail shifts, uncover growth opportunities, and make smarter decisions at scale. We partner with business intelligence, sales, supply chain, pricing, inventory, distribution, and marketing teams to provide timely visibility into competitive activity across major retailers like Home Depot, Lowe's, and Menards with plans to expand into additional industry retailers in the near future. Whether it is tracking assortment changes, identifying pricing trends, or spotting inventory risks, Datavations equips you with the actionable insights needed to grow market share and revenue — before your competitors do. Our platform includes a suite of purpose-built tools: * Assortment Optimizer: Identify assortment gaps and opportunities across key retail accounts * Inventory Optimizer: Uncover inventory risks and opportunities to improve in-stock performance and on-shelf availability. * Pricing Optimizer: Monitor pricing and promotional trends to inform smarter pricing strategies. * Market Watch: Stay on top of category-level and competitive shifts with timely, easy-to-digest market insights. At Datavations, we turn complex retail data into clear, prescriptive actions — helping manufacturers build stronger retail partnerships and outperform the competition.

Similar Jobs

TIDAL Logo TIDAL

Creative Director

Consumer Web • Information Technology • Mobile • Music • News + Entertainment • Software
Remote or Hybrid
New York, NY, USA
450 Employees
252K-377K Annually
Hybrid
4 Locations
289097 Employees

Canoe Logo Canoe

Data Analyst

Artificial Intelligence • Fintech • Information Technology • Machine Learning • Financial Services
Hybrid
New York City, NY, USA
180 Employees
70K-100K Annually

PNC Bank Logo PNC Bank

Technology Solution Center Analyst Lead

Machine Learning • Payments • Security • Software • Financial Services
Remote or Hybrid
USA
55000 Employees
41K-83K Annually

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account