Data Engineer – Data Infrastructure & eDiscovery-6387

Posted 5 Days Ago
San Jose, CA, USA
In-Office
Mid level
Artificial Intelligence • Information Technology • Software • Consulting
The Role
Build and maintain complex ETL pipelines, data warehouses, monitoring systems, and alerting infrastructure for legal and eDiscovery data. Develop advanced SQL and Python solutions, lead cross-functional engineering initiatives, collaborate with attorneys and Data Scientists, and identify AI and automation opportunities while maintaining privacy and security standards.
Summary Generated by Built In
Data Engineer – Data Infrastructure & eDiscovery

itD is seeking an experienced Data Engineer to build, enhance, and maintain high-complexity data pipelines, data warehousing infrastructure, and monitoring and alerting systems supporting its Legal and eDiscovery team. The ideal candidate will bring deep expertise in SQL, Python, ETL pipeline development, and workflow orchestration, with a proven track record of leading end-to-end data engineering initiatives across cross-functional teams. This individual will help deliver scalable, reliable, and secure data infrastructure while partnering with technical and non-technical stakeholders, including attorneys and Data Scientists.

Location: Remote – California. Candidates located in or near the San Francisco Bay Area are preferred. Candidates must indicate their willingness to occasionally work onsite in San Francisco.

Duration: 6 months

We provide comprehensive medical benefits, a 401(k) plan, paid holidays, and more.

Please note that we are only considering direct W2 candidates at this time, as we are unable to offer sponsorship.

Responsibilities
  • Design, develop, and maintain complex ETL pipelines to support large-scale data extraction, transformation, and processing across enterprise data environments.
  • Build and enhance scalable data warehousing solutions, ensuring efficient querying and management of massive datasets.
  • Lead end-to-end development of high-complexity monitoring, alerting, and data pipeline systems to proactively identify and prevent infrastructure issues.
  • Develop and optimize advanced SQL queries using technologies such as Presto, PostgreSQL, and MySQL.
  • Collaborate with attorneys, Data Scientists, and cross-functional technical teams to understand data requirements, identify relevant data sources, and deliver reliable data solutions.
  • Lead cross-functional engineering initiatives by defining project plans, coordinating stakeholders, preparing technical documentation, and driving successful implementation.
  • Identify opportunities to leverage AI and automation to streamline workflows, improve operational efficiency, and support non-technical stakeholders while maintaining strong privacy and security standards.
Internal Responsibilities
  • Attend regular internal practice community meetings.
  • Collaborate with your itD practice team on industry thought leadership.
  • Complete client case studies and learning material (blogs, media material).
  • Build out material to contribute to the Digital Transformation practice.
  • Attend internal itD networking events (in person and virtual).
  • Work with leadership on career fast-track opportunities.
Required Qualifications and Skills
  • 3+ years of professional experience in Data Engineering.
  • Expert-level proficiency in SQL, including experience with relational databases such as Presto, PostgreSQL, or MySQL.
  • Expert-level proficiency in Python.
  • Expert-level experience building, managing, and optimizing ETL/data pipelines.
  • Expert-level proficiency with workflow orchestration and data pipeline tools such as Apache Airflow or similar technologies.
  • Demonstrated experience leading end-to-end data engineering initiatives involving large, cross-functional teams and diverse technical and non-technical stakeholders.
  • Strong written and verbal communication skills, with the ability to communicate complex technical concepts clearly and concisely.
  • Experience navigating ambiguous requirements and independently driving technical projects to completion.
Preferred Qualifications and Skills
  • Demonstrated experience leveraging AI to accelerate project delivery or developing AI-powered solutions to automate workflows for non-technical stakeholders.
  • Experience working in highly regulated industries, including legal, compliance, finance, security, or privacy.
  • Previous experience supporting legal technology, eDiscovery, data privacy, or compliance-related initiatives.
  • Experience with data loss prevention and remediation.
  • Experience mentoring and supporting junior engineering team members.
  • Previous experience working in startups, small-to-mid-sized organizations, or environments requiring adaptability and broad ownership.
  • Experience working with attorneys, legal teams, or law firms through professional, internship, or volunteer experience.
Education

Bachelor’s degree in a relevant field or equivalent work experience required.

Company Description
About itD: We are part of a new generation of consulting and software development company that blends diversity, innovation, and integrity with real business results. Our structure rejects any strong hierarchy, empowering us to deliver excellent results. We are a woman- and minority-led firm. Every day, we challenge ourselves to be considerate, fair and to re-think what great outcomes mean for our customers. This permeates down to how we approach every interaction, on every project, for every client. You’ll thrive here if you are a dynamic self-starter, a difference-maker or someone who wants to deliver great results, without constraints.

The itD Digital Experience: Joining us means you’ll be part of our global community, you have a say about your own career journey, and you’ll get a chance to give back to causes that matter. You will experience working with Fortune 500 companies and high-performance teams across numerous industries. itD offers our employees excellent benefits such as medical, dental, vision, life insurance, paid holidays, 401K + matching, networking & career learning and development programs. We are growing and we want to see you grow! Visit https://itdtech.com/careers to learn more about what working at itD can mean for you.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law. itD is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the application process, or to perform the essential functions of a position, please contact us at [email protected] and let us know the nature of your request and your contact information.

Additional Info
Dynamic environment in a culture of respect, empowerment and recognition for a job well done, apply today!

Skills Required

  • 3+ years of professional experience in data engineering
  • Expert-level proficiency in SQL and relational databases such as Presto, PostgreSQL, or MySQL
  • Expert-level proficiency in Python
  • Expert-level experience building, managing, and optimizing ETL and data pipelines
  • Expert-level proficiency with workflow orchestration and data pipeline tools such as Apache Airflow or similar
  • Experience leading end-to-end data engineering initiatives with cross-functional stakeholders
  • Strong written and verbal communication skills
  • Experience navigating ambiguous requirements and independently driving technical projects to completion
  • Bachelor's degree in a relevant field or equivalent work experience
  • Experience leveraging AI to accelerate project delivery or develop AI-powered workflow solutions
  • Experience in regulated industries such as legal, compliance, finance, security, or privacy
  • Experience supporting legal technology, eDiscovery, data privacy, or compliance initiatives
  • Experience with data loss prevention and remediation
  • Experience mentoring junior engineering team members
  • Experience working in startups or small-to-mid-sized organizations
  • Experience working with attorneys, legal teams, or law firms
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Campbell, California
273 Employees
Year Founded: 2005

What We Do

itD is a different kind of technology and software development consultancy that puts client needs at the center of what we do. We combine the experience of a full-service consultancy with the agility of a specialized firm to help clients reimagine and improve operations and solve challenges unique to their business. Founded in 2005, we are headquartered in Silicon Valley and are honored to have long term partnerships with many of the world’s leading enterprise technology firms. With onshore, nearshore and offshore capability centers we are able to provide seamless global reach. We define ourselves by solving the toughest challenges in business. To tackle these challenges, we deploy the best people armed with the best technology to help our clients by enabling next-generation experiences, transforming tech operations, leveraging BI and analytic depth to convert data to advantage, delivering advanced DevOps and software development services and unlocking the potential of AI. Our mantra as itD is “Innovate Transform Deliver” and as a proud woman- and minority-owned business, we are focused on delivering a unique perspective and approach that attracts a robust and diverse talent pool. We believe this diversity of talent, thinking and perspective leads to better outcomes for our clients and a positive impact in our communities through our focus on giving back initiatives. We invite you to bring us the challenges no one else can solve. Because while other firms might give up, pivot, or pass… Impossible drives us. Certified Woman Owned - WBENC

Similar Jobs

Rapid7 Logo Rapid7

Staff Software Engineer

Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Hybrid
San Francisco, CA, USA
2400 Employees
165K-223K Annually

Wipfli Logo Wipfli

Audit Manager, Tribal Industry

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
97K-131K Annually

Wipfli Logo Wipfli

Architect

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
129K-174K Annually

Wipfli Logo Wipfli

Manager, Financial Reporting - Physician Practice Clients

Cloud • Fintech • Software • Business Intelligence • Consulting • Financial Services
Remote or Hybrid
United States
2900 Employees
97K-145K Annually

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account