Lead Data Engineer

Title: Lead Data Engineer

Reports to: Chief Technology Officer

About the Company: 

Sourcemap is the leading provider of supply chain mapping, traceability, and transparency software. Our clients include category-leading global brands, manufacturers and suppliers across the food & agriculture, fashion, beauty, manufacturing and electronics industries. We seek committed individuals who will join our team to support our award-winning, values-led work and to tackle important supply chain challenges in a dynamic startup environment.

Job Summary:

Sourcemap is seeking a Lead Data Engineer to join our growing Engineering team. In this hands-on role, you will play a key part in building and deploying new platform features, while ensuring performance, reliability, and scalability. Additionally, you will participate in developing and mentoring junior team members by sharing best practices and past experiences to support their growth.

This role offers the opportunity to work with cutting-edge data technologies, collaborate with cross-functional teams, and contribute to the evolution of our data infrastructure.

Sourcemap is headquartered in New York City and there may be an option for this position to be remote or hybrid in CST or EST time zones.

Primary Responsibilities:

• Develop and maintain ETL and ELT pipelines.
• Design, build and manage Data Warehouse and Data Lake environments.
• Develop APIs to support data integration and accessibility.
• Assemble and process large, complex sets of data to meet both functional and non-functional business requirements.
• Optimize data delivery to improve efficiency and reliability.
• Automate manual data processing procedures to streamline operations.
• Collaborate with stakeholders including data scientists, design, and product teams, to address data-related technical challenges.
• Leverage strong analytic skills to work with and extract insights from unstructured datasets.

Experience Requirements and Skills:
Required

• 7+ years of experience writing production-ready Data Pipelines (Python, SQL, Scala, etc.).
• 6+ years of experience working with relational SQL and NoSQL databases.
• 3+ years of experience using geospatial tools, data and techniques (ESRI, QGIS, GDAL, Geopandas,), including handling multiple geometry types and coordinate transformations, etc.
• A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Data architecture experience with cloud platforms such as Azure, Databricks, etc.
• Experience using Big Data Tools such as Databricks, Snowflake, Spark, etc.
• Project Management experience.
• Other experience: proficiency in Git and debugging complex data pipelines.
• Comfortable with Data Visualization & Web Mapping concepts.

Other Skills & Qualifications:

• Effective listening, verbal and written communication skills. Demonstrates openness to others' ideas.
• Ability to identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
• Adaptable and agile in a fast-paced environment.
• Enjoys working in a collaborative environment.
• Goal-oriented and a self-starter.
• Ability to multitask, prioritize and manage time effectively in order to meet demanding deadlines.
• A natural leader who enjoys mentoring and guiding junior developers.
• Enthusiastic and positive team player.

Sourcemap offers a competitive compensation package based on job-related factors such as business needs, experience, level of responsibility, and qualifications. For this role, the base salary range is $150K to $160K. Sourcemap offers a benefit package, including but not limited to paid time off, paid holidays, medical, dental and vision benefits, 401k.

Sourcemap provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.