Senior Data Pipeline Engineer, AgTech
The mission of the Data Insights group is to foster a data-driven organization by providing and supporting robust, organized wise use of data to gain insights and make decisions. This role, as part of the Data Insights group, supports the development of data processing pipelines for Sensei Ag. Day-to-day tasks would include monitoring of data processing, troubleshooting and debugging data processing tasks, and development of new data flows for existing platforms. This role will also provide basic support to the development of new data processing technologies including setup and administration of new tools and engineering support to new data software systems. The role offers multiple growth opportunities including work in data science, data visualization, and sensing/control systems. An ideal candidate will have a passion for helping build systems which will empower Sensei Ag to grow crops more efficiently and sustainably.
Responsibilities
- Collaborate with cross-functional teams to understand data requirements and help translate domain expertise into data products that meet business needs.
- Build scalable data pipelines that will enable data users to derive insights and build models faster and more efficiently.
- Design, build and maintain robust data pipelines and data processing systems.
- Implement data quality frameworks to ensure the accuracy and integrity of data.
- Optimize data storage and retrieval for efficient data access and analysis.
- Stay up to date with industry trends and emerging technologies in data engineering.
Minimum years of experience required
- 5+ years of data pipeline and/or software engineering experience.
Required Skills, Abilities and Qualifications
- Solid understanding of data engineering fundamentals (design patterns, common practices) and what it takes to build high-volume data products and services.
- Experience with Python, SQL, and Python data science libraries such as Pandas and PySpark.
- Strong proficiency in querying and manipulating large datasets using SQL and Python.
- Experience with cloud-based data technologies, such as OCI, AWS, Azure or GCP.
- Familiarity with efficient big data formats and an understanding of their tradeoffs.
- Familiarity with data modeling and database design principles.
- A natural curiosity for technologies and problem-solving.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Preferred Skills, Abilities and Qualifications
- Experience with developing ETL flows.
Educational Requirements
- Bachelor's degree in Computer, Data Science or related field.
Travel Requirements
- Up to 10% of the time.
Traits We Value
- Appreciation for transforming health and the future of food
- Smart, not arrogant
- Humble and hardworking
- Entrepreneurial, not risk averse
- Kind and genuine
- Grit and lots of it
FLSA Status
- Exempt
Compensation
- $95,000 - $155,000 per year
Benefits
- Comprehensive Medical Plans
- Prescription Drug Benefits
- Employee Wellness
- Dental Plan
- Vision Plan
- HSA/FSA
- Basic Life and AD&D
- Short and Long Term Disability
- Flexible Spending Accounts
- Employee Assistance Program (EAP)
- Travel Assistance Program
- Paid-Time Off
- 401K
NOTE: Residents of Hawaii, receive a Comprehensive Healthcare Bundle consisting of: Medical, Dental, Vision and Rx prescriptions, different from US Mainland plans/programs.
NOTE: This job description is not intended to be an exhaustive list of all duties, responsibilities or qualifications associated with the job. Other duties may be assigned.