At Acryl Data, we bring clarity to data by enabling delightful search and discovery, data observability, and federated governance across your entire data ecosystem.
Acryl Data is well funded by top tier VCs (8VC, LinkedIn), and is dedicated to building and serving a thriving open source community and product.
In this role, you will
- Enhance the Python based ingestion framework to support ingesting usage statistics, lineage and operational metadata from systems like Snowflake, Redshift, Kafka, & more!
- Build connectors for major systems in the modern data and ML stacks
- Enable the ingestion framework to run in a cloud native environment
Requirements:
- Minimum 4 years of engineering experience
- Expertise in Python
- Familiarity with tools in the modern data and ML ecosystem
- Knowledge of distributed systems
- Ability to design for scale and fault tolerance
Top Skills
What We Do
Founded by the leaders that built data teams at LinkedIn and Airbnb, Acryl Data enables you to take back control of your fragmented data stack. We do this by driving the #1 open source Metadata Platform DataHub, which has a community of 8,000+ data practitioners and is deployed in 1,000+ companies.
Acryl DataHub is a third-generation streaming metadata platform that integrates with 50+ tools (dbt, Kafka, Snowflake, Airflow, Looker, etc) in the data stack to enable data discovery, data lineage, data governance, and data observability.
✅ Connect to your data sources within minutes, and gain end-to-end visibility.
✅ Power mission-critical workflows with a SOC-2-compliant platform.
✅ Bring data and business teams together with a single source of truth to create governed data products.
Powering data teams at Notion, Zendesk, Riskified, and many more!
.jpeg){kind=icon}
