The Role
As a Data Architect, you'll develop datasets for data visualization and machine learning while working with structured and unstructured data. Responsibilities include automating data pipelines, building data ingestion frameworks using Data Bricks and Apache Spark, and collaborating with stakeholders to deliver data products.
Summary Generated by Built In
- Your team will develop datasets that enable data visualization, machine learning and data driven decision making across client product line
- Working with structured and unstructured datasets and automating data pipelines to ingest, analyze, validate, normalize and clean data in a hybrid multi-cloud environment
- Building data ingestion pipelines from multiple data sources using Data Bricks and Apache Spark
- Partnering with analysts, solution architects, modelers and developers to build data product and data pipelines.
- Providing technical and thought leadership
- Strong T-SQL Skills with experience in Snowflake
- Familiarity with CI/CD methods
- Significant experience in Python development
- Highly proficient at PySpark development
- Solid grasp of database engineering and design principles
- Current Databricks Certification
- Experience in building business stakeholder relationships at all levels, leadership communications and managing project delivery from design to launch
- Education Assistance/Student Loan Repayment - up to $2400 annually
- Remote work allowance
- Internet reimbursement
- Bench pay
- Profit share
- Healthcare reimbursement
- 401k - 4% match
- Short-Term disability
- Long-Term disability
- Life Insurance
Top Skills
Pyspark
Python
T-Sql
The Company
What We Do
Bitful is a new kind of technology consulting firm: One that puts humans first.
Together, we build future-proof, open, explorable data systems and perform cloud-computing marvels. We profoundly solve app challenges, and engineer game-changing digital products. And we do all of the above to create and fund opportunities for underserved communities who deserve to be every bit as supported, connected, and inspired as we are at Bitful.
Better tech for the greater good: That’s Bitful
