Abacus Insights is a mission-driven, growth-stage technology company focused on transforming the healthcare industry, ultimately creating a more personalized patient experience, improving health outcomes, and lowering the overall cost of healthcare. Abacus Insights provides a flexible, efficient, and secure platform that organizes and exchanges healthcare data from various sources and formats, allowing our customers to uncover differentiated insights that address their clients' needs. In addition, our employees know that they play an active role in keeping our customers' data safe and are responsible for ensuring that our comprehensive policies and practices are met.

With our deep expertise in cloud-enabled technologies and knowledge of the healthcare industry, we have built an innovative data integration and management platform that allows healthcare payers access to data that has been historically siloed and inaccessible. As a result, these payers can ingest and manage all the information they need to transform their business by supporting their analytical, operational, and financial needs through our platform.

Since our founding in 2017, Abacus has built a highly successful SaaS business, raising more than $53 Million by leading VC firms with profound expertise in the healthcare and technology industries. We are solving massive complex problems in an industry ready for disruption. We're building powerful momentum and would love for you to be a part of it!

About the role:

Our Connectors engineering team wants to bring on an experienced Sr. Data Engineer. The Connectors engineering team delivers the data pipelines that ingest and process diverse data sources, including large batch processing and streaming systems. As a senior team member, you will be exposed to every aspect of the Abacus platform and help drive the products' evolution as we continue to serve our fast-growing customer base. We value innovation and encourage you to bring your knowledge and expertise to revisit our existing services and build out new evolutions of our platform. If you are interested in guiding a critical feature delivery team to solve complex healthcare data problems, this position is for you.

You Will:

• Deliver core product features by designing and implementing automated, resilient, and rapidly evolving ETL pipelines using Spark, Kubernetes, Airflow, and native AWS services
• Become an expert in AWS and, in the future, other cloud service providers
• Design infrastructure for greater scalability, availability, and reliability
• Deploy our infrastructure with Terraform and Serverless technology
• Push the envelope concerning continuous integration and zero-downtime deploys
• Drive the implementation of data management and governance procedures within the company
• Work with secure systems in highly regulated environments; we process highly-sensitive healthcare data
• Help improve our SDLC process through proactive thinking, promoting best practices, and cross-team collaboration

What We're Looking For:

• Experience designing, building, and maintaining "big data" data architectures, notably data lakes, columnar databases, batch processing (Spark), stream processing (Spark, Kafka), and message queuing
• Strong knowledge of AWS data services (EMR, Glue, Athena, Redshift, Kinesis, SQS, DynamoDB), serverless architectures (Lambda), and container orchestrators (Kubernetes)
• Expertise in building and shipping highly scalable and distributed systems on cloud platforms
• Expert-level programming skills with Python, Java, or other OOP languages
• Knowledge of infrastructure automation practices and tools - Terraform and other serverless technologies
• Background performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
• A willingness to learn new things, a comfort level with potential uncertainty, and a desire to be close to business problems

Bonus Points:

• Experience with 3rd party Cloud Data Platforms (DataBricks, Snowflake)
• Healthcare Data Experience (Claims, Billing, Lab, Clinical Data)

Equal Opportunity Employer

As a mission-led technology company that is helping to drive better healthcare outcomes, Abacus Insights believes that the best innovation and value we can bring to our customers comes from diverse ideas, thoughts, experiences, and perspectives. Therefore, we proudly dedicate extensive time and resources to building diverse teams and providing equal employment opportunities to all applicants. Abacus prohibits discrimination and harassment of any type regarding race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

#BI-REMOTE