Senior Data Engineer- Databricks

Reposted 21 Days Ago
Hiring Remotely in US
Remote
200K-200K
Senior level
Edtech
The Role
The Senior Data Engineer will design and implement scalable data pipelines using Databricks and Apache Spark, optimizing workflows for AI-driven solutions and collaborating with data teams.
Summary Generated by Built In

Risepoint assists primarily regional universities in increasing their access and impact by making their academic programs available to students online. Founded in 2007, Risepoint's mission is to expand access to high-quality, affordable, and workforce-relevant education, especially for working and adult students. Risepoint brings single-minded dedication to student success, an integrated set of services, and data-driven performance to our collaboration with university partners.

About the Role

We’re looking for a hands-on Data Engineer to build reliable, scalable data pipelines on Databricks. You’ll turn requirements into production-grade ELT/ETL jobs, Delta Lake tables, and reusable components that speed up our teams. In this role, you’ll implement and improve reference patterns, optimize Spark for performance and cost, apply best practices with Unity Catalog and workflow orchestration, and ship high-quality code others can build on. If you love solving data problems at scale and empowering teammates through clean, well-documented solutions, you’ll thrive here.

Key Responsibilities

  • The ideal candidate will have a strong background in building scalable data pipelines, optimizing big data workflows, and integrating Databricks with cloud services
  • This role will play a pivotal part in enabling the customer’s data engineering and analytics initiatives—especially those tied to AI-driven solutions and projects—by implementing cloud-native architectures that fuel innovation and sustainability
  • Partner directly with the customer’s data engineering team to design and deliver scalable, cloud-based data solutions
  • Execute complex ad-hoc queries using Databricks SQL to explore large lakehouse datasets and uncover actionable insights
  • Leverage Databricks notebooks to develop robust data transformation workflows using PySpark and SQL
  • Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks
  • Build ETL/ELT workflows with AWS and Azure Services
  • Optimize Spark jobs for both performance and cost within the customer’s cloud infrastructure
  • Collaborate with data scientists, ML engineers, and business analysts to support AI and machine learning use cases, including data preparation, feature engineering, and model operationalization
  • Contribute to the development of AI-powered solutions that improve operational efficiency, route optimization, and predictive maintenance in the waste management domain
  • Implement CI/CD pipelines for Databricks jobs using GitHub Actions, Azure DevOps, or Jenkins
  • Ensure data quality, lineage, and compliance through tools like Unity Catalog, Delta Lake, and AWS Lake Formation
  • Troubleshoot and maintain production data pipelines
  • Provide mentorship and share best practices with both internal and customer teams

Qualifications

  • Bachelor’s degree in computer science, Engineering, or a related field
  • 5+ years of experience in software/data engineering, including at least 2 years working with Databricks and Apache Spark
  • Strong proficiency in Python, SQL, and PySpark
  • Deep understanding of AWS and Azure Cloud service
  • Experience with Databricks Data LakeHouse, Databricks Workflows, and Databricks SQL, dbt
  • Solid grasp of data Lakehouse and warehousing architecture
  • Prior experience supporting AI/ML workflows, including training data pipelines and model deployment support
  • Familiarity with infrastructure-as-code tools like Terraform or CloudFormation
  • Strong analytical and troubleshooting skills in a fast-paced, agile environment
  • Excellent collaboration skills for interfacing with both technical and non-technical customer stakeholders
  • Clear communicator with strong documentation habits
  • Comfortable leading discussions, offering strategic input, and mentoring others

    Risepoint offers the following comprehensive benefits:

    • 18 days PTO + Winter Shutdown 
    • 12 designated holidays + 1 floating holiday 
    • Medical – four options  
    • Dental 
    • Vision 
    • Life & Disability (company paid) 
    • Flexible Spending Account & Health Savings Account 
    • Retirement plan with company match 
    • Maternity / Paternity / Parental Leave (company paid) 
    • Volunteer Time Off 

    Supplemental Benefits:

    • Wellness program
    • Alternative medicine options
    • Pet discounts
    • Accident, Critical Illness and Hospital Indemnity

    Personal and Professional Development:

    • Continuous Professional and Leadership Development Programs 
    • Tuition Reimbursement for employees and their dependents 
    • Rewards & Recognition programs

    Risepoint is an equal-opportunity employer and supports a diverse and inclusive workforce.

    Top Skills

    Spark
    AWS
    Azure
    Azure Devops
    CloudFormation
    Databricks
    Github Actions
    Jenkins
    Pyspark
    Python
    SQL
    Terraform
    Am I A Good Fit?
    beta
    Get Personalized Job Insights.
    Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

    The Company
    HQ: Dallas, TX
    821 Employees
    Year Founded: 2007

    What We Do

    At Academic Partnerships, we are expanding access to higher education by helping universities launch, grow, and manage affordable, top-quality online degree programs.
    For more than a decade, we have helped universities expand their influence through the online delivery of instruction. Today, we serve more than 60 universities in the United States. We have assisted more than 5,200 faculty members in the transition of nearly 5,400 courses into an online format, spanning 650 undergraduate and graduate degree programs, and we have had the privilege of supporting more than 270,000 students along their higher education journey

    Similar Jobs

    Remote
    US
    737 Employees
    Remote
    United States
    115 Employees
    200K-235K Annually
    Remote
    USA
    20 Employees
    120-150

    Coinbase Logo Coinbase

    Software Engineer

    Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
    Remote
    United States
    4000 Employees
    152K-179K Annually

    Similar Companies Hiring

    RethinkFirst Thumbnail
    Telehealth • Software • Professional Services • Information Technology • HR Tech • Healthtech • Edtech
    New York, NY
    300 Employees
    ReUp Education Thumbnail
    Social Impact • Edtech
    Austin, TX
    180 Employees
    Stepful Thumbnail
    Software • Healthtech • Edtech • Artificial Intelligence
    New York, New York
    60 Employees

    Sign up now Access later

    Create Free Account

    Please log in or sign up to report this job.

    Create Free Account