Data Engineer - AWS Glue, Spark, Python, Snowflake

| New York, NY, USA +80 more | Remote | Hybrid
Employer Provided Salary: 130,000-165,000 Annually
Salary data is provided by the employer. Please note this is not a guarantee of compensation.
Sorry, this job was removed at 1:45 p.m. (CST) on Tuesday, May 7, 2024
Find out who's hiring in New York City, NY.
See all Data + Analytics jobs in New York City, NY
Apply
By clicking Apply Now you agree to share your profile information with the hiring company.

COMPANY: Canoe Intelligence
WEBSITE: https://canoeintelligence.com/
TITLE: Data Engineer - AWS Glue, Spark, Python, Snowflake
LOCATION: New York City (hybrid) or Fully Remote in the United States
SALARY: $130,000 - $165,000 (based on NYC, will be adjusted for geo)
The Role:
We are seeking a highly skilled Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with AWS Glue, Spark, Python, and Snowflake, with a strong background in data engineering, ETL processes, and data warehousing.
What You'll Do:

  • Design, develop, and maintain ETL processes using AWS Glue for extracting, transforming, and loading data from various sources into our data lake and data warehouse.
  • Collaborate with cross-functional teams to understand data requirements, identify data sources, and implement solutions for data ingestion and integration.
  • Optimize and tune ETL workflows for performance, scalability, and reliability.
  • Develop custom transformations and data pipelines using Spark and Python as needed.
  • Ensure data quality and integrity throughout the ETL process, implementing appropriate error handling and monitoring mechanisms.
  • Implement and enforce data governance policies and procedures within the data warehouse, ensuring compliance with regulatory requirements and industry best practices.
  • Work closely with data architects and analysts to design and implement data models, schemas, and structures in Snowflake, with a focus on data governance principles such as data lineage, data quality monitoring, and metadata management.
  • Collaborate with stakeholders to define and document data governance standards, processes, and guidelines, and facilitate training and awareness programs as needed.
  • Continuously evaluate and implement best practices, tools, and technologies to improve data governance practices and ensure data security, privacy, and confidentiality.


What We're Looking For:

  • Bachelor's degree in Computer Science, Engineering, or related field; or equivalent work experience.
  • Proven experience working as a Data Engineer with a focus on ETL processes, data integration, and data warehousing.
  • Extensive hands-on experience with AWS Glue and Python. Strongly preferred experience with Spark and Snowflake.
  • Strong understanding of cloud-based data technologies and services, particularly within the AWS ecosystem.
  • Solid understanding of relational database concepts and experience with SQL.
  • Excellent problem-solving skills with a strong attention to detail.
  • Ability to communicate effectively and collaborate with cross-functional teams.
  • Proactive attitude with a willingness to learn and adapt to new technologies and methodologies.


What You'll Get:

  • Medical, dental, vision benefits
  • Flexible PTO
  • 401(k)
  • Flexible work from home policy
  • Home office stipend + wifi reimbursement
  • Employee Assistance Program
  • Gym reimbursement
  • Education assistance
  • Parental Leave
  • Commuter benefits


    Our Values:

    • Client First -> Listen, and deliver client-centric solutions
    • Be An Owner -> Take initiative, improve situations, drive positive outcomes
    • Excellence -> Always set the highest standard for yourself and others
    • Win Together -> 1 + 1 = 3


    Who We Are:
    Canoe is reimagining alternative investment data processes for hundreds of leading institutional investors, capital allocators, asset servicing firms and wealth managers. By combining industry expertise with the most sophisticated data capture technologies, Canoe's technology automates the highly-frustrating, time-consuming, and costly manual workflows related to alternative investment document and data management, extraction and delivery. With Canoe, clients can refocus capital and human resources on business performance and growth, increase efficiency, and gain deeper access to their data. Canoe's AI-driven platform was developed in 2013 for Portage Partners LLC, a private investment firm.
    Canoe is an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected under federal, state, or local law.

    Read Full Job Description
    Apply Now
    By clicking Apply Now you agree to share your profile information with the hiring company.
    Candidate Location Eligibility:
    Albuquerque, NM
    Ann Arbor, MI
    Atlanta, GA
    Austin, TX
    Baltimore, MD
    Baton Rouge, LA
    Birmingham, AL
    Boise, ID
    Boston, MA
    Buffalo, NY
    Charleston, SC
    Charlotte, NC
    Chicago, IL
    Cincinnati, OH
    Cleveland, OH
    Colorado, CO
    Columbus, OH
    Dallas-Fort Worth, TX
    Dayton, OH
    Des Moines, IA
    Detroit, MI
    Fayetteville-Springdale-Rogers, AR
    Greensboro, NC
    Hampton Roads, VA
    Hartford, CT
    Houston, TX
    Huntsville, AL
    Indianapolis, IN
    Jacksonville, FL
    Kansas City, MO
    Las Vegas, NV
    Lexington, KY
    Lincoln, NE
    Little Rock, AR
    Los Angeles, CA
    Louisville, KY
    Madison, WI
    Memphis, TN
    Miami, FL
    Milwaukee, WI
    Minneapolis–Saint Paul, MN
    Nashville, TN
    New Orleans, LA
    New York City, NY
    Ogden, UT
    Oklahoma City, OK
    Omaha, NE
    Orlando, FL
    Other US Location
    Palm Bay-Melbourne-Titusville
    Pensacola, FL
    Peoria, IL
    Philadelphia, PA
    Phoenix – Mesa – Scottsdale, AZ
    Pittsburgh, PA
    Portland, ME
    Portland, OR
    Providence, RI
    Provo, UT
    Raleigh-Durham, NC
    Reno, NV
    Richmond, VA
    Rochester, NY
    Sacramento, CA
    Salt Lake City, UT
    San Antonio, TX
    San Diego, CA
    San Francisco, CA
    San Luis Obispo, CA
    Santa Cruz, CA
    Seattle, WA
    Spokane, WA
    St. Louis, MO
    Tallahassee, FL
    Tampa Bay, FL
    Tucson, AZ
    Tulsa, OK
    Washington DC
    Wichita, KS
    Wilmington, NC

    Technology we use

    • Engineering
    • Sales & Marketing
    • People Operations
      • JavaLanguages
      • JavascriptLanguages
      • PHPLanguages
      • PythonLanguages
      • SqlLanguages
      • ReactLibraries
      • VueLibraries
      • Angular.JSFrameworks
      • LaravelFrameworks
      • MySQLDatabases
      • WordpressCMS
      • HubSpotCRM
      • SalesforceCRM
      • SlackCollaboration
      • ZoomCollaboration

    An Insider's view of Canoe

    What’s the vibe like in the office?

    A healthy mix of cold brew on tap, snacks and quiet spaces to get work done. On most days the office is typically pretty quiet, except when the remote folks are in town! Bring your pool cue or ping pong paddle as fresh competition is wanted. Friendly office banter is welcome is an added bonus.

    Drew

    Full Stack Developer

    What makes someone successful on your team?

    There are three key qualities that drive success on our team: independent & resourceful, organized, and self-motivated. As a small team, we wear multiple hats and are often handling all aspects of the sales process in any given day. It's critical to be self-reliant & organized, while maintaining a high degree of persistence and discipline.

    Maggie

    Sales Executive

    How do your team's ideas influence the company's direction?

    Canoe is an incredibly collaborative and flat organization. New ideas and perspectives from our team are critical to the company’s continued growth and evolution and are valued deeply. At Canoe, the impact you have on the company’s trajectory is direct and tangible, and in my mind, that’s one of the things that makes Canoe so special.

    Mike

    Partner and Chief Revenue Officer

    What are some things you learned at the company?

    I've learned so much at Canoe not only about the alternative investments space, but also the essential skills needed to succeed individually and as a team within a startup. Our collaborative, fast-paced culture allows for growth based on interests and skills while our diverse team allows us to learn from and contribute to each other's development.

    Minoo

    Client Success Manager

    What are Canoe Perks + Benefits

    Canoe Benefits Overview

    At Canoe, we provide our team with a full benefits package, including medical, dental, vision, 401k, commuter benefits, gym/wellness reimbursements, and more. While the whole team is currently remote, our development team continues to conduct daily stand-ups to regularly touch base. We have monthly company-wide meetings, semi-annual Town Halls, and weekly virtual games for the team to hang out away from work.

    Culture
    Volunteer in local community
    Open door policy
    Team based strategic planning
    Open office floor plan
    Hybrid work model
    Remote work program
    Diversity
    Mandated unconscious bias training
    Diversity manifesto
    Hiring practices that promote diversity
    Health Insurance + Wellness
    Flexible Spending Account (FSA)
    Disability insurance
    Dental insurance
    Vision insurance
    Health insurance
    Life insurance
    Pet insurance
    Wellness programs
    Financial & Retirement
    401(K)
    Company equity
    Performance bonus
    Child Care & Parental Leave
    Generous parental leave
    Family medical leave
    Vacation + Time Off
    Unlimited vacation policy
    Paid holidays
    Paid sick days
    Canoe offers unlimited sick days for all employees.
    Bereavement leave benefits
    Office Perks
    Company-sponsored outings
    Company-sponsored happy hours
    Fitness stipend
    Canoe reimburses each team member up to $100 per month for health and wellness activities.
    Home-office stipend for remote employees
    Canoe employees receive a $200 stipend to cover the cost of remote work accommodations (Canoe provides employees with computers and computer peripherals separately).
    Professional Development
    Lunch and learns
    Promote from within
    Mentorship program
    Continuing education stipend
    Canoe offers education reimbursement for all full-time employees of $1,000 annually.
    Continuing education available during work hours

    More Jobs at Canoe

    Apply Now
    By clicking Apply Now you agree to share your profile information with the hiring company.
    Learn more about CanoeFind similar jobs like this