Remote Associate Director, Data Engineering (Knowledge Graph) (Remote)

Apply Now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
Position Summary
We are looking for an adept, action-oriented Principal/Associate Director of Data Engineering to design>and build out a multi-tenant data mesh to enable our soon-to-be-launched digital transformation product which uses advanced NLP, knowledge engineering, and ML to accelerate innovation in engineering, manufacturing, and scientific operations. The perfect candidates will have strong data infrastructure and data architecture skills, a proven track record of collaborating and iteratively implementing data-intensive solutions, strong operational skills to drive efficiency and speed, strong project leadership, and a strong vision for how data engineering can proactively create positive impact for companies. You will be a part of an early-stage team. You will educate stakeholders, mentor team members, and have a significant stake in defining the future of the Data Engineering function for the product.
Job Responsibilities
  • Design, build, and maintain a multi-tenant Data Mesh within the AWS cloud comprised of Data Lakes, Warehouses, Streaming, Graphs, and analytical NoSQL stores
  • Drive adoption and standardization of data governance, lineage, cataloging, and stewardship practices across teams
  • Work closely with data scientists, micro-service developers, and security experts to build out a big data platform incrementally and securely
  • Work closely with the product management and development teams to rapidly translate the understanding of customer data and requirements to product and solutions
  • Maintain an excellent understanding of the business's long-term goals and strategy and ensures that the design and architecture are aligned with these
  • Define and manage SLA's for data sets and processes running in production
  • Design for disaster recovery balancing availability and consistency in multi-region scenarios
  • Research and experiment with emerging technologies and tools related to big data
  • Establish and reinforce disciplined software engineering processes and best-practices

Ideal Qualifications
  • Comfort and ideally substantial experience operating big data infrastructure in a cloud-based ecosystem (AWS preferred)
  • Deep understanding of the theoretical and practical tradeoffs of various data formats in object/file stores (Parquet, Avro, JSON, etc.) in combination with a variety of ETL tools (Spark, Presto, etc.)
  • Deep understanding of the theoretical and practical tradeoffs of various NoSQL stores (Cassandra, Elasticsearch, DynamoDB, etc.) with respect to different read/write patterns and availability/consistency requirements
  • Mastery of operating and designing stream-based data systems (Kafka, AWS Kinesis, GCP PusSub, etc.) particularly under varying load
  • Be proficient in modern big data architectural approaches (Kappa/Lambda architectures, Data Lake Zones, etc.)
  • Experience with data governance, lineage, cataloging tooling (Apache Atlas, Apache Ranger, AWS Glue Catalog, etc.)
  • Experience with data pipeline and workflow management tools (AWS Data Pipeline, Apache Airflow, Argo, etc.)
  • Experience with stream-processing systems (ksqlDB, Spark Streaming, Apache Beam/Flink, etc.)
  • Experience with software engineering standard methodologies (unit testing, code reviews, design document, continuous delivery)
  • Develop and deploy production-grade services, SDK's, and data infrastructure emphasizing performance, scalability, and self-service.
  • Ability to conceptualize and articulate ideas clearly and concisely
  • Entrepreneurial or intrapreneurial experience where you helped lead the creation of a new product & organization

Nice to Have's
  • Strong algorithms, data structures, and coding background with either Java, Python or Scala programming experience
  • Experience working with knowledge graphs stores (Stardog, TigerGraph, Ontotext GraphDB, Neo4j) and surrounding semantic technology (OWL, RDF, SWRL, SPARQL, JSON-LD)
  • Experience working with Snowflake data warehouses and dimensional modeling practices
  • BA/BS or Masters in Computer Science, Math, Physics, or other technical fields
  • Experience with at least 10+ terabyte datasets, ideally up to multiple petabytes

What We Offer
  • Competitive base salary, bonus plans and equity.
  • A comprehensive, benefits package that includes medical, dental, vision and life insurance plans, paid time off, a generous 401k match with no vesting period, parental leave and 3 volunteering days each year. For more information on benefits, please access the benefits page on our careers site: https://careers.ihsmarkit.com/benefits.php.
  • For work locations in the state of Colorado, the anticipated minimum base salary for this role would be $160,000 - $279,000. Compensation will be determined by the education, experience, knowledge, and abilities of the applicant.

We're building a software solution that connects data in revolutionary ways, illuminating answers that were previously impossible to find and empowering our clients to envision the future so they can determine the best course of action in the present. Join us!
Equal Opportunity Employer:
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
If you need an accommodation during the application process due to a disability, please send an email to: [email protected] and your request will be forwarded to the appropriate person.
US Candidates Only:
The EEO is the Law Poster http://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf describes discrimination protections under federal law.
Read Full Job Description
Apply Now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Technology we use

  • Engineering
  • Product
  • Sales & Marketing
    • C#Languages
    • C++Languages
    • dotnetLanguages
    • JavascriptLanguages
    • SwiftLanguages
    • jQueryLibraries
    • ReactLibraries
    • Angular.JSFrameworks
    • ASP.NETFrameworks
    • Node.jsFrameworks
    • Vue.jsFrameworks
    • CassandraDatabases
    • Microsoft SQL ServerDatabases
    • MySQLDatabases
    • Google AnalyticsAnalytics
    • IllustratorDesign
    • InVisionDesign
    • PhotoshopDesign
    • SketchDesign
    • ConfluenceManagement
    • JIRAManagement
    • Microsoft ProjectManagement
    • SalesforceCMS

An Insider's view of Markit Digital

What’s the vibe like in the office?

Uniqueness and creativity can be seen in all areas here! We have a digital community bulletin board where you can buy, sell, or post just about anything (seriously, anything!), a company sponsored picnic that includes spirited cornhole competitions, and regular group outings like running or cycling, before, during, or after work.

Marj

Executive Director, Sales

How do you collaborate with other teams in the company?

My teammates and I come from a diverse set of backgrounds and combine our unique perspectives to provide innovative solutions to problems. As a result, our products push new boundaries and delight our clients.

Jason

Product Management Director

What are some things you learned at the company?

I’ve learned to appreciate and be intentional. My teammates are always ready to help each other find a better workflow, learn new tools, and support each other emotionally. This culture of support and collaboration inspires me to contribute by creating amazing work for our clients and being creative in connecting with colleagues intentionally.

Juwon

UI Designer

How would you describe the company’s work-life balance?

Our culture promotes hard work while also living a fulfilling life outside of the office. We all love spending time working together on challenging projects, and when the time comes to get away, the support is felt throughout the company. Whether it's an extended vacation or volunteer opportunity to give back to our community!

Corwin

Associate Creative Director, UI Design

What are Markit Digital Perks + Benefits

Markit Digital Benefits Overview

• Global paid sick leave of a minimum of 10 days*
• Global paid care leave of 10 days* each calendar year, to care for your spouse/domestic partner, child, parent or grandparent who has a serious illness or health condition.
• Global paid parental leave of 26 weeks* for all parents, regardless of gender, to be taken within the first year of welcoming a child through birth, adoption, fostering, or surrogacy. Note: if both parents work for the combined organization, both parents are eligible for this leave.
• Global paid compassion leave: You are entitled to paid compassion leave following the loss of a close relative or loved one.
• Unpaid leave of up to 8 weeks (you do not have to use any other leave before taking this leave).
• Unpaid sabbatical leave of up to 6 months to be used to educate, innovate, gain knowledge and/or pursue individual interests.
• Day off for your birthday**
• Day off for your service anniversary**
• Day off for personal wellbeing on a date that you choose

Culture
Volunteer in local community
We each get 3 days a year to volunteer and will help match you with existing opportinities.
Partners with Nonprofits
Friends outside of work
Eat lunch together
Intracompany committees
We have ample opportunities to join committees! We've got guilds, a Pride committee, a crafting club, a book club, a green team, a parenting community and several more.
Daily sync
Open door policy
Team owned deliverables
Team based strategic planning
Group brainstorming sessions
Pair programming
Open office floor plan
Diversity
Documented equal pay policy
Dedicated Diversity/Inclusion Staff
Unconscious bias training
Diversity manifesto
Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Disability Insurance
Dental Benefits
Vision Benefits
Health Insurance Benefits
Life Insurance
Pet Insurance
Wellness Programs
Team workouts
Mental Health Benefits
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Company Equity
Restricted share unites (RSU's) may be grated recognizing performance.
Performance Bonus
Match charitable contributions
Child Care & Parental Leave Benefits
Generous Parental Leave
Flexible Work Schedule
Life happens and we trust our colleagues to get the work they committed to done.
Remote Work Program
COVID-19 has provided us the opportunity to quickly acclimate to working remotely and we are establishing new guidelines as we continue to learn.
Family Medical Leave
Vacation & Time Off Benefits
Generous PTO
Paid Volunteer Time
Paid Holidays
Paid Sick Days
Perks & Discounts
Casual Dress
Commuter Benefits
Company Outings
Stocked Kitchen
Parking
Recreational Clubs
Fitness Subsidies
Professional Development Benefits
Job Training & Conferences
Diversity Program
Lunch and learns
Cross functional training encouraged
Promote from within
Mentorship program
Time allotted for learning
We all want the opportunity to learn and grow. You and your manager can talk about what makes sense for you and your team.
Online course subscriptions available
Customized development tracks

Additional Perks + Benefits

To name a few...pet insurance, ECO pass, loaner bikes and secure bike storage, showers + locker room onsite, food trucks every day and regular visits from Sweet Cow Ice Cream.

More Jobs at Markit Digital

Apply Now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
Save jobView Markit Digital's full profileSee more Markit Digital jobs