Senior Solutions Consultant - Open Data Platform

Posted 23 Days Ago
Be an Early Applicant
Kitchener, ON, CAN
In-Office
Senior level
Software
The Role
Lead customer-facing implementations of the Open Data Platform, designing and delivering MVPs, reference architectures, and demos. Solve complex migrations and deployment issues, optimize performance, provide post-sales support, and drive long-term adoption and customer success.
Summary Generated by Built In

About the Role: We are looking for a Senior Solutions Consultant with deep Hadoop knowledge and strong enterprise presence.
You'll be the principal technical owner of ODP (open data platform) deployments - responsible not just for standing up the platform, but for guiding a customer's infrastructure, security and database teams to the right architectural decisions, and for making those decisions stick in environments where security and change control are non-negotiable.

This is a hands-on role with a consultative position. You'll be equal parts architect, engineer and trusted advisor: designing the target-state cluster, executing the build, and translating hard technical trade-offs into terms a customer's stakeholders can act on. You are the person the customer relies on to get a secure, scalable platform right the first time.

What we look for:

  • Own cluster architecture and deployment. Lead end-to-end deployment of Acceldata ODP managed via Apache Ambari. Define cluster topology - master, slave and client node placement - sized to the customer's workload and infrastructure.
  • Prepare and harden infrastructure. Advise on and execute OS-level prerequisites on RHEL or Ubuntu: password-less SSH, DNS/NTP, firewall (iptables) rules, SELinux and PackageKit handling, and system tuning such as umask and open file descriptors.
  • Deliver secure and air-gapped deployments. Design and implement installations inside firewalled and air-gapped data centres using local mirror repositories or trusted HTTP proxy servers, working within the customer's change-control and compliance constraints.
  • Integrate backend databases. Provision and configure operational databases (Oracle, PostgreSQL, or MySQL/MariaDB), including schemas, users and JDBC drivers for core services - Ambari, Hive, Spark, Ranger and Schema Registry.
  • Extend the ecosystem via mpacks. Install, configure and troubleshoot components through Ambari Management Packs - Spark, Kafka, Flink, NiFi, Ozone, Airflow, Trino, ClickHouse, JupyterHub and MLflow.
  • Implement enterprise security. Stand up cluster security end-to-end: Kerberos integration, Apache Ranger authorization policies, SSL/TLS certificate management, LDAP/AD integration, and secure credential handling (e.g. obfuscating LDAP bind passwords via the Ambari Credential Store / JCEKS).
  • Advise and enable the customer. Run working sessions with the customer's infrastructure, security and DBA teams; document target-state architecture and handover runbooks; and coordinate with Acceldata engineering and account teams to unblock issues and drive long-term adoption.
  • 8+ years of experience in customer-facing product implementation, designing and deploying performant end-to-end data architectures, and solving complex migrations and deployments.
  • Comfortable writing code in either Java, Python or Scala.
  • Consult on design and architecture; implement strategic customer projects that lead to customers' successful understanding, evaluation, and adoption of Acceldata Data Observability Cloud.
  • Good understanding of Data management concepts like Data Quality, Data Catalog and Data Governance.

Must-Have Qualifications

  • Deep architectural knowledge of the Apache Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, ZooKeeper).
  • Strong Linux system administration on RHEL and/or Ubuntu, with a real command of network configuration, firewall rules and system tuning.
  • Practical experience with enterprise security: Kerberos (KDC), SSL/TLS, LDAP/AD and Apache Ranger.
  • Comfort operating within the platform's runtime stack (Java and Python) for configuration and troubleshooting.
  • Excellent communication skills - able to explain hard technical trade-offs clearly to both engineers and senior stakeholders - and the autonomy to drive complex work with little supervision.

Strongly Preferred (Great Foundation)

  • Extensive experience managing Cloudera (CDH/CDP) or Hortonworks (HDP) distributions - this maps to an excellent foundation for the role.
  • Familiarity with several of the mpack components above (Spark, Kafka, NiFi, Trino, Ozone, MLflow, etc.) rather than all.
  • Experience delivering into regulated, secured or air-gapped environments.
  • Strong desire to tackle hard technical problems in Kubernetes; proven ability to do so with little or no direct daily supervision.
  • Ability to quickly learn new technologies and willingness to support working in different time zones, and may be required to travel up to 50% of the time to meet with customers.
  • Prior customer-facing / professional-services or consulting experience in enterprise environments.

You'll work on genuinely hard problems for some of the most demanding data organisations in the world, with the autonomy to own an engagement end-to-end and the visibility that comes with being the customer's principal technical partner. If you enjoy the moment a complex, secured cluster comes up clean, and the customer's team trusts what you've built - this is that job.
 
Acceldata has been named to Forbes' America's Best Startup Employers for two consecutive years, recognised on CRN's Big Data 100 for data observability and DataOps, and named a Leader in Everest Group's Data Observability PEAK Matrix.
 
Above all, Acceldata has a people-first culture; you get full ownership of real, high-impact problems from day one.

Skills Required

  • 10+ years experience in customer engineering, data platforms and cloud technology projects
  • 8+ years experience in customer-facing product implementation
  • Experience managing multiple B2B infrastructure software development projects (expansion, migration, adoption, retention)
  • Proficiency coding in Java, Python or Scala
  • Design and deploy end-to-end data architectures; solve complex migrations and deployments
  • Hands-on experience with two or more cloud ecosystems (AWS, Azure, GCP) with expertise in at least one
  • Strong knowledge of data management concepts: Data Quality, Data Catalog, Data Governance
  • Deep experience with Kubernetes and cloud-native systems
  • Experience with Hadoop and big data systems
  • Experience operating and troubleshooting Linux systems (Red Hat and Debian-based distributions)
  • Proven ability to provide escalated support for data operational issues and work with customer engineering teams
  • Excellent communication skills; able to explain complex issues clearly
  • Willingness to support different time zones and travel up to 50% to meet customers
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Campbell, CA
226 Employees
Year Founded: 2018

What We Do

Founded in 2018, Campbell, CA-based Acceldata has developed the world's first enterprise data observability platform to help enterprises build and operate great data products. Acceldata's solutions have been embraced by global customers, such as Dun & Bradstreet, Verisk, Oracle, PubMatic, PhonePe (Walmart), and many more. Acceldata investors include Insight Partners, March Capital, Industry Ventures, Lightspeed, Sorenson Ventures, Sanabil, and Emergent Ventures. Contact us to learn about the benefits of data observability.

Similar Jobs

Samsara Logo Samsara

Artificial Intelligence Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
CA
4000 Employees
127K-214K Annually

Superhuman Logo Superhuman

Software Engineer

Artificial Intelligence • Information Technology • Machine Learning • Natural Language Processing • Productivity • Software • Generative AI
Remote or Hybrid
Canada
1500 Employees
168K-291K Annually

Snap Inc. Logo Snap Inc.

Software Engineer

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
Hybrid
Toronto, ON, CAN
5000 Employees
173K-259K Annually

Square Logo Square

Head of Square Commercial Operations & Deal Excellence

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote or Hybrid
8 Locations
12000 Employees
218K-327K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account