About the Role: We are looking for a Senior Solutions Consultant with deep Hadoop knowledge and strong enterprise presence.
You'll be the principal technical owner of ODP deployments - responsible not just for standing up the platform, but for guiding a customer's infrastructure, security and database teams to the right architectural decisions, and for making those decisions stick in environments where security and change control are non-negotiable.
This is a hands-on role with a consultative position. You'll be equal parts architect, engineer and trusted advisor: designing the target-state cluster, executing the build, and translating hard technical trade-offs into terms a customer's stakeholders can act on. You are the person the customer relies on to get a secure, scalable platform right the first time.
Product Link: https://www.acceldata.io/open-data-platform
What we look for:
- Own cluster architecture and deployment. Lead end-to-end deployment of Acceldata ODP managed via Apache Ambari. Define cluster topology - master, slave and client node placement - sized to the customer's workload and infrastructure.
- Prepare and harden infrastructure. Advise on and execute OS-level prerequisites on RHEL or Ubuntu: password-less SSH, DNS/NTP, firewall (iptables) rules, SELinux and PackageKit handling, and system tuning such as umask and open file descriptors.
- Deliver secure and air-gapped deployments. Design and implement installations inside firewalled and air-gapped data centres using local mirror repositories or trusted HTTP proxy servers, working within the customer's change-control and compliance constraints.
- Integrate backend databases. Provision and configure operational databases (Oracle, PostgreSQL, or MySQL/MariaDB), including schemas, users and JDBC drivers for core services - Ambari, Hive, Spark, Ranger and Schema Registry.
- Extend the ecosystem via mpacks. Install, configure and troubleshoot components through Ambari Management Packs - Spark, Kafka, Flink, NiFi, Ozone, Airflow, Trino, ClickHouse, JupyterHub and MLflow.
- Implement enterprise security. Stand up cluster security end-to-end: Kerberos integration, Apache Ranger authorization policies, SSL/TLS certificate management, LDAP/AD integration, and secure credential handling (e.g. obfuscating LDAP bind passwords via the Ambari Credential Store / JCEKS).
- Advise and enable the customer. Run working sessions with the customer's infrastructure, security and DBA teams; document target-state architecture and handover runbooks; and coordinate with Acceldata engineering and account teams to unblock issues and drive long-term adoption.
- 8+ years of experience in customer-facing product implementation, designing and deploying performant end-to-end data architectures, and solving complex migrations and deployments.
- Comfortable writing code in either Java, Python or Scala.
- Consult on design and architecture; implement strategic customer projects that lead to customers' successful understanding, evaluation, and adoption of Acceldata Data Observability Cloud.
- Good understanding of Data management concepts like Data Quality, Data Catalog and Data Governance.
Must-Have Qualifications
- Deep architectural knowledge of the Apache Hadoop ecosystem (HDFS, YARN, MapReduce, Hive, ZooKeeper).
- Strong Linux system administration on RHEL and/or Ubuntu, with a real command of network configuration, firewall rules and system tuning.
- Practical experience with enterprise security: Kerberos (KDC), SSL/TLS, LDAP/AD and Apache Ranger.
- Comfort operating within the platform's runtime stack (Java and Python) for configuration and troubleshooting.
- Excellent communication skills - able to explain hard technical trade-offs clearly to both engineers and senior stakeholders - and the autonomy to drive complex work with little supervision.
Strongly Preferred (Great Foundation)
- Extensive experience managing Cloudera (CDH/CDP) or Hortonworks (HDP) distributions - this maps to an excellent foundation for the role.
- Familiarity with several of the mpack components above (Spark, Kafka, NiFi, Trino, Ozone, MLflow, etc.) rather than all.
- Experience delivering into regulated, secured or air-gapped environments.
- Strong desire to tackle hard technical problems in Kubernetes; proven ability to do so with little or no direct daily supervision.
- Ability to quickly learn new technologies and willingness to support working in different time zones, and may be required to travel up to 50% of the time to meet with customers.
- Prior customer-facing / professional-services or consulting experience in enterprise environments.
Skills Required
- Experience managing multiple B2B infrastructure software development projects including migration, feature adoption, retention, and customer satisfaction
- 10+ years in customer engineering, data platforms and cloud technology projects requiring integration
- 8+ years of customer-facing product implementation experience
- Proficiency writing code in Java, Python or Scala
- Design and deploy end-to-end performant data architectures and solve complex migrations and deployments
- Good understanding of data management concepts (Data Quality, Data Catalog, Data Governance)
- Hands-on experience with two or more cloud ecosystems (AWS, Azure, GCP) with expertise in at least one
- Deep experience with Kubernetes and cloud-native systems
- Experience with Hadoop and big data systems
- Experience operating and troubleshooting Linux systems (Red Hat and Debian-based distributions)
- Strong communication skills and ability to explain complex technical solutions clearly
- Willingness to work across time zones and travel up to 50% to meet with customers
- Experience providing escalated support for customer data operational issues alongside customer engineering teams
Similar Jobs
What We Do
Founded in 2018, Campbell, CA-based Acceldata has developed the world's first enterprise data observability platform to help enterprises build and operate great data products. Acceldata's solutions have been embraced by global customers, such as Dun & Bradstreet, Verisk, Oracle, PubMatic, PhonePe (Walmart), and many more. Acceldata investors include Insight Partners, March Capital, Industry Ventures, Lightspeed, Sorenson Ventures, Sanabil, and Emergent Ventures. Contact us to learn about the benefits of data observability.
