Software Development Engineer 3

About the Team/Role

As a SDE3 of Data Lake House Engineering will be responsible for the design and implementation of the Data Lake house platform (supporting both Data Engineering and Data Lake house   applications), Data Engineering pipeline  productionalization (E2E data pipelines, data model development, deployment, monitoring, refresh, etc), Data Lake house, and related technology, systems, and tools. This technologist will drive the technology development and architecture in these areas to ensure the platforms, systems, tools, models, and services generated from this team is technically sound with strong security, quality, reliability, usability, scalability, performance, efficiency, and operability to serve the fast growing needs of Wex and customers.

This is a fantastic opportunity for a highly motivated and passionate software engineer to apply deep expertise and rich experience in the Data engineering and related areas to develop pipeline, technology, platforms, and services., and apply them to generate real business impact in a fast growing Wex portfolio during its technology transformation stage to meet high customer demands. At the same time, you will learn and grow your career by solving large scale and complex problems.

This Staff SWE will have technical ownership of WEX’s Data Lake House Data architecture /Data engineering & service technology implementations, including but not limited to architecture, technical direction, engineering best practice, and quality/compliance. This also includes proper and effective architectural integration with other platforms, products, and services across the company. This engineer will work closely with team members of the Platform engineering and Data Lake house Engineering teams..

The ideal candidate will be a hands-on engineer with deep technical expertise in building and scaling data and analytics  environments, coupled with strong leadership and communication skills to drive alignment across the organization.

How you’ll make an impact

• Involve in the development of technology and platform for the company's Data Lake house needs, ensure the functional richness, reliability, performance, and flexibility of the Data Lake house Platform.

• Involve in design the architecture and lead the implementation of the Data Engineering System  and services.

• Challenge the status quo and hold a high bar to drive for better and better technical solutions to effectively serve all the needs in the broad risk area of Wex. 

• Leverage data and/or AI technology or tools in your design and development for high productivity and better solution quality. Show strong thought leadership and influence your peers in this area.

• Closely partner with the other senior engineers across the organizations at Wex to deeply understand the business needs and jointly come up with technical solutions to serve these needs effectively. Demonstrate strong thought leadership and partnership.

• Partner closely with information security teams to ensure the security and privacy of data, implementing encryption and access controls as required.

• Partner with solutions architecture and LOB product and engineering orgs on integrations of the Data Lake Platform with their products/systems, and ensure reliable and performed execution.

• Engage with external partners and vendors to evaluate technologies and services that complement the company’s Data Lake strategy.

• Create, prioritize, communicate, manage, and execute roadmaps, project plans, and commitments.

• Report on the status of development, quality, operations, and system performance to management and partners.

• Drive the technical vision and strategy of Data Lake to serve the business needs for the near term and long term. A close partnership with the Data Engineering teams and the operational reporting teams of applications 

• Set a high bar, and provide technical guidance and effective training & mentorship to the engineering teams in your group, including engineering principles, skills, and best practices. Uphold strong DORA metrics across the org. Foster an environment of continuous learning and innovation. Build an inclusive, productive, innovative, and engaging Risk group, including attracting high talents from the industry.

• Set clear, measurable quality goals for your group in a data-driven way

• Partner with the security org and SRE org to ensure continuous improvement and meeting of security requirements, SLOs, and error budget.

• Take strong financial responsibility for your team.

• Hold yourself and your team accountable for delivering quality results using defined OKRs.

• Provide strategic thought leadership on business initiatives using your deep technical and business industry expertise.

Experience you’ll bring

• A technically deep and innovative Data  Engineer leader able to act and deliver to the business needs.

• Have 5+ years of software design and development experience at a large scale.

• Strong software development skills in his or her chosen programming language, but ready and willing to learn and program in Java and Python.

• Broad understanding of Data Lakehouse  formats like Apache Hudi, Apache Iceberg or Delta Lake.

• Strong experience in Spark Pypark programming, Notebook, Catalogs, spark computing and cluster management.

• Strong experience in debugging spark execution and spark optimization for cost and performance tuning.

• Experience in Orchestration, Airflow, DAGs and scalability.

• Experience in data modeling, star schema, snowflake schema, big wide table, semantic layer, 360 objects.

• Data sharing, data masking and security.

• Data qualification, completeness, freshness, basic and business rule validation, auditing,  monitoring and alerting.

• Good to have experience grafana, prometheus, sentry, datahub

• Experience with parquet, avro, delta etc.

• Experience in Snowflake, SQL, DBT, models, jinja template, unit test and data lineage.

• Broad understanding of cloud architecture tools and services, such as S3, EMR, Kubernetes, Lambda functions. Experience in AWS and Azure is highly desirable.

• Deep technically; hands-on in architecture design, development, deployment, and production operation; familiar with agile software development and modern development tools and frameworks; holding strong engineering principles including automation and quality as well as best practices with a high bar. Extensive experience in full software development life cycle E2E including in production monitoring.

• Rich experience and deep expertise in the areas of Big Data and large scale data platforms, especially in Data Lake.

• Highly experienced and deep understanding of CI/CD automation.

• Rich experience in combined engineering practice and agile development. Experienced in leading and guiding teams for effective development using this approach.

• Excellent analytical skills; Capability in identifying and resolving complex problems.

• An understanding of and experience in payment organizations is a plus. 

• A mentor to individual contributors of different seniority levels and expertise.

• Ability to encourage and foster a culture of visibility and transparency across teams

• Strong written and verbal communication skills

• Strong philosophy of continuous improvement

• Bachelor degree in Computer Science or a related field. A higher degree in a related field is a plus.

Leadership & Personal Characteristics

Beyond experience, the right leadership competencies and personal style are critical to  of Data Lake house  engineering. The candidate will model WEX's commitment to innovation, integrity, execution, relationships, community, and the excellence that they commit to their customers. They will have a strong corporate stewardship philosophy and leadership style combined with the following:

• Demonstrates a collaborative, engaging, mission-driven style with good listening skills combined with gravitas and self-confidence in order to effectively interact with senior leadership and other key constituencies with humility, empathy, transparency, cultural sensitivity, and agility.

• Champions a culture of high standards, pushes for progress, embraces change and challenges the status quo based on integrity, strong partnership and financial responsibility. Possess uncompromising ethics and unwavering integrity.

• Able to operate in a fast-paced entrepreneurial environment with a hands-on approach.

• Leads with empathy. Recognizes others, listens intently, holds others accountable, and makes diversity and inclusion a priority. Promotes a culture of trust, transparency, fairness, innovation, collaboration, inclusion, and diversity of thought; empowers individuals. 

• Communicates effectively in small and large group formats. Able to articulate a compelling vision and purpose that excites the team and drives outstanding performance and service delivery excellence. 

• Talent magnet, talent developer and talent scout that proactively engages external talent and builds and nurtures internal talent; empowers individuals and manages diverse teams to drive engagement and performance. 

• Possesses a high level of intellectual curiosity and learning agility. A natural change agent with a combination of vision and execution skills.

• Understands nuance and how to drive change through influence across a complex business. Superb stakeholder management and comfortable operating in a fast-changing environment.