Principal Data Engineer (R-17891)

Key Responsibilities:

• Design and Implement business requirements by collaborating with stakeholders.
• Advise project leadership on technical subjects and provide input on feasibility of product asks.
• Assist the leadership team in identifying engineering talent, by determining underutilized engineers already in the organization and by participating in the interview process.
• Keep stakeholders apprised of project progress by regularly provides engineering updates.
• Take ownership of the application code and develop a complete understanding of how the application functions.
• Master the development tools being used and the services employed.
• Develop a thorough understanding of how the application functions from a systems perspective (Application Code + CI / CD + Serverless & Hosted Infrastructure). Adhere to and encourage best practices set forth by the Engineering and Quality Assurance teams.
• Collaborate with cross-functional teams(DevOps, Product, Stakeholders, QA) to identify and design requirements for advanced systems with respect to processing, analyzing, searching, visualizing, developing, and testing vast datasets to ensure data accuracy.
• Be a good collaborator with your peers.
• Attend all required meetings.
• Participate in meetings. Be respectful and clearly communicate. If you are unsure of something, request clarification. If you see a better way of doing something, articulate how it is better and what tradeoffs might be entailed.
• Architect robust systems and write software that is highly fault tolerant, producing high quality results.
• Create new insights for our customers to understand their markets, and new tools to visualize the directions they should head.
• Cooperatively design and document systems that can be cleanly and easily maintained by a team.
• Share a friendly, supportive, and reliable attitude with a great team that hold each other accountable.
• Execute efficiently on short and long-term goals.
• Maintain data quality by writing validation tests.
• Understand variety of unique data sources.
• Create and document data documentation, including, processing systems and flow diagrams.
• Help maintain existing systems, including troubleshooting and resolving alerts.
• Expected to meet critical project deadlines.
• Excellent organizational, analytical, and decision-making skills.
• Excellent verbal, written, and interpersonal communication skills.
• Capable of working collaboratively and independently.
• Share ideas across teams to spread awareness and use of frameworks and tooling.
• Show an ownership mindset in everything you do; be a problem solver, be curious and be inspired to take action, be proactive, seek ways to collaborate and connect with people and teams in support of driving success.
• Continuous growth mindset, keep learning through social experiences and relationships with stakeholders, experts, colleagues and mentors as well as widen and broaden your competencies through structural courses and programs.

Key Requirements:

• Overall 10+ years of successful commercial experience of software engineering life cycle
• Experience designing and implementing scalable architecture with real-time capabilities.
• Experience moving large volumes of data across services and architectures.
• Experience with Google Cloud Platform services (BigQuery, Dataflow, Google Cloud Functions, Google Pub/Sub, Cloud Run,etc.) or AWS equivalent technologies (EC2, RDS, S3, Redshift, EMR, etc).
• Extensive experience with SQL and relational databases, including optimization and design.
• Analytic tools and ETL/ELT/data pipeline frameworks such as Airflow.
• Testable and efficient Python coding for data processing and analysis.
• Excited by the idea of building scalable and reliable products.
• Expert at developing secure and performant applications.
• Experience with OS level scripting (bash, sed, awk, grep, etc.).
• Experience in AdTech, web cookies, and online advertising technologies is a plus.
• Expertise in containerized infrastructure and CI/CD systems, including CloudBuild, Docker, Kubernetes, and GitHub Actions.
• Experience with version control (GIT/Github/BitBucket) and Agile Project Management tools (Jira/Confluence).
• Experience with object-oriented programming, functional programming
• Familiarity with parallelization of applications on a single machine and across a network of machines.
• Experience with data visualization tools like Looker, Tableau, or Power BI.
• Experience working with global remote teams.
• Extremely data driven and detail oriented.
• Knowledge of data transformation processes.
• Google Cloud certification a plus.
• Proficiency in Microsoft Office Suite.