Senior Data Engineer

What you’ll do:

• Data Pipeline Development: Design, develop, and maintain scalable data pipelines and architectures using modern tools like Databricks, Apache Spark, and Data Lakes while integrating advanced data management technologies.
• Collaboration & Modelling: Work closely with business and analytics teams to refine data models, enhance business intelligence tools, and support data-driven decision-making.
• Data Quality & Security: Implement robust quality control measures to ensure data accuracy and integrity while adhering to data management and security policies to safeguard system integration and data transfer.
• Cloud & System Optimization: Develop and maintain cloud-native databases, optimize data retrieval processes, and enhance analytics dashboards for actionable insights.
• Mentorship & Communication: Mentor engineers on data best practices and communicate technical concepts effectively to non-technical stakeholders, fostering a culture of excellence and collaboration.
• Continuous Improvement: Stay updated on emerging technologies, proactively enhance existing systems, and identify and resolve infrastructure issues to ensure stability and efficiency.

The right person for this role will have:

• Minimum of 5 years in professional data engineering roles, demonstrating responsibility in data engineering projects.
• Programming Languages: Proficiency in Python and SQL; familiarity with Java or Scala is advantageous.
• Big Data Technologies: Experience with Apache Spark for large-scale data processing and analytics and Apache Hadoop for distributed storage and processing of big data.
• Data Warehousing: Experience in maintaining and implementing databases, focusing on efficient data management and system integration.
• Cloud Platforms: Hands-on experience with AWS services; knowledge of Azure or Google Cloud is beneficial.
• Data Modelling: Ability to design complex data architectures and implement data governance practices.
• ETL/ELT Processes: Expertise in designing and optimizing data pipelines for the extraction, transformation, and loading of data.
• Containerization and Orchestration: Basic knowledge of Docker and Kubernetes.
• CI/CD Practices: Understanding of continuous integration and continuous deployment practices relevant to data engineering.
• Data Pipeline Tools: Experience with tools like Apache Airflow and Kafka for data pipeline orchestration.
• Visualization Tools: Proficiency in tools such as Tableau, Power BI, or Python libraries like Matplotlib and Seaborn for data presentation.
• Analytical Abilities: Strong problem-solving skills with an understanding of algorithms and data structures.
• ETL Best Practices: Knowledge of best practices for maintaining scalable, secure, and efficient data infrastructures.
• Agile Methodologies: Practical experience with Agile development principles, including Scrum or Kanban methodologies.
• Version Control: Competence in using Git, including branching strategies and collaborative workflows.
• Security Knowledge: Awareness of cybersecurity fundamentals, secure coding practices, and common security vulnerabilities.
• Leadership and Communication: Strong leadership and communication abilities, with experience mentoring junior engineers and collaborating with various teams across the organization.

Bonus points if you have:

• Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or a related IT discipline; or equivalent relevant experience.
• You have experience in developing solutions and microservices using Python, with a solid understanding of its capabilities and best practices.
• You possess the ability to write clean, efficient, and well-documented Python code.
• Understanding of the insurance industry, including familiarity with insurance products, underwriting, and claims management processes.
• Experience in designing, implementing, and maintaining scalable data pipelines on the Databricks platform.
• You have the ability to collaborate with data scientists and analysts to deliver high-quality data solutions, ensuring data is clean, accessible, and ready for analysis.

Our guiding principles:

• Customers at the core. We put the customer at the center of all we do. At a basic level, we believe business success comes down to talking to customers and building something they want. We don’t listen to customers and just take what they say blindly, but we think critically about it and build what they need. Customers are the core of everything we do, and our business exists to serve them. We prioritize their needs over all else within the company.
• Move with urgency. There are times when we need to move slowly and deliberately, but we default to acting fast and with urgency. We slow down when necessary, but this should be a deliberate choice. Businesses become more lethargic as they grow, this principle is designed to fight this fact.
• Be curious. We understand the world by being curious and asking why. We aren’t satisfied with surface level understanding, and seek a deeper understanding of why things are the way they are. Don’t take someone’s word for it or the answer “because that’s how we do it.” Understand why and dig deep.
• Excellence in execution. We know that what separates good from great is a high level of execution. We commit ourselves to excellence in everything that we do, from delivering an amazing product to writing a great email.
• Act like an owner.  We’re all owners of the business and act like it. We follow through on commitments, own our results and think long-term.
• Fight for simplicity. The law of increasing functional information states that systems evolve to become more complex over time. At Quandri, we believe there is sophistication in simplicity; as such, we intentionally fight for streamlined solutions and are committed to the uncomplicated.

Compensation and Benefits:

• The range for base pay is $125k - $150k which is dependent on level of experience, performance and choice of stock option compensation
• Employee stock options based on experience level
• Comprehensive health benefits, including Lifestyle Spending Account
• Four weeks of paid vacation per year
• Work anywhere in the world for 60 calendar days of the year