Senior Data Engineering Manager - Ingestion and Transformation at Scale

Reposted 3 Days Ago
Easy Apply
Be an Early Applicant
Gent
In-Office
Senior level
Real Estate • Software • Hospitality
The Role
Lead a team of data engineers in developing and maintaining scalable data architectures and processing pipelines, while coaching and mentoring team members.
Summary Generated by Built In

At Lighthouse, we’re on a mission to disrupt commercial strategy for the hospitality industry. Our innovative commercial platform takes the complexity out of data, empowering businesses with actionable insights, advanced pricing tools, and cutting-edge business intelligence to unlock their full revenue potential.

Backed by $370 million in series C funding and driven by an unwavering passion for growth, we’ve welcomed five companies into our journey and have surpassed $100 million in ARR in 2024. Our 850+ teammates span 35 countries and represent 34 nationalities.

At Lighthouse, we’re more than just a workplace – we’re a community. Collaborative, fun, and deeply committed, we work hard together to revolutionize the hospitality sector. Are you ready to join us and shine brighter in the industry’s most exciting rocket-ship? 🚀

What you will do

As Senior Data Engineering Manager, you will be leading an engineering team owning a massive-scale ingestion and transformation engine that acquires and transforms the world’s hospitality data into a high-fidelity unified semantic layer. You will be responsible for building and maintaining complex data pipelines handling large data streams - to the order of 100 TB per day. This is a high-impact leadership role where you will see your team's work directly translate into real-world applications that impact hotels worldwide. The role requires you to combine strong technical experience with operational and people management excellence.

Where you will have impact

  • Lead, coach, and mentor a team of data engineers, fostering a culture of technical excellence and long-term career growth.
  • Be the technical guide the team can lean on for growing their technical careers and for collaborating on their technical work, while at the same time being strong with people, organization, structure, planning and driving delivery.
  • (Help) drive the architecture, design, implementation, maintenance, improvements and scaling of the streaming and batch data pipelines that ingest and transform the massive volume of data powering our products.
  • You will be at the forefront of our AI evolution, helping to embed intelligence into our platform. You’ll not only build AI features for our customers but also champion an AI-first development culture within the engineering team.
  • Identify, estimate, plan and deliver continuous improvements with the team in data quality, system stability, observability, data pipeline performance, latency, and reliability.
  • Collaborate closely with product, other engineering teams, support and business teams.

About our team

You'll be leading a skilled team of data engineers who are part of our Integration Engineering business unit and who own the ingestion and complex transformations of one of the functional data domains. This team is responsible for turning massive streams of complex structured and less structured data into data products with actionable insights for the hospitality industry.

What's in it for you?

  • Flexible time off: Autonomy to manage your work-life balance.
  • Career development: Workshops, frameworks, and trainings to maximize your professional potential.
  • Impactful work: Shape products relied on by 85,000+ users worldwide.
  • Mobility options: Mobility budget or company car (based on your job category).
  • Net allowance: Support for home office related expenses.
  • Vouchers: Lunch vouchers & Eco vouchers.
  • Comprehensive health insurance: Extensive coverage for you and your dependents.
  • Pension funding: Group insurance to secure your future.
  • Referral bonuses: Earn rewards for bringing in new talent.

Who you are

  • You are an experienced people leader with a passion for coaching and mentoring engineers, driving their technical and professional growth.
  • You have experience architecting, designing, implementing, testing, deploying and maintaining complex data architectures.
  • You have a proactive, "can-do" attitude, viewing challenges as opportunities and inspiring a positive, solution-oriented mindset within your team.
  • You excel at seeing the bigger picture, breaking down large architectural projects into clear, manageable tasks, and accurately estimating effort.
  • You are a forward-thinking builder who views AI as a core component of modern architecture. You have a proven interest (or experience) in working with LLMs, agentic workflows, or AI-assisted coding tools to ship higher-quality code, faster.
  • You get energized from optimizing structure, tooling, support and other processes.
  • While this is a leadership role, you come from a strong hands-on background in data engineering or in building complex software integrations, and can act as a technical guide for your team.
  • Professional proficiency in Python for large-scale data processing and pipeline development.
  • Strong knowledge of data cloud technologies, data streaming systems (like Kafka or Google Cloud Pub/Sub), and cloud database solutions (like BigQuery, Snowflake, or Databricks).
  • Fluency in English, with excellent communication and stakeholder management skills.

We welcome

  • Experience within the hospitality technology sector or similar industries (e.g. airline industry).

Technologies you will work with

Python, Google Cloud Platform (GCP), BigQuery, Spanner, Pub/Sub, Kubernetes.

#LI-Hybrid

Thank you for considering a career with Lighthouse. We are committed to fostering a diverse and inclusive workplace that values equal opportunity for all. We welcome candidates from all backgrounds, regardless of age, gender, race, religion, sexual orientation, and disability. We actively encourage applications from individuals with disabilities and are dedicated to providing reasonable accommodations throughout the recruitment process and during employment to ensure all qualified candidates can participate fully. Our commitment to equality is not just a policy; it's part of our culture.

If you share our passion for innovation and teamwork, we invite you to join us in shaping the future of the hospitality industry. At Lighthouse, our guiding light is to be an equal opportunity employer, and we encourage individuals from all walks of life to apply. Not ticking every box? No problem! We value diverse backgrounds and unique skill sets. If your experience looks a little different from what we've described, but you're passionate about what we do and are a quick learner, we'd love to hear from you.

We value the unique perspective and talents that you bring, and we're excited to see how your light can shine within our team. We can't wait to meet you and explore how we can grow and succeed together, illuminating the path towards a brighter future for the industry. #LI-Hybrid

Top Skills

BigQuery
Bigtable
Dataflow
Google Cloud Platform (Gcp)
Kubernetes
Pub/Sub
Python
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Dallas, TX
880 Employees
Year Founded: 2012

What We Do

Lighthouse is the leading commercial platform for the travel & hospitality industry. We transform complexity into confidence by providing actionable market insights, business intelligence, and pricing tools that maximize revenue growth.

Trusted by over 70,000 hotels in 185 countries, and supported by 700+ employees, Lighthouse is the only solution that provides real-time hotel and short-term rental data in a single platform. We strive to deliver the best possible experience with unmatched customer service. We consider our clients as true partners — their success is our success.

How can Lighthouse help you?

Rate Insight
Track competitor pricing to maximize revenue

Market Insight
Accurately predict future market demand

Parity Insight
Identify and solve parity issues portfolio wide

Benchmark Insight
Effectively navigate competitive performance trends

Distribution Insight
Optimize distribution channel performance

Destination Insight
Enrich your strategy with short-term rental insights

Business Intelligence
Monitor, optimize, and report on your performance

Pricing Manager
Boost revenue with AI-driven room price recommendations

Channel Manager
AI-powered channel management that transforms pricing and distribution for independent hotels

Hotel Data Solutions
Bespoke data sets to elevate your commercial strategy

Short-Term Rental Data Solutions
Power your short-term rental strategy with custom insights

Revenue Management Services
Master commercial strategy with expert revenue support

Similar Jobs

Lansweeper Logo Lansweeper

Principal Product Manager

Cloud • Information Technology • Software
Hybrid
Merelbeke, BEL
404 Employees

Lansweeper Logo Lansweeper

Senior User Experience Designer

Cloud • Information Technology • Software
Remote or Hybrid
Merelbeke, BEL
404 Employees

IMC Trading Logo IMC Trading

IT Operations Engineer

Fintech • Machine Learning • Software • Financial Services
Hybrid
29 Locations
1954 Employees

GitLab Logo GitLab

Security Engineer

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
In-Office or Remote
36 Locations
2500 Employees

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account