Our client is a US-based company that provides In-flight Internet and entertainment services to aircraft across the globe, serving commercial aircrafts. At this moment we cooperate on Business Intelligence, Data Analysis, Data Science and BigData directions and look for talents who can contribute to the complex data management and analysis projects.
About the Role:
We are looking for a Data Engineer with strong expertise in DBT, PostgreSQL, and Python, who will be responsible for working with a live database that requires near real-time data processing. The key requirement of the role will be ensuring that data is processed, stored, and made available with minimal delay, as latency is not acceptable. The engineer must understand the importance of optimizing performance to make data available to consumers instantaneously while doing the minimal necessary processing.
Experience with AWS, Airflow, and Snowflake is a plus.
Key Responsibilities:
- Work with a live database that requires near real-time data processing.
- Ensure that data is processed, stored, and made available with minimal delay, as latency is not acceptable.
- Optimize system performance to enable instantaneous data availability for consumers.
- Design and implement efficient data processing solutions while minimizing unnecessary overhead.
- Monitor and troubleshoot data pipelines to maintain high availability and reliability.
- Design, develop, and maintain efficient ETL pipelines.
- Work with PostgreSQL to ensure optimal database performance and scalability.
- Collaborate with cross-functional teams to understand data needs and implement solutions.
- Ensure data quality, integrity, and compliance with best practices.
- Work with cloud-based data solutions, primarily AWS (or learn on the job).
Requirements:
- Proficiency in Python for data engineering tasks.
- At least 3 years of experience with dbt.
- Expertise in PostgreSQL as a target technology (this role involves leveraging specific PostgreSQL features, such as hypertables for automatic partitioning and pattern-based data parsing, to ensure high performance and efficiency)
- Deep technical expertise and experience in handling real-time data, ensuring that system architecture is designed with zero delays in data availability and maximum efficiency.
- Experience with ETL/ELT processes, data ingestion, and transformation best practices.
- Familiarity with cloud-based solutions like AWS is a plus.
- Knowledge of Apache Airflow and Snowflake is advantageous, but willingness to learn is sufficient.
- Strong problem-solving skills and ability to work independently and in a team.
- Excellent communication and documentation skills.
We offer:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
Top Skills
What We Do
N-iX is a global software solutions and engineering services company that helps world’s leading organizations turn challenges into lasting business value, operational efficiency, and revenue growth using advanced technology. Whether you need to build a custom solution, modernize your digital product or acquire extra tech expertise - we have the experience and capabilities to ensure your success.
With over 2,000 professionals in 25 countries across Europe and the Americas, N-iX offers expert solutions in cloud, data analytics, embedded software, IoT, AI, machine learning, and other tech domains. Being in business for over two decades, we have worked with dozens of industry-leading enterprises and Fortune 500 companies creating value across a wide variety of sectors, including finance, manufacturing, supply chain, retail, e-commerce, healthcare, and more. Our unique combination of business domain expertise and technical know-how enables us to effectively collaborate with ISVs, tech companies, and enterprises of all sizes. Thanks to the strong tech ecosystem and partnerships with AWS, GCP, Microsoft, SAP, OpenText, Snowflake, and others, we bring extra speed, scale and efficiency to more than 160 organizations across the globe. N-iX is recognized by numerous industry awards, such as CRN Solution Provider 500, Global Outsourcing 100 by IAOP, ISG Provider Lens™, Modern Application Development services providers by Forrester, etc
.jpg)
