Role Overview:
As a Data Engineer on our Development Team, you will design, develop, and optimize data pipelines within an AWS ecosystem for a US-based B2B marketplace company. Your expertise in PySpark will be instrumental in processing large-scale datasets, ensuring the reliability and performance of our data systems. You will collaborate with cross-functional teams, including data scientists and analysts, to deliver high-impact solutions that support business objectives.
Key Responsibilities:
- Design, develop, and implement data pipelines using PySpark within AWS environments
- Leverage AWS services such as S3, Glue, EMR, Lambda, and Redshift for building scalable data solutions
- Optimize PySpark workflows for performance, reliability, and cost-efficiency
- Collaborate with stakeholders to understand data requirements and translate them into technical solutions
- Ensure data quality and integrity through robust testing and monitoring processes
- Implement data governance, security, and compliance best practices in all development activities
- Document technical designs, processes, and workflows to support ongoing maintenance and team knowledge sharing.
Requirements:
- Bachelor’s degree in Computer Science, Engineering, or a related field
- 4 years+ of experience in data engineering, with a focus on building and optimizing data pipelines using PySpark
- Strong experience with AWS services, including S3, Glue, Lambda, EMR, and Redshift
- Proficiency in Python programming and familiarity with related frameworks and libraries
- Solid understanding of distributed computing and experience with Apache Spark
- Hands-on experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation) is a plus
- Strong analytical and problem-solving skills, with attention to detail and a proactive approach to troubleshooting
- Excellent communication and collaboration skills, with the ability to work in a dynamic, team-oriented environment
- Upper-Intermediate level of English
We offer:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
Top Skills
What We Do
N-iX is a global software solutions and engineering services company that helps world’s leading organizations turn challenges into lasting business value, operational efficiency, and revenue growth using advanced technology. Whether you need to build a custom solution, modernize your digital product or acquire extra tech expertise - we have the experience and capabilities to ensure your success.
With over 2,000 professionals in 25 countries across Europe and the Americas, N-iX offers expert solutions in cloud, data analytics, embedded software, IoT, AI, machine learning, and other tech domains. Being in business for over two decades, we have worked with dozens of industry-leading enterprises and Fortune 500 companies creating value across a wide variety of sectors, including finance, manufacturing, supply chain, retail, e-commerce, healthcare, and more. Our unique combination of business domain expertise and technical know-how enables us to effectively collaborate with ISVs, tech companies, and enterprises of all sizes. Thanks to the strong tech ecosystem and partnerships with AWS, GCP, Microsoft, SAP, OpenText, Snowflake, and others, we bring extra speed, scale and efficiency to more than 160 organizations across the globe. N-iX is recognized by numerous industry awards, such as CRN Solution Provider 500, Global Outsourcing 100 by IAOP, ISG Provider Lens™, Modern Application Development services providers by Forrester, etc
