Senior Data Engineer

Reposted 23 Days Ago
Be an Early Applicant
5 Locations
Senior level
Consulting • PropTech
The Role
The Senior Data Engineer is responsible for designing, developing, and maintaining scalable data pipelines and ETL processes, using technologies such as PySpark and Airflow. They will work closely with cross-functional teams to ensure data quality and compliance, while continuously evaluating new tools to enhance data infrastructure.
Summary Generated by Built In

Description

Intellectsoft is a software development company delivering innovative solutions since 2007. We operate across North America, Latin America, the Nordic region, the UK, and Europe.We specialize in industries like Fintech, Healthcare, EdTech, Construction, Hospitality, and more, partnering with startups, mid-sized businesses, and Fortune 500 companies to drive growth and scalability. Our clients include Jaguar Motors, Universal Pictures, Harley-Davidson, Qualcomm, and London Stock Exchange.Together, our team delivers solutions that make a difference. Learn more at 

The product is an AI-powered platform that helps businesses make better decisions and work more efficiently. It uses advanced analytics and machine learning to analyze large amounts of data and provide useful insights and predictions. The platform is widely used in various industries, including healthcare, to optimize processes, improve customer experiences, and support innovation. It integrates easily with existing systems, making it easier for teams to make quick, data-driven decisions.

Requirements
  • 4+ years of professional experience, including 2+ years of data engineering with Apache Spark and SQL.
  • Proficiency in Python for data processing and automation.
  • Knowledge of PySpark, distributed computing, analytical databases and other big data technologies.
  • Expertise in designing and managing ETL pipelines and distributed data processing frameworks.
  • Strong knowledge of database systems, data modeling, and analytical databases.
  • Hands-on experience with workflow orchestration tools such as Apache Airflow.
  • Familiarity with cloud platforms like AWS, GCP, or Azure.
  • Solid understanding of software development lifecycles, including coding standards, version control, and testing.

Nice to have skills

  • Bachelor’s or master’s degree in Computer Science or a related field.
  • Familiarity with the data science and machine learning development process.
  • Understanding of Machine Learning pipelines or frameworks.

Responsibilities

  • Design and build highly reliable and scalable data pipelines using PySpark and big data technologies.
  • Collaborate with the data science team to develop new features that enhance model accuracy and performance.
  • Create standardized data models to improve consistency across various deployments.
  • Troubleshoot and resolve issues in existing ETL pipelines and optimize workflows.
  • Conduct POCs to evaluate new technologies and integrate additional data sources.
  • Follow and promote best practices for software development, ensuring high-quality solutions that meet requirements and deadlines.
  • Document development updates and maintain clear technical documentation.
Benefits
  • 35 absence days per year for work-life balance
  • Udemy courses of your choice
  • English courses with native-speaker
  • Regular soft-skills trainings
  • Excellence Сenters meetups
  • Online/offline team-buildings

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
199 Employees
On-site Workplace
Year Founded: 2007

What We Do

Intellectsoft is a digital transformation consultancy service that provides cutting-edge engineering solutions for global organizations with the mission to help enterprises accelerate the adoption of new technologies, untangle complex issues that always emerge during digital evolution, and orchestrate ongoing innovation.

Intellectsoft has been named as one of the highly-rated software development B2B companies in 2021 by Clutch. Ranked No. 244 by Inc. magazine’s annual Inc. 5000 Regionals 2021, Intellectsoft has become one the nation’s fastest-growing private companies and demonstrated solid revenue growth of 37% over the last two years, fueled by customer’s need for innovative software solutions in the era of digitalization.

The Company’s services portfolio offers strategic IT consulting, CX design, development, and full lifecycle management of custom software products and applications, and system integration. Whether it is a consumer-oriented app or a transformative enterprise-class solution, the company leads the process from ideation and concept to delivery and provides ongoing support.

Similar Jobs

Commonwealth Bank Logo Commonwealth Bank

Senior Data Engineer

Fintech • Financial Services
Area, Viveiro, Lugo, Galicia, ESP
52000 Employees
2 Locations
52000 Employees

Commonwealth Bank Logo Commonwealth Bank

Senior Data Engineer Design

Fintech • Financial Services
Area, Viveiro, Lugo, Galicia, ESP
52000 Employees

Commonwealth Bank Logo Commonwealth Bank

Senior Data Engineer

Fintech • Financial Services
2 Locations
52000 Employees

Similar Companies Hiring

Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
55 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Enterprise Web • Consulting • Cloud
Chicago, IL
45 Employees
Quantum Rise Thumbnail
Software • Professional Services • Natural Language Processing • Machine Learning • Consulting • Automation • Artificial Intelligence
Chicago, Illinois
17 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account