The Role
Design, build, and optimize scalable cloud-based data pipelines using PySpark and Databricks. Develop and maintain ETL/ELT workflows, model data for warehousing in AWS Redshift, and tune performance. Troubleshoot production issues and work with Python and SQL to process large-scale distributed data. Prior domain experience in e-commerce, airlines, transportation, or logistics is desirable.
Summary Generated by Built In
Data Engineer – PySpark, Databricks & AWS Redshift
Location: Chicago, IL (locals Only)
Employment Type: W2 Contract
Job Description
We are seeking an experienced Data Engineer with strong hands-on expertise in PySpark, Databricks, and AWS Redshift to join our data engineering team. The ideal candidate will have a solid background in designing, building, and optimizing scalable data pipelines and data processing solutions in cloud-based environments.
Requirements
Required Qualifications
Atleast 7 plus years of Strong professional experience as a Data Engineer working with large-scale data platforms.
Extensive hands-on experience with PySpark.
Strong experience with Databricks, including developing and optimizing production data pipelines.
Strong hands-on experience with AWS Redshift.
Proficiency in Python and SQL.
Experience building and maintaining ETL/ELT pipelines and data processing workflows.
Strong understanding of data warehousing, data modeling, and distributed data processing concepts.
Experience working with cloud-based data platforms, preferably AWS.
Strong troubleshooting, performance-tuning, and problem-solving skills.
Prior experience within e-commerce, airlines, transportation, or logistics environments is highly desirable.
Skills Required
- At least 7 years of professional experience as a Data Engineer working with large-scale data platforms.
- Extensive hands-on experience with PySpark.
- Strong experience with Databricks, including developing and optimizing production data pipelines.
- Strong hands-on experience with AWS Redshift.
- Proficiency in Python and SQL.
- Experience building and maintaining ETL/ELT pipelines and data processing workflows.
- Strong understanding of data warehousing, data modeling, and distributed data processing concepts.
- Experience working with cloud-based data platforms, preferably AWS.
- Strong troubleshooting, performance-tuning, and problem-solving skills.
- Prior experience within e-commerce, airlines, transportation, or logistics environments.
- Must be local to Chicago, IL (locals only).
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
SCI Solutions Global LLC is a U.S.-based technology consulting and talent-solutions company. It provides digital-transformation services, IT project-delivery support, skilled technology professionals, and scalable software solutions to businesses ranging from startups to large enterprises. The company helps clients address technology challenges, build high-performing teams, and improve business outcomes through tailored consulting, staffing, systems, and software expertise across multiple industries and technology disciplines.
