Senior Data Engineers

Posted Yesterday
Be an Early Applicant
Chicago, IL
In-Office
131K-139K Annually
Senior level
Artificial Intelligence • Automotive • Internet of Things • Software
The Role
The Senior Data Engineer develops large scale data pipelines, automates processes, provides technical support, mentors juniors, and utilizes various AWS and data processing technologies.
Summary Generated by Built In

CCC Intelligent Solutions Inc. (CCC) is a leading cloud platform for the multi-trillion-dollar insurance economy, creating intelligent experiences for insurers, repairers, automakers, part suppliers, and more. At CCC, we’re making life just work by empowering more than 35,000 businesses with industry-leading technology to get drivers back on the road and to health quickly and seamlessly. We’re pushing boundaries with innovative AI solutions that simplify and enhance the claims and repair journey. Through purposeful innovation and the strength of its connections, CCC technologies empower the people and industry relied upon to keep lives moving forward when it matters most. Learn more about CCC at www.cccis.com.


 

The Role


 

Key Responsibilities:

Senior Data Engineers for Chicago, IL location. Develop large scale end to end data pipeline applications, covering multiple data sources spread across data center and AWS cloud. Use developed software applications to locate and analyze source data; create data flows to extract, profile, and store ingested data; define and build data cleansing and imputation; map to a common data model; transform to satisfy business rules and statistical computations; and validate data content. Produce software data building blocks, data models, and data flows, such as dimensional data, data feeds, dashboard reporting, and data science research and exploration. Produce automated software tests of data flow components and for data content quality. Automate orchestration and error handling for use by production operation teams. Provide technical expertise to diagnose errors from production support teams. Guide junior team members in performance tuning applications in distributed computing environments. Perform root cause analysis on all data and processes and identify opportunities for improvement. Develop metadata-driven and fully parameterized data processing tools. Mentor junior engineers. Technical Environment: Programming with Python and PySpark; Massively Parallel Processing (MPP) and distributed resource management with YARN in AWS EMR; columnar storage formats (Parquet, ORC) and Apache Hudi; ETL pipeline orchestration using Apache Airflow; Building and optimizing data pipelines with Apache Kafka; Advanced SQL for profiling and validation; Presto; PostgreSQL; Unix scripting and root cause analysis of data and processes; CI/CD tools (Git, GitHub Actions, Jenkins); Agile methodologies and metadata-driven development; AWS tools - EMR, S3, RDS, Redshift, CloudWatch, Bedrock, MWAA; Machine learning; predictive modeling using DataRobot.

#LI-DNI

#NOINDEED


 

Requirements:

Master’s degree in Computer Science, Computer Engineering, Management Information Systems, Business Analytics or related field plus 3 years of experience with software development/data processing or analysis required. Required skills: Programming with Python and PySpark; Massively Parallel Processing (MPP) and distributed resource management with YARN in AWS EMR; columnar storage formats (Parquet, ORC) and Apache Hudi; ETL pipeline orchestration using Apache Airflow; Building and optimizing data pipelines with Apache Kafka; Advanced SQL for profiling and validation; Presto; PostgreSQL; Unix scripting and root cause analysis of data and processes; CI/CD tools (Git, GitHub Actions, Jenkins); Agile methodologies and metadata-driven development; AWS tools - EMR, S3, RDS, Redshift, CloudWatch, Bedrock, MWAA; Machine learning; predictive modeling using DataRobot. Some telecommuting permitted. $130,707/yr - $139,000/yr.


 

About CCC's Commitment to Employees:

CCC Intelligent Solutions understands that our employees play an integral role in our vision to shape a world where life just works. Our team is defined by our values of Integrity, Customer-Focus, Innovation, Inclusion & Diversity, Tenacity, and Connection. Through diverse perspectives, purposeful innovation, and the strength of connections, our technologies empower the people and industry relied upon to keep lives moving forward when it matters most.

At CCC, together everyone can thrive as we innovate and collaborate, creating employee experiences that just work. We are committed to providing opportunities for our people to make real-life impacts, advance in their careers, and contribute to CCC’s success.

CCC offers competitive compensation and benefits to support you and your families, including:

  • 401K Match

  • Paid time off

  • Annual Incentive Plan Performance Bonus

  • Comprehensive health insurance

  • Adoption Assistance

  • Tuition Reimbursement

  • Wellness Programs

  • Stock Purchase Plan options

  • Employee Resource Groups

For more information about our benefits, please check out our careers site.

Here, you belong. You are seen, valued, and respected. We celebrate you for who you are and all you bring. Every voice is heard and is important to our success. You can hear what employees have to say about our culture here

If you require reasonable accommodation to complete a job application, please contact (800) 621-8070.

Top Skills

Apache Airflow
Apache Hudi
Apache Kafka
Aws Cloudwatch
Aws Emr
Aws Rds
Aws Redshift
Aws S3
Datarobot
Git
Github Actions
Jenkins
Orc
Parquet
Postgres
Presto
Pyspark
Python
SQL
Unix
Yarn
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Chicago, IL
2,000 Employees
Year Founded: 1980

What We Do

CCC Intelligent Solutions Inc. (CCC), is a leading cloud platform provider for the multi-trillion-dollar P&C insurance economy, creating intelligent experiences for insurers, repairers, automakers, part suppliers, and more. The CCC Intelligent Experience (IX) Cloud™ platform, powered by proven AI and an innovative event-based architecture, connects more than 35,000 businesses to power customized applications and platforms for optimal outcomes and personalized experiences that just work. Through purposeful innovation and the strength of its connections, CCC technologies empower the people and industry relied upon to keep lives moving forward when it matters most. Learn more about CCC at www.cccis.com.

Why Work With Us

When you join CCC, you’re not just joining a company—you’re joining a community that’s passionate about transforming industries and making a difference. Our state-of-the-art Chicago headquarters amenities include a full-size basketball court, health club, rooftop terrace, pool tables, shuffleboard, and other activities to help you unwind.

Gallery

Gallery

Similar Jobs

Capital One Logo Capital One

Lead Data Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
Chicago, IL, USA
205K-234K Annually

CDW Logo CDW

Sr. Stock Plan Administrator

Artificial Intelligence • eCommerce • Information Technology • Internet of Things • Automation
Hybrid
Chicago, IL, USA
97K-130K Annually

CDW Logo CDW

Sr. Stock Plan Administrator

Artificial Intelligence • eCommerce • Information Technology • Internet of Things • Automation
Hybrid
Rosemont, IL, USA
97K-130K Annually

CDW Logo CDW

Technology VMO Manager

Artificial Intelligence • eCommerce • Information Technology • Internet of Things • Automation
Remote or Hybrid
IL, USA
111K-154K Annually

Similar Companies Hiring

Credal.ai Thumbnail
Software • Security • Productivity • Machine Learning • Artificial Intelligence
Brooklyn, NY
Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
PRIMA Thumbnail
Travel • Software • Marketing Tech • Hospitality • eCommerce
US
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account