Senior Data Engineer (USA/Remote)

Posted 2 Days Ago
Hiring Remotely in Virginia
Remote
87K-148K Annually
5-7 Years Experience
Consulting
Find work you believe in with approximately 9,000 specialized experts across 75 locations.
The Role
Design, develop, and maintain scalable data pipelines using Spark, Hive, and Airflow. Develop API services and interactive data visualizations. Monitor and optimize data infrastructure performance. Implement data quality and validation jobs. Collaborate with DevOps engineers on CI/CD processes. Maintain data security and privacy.
Summary Generated by Built In

ICF is a mission-driven company filled with people who care deeply about improving the lives of others and making the world a better place. Our core values include Embracing Difference; we seek candidates who are passionate about building a culture that encourages, embraces, and hires dimensions of difference.  

 

Our Health Engineering Systems (HES) team works side by side with customers to articulate a vision for success, and then make it happen. We know success doesn't happen by accident. It takes the right team of people, working together on the right solutions for the customer. We are looking for a seasoned Senior Data Engineer who will be a key driver to make this happen. 

 

Responsibilities:  

Design, develop, and maintain scalable data pipelines using Spark, Hive, and Airflow 

Develop and deploy data processing workflows on the Databricks platform 

Develop API services to facilitate data access and integration 

Create interactive data visualizations and reports using AWS QuickSight 

Builds required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies 

Monitor and optimize the performance of data infrastructure and processes 

Develop data quality and validation jobs 

Assembles large, complex sets of data that meet non-functional and functional business requirements 

Write unit and integration tests for all data processing code 

Work with DevOps engineers on CI, CD, and IaC 

Read specs and translate them into code and design documents 

Perform code reviews and develop processes for improving code quality 

Improve data availability and timeliness by implementing more frequent refreshes, tiered data storage, and optimizations of existing datasets 

Maintain security and privacy for data at rest and while in transit 

Other duties as assigned 

 

Minimum Qualifications:  

Bachelor's degree in computer science, engineering or related field or comparable experience.  

5+ years of hands-on software or data development experience (3 years with Masters)

4+ years of data pipeline experience using Python, Java and cloud technologies 

Candidate must be able to obtain and maintain a Public Trust clearance 

Candidate must reside in the US, be authorized to work in the US, and work must be performed in the US 

Must have lived in the US 3 full years out of the last 5 years 

 

Preferred Qualifications:  

 

Experienced in Spark and Hive for big data processing 

Experience building job workflows with the Databricks platform 

Strong understanding of AWS products including S3, Redshift, RDS, EMR, AWS Glue, AWS Glue DataBrew, Jupyter Notebooks, Athena, QuickSight, EMR, and Amazon SNS 

Familiar with work to build processes that support data transformation, workload management, data structures, dependency and metadata 

Experienced in data governance process to ingest (batch, stream), curate, and share data with upstream and downstream data users. 

Experienced in data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. 

Demonstrated understanding using software and tools including relational NoSQL and SQL databases including Cassandra and Postgres; workflow management and pipeline tools such as Airflow, Luigi and Azkaban; stream-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including Scala, C++, Java and Python. 

Familiar with DevOps methodologies, including CI/CD pipelines (Github Actions) and IaC (Terraform) 

Ability to obtain and maintain a Public Trust; residing in the United States 

Experience with Agile methodology, using test-driven development. 

 

Job Location: This position requires that the job be performed in the United States. If you accept this position, you should note that ICF does monitor employee work locations and blocks access from foreign locations/foreign IP addresses, and also prohibits personal VPN connections. 

#Indeed

#LI-CL1

Working at ICF

ICF is a global advisory and technology services provider, but we’re not your typical consultants. We combine unmatched expertise with cutting-edge technology to help clients solve their most complex challenges, navigate change, and shape the future.

We can only solve the world's toughest challenges by building an inclusive workplace that allows everyone to thrive. We are an equal opportunity employer, committed to hiring regardless of any protected characteristic, such as race, ethnicity, national origin, color, sex, gender identity/expression, sexual orientation, religion, age, disability status, or military/veteran status. Together, our employees are empowered to share their expertise and collaborate with others to achieve personal and professional goals. For more information, please read our EEO & AA policy.

Reasonable Accommodations are available, including, but not limited to, for disabled veterans, individuals with disabilities, and individuals with sincerely held religious beliefs, in all phases of the application and employment process. To request an accommodation please email [email protected] and we will be happy to assist. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations. Read more here: Requesting an Accommodation for the ICF interview process.

Read more about workplace discrimination rights, the Pay Transparency Statement, or our benefit offerings which are included in the Transparency in (Benefits) Coverage Act.

 

Pay Range - There are multiple factors that are considered in determining final pay for a position, including, but not limited to, relevant work experience, skills, certifications and competencies that align to the specified role, geographic location, education and certifications as well as contract provisions regarding labor categories that are specific to the position.

The pay range for this position based on full-time employment is:

$87,069.00 - $148,017.00

Virginia Remote Office (VA99)

Top Skills

Java
Python
The Company
HQ: Reston, VA
9,000 Employees
Hybrid Workplace
Year Founded: 1969

What We Do

ICF is a global advisory and technology services company with approximately 9,000 employees in industries across the public and private sectors. For over 50 years, we’ve been helping clients take on some of the world’s most complex challenges to produce exceptional results. Our work is the catalyst to help shape the future for all.

Beyond our purpose-driven work, we invest in our employees and their experience with us. We have numerous options for healthcare and many additional benefits, including immediate access to 401k retirement matching and pet insurance. Our Employee Community Networks help members find support, belonging, and growth by enhancing internal networks and professional development. We offer paid volunteer time and match your donations. As learning is a never-ending journey, we offer tuition reimbursement, mentorship programs, communities of practice to contribute to and grow from, and memberships to LinkedIn Learning and Coursera. We aim to consider every aspect of how to invest in people so they can belong, grow, and thrive with us.

Why Work With Us

At ICF, we are a purpose-driven company with a strong culture and underlying values that prize diversity, opportunity, equality, and respect. We are not all the same. And that has always been our greatest strength. We are at our best when every member of our team feels respected, included, and heard—when everyone can show up as themselves and do th

Gallery

Gallery

Jobs at Similar Companies

Chicago, IL, USA
120 Employees

Eastwall Logo Eastwall

Solution Architect

Artificial Intelligence • Cloud • Information Technology • Software • Consulting • App development • Big Data Analytics
Remote
United States
20 Employees
150K-180K Annually

Energy CX Logo Energy CX

Strategic Account Executive

Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Easy Apply
Chicago, IL, USA
55 Employees

Similar Companies Hiring

Premier International Thumbnail
Information Technology • Database • Consulting
Chicago, IL
120 Employees
Eastwall Thumbnail
Software • Information Technology • Consulting • Cloud • Big Data Analytics • Artificial Intelligence • App development
Denver, CO
20 Employees
Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
55 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account