Data Engineer

Data Engineer

California College Guidance Initiative

Remote/Virtual - All candidates must live in California.

Full-Time

The California College Guidance Initiative is looking for a data engineering expert to join the Cloud Infrastructure Team. As part of the team, you will be a key strategic leader in the expansion, refinement, and continued development of CCGI’s infrastructure utilizing Snowflake and Amazon Web Services (AWS), as well as continuing to build out our data analytics and engineering tools. This role will be instrumental in helping us scale our work statewide and open the door for expanded use of California's official college and career planning platform for K-12th grade students, parents, and educators, CaliforniaColleges.edu.
 

The ideal candidate for this team has extensive experience building out data ETL/ELT workloads, including the testing, maintenance, and refinement of containerized workloads in cloud architectures. The candidate should also have experience successfully scaling up an organization’s data intake from batch to streaming data, as well as automating data delivery. This person is comfortable working with data storage and can troubleshoot data accessibility via SQL, Python, shell scripting, AWS, Snowflake, and take on a leadership role in special projects when needed. Additionally, this person should have experience developing technical documentation and implementing security governance protocols.

There are no direct supervisory responsibilities for this position, but you must be able to proactively and successfully partner and collaborate with other subject matter experts on a time bound projects. Lastly, you must be comfortable leading and project managing work with many unknowns and ambiguous solutions, as well as carry a deep knowledge and/or curiosity about the needs and behaviors of students, educators, and parents, and a passion for educational equity.

What Will You Be Doing?

• Lead batch and streaming ETL/ELT processes which include the development, refinement, and containerization of data loading and processing using event driven architecture and workflow orchestration developed within integrated development environments (IDEs) using AWS cloud services, Snowflake data warehouses, Python and SQL scripts, dbt, and shell scripts.
• Review, redesign, and expand data models for existing analytics, data warehousing and self-service business intelligence architecture to create fully automated data pipeline(s) from staged or streamed data to organization of data warehouse objects and producing access via reporting, alerts or API access.
• Design and implement data pipeline automation requiring Python scripting and SQL statements, integrating with Salesforce, Slack and AWS services using serverless, cloud servers and containerized systems.
• Lead meetings, research processes, collect data, analyze information and collaborate with the key stakeholders of your projects.
• Develop and maintain expert knowledge of CaliforniaColleges.edu.
• Continuously improve data pipelines and architecture by staying updated on industry trends and best practices.
• Model CCGI’s values both in action and in how decisions are made.

What Technical Skills Do You Need?

• Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
• Advanced proficiency with cloud data warehousing analytical tools: Snowflake, Redshift, Spark, Kafka, etc.
• Advanced proficiency with ETL tools like Jupyter Notebooks, Matillion, dbt, Talend, etc.
• Advanced proficiency building and optimizing data pipelines, and data sets.
• Advanced proficiency with scripting languages like Python, Scala, R, etc.
• Provision AWS services to automate deployment services. 
• Standard development and testing environments based on production.
• Advanced proficiency developing ETL processes for data warehousing or obtained SnowPro Core or AWS Cloud Practitioner Certification or currently has or is in the process of obtaining AWS Certification as a Solutions Architect - Associate.
• Expert SQL knowledge (SQL Server, PostgreSQL, MySQL, etc.) and understanding of relational databases, query authoring and optimization, as well as working familiarity with a variety of databases.
• A successful history of manipulating, processing and extracting value from large structured and unstructured datasets.
• Experience working in K-12 data and education is highly desirable.
• Experience building Salesforce integrations is a plus

What Intangibles Do You Need?

• Self-directed and proactive problem-solver applying new knowledge.
• Demonstrated ability to organize, prioritize, and manage multiple projects and tasks simultaneously.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Demonstrated ability to prioritize, multi-task, and effectively manage multiple tasks simultaneously.
• Clear, confident, and attentive verbal communicator to conduct meetings.
• Ability to write with attention to accuracy, audience, and concision within task tickets.
• Ability to communicate complex information simply to non-technical personnel.
• Ability to collect and analyze information, problem-solve, and make decisions.
• Capacity to think in an organized and rational manner in order to understand connections between ideas and/or facts.
• Commitment to developing and maintaining trusting professional relationships.
• Comfort with and ability to easily transition between independent and collaborative tasks.
• A commitment to increasing educational access and equity.
• Ability to model, provide, and receive feedback using the Nonviolent Communication model.

More about the Cloud Infrastructure Team

The team oversees all of CCGI’s internal cloud-based data analytics and engineering infrastructure and technical strategy. This includes data analytics, data warehousing, and data engineering projects, ensuring alignment with the organization's mission and goals.

This role will join experienced data engineers and you will join an environment that allows for knowledge sharing and creates opportunities for you to take initiatives to learn even more. This role reports to the Director, Cloud Infrastructure.

More about CCGI

CCGI works to ensure that all 6th-12th grade students in California have access to a systematic baseline of guidance and support as they plan, prepare, and pay for postsecondary education and training.

This baseline is provided by CaliforniaColleges.edu, which provides California students and educators with a wide range of college and career planning information and tools. The site also houses, audits, and transmits student data to help ensure more accurate and efficient decisions regarding admissions, financial aid, and course placement. CCGI provides technical assistance, support, and training to K-12 school districts in order to support students, counselors, and parents with the systematic use of CaliforniaColleges.edu, including its transcript-informed tools.

CCGI is a positive, diverse, and supportive culture.

Everyone at CCGI works remotely. We are all located in various parts of California. We rarely meet in person. Instead, we make use of tools, such as ZOOM, Slack, and Salesforce, to communicate and document our work.

CCGI is housed at the Foundation for California Community Colleges but is an autonomous initiative with its own mission, goals, and leadership team.

The Foundation for California Community Colleges (Foundation) is committed to providing an environment of mutual respect where equal employment opportunities (EEO) are available to all employees and applicants without regard to race, color, ancestry, national origin, genetic characteristics, sex, gender identity, gender expression, sexual orientation, marital/parental status, political affiliation, religion, age, disability, pregnancy, childbirth, breastfeeding or veteran status. In addition to federal law requirements, the Foundation for California Community Colleges complies with applicable state and local laws governing nondiscrimination in employment.

The Foundation for California Community Colleges is committed to workplace policies and hiring practices that comply with federal, state, and local law. During the hiring process, the Foundation is interested in hiring qualified candidates who are eligible and authorized to work in the United States. However, at this time, the Foundation is not able to sponsor visas. As a result, the Foundation cannot hire applicants that currently, or in the future, require immigration sponsorship for work authorization (i.e., H1B or F1 Student Visa).

Application Instructions

• Go to https://foundationccc.wd1.myworkdayjobs.com/fccc-careers
• Find “Data Engineer” and follow the directions to apply.
• Include both a cover letter and resume with your application.

The application process will be open until the position is filled.

Budgeted Annual Salary Pay Range:

$110,000.00 - $160,000.00

Final salary and rates are based on education, experience, skills relevant to the role, and internal equity.