Data Operations Engineer II

Posted 6 Days Ago
2 Locations
In-Office or Remote
Mid level
Information Technology
The Role
Build, monitor, and maintain data ingestion pipelines and databases (Databricks, Snowflake, SQL Server). Automate collection and monitoring with scripts, administer managed file transfers, create CI/CD and monitoring/alerting, diagnose incidents, and document/runbook operational procedures.
Summary Generated by Built In

Want to be part of a team that builds, monitors, and maintains the data ingestion systems behind the world’s most accurate weather source, running reliably around the clock? We are looking for a Data Operations Engineer II who displays a deep interest in and passion for scripting, automation, and operational reliability; an experienced and detail-oriented individual who likes to diagnose systems and help identify areas of improvement. Reporting directly to the Manager, Data Operations, this position will be responsible for building, monitoring, and independently maintaining the data ingestion processes and systems that move, store, and transform data across platforms – including administering Databricks, our Data Marketplace and Ad Platform, and the core weather, locations, and provider data that power AccuWeather’s products. You will develop, maintain, and optimize complex scripts to automate data collection and monitoring, build end-to-end monitoring systems and automated alert mechanisms to ensure pipeline health, and troubleshoot issues to ensure continuous operation and data integrity.

You will demonstrate skill across multiple platforms, solve technical problems independently, and collaborate with peers and stakeholders in an Agile-based environment, to deliver reliable data operations that cater to a global audience.

We are open to hiring candidates to work from our global headquarters in State College, PA, USA, or remotely.


KEY RESPONSIBILITIES

· Build, monitor, and maintain data ingestion processes and systems that move, store, and transform data across platforms, administering Databricks and our Data Marketplace and Ad Platform.

· Develop, maintain, and optimize complex scripts using Python, PowerShell, or similar languages to automate data collection and monitoring.

· Own the operational state of a defined set of data pipelines — monitoring, incident response, maintenance procedures, and escalation for systems in your scope.

· Own SQL database maintenance (Forecast, current, historical, locations) for data loading and deployment.

· Develop and maintain unit test coverage for Data Ops code bases, ensuring scripts and pipelines behave as expected before deployment.

· Administer GoAnywhere and other managed file transfer platforms.

· Build and manage end-to-end monitoring systems and automated alert mechanisms to optimize the health and performance of data pipelines, ensuring alerts are appropriately calibrated to trigger the right notifications.

· Own incident diagnosis and resolution within established parameters — investigating alerts, identifying root causes, implementing fixes, validating recovery, and documenting resolutions.

· Build and maintain CI/CD pipelines (GitHub Actions, Azure DevOps) to support reliable, repeatable deployments

· Own proactive operational maintenance — executing scheduled maintenance, applying patches and updates, and performing checks that prevent incidents before they occur.

· Create and maintain comprehensive documentation of scripts, automation and monitoring workflows, data pipelines, and deployment procedures.

· Contribute to and improve runbooks based on incidents you've worked through that weren't adequately covered before.

· Collaborate closely with cross-functional teams, providing support for scripting needs and contributing to automation strategy.

· Independently plan and prioritize work to meet deadlines.

· Begin sharing knowledge with peers; engage in informal coaching moments.

· Performs other duties as assigned.


QUALIFICATIONS

· Required Qualifications:

o BA/BS in Computer Science, Information Technology, or a related field, with 3+ years of experience in data operations, scripting, and automation.

o Intermediate proficiency in scripting languages such as Python, PowerShell, Bash, or similar.

o Fully competent in Azure, Databricks, Snowflake, and SQL Server.

o Experience managing relational databases such as SQL.

· Preferred Qualifications:

o Proficiency in Object-Oriented Programming (OOP) languages such as C++, Java, or similar.

o Experience with DataDog or similar tools for monitoring and performance tracking.

o Experience with deployment automation (CI/CD) tools and processes.

o Administration experience with managed file transfer tools (e.g. GoAnywhere)

o Experience working with cloud platforms (e.g., AWS, Azure, GCP).

o Familiarity with version control systems (e.g., Git).

· Skills & Competencies:

o Exceptional analytical and problem-solving skills with meticulous attention to detail.

o Demonstrated ability to debug systems, tracing issues back to their source.

o Excellent communication skills with the ability to collaborate effectively within a team environment.

o Ability to adapt to changing priorities and manage multiple tasks simultaneously.

o Provides clear incident updates on a defined cadence during active incidents.


ABOUT ACCUWEATHER

AccuWeather, recognized and documented as the most accurate and most used source of weather forecasts and warnings in the world, has saved over 12,000 lives, prevented injury to over 100,000 people, and saved companies tens of billions of dollars through better planning and decision-making.

Billions of people around the world rely on AccuWeather’s proven Superior Accuracy™ across our consumer digital platforms. AccuWeather.com is the #1 weather destination and one of the top 100 most-visited websites in the world, and our award-winning AccuWeather app delivers detailed real-time forecasts to millions of smartphones.

AccuWeather forecasts also appear on digital signage, in 700 newspapers, are heard on over 400 radio stations, and viewed on 100 television stations. The AccuWeather Network and AccuWeather NOW® reach an audience of over 125 million on cable and streaming platforms including DirecTV, Charter Communications - Spectrum, Verizon, Philo, Frndly TV, Comcast’s Xfinity X1 and Xfinity Stream, Roku, Xumo, Rockbot, LG, and Amazon Freevee.

AccuWeather For Business serves more than half of the Fortune 500 companies and thousands of other businesses and government agencies globally.

Dr. Joel Myers, Founder and Executive Chairman, established AccuWeather in 1962 and is considered the “father of modern commercial meteorology.” Myers, a leading creative thinker and visionary, has been called “the most accurate man in weather” by The New York Times and has been recognized as one of the top entrepreneurs in American history by Entrepreneur’s Encyclopedia of Entrepreneurs.


COMMITMENT TO DIVERSITY & INCLUSION

AccuWeather is proud to be an Equal Opportunity/Affirmative Action Employer. We are committed to equal employment opportunity to all applicants and existing employees and we evaluate qualified applicants without regard to race, creed, color, national origin, sex (including pregnancy and gender identity/expression), sexual orientation, age, ancestry, physical or mental disability, marital status, political affiliation, religion, citizenship status, genetic information, veteran status, or any other basis protected under applicable federal, state, or local law. AccuWeather is committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation because of a disability for any part of the employment process, please send an e-mail to [email protected] and let us know the nature of your request and your contact information.

Skills Required

  • BA/BS in Computer Science, Information Technology, or related field with 3+ years experience in data operations, scripting, and automation
  • Intermediate proficiency in scripting languages (Python, PowerShell, Bash)
  • Fully competent in Azure, Databricks, Snowflake, and SQL Server
  • Experience managing relational databases and writing SQL for data loading and deployment
  • Develop and maintain unit test coverage for Data Ops code bases
  • Build and maintain CI/CD pipelines (GitHub Actions, Azure DevOps)
  • Proficiency in OOP languages such as C++ or Java
  • Experience with monitoring/performance tools such as DataDog
  • Administration experience with managed file transfer tools (e.g., GoAnywhere)
  • Experience working with cloud platforms (AWS, Azure, GCP)
  • Familiarity with version control systems (Git)
  • Exceptional analytical and problem-solving skills with attention to detail
  • Demonstrated ability to debug systems and trace issues to root cause
  • Excellent communication and collaboration skills
  • Ability to adapt to changing priorities and manage multiple tasks
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: State College, PA
542 Employees
Year Founded: 1962

What We Do

AccuWeather, recognized and documented as the most accurate source of weather forecasts and warnings in the world, has saved tens of thousands of lives and prevented hundreds of thousands of injuries and tens of billions of dollars in property damage. With global headquarters in State College, PA, and other offices around the world, AccuWeather serves more than 1.5 billion people daily, helping them plan their lives and get more out of their day through its digital media, including free mobile apps, mobile web and www.AccuWeather.com website as well as radio, television, newspapers, the national 24/7 and AccuWeather Network channel. Additionally, AccuWeather produces and distributes news, weather content, and video for more than 180,000 third-party websites. Among AccuWeather’s many innovative and award-winning features available free to the public are AccuWeather MinuteCast® Minute by Minute™ forecasts with Superior Accuracy™ and the patented AccuWeather RealFeel® Temperature scale. Furthermore, AccuWeather serves more than half of the Fortune 500 companies and thousands of businesses globally.

Similar Jobs

People Inc. Logo People Inc.

Editor

AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech
Remote or Hybrid
US
3500 Employees
55K-58K Annually

General Motors Logo General Motors

Account Executive

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
United States
165000 Employees

General Motors Logo General Motors

Directeur de district - Ventes - Saguenay et Côte-Nord (District Manager - Sales - Saguenay and Côte-Nord)

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
United States
165000 Employees
76K-114K Annually

General Motors Logo General Motors

Principal Software Engineer

Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Remote or Hybrid
United States
165000 Employees
186K-236K Annually

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account