Senior Observability Engineer - Platform and Telemetry

Posted 16 Hours Ago
Be an Early Applicant
3 Locations
In-Office
90K-190K Annually
Senior level
Information Technology • Consulting • Defense
The Role
Designs, deploys, secures, operates, and improves observability platforms across classified and disconnected OpenShift environments. Builds telemetry collection and processing pipelines for metrics, logs, traces, and events using Elastic, Grafana, Prometheus, Loki, OpenTelemetry, and object storage. Manages retention, backup, recovery, resiliency, performance, and platform self-monitoring. Collaborates with architecture, DevSecOps, security, data engineering, and SRE teams while supporting telemetry preparation for anomaly detection and AI capabilities.
Summary Generated by Built In
Job Title: Senior Observability Engineer - Platform and Telemetry

Job Category: Information Technology

Time Type: Full time

Minimum Clearance Required to Start: TS/SCI with Polygraph

Employee Type: Regular

Percentage of Travel Required: Up to 10%

Type of Travel: Continental US

Anticipated Posting End: 3/1/2027

The Opportunity:


The Senior Observability Platform Engineer—Platform and Telemetry Focus designs, deploys, operates, and improves the core observability platform. This role owns the technical foundation for secure telemetry collection, processing, storage, retention, resiliency, and platform self-observability across classified and disconnected OpenShift environments.

The engineer will support the approved telemetry architecture, including Elastic and Grafana, Prometheus, Loki, and S3-compatible object storage.


Responsibilities


Platform Deployment and Operations


  • Deploy, configure, secure, upgrade, and operate the telemetry platform on Red Hat OpenShift.
  • Build and maintain highly available telemetry ingestion, processing, storage, retention, backup, and recovery capabilities.

Telemetry Collection and Pipeline Engineering


  • Design and operate collection pipelines for infrastructure, Kubernetes/OpenShift, application, security, cloud, CI/CD, and cost telemetry.
  • Configure and maintain Grafana, OpenTelemetry Collectors, OTLP endpoints, exporters, receivers, processors, and/or Elastic ingest pipelines, as applicable.

Storage, Retention, and Resiliency


  • Configure and manage metrics, logs, traces, and archival storage back ends.
  • Implement data retention, compaction, lifecycle management, backup, restoration, and disaster-recovery procedures.

Platform Self-Observability and Security


  • Implement telemetry and dashboards for ’s own health, including pipeline throughput, dropped samples, query latency, ingestion rate, storage utilization, component health, and resource consumption.
  • Instrument pipeline components to capture throughput, queue depth, backpressure, dropped-record reasons, CPU and memory utilization, and end-to-end pipeline latency.

Collaboration and Documentation


  • Partner with the Observability Architect, OpenShift DevSecOps Engineer, Security Engineer/ISSO, Data Engineer, and Grafana/SRE-focused engineer.
  • Support reliable telemetry availability and data preparation for anomaly detection and other approved AI capabilities.

Qualifications:

Required:


  • Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field; equivalent experience may substitute.
  • 7+ years of experience in platform engineering, observability engineering.
  • 3+ years of hands-on production experience with Kubernetes or Red Hat OpenShift.
  • Hands-on experience with Elastic Stack, including Elasticsearch, ingest pipelines, index lifecycle management, storage tiers, and retention; and/or Grafana LGTM components including Alloy, Prometheus/Mimir, Loki, Tempo, and object storage.
  • Experience with OpenTelemetry, OTLP, metrics, logs, traces, structured events, and telemetry data processing.
  • Strong experience with Linux, containers, Helm, Kustomize, Git, GitLab CI/CD, Argo CD or OpenShift GitOps, and infrastructure-as-code.
  • Experience with storage lifecycle management, backup/recovery, capacity planning, performance tuning, and distributed-system troubleshooting.
  • Ability to automate with Bash, Python, Go, or a comparable language.

Desired


  • Experience operating systems in air-gapped, classified, disconnected, or highly regulated environments.
  • Experience with NIST SP 800-53, NIST SP 800-137, FIPS requirements, RMF/ATO processes, and secure software-supply-chain practices.
  • OpenShift, Kubernetes, Grafana, Elastic, Prometheus, or OpenTelemetry certifications.
  • Experience with S3-compatible object storage, OpenCost, FinOps telemetry, chargeback, or showback systems.
  • Familiarity with AWS, Azure, hybrid-cloud telemetry, and enterprise identity/security tooling.

-

What You Can Expect:

 A culture of integrity.

At CACI, we place character and innovation at the center of everything we do. As a valued team member, you’ll be part of a high-performing group dedicated to our customer’s missions and driven by a higher purpose – to ensure the safety of our nation.

An environment of trust.

CACI values the unique contributions that every employee brings to our company and our customers - every day. You’ll have the autonomy to take the time you need through a unique flexible time off benefit and have access to robust learning resources to make your ambitions a reality.

A focus on continuous growth.

Together, we will advance our nation's most critical missions, build on our lengthy track record of business success, and find opportunities to break new ground — in your career and in our legacy.

Pay Range:

There are a host of factors that can influence final salary including, but not limited to, geographic location, Federal Government contract labor categories and contract wage rates, relevant prior work experience, specific skills and competencies, education, and certifications. Our employees value the flexibility at CACI that allows them to balance quality work and their personal lives. We offer competitive compensation, benefits and learning and development opportunities. Our broad and competitive mix of benefits options is designed to support and protect employees and their families. At CACI, you will receive comprehensive benefits such as; healthcare, wellness, financial, retirement, family support, continuing education, and time off benefits.

Since this position can be worked in more than one location, the range shown is the national average for the position.

The proposed salary range for this position is:

$90,300-$189,600

CACI is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, age, national origin, disability, status as a protected veteran, or any other protected characteristic.

Skills Required

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field; equivalent experience may substitute.
  • 7+ years of experience in platform engineering or observability engineering.
  • 3+ years of hands-on production experience with Kubernetes or Red Hat OpenShift.
  • Hands-on experience with Elastic Stack, including Elasticsearch, ingest pipelines, index lifecycle management, storage tiers, and retention; and/or Grafana LGTM components including Alloy, Prometheus/Mimir, Loki, Tempo, and object storage.
  • Experience with OpenTelemetry, OTLP, metrics, logs, traces, structured events, and telemetry data processing.
  • Strong experience with Linux, containers, Helm, Kustomize, Git, GitLab CI/CD, Argo CD or OpenShift GitOps, and infrastructure as code.
  • Experience with storage lifecycle management, backup and recovery, capacity planning, performance tuning, and distributed-system troubleshooting.
  • Ability to automate with Bash, Python, Go, or a comparable language.
  • Experience operating systems in air-gapped, classified, disconnected, or highly regulated environments.
  • Experience with NIST SP 800-53, NIST SP 800-137, FIPS requirements, RMF/ATO processes, and secure software-supply-chain practices.
  • OpenShift, Kubernetes, Grafana, Elastic, Prometheus, or OpenTelemetry certifications.
  • Experience with S3-compatible object storage, OpenCost, FinOps telemetry, chargeback, or showback systems.
  • Familiarity with AWS, Azure, hybrid-cloud telemetry, and enterprise identity/security tooling.
  • TS/SCI with Polygraph clearance required to start.

CACI International Inc Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about CACI International Inc and has not been reviewed or approved by CACI International Inc.

  • Healthcare Strength — Pay is supported by a broad set of health-plan options across multiple national carriers, with telemedicine and tax-advantaged accounts included. Dental and vision choices are also described as multi-option, which strengthens overall coverage breadth.
  • Leave & Time Off Breadth — Flexible Time Off is available for many salaried-exempt roles, while hourly roles accrue PTO, creating multiple time-off pathways by employment class. Paid disability coverage, fixed holidays, and paid leave programs (including parental leave and other leave types) further round out time-off and leave coverage.
  • Retirement Support — Retirement support includes a 401(k) match structure described as 50% up to 8% of pay (effective 4%) and an Employee Stock Purchase Plan with a discount. Tuition reimbursement and certification support also add to the overall rewards package that complements core retirement benefits.

CACI International Inc Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Reston, VA
17,673 Employees
Year Founded: 1962

What We Do

CACI’s approximately 23,000 talented employees are vigilant in providing the unique expertise and distinctive technology that address our customers’ greatest enterprise and mission challenges. Our culture of good character, innovation, and excellence drives our success and earns us recognition as a Fortune World's Most Admired Company. As a member of the Fortune 1000 Largest Companies, the Russell 1000 Index, and the S&P MidCap 400 Index, we consistently deliver strong shareholder value. Visit us at www.caci.com.

Similar Jobs

CDW Logo CDW

Billing Specialist

Artificial Intelligence • Cloud • Information Technology • Consulting • Cybersecurity • Infrastructure as a Service (IaaS)
Remote or Hybrid
US
15100 Employees
55K-76K Annually

Airwallex Logo Airwallex

Senior Counsel

Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
In-Office
3 Locations
2700 Employees
200K-280K Annually

Pfizer Logo Pfizer

Cardiovascular Specialist, Health and Science Professional - West Nyack, NY

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
New York, NY, USA
121990 Employees
76K-200K Annually

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Sales Associate II

eCommerce • Fashion • Retail • Sales • Wearables • Design
Hybrid
Central Valley, NY, USA
16000 Employees
15-24 Hourly

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
Outpost Space Thumbnail
Aerospace • Defense
Los Angeles, California
38 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account