The Role
The role involves building and operating a multi-tenant analytics platform on AWS with a focus on streaming and batch data pipelines, managing workflows, and ensuring reliability and performance in production systems.
Summary Generated by Built In
CTERA is looking for a Senior Data Engineer to build and operate a multi-tenant analytics platform on AWS + Kubernetes (EKS), delivering streaming and batch pipelines via GitOps as a Platform-as-a-Service (PaaS).
Responsibilities:
- Ingestion pipelines: Build and operate Flink / Spark streaming and batch jobs ingesting from Kafka, S3, APIs, and RDBMS into OpenSearch and other data stores.
- Platform delivery: Provide reusable, multi-tenant pipelines as a self-service PaaS.
- Workflow orchestration: Manage pipeline runs using Argo Workflows.
- GitOps delivery: Deploy and operate pipelines via ArgoCD across environments.
- IaC & AWS: Provision infrastructure with Terraform and secure access using IAM / IRSA.
- Reliability: Own monitoring, stability, and troubleshooting of production pipelines.
- Collaboration: Work with product, analytics, and infra on schemas and data contracts.
Requirements:
- Software skills: Senior-level, hands-on data engineering experience building and operating production systems with ownership of reliability and scale.
- Processing: Strong experience with Flink and Spark (streaming + batch).
- Data sources & sinks: Experience integrating with Kafka, S3, REST APIs, and RDBMS, and publishing to OpenSearch / Elasticsearch, data warehouses, or NoSQL databases.
- Big Data: Familiarity with big-data systems; Iceberg / PyIceberg a plus.
- Cloud & DevOps: Hands-on experience with EKS, RBAC, ArgoCD, and Terraform for infrastructure and delivery workflows.
- Datastores: Hands-on experience with OpenSearch / Elasticsearch including indexing strategies, templates/mappings, and operational troubleshooting.
- AI tools: Experience with AI-assisted development tools. (e.g., CursorAI, GitHub Copilot, or similar).
Top Skills
APIs
Argo Workflows
Argocd
AWS
Eks
Elasticsearch
Flink
Gitops
Kafka
Kubernetes
Opensearch
Rdbms
S3
Spark
Terraform
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
CTERA is the distributed cloud file storage leader, powering more than 50,000 enterprise locations and millions of corporate users.
