The Role
Lead infrastructure strategy and build/automate AWS infrastructure. Maintain and grow data lakehouse (Databricks) and event processing. Champion security, CI/CD, monitoring, model serving, and provide engineering leadership while participating in L2 support rotation.
Summary Generated by Built In
- Drive the infrastructure strategy alongside the rest of the DevOps team
- Be responsible for building, managing, and automating our AWS infrastructure
- Oversee the maintenance and growth of our data lakehouse infrastructure and implementation
- Champion security by adopting necessary tools and processes
- Provide leadership to the entire engineering team on various infrastructure and big data topics
- Identify and adopt high-level technologies, processes, and services that impact the organization on a system-wide scope
- Participate in the L2 rotation for engineering support
Requirements
- 8+ years of experience as a DevOps Engineer
- 5+ years of experience with the AWS cloud platform, including proficiency with AWS SDK, AWS CLI/UI, and services such as VPC, Route53, Private and Public subnets, route tables, IGW, EC2 Instances, CloudFront, API Gateway, IAM, ELB, Autoscaling, CloudWatch, EFS, NFS, EBS, S3, RDS, Lambda, SQS/SNS, Kafka, Security groups, etc.
- 5+ years of experience with Terraform/Terragrunt
- 5+ years of experience with event processing infrastructure
- 2+ years of experience as a Data Engineer with Databricks, including data pipelines, Debezium, Spark, and data modeling
- Expert proficiency with Python
- Model serving experience
- Expert proficiency in deploying, maintaining, and scaling applications
- Proficiency with Docker, Kubernetes, and Serverless functions
- Expert proficiency in setting up CI/CD pipelines (tools/processes/governance)
- Experience creating and maintaining fully automated CI/CD pipelines for code deployment using tools such as Git, CircleCI, AWS Code build, and Code Deploy / Code pipeline
- Proficient with both Relational and Non-Relational databases
- Experience with Security vulnerability scanning tools (Guard Duty, Inspector)
- Experience building Monitoring dashboards and leveraging tools such as Cloudwatch, Datadog, and Sumologic
Skills Required
- 8+ years of experience as a DevOps Engineer
- 5+ years of experience with AWS (AWS SDK, AWS CLI/UI) and services including VPC, Route53, subnets, route tables, IGW, EC2, CloudFront, API Gateway, IAM, ELB, Auto Scaling, CloudWatch, EFS, NFS, EBS, S3, RDS, Lambda, SQS, SNS, Security Groups
- 5+ years of experience with Terraform and Terragrunt
- 5+ years of experience with event processing infrastructure (e.g., Kafka)
- 2+ years of experience as a Data Engineer with Databricks, including data pipelines, Debezium, Spark, and data modeling
- Expert proficiency with Python
- Model serving experience
- Expert proficiency deploying, maintaining, and scaling applications
- Proficiency with Docker, Kubernetes, and Serverless functions
- Expert proficiency in setting up CI/CD pipelines and governance
- Experience creating and maintaining fully automated CI/CD pipelines using Git, CircleCI, AWS CodeBuild, CodeDeploy, and CodePipeline
- Proficient with both relational and non-relational databases
- Experience with security vulnerability scanning tools such as GuardDuty and Inspector
- Experience building monitoring dashboards and using CloudWatch, Datadog, and Sumo Logic
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Pivotal Solutions is a national staffing and consulting firm founded in 2002 that specializes in matching job seekers and companies for roles in IT & Technology and Accounting & Finance. They offer a variety of staffing solutions, including Direct Hire and Contract-to-Hire placements, serving a diverse client base that ranges from innovative startups to Fortune 500 companies across the United States.
