DevOps Engineer
Location: REMOTE
Description: Our client is currently seeking a DevOps Engineer
• Works as part of a lean agile DevOps team to deliver business solutions within the Xfinity Mobile
• Interacts with Architects, Business Owners, 3rd party vendors and, Peer DevOps teams to gather and analyze requirements
• Leads the integration of projects into operations including instrumentation, automation, and standardization
• Support defect analysis and resolution throughout SDLC- Participates in writing and executing integration, and system test procedures.
• Document final program and develop user instructions, software/hardware requirements, program input / outputs and execution / installation steps
• Provides final escalation on-call production support for developed applications
• Complies with all established procedures, standards and policies of Comcast- Other functions that may be assigned
• Punctual, regular, and consistent attendance Minimum Requirements
• Experience deploying, maintaining, managing, and configuring a Hadoop/Spark cluster
• Application performance tuning- TCP/IP and networking technologies and protocols
• Work closely with the database team, network team, BI team, and application teams to make sure that all the big data applications are highly available and performing as expected.
• At least 5+ years Linux Red Hat Linux systems administrator, including designing, deploying, administering, troubleshooting, and tuning Linux systems in a medium to large enterprise environment
o5+ years overall experience working in DevOps domain
o5+ years experience in CI/CD Tools - Jenkins, Ansible, Concourse, Liquibase
o2+ experience with cloud platform & tools - AWS, Cloud Foundry
o2+ Programming/scripting experience using Python, Java, Shell
oStrong Knowledge of managing Big Data ecosystem- Hadoop, Databricks is a plus
oExperience with containerized environment such as Kubernetes or Docker
oExperience with applications platform like Pentaho, Kafka/Zookeeper, Nginx
oExperience with code scanning tools such as SonarQube, White Source & Check Marx
oExperience with monitoring & logging tools - AppDynamics, Nagios, ELK, Splunk
oExperience with NoSQL Databases like MongoDB, Cassandra, GraphDB, Couchbase, DynamoDB
• Works as part of a lean agile DevOps team to deliver business solutions within Xfinity Mobile
• Designing and Implementing highly performant data ingestion pipelines from multiples sources using Apache Spark and/or Azure
• Accelerate the rate at which your colleagues iterate on code and deliver features to customers using the Databricks Platform or Databricks Runtime
• Interacts with Architects, Business Owners, 3rd party vendors and, Peer DevOps teams to deeply understand the data flow and business use cases
• Improve efficiency and productivity across the entire organization.
• Develop tools to be fast, CLIs intuitive, giving your colleagues (and yourself) the best experience possible
• Passionate for automation through automated workflows, automated testing, automated deployments, automated monitoring. Basically to automate away any tedious work
• Comfortable in a heterogeneous environment and able to quickly learn new technologies. The team deals with a variety of environments from Kubernetes services to Jenkins automation, Scala libraries to Python scripting, writing graph algorithms to debugging 3rd-party Javascript, Dev-Tools does it all.
• Able to quickly learn different codebases, dive into unfamiliar third-party projects (in unfamiliar languages!), and driving to go beyond what they say you can do "on the box"
• Become an expert in many more systems, languages, and tools than you may normally be comfortable with
• Application performance tuning- TCP/IP and networking technologies and protocols
• Responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
• Work closely with the database team, network team, BI team, and application teams to make sure that all the big data applications are highly available and performing as expected.
• Experience with setup all the configurations- Core-Site, HDFS-Site, YARN-Site and Map Red-Site.
• At least 5+ years Linux Red Hat Linux systems administrator, including designing, deploying, administering, troubleshooting, and tuning Linux systems in a medium to large enterprise environment
• At least 3 plus years' experience in application integration and automation with strong working knowledge of the following technologies / products / methodologies.
Competencies Minimum:
o A collaborative mindset and good communication skills
o Must have AWS Databricks with experience in Data Integrations
o Must be Strong in SQL SPARK/JAVA skills.
o Experience Performance Tuning of Spark SQL running on DATA LAKE storage
o Strong Knowledge on Databricks and Cluster Configurations.
o Strong understanding on Data Warehousing, Data Model, Data Validation, Data Migration
o Strong working knowledge of Linux OS
o Working knowledge in Python, Spark, Java
o Working knowledge of Scala a plus
o Should have experience in any other ETL tool and projects
o Working Experience with build systems
o Experience with Continuous Integration/Continuous Deployment frameworks
o Experience with container technologies, such as Docker
o Experience with monitoring frameworks for large systems
o Experience with cloud APIs (e.g., a public cloud such as AWS)
Contact: [email protected]
This job and many more are available through The Judge Group. Find us on the web at www.judge.com