As a DataOps/DevOps Enginner-2/Lead, you will be responsible for managing, design highly scalable and Available solution for data pipelines that provides the foundation for collecting, storing, modelling, and analysing massive data sets from multiple channels.
This position reports to DevOps Architect.
Responsibilities:
- Align Sigmoid with key Client initiatives
o Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
o Connect with VP and Director level clients on a regular basis.
o Travel to client locations
o Ability to understand business requirements and tie them to technology solutions
- Strategically support Technical Initiatives
o Design, manage & deploy highly scalable and fault-tolerant distributed components using Bigdata technologies.
o Ability to evaluate and choose technology stacks that best fit client data strategy and constraints
- Drive Automation and massive deployments
o Ability to drive good engineering practices from bottom up
o Develop industry leading CI/CD, monitoring and support practices inside the team
o Develop scripts to automate devOps processes to reduce team effort
o Work with the team to develop automation and resolve issues
- Support TB scale pipelines
o Perform root cause analysis for production errors
o Support developers in day-to-day devOps operations
o Excellent experience in Application support, integration development and data management.
o Design roster and escalation matrix for team
- Provide technical leadership and manage it day to day basis
o Guiding devOps in day-to-day design, automation & support tasks
o Play a key role in hiring technical talents to build the future of Sigmoid.
o Conduct training for technology stack for developers in house and outside
- Culture
o Must be a strategic thinker with the ability to think unconventional / out:of:box.
o Analytical and data driven orientation.
o Raw intellect, talent and energy are critical.
o Entrepreneurial and Agile: understands the demands of a private, high growth company.
o Ability to be both a leader and hands on "doer".
Qualifications:-
- 4 - 7 years track record of relevant work experience and a computer Science or a related technical discipline is required
- Proven track record of building and shipping large-scale engineering products and/or knowledge of cloud infrastructure such as Azure/AWS preferred
- Experience in Shell, Python, or any scripting language
- Experience in managing Linux systems, build and release tools like Jenkins
- Effective communication skills (both written and verbal)
- Ability to collaborate with a diverse set of engineers, data scientists and product managers
- Comfort in a fast-paced start-up environment
Preferred Qualification:
- Support experience in BigData domain
- Architecting, implementing, and maintaining Big Data solutions
- Experience with Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, Impala, Spark, Kerberos, KAFKA, etc)
- Experience in container technologies like Docker, Kubernetes & configuration management systems
Skills To Look At - Linux, AWS, Build & Release Tools, Scripting - Shell & Python, Docker, Kubernetes, Configuration Management and Databases, Hadoop, spark, ELK (Elastic Search, Logstash, Kibana), big data system such as (Influx DB or Elasticsearch or Cassandra), Ansible, Chef, Puppet
Top Skills
What We Do
Sigmoid is a leading data engineering and AI solutions company that helps enterprises gain a competitive advantage with effective data-driven decision-making. Our team is strongly driven by the passion to unravel data complexities. We generate actionable insights and translate them into successful business strategies.
We leverage our expertise in open-source and cloud technologies to develop innovative frameworks catering to specific customer needs. Our unique approach has positively influenced the business performance of our Fortune 500 clients across CPG, retail, banking, financial services, manufacturing, and other verticals.
Backed by Sequoia Capital, Sigmoid has offices in New York, San Francisco, Dallas, Lima, Amsterdam, and Bengaluru. We are recognized among the world's fastest growing and innovative tech companies, winning several awards and recognition like the Deloitte Technology Fast 500, Financial Times- The Americas’ Fastest Growing Companies, Inc. 5000, Great Place To Work- India’s Best Leaders in Times of Crisis, Data Breakthrough, Aegis Graham Bell, TiE50, NASSCOM Emerge 50, and others.
Learn more: https://www.sigmoid.com/ or https://sigmoid.com/careers/ for careers.
