Technical Lead – Databricks Champion

Posted 11 Days Ago
Be an Early Applicant
Bengaluru, Bengaluru Urban, Karnataka, IND
In-Office
Senior level
Information Technology • Consulting
The Role
Lead design and delivery of a scalable big-data platform: consult with Fortune 500 clients, design and implement distributed data solutions (ETL, APIs, integrations), mentor and hire engineers, productionize jobs, and stay hands-on with Spark/Hadoop and cloud technologies.
Summary Generated by Built In

Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world’s leading data-rich organizations across sectors such as CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges. Our global team specializes in cloud data modernization, predictive analytics, generative AI, and DataOps, supported by 10+ delivery centers and innovation hubs, including a major global presence in Bengaluru and operations across the USA, Canada, UK, Netherlands, Poland, Singapore, and India.
Recognized as a leader in the data and analytics space, Sigmoid is backed by Peak XV Partners and has consistently received accolades for innovation and rapid growth. Highlights include being named a ‘Leader’ in ISG’s Specialty Analytics Services for Supply Chain (2024), a two-time ‘India Future Unicorn’ by Hurun India, and a four-time honoree on both the Inc. 500 and Deloitte Technology Fast 500 lists.

Technical Lead – Data Engineering

As a Technical Lead, you will be responsible in building a highly-scalable and extensible big data platform that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.

This position reports to Engineering Manager.

Responsibilities: 

  • Align Sigmoid with key Client initiatives
    • Interface daily with customers across leading Fortune 500 companies to understand strategic requirements
    • Connect with VP and Director level clients on a regular basis.
    • Travel to client locations
    • Ability to understand business requirements and tie them to technology solutions
  • Facilitate in Technical Aspects
    • Design, develop and evolve highly scalable and fault-tolerant distributed components using Big data technologies.
    • Excellent experience in Application development and support, integration development and data management.
  • Provide technical leadership and manage it day to day basis
    • Guiding developers in day to day design and coding tasks
    • Play a key role in hiring technical talents to build the future of Sigmoid.
  • Stay up-to-date on the latest technology to ensure the greatest ROI for customer & Sigmoid
    • Hands on coder with good understanding on enterprise level code
    • Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems
    • Experience in defining technical requirements, data extraction, data transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment
  • Culture
    • Must be a strategic thinker with the ability to think unconventional / out:of:box.
    • Analytical and data driven orientation.
    • Raw intellect, talent and energy are critical.
    • Entrepreneurial and Agile : understands the demands of a private, high growth company.
    • Ability to be both a leader and hands on "doer". 

Qualifications: -

  • 8+ years of track record of relevant work experience and a computer Science or a related technical discipline is required
  • Experience in architecture and delivery of Enterprise scale applications and capable in developing framework, design patterns etc. Should be able to understand and tackle technical challenges, propose comprehensive solutions and guide junior staff
  • Proven track record of building and shipping large-scale engineering products and/or knowledge of cloud infrastructure such as GCP/AWS preferred
  • Experience working with large, complex data sets from a variety of sources
  • Experience with Hadoop, Spark, or similar stack a must
  • Experience with functional and object-oriented programming, Python or Scala a must
  • Effective communication skills (both written and verbal)
  • Ability to collaborate with a diverse set of engineers, data scientists and product managers
  • Technical knowledge in Spark, Hadoop & GCS Stack.
  • Comfort in a fast-paced start-up environment   

Preferred Qualification:

  • Experience in agile methodology
  • Development and support experience in Big Data domain
  • Architecting, developing, implementing and maintaining Big Data solutions
  • Experience with database modeling and development, data mining and warehousing.
  • Experience with Hadoop ecosystem (HDFS, MapReduce, Oozie, Hive, Impala, Spark, Kerberos, KAFKA, etc)

Note:

By submitting your application, you consent to being contacted by our Talent Acquisition team via phone call, email, SMS, WhatsApp, or other communication channels regarding your application and relevant career opportunities.

Skills Required

  • 8+ years relevant work experience
  • Bachelor's in Computer Science or related technical discipline
  • Experience architecting and delivering enterprise-scale applications and frameworks
  • Experience with Hadoop, Spark, or similar big-data stack
  • Experience with functional and object-oriented programming using Python or Scala
  • Experience working with large, complex datasets from multiple sources
  • Experience defining technical requirements, data extraction/transformation, automating and productionizing jobs
  • Hands-on coding and enterprise-level code understanding
  • Technical knowledge in Spark, Hadoop and GCS stack
  • Effective written and verbal communication skills
  • Proven track record building and shipping large-scale engineering products; knowledge of cloud infrastructure (GCP/AWS)
  • Experience with Hadoop ecosystem components (HDFS, MapReduce, Oozie, Hive, Impala, Kerberos, Kafka)
  • Experience in agile methodology and Big Data solution lifecycle (architecture, development, implementation, maintenance)
  • Ability to collaborate with diverse engineers, data scientists and product managers
  • Willingness to travel to client locations
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
499 Employees
Year Founded: 2013

What We Do

Sigmoid is a leading data engineering and AI solutions company that helps enterprises gain a competitive advantage with effective data-driven decision-making. Our team is strongly driven by the passion to unravel data complexities. We generate actionable insights and translate them into successful business strategies. We leverage our expertise in open-source and cloud technologies to develop innovative frameworks catering to specific customer needs. Our unique approach has positively influenced the business performance of our Fortune 500 clients across CPG, retail, banking, financial services, manufacturing, and other verticals. Backed by Sequoia Capital, Sigmoid has offices in New York, San Francisco, Dallas, Lima, Amsterdam, and Bengaluru. We are recognized among the world's fastest growing and innovative tech companies, winning several awards and recognition like the Deloitte Technology Fast 500, Financial Times- The Americas’ Fastest Growing Companies, Inc. 5000, Great Place To Work- India’s Best Leaders in Times of Crisis, Data Breakthrough, Aegis Graham Bell, TiE50, NASSCOM Emerge 50, and others. Learn more: https://www.sigmoid.com/ or https://sigmoid.com/careers/ for careers.

Similar Jobs

Optum Logo Optum

Senior Software Engineering Lead

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
160000 Employees

ZS Logo ZS

Manager - AI Engineering

Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
15000 Employees

Boeing Logo Boeing

Associate Materials and Process Research Engineer

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
170000 Employees

Boeing Logo Boeing

Process Engineer

Aerospace • Information Technology • Software • Cybersecurity • Design • Defense • Manufacturing
In-Office
Bengaluru, Bengaluru Urban, Karnataka, IND
170000 Employees

Similar Companies Hiring

Scrunch  Thumbnail
Artificial Intelligence • Information Technology • Marketing Tech • Software • SEO
Salt Lake City, Utah
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account