Data Engineer

Posted 21 Days Ago
Easy Apply
Bengaluru, Karnataka
1-3 Years Experience
Artificial Intelligence • Computer Vision • Machine Learning • Software • Energy
SparkCognition is a global leader in artificial intelligence software solutions.
The Role
As a Data Engineer at SparkCognition, you will be responsible for bringing large volumes of data from renewable energy sites to cloud, architecting scalable data ETL and MLOps pipelines, and working on engineering projects to design and maintain highly scalable data management systems.
Summary Generated by Built In

delivers world-class AI solutions that allow a business to solve their most critical problems, empowering them to run a more sustainable, safer, and profitable business. Our award-winning AI solutions predict future outcomes, optimize processes, and prevent cyberattacks. We partner with the world’s industry leaders to analyze, optimize, and learn from data. We augment human intelligence, drive profitable growth, and achieve operational excellence.

Drive change and create a footprint.

SparkCognition’s Renewable Suite is the world's leading AI enabled SaaS platform that provides asset performance management and prescriptive analytics software to ever growing renewable energy power plants by combining the power of machine learning, big data, and deep domain expertise. Our platform works across multiple asset types such as wind, solar, storage and DC coupled assets to offer insights to our customers across their fleets. As a you will be working closely with team members across domains with deep technical skills and passion for clean energy.

  • Bringing large volumes of data from wind, solar, storage sites to cloud
  • Architecting scalable data ETL and MLOps pipelines and workflows 
  • Work on engineering projects to design, construct, install, test and maintain highly scalable data management systems

  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. 
  • Experience with Python
  • 2+ years of experience building and optimizing ‘big data’ data pipelines, architectures 
    and data sets. Startup experience a plus
  • Experience building ETL pipelines from large disconnected datasets. 
  • Experience with big data tools: Hadoop, Spark, Kafka, etc. 
  • Experience with relational databases such as Postgres
  • Experience with Elasticsearch a plus

  • Experience in renewable energy or IoT time series data
  • Experience in workflow orchestration technologies like Airflow or Prefect
  • Experience with AWS cloud services: EC2, EMR, S3, RDS, Redshift or experience with GCP

Top Skills

Python
The Company
HQ: Austin, TX
360 Employees
Hybrid Workplace
Year Founded: 2013

What We Do

SparkCognition’s award-winning AI solutions predict future outcomes, prescribe next best actions, and help ensure worker safety. We partner with the world’s industry leaders to analyze, optimize, and learn from all types of data, augment human intelligence, drive profitable growth, and achieve operational excellence.

Our patented AI technologies, including machine learning, deep neural networks, natural language processing, and computer vision lead the industry in innovation and help accelerate digital transformation. Our solutions allow organizations to solve critical problems – prevent unexpected downtime, maximize asset performance, deliver net-zero initiatives, and eliminate accidents, all while avoiding zero-day cyberattacks.

SparkCognition’s products enable organizations to quickly capitalize on their data to provide real-time actionable insights, amplify their return on investment, and redefine best practices. Since inception, we have worked toward perfecting AI to accelerate market adoption and enhance, advance, and safeguard organizations, fostering a smarter, safer, and more sustainable future. To learn more, visit www.sparkcognition.com.

Why Work With Us

At SparkCognition, we have a culture of innovation – we tackle critical challenges with our teams of experts. We invest heavily in advancing the science of AI – our internal research group offers employees the opportunity to drive real scientific innovation. As a result, we have 170+ patents filed/pending in the US and globally.

Gallery

Gallery

Jobs at Similar Companies

Cencora Logo Cencora

Software Engineer II | Frontend / Javascript

Healthtech • Logistics • Software • Pharmaceutical
Pune, Maharashtra, IND
46000 Employees

Energy CX Logo Energy CX

Talent Acquisition Specialist

Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Easy Apply
Chicago, IL, USA
55 Employees
65K Annually
Remote
Louisville, CO, USA
69 Employees
51K-86K Annually

Similar Companies Hiring

TrainingPeaks (A Peaksware Company) Thumbnail
Software • Fitness
Louisville, CO
69 Employees
Energy CX Thumbnail
Utilities • Professional Services • Greentech • Financial Services • Energy • Consulting • Business Intelligence
Chicago, IL
55 Employees
Cencora Thumbnail
Software • Pharmaceutical • Logistics • Healthtech
Conshohocken, PA
46000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account