Data Engineer

Posted 5 Days Ago
Mountain View, CA
Mid level
Information Technology • Consulting
The Role
The Data Engineer will design and develop data pipeline architectures, optimize data flow, and support cross-functional teams. Responsibilities include building infrastructures for data extraction, transforming and loading data, developing analytics tools for insights, and collaborating to enhance data systems functionality.
Summary Generated by Built In

Job Brief:
VentureDive is seeking a highly experienced Data Engineer to join our growing team of analytics experts. The hire will be responsible for leading and expanding our data and data pipeline architecture, as well as driving data flow optimization and collection across multiple teams and products.
The Data Engineer will provide technical leadership and support to software developers, database architects, data analysts, and data scientists on data initiatives, and will ensure optimal data delivery architecture is consistent throughout ongoing and future projects. He/She must be able to drive technical solutions and provide guidance to multiple teams, systems, and stakeholders, while staying up to date with industry trends and emerging technologies.
VentureDive Overview:
Founded in 2012 by veteran technology entrepreneurs from MIT and Stanford, VentureDive is the fastest growing technology company in the region that develops and invests in products and solutions that simplify and improve the lives of people world-wide. We aspire to create a technology organization and an entrepreneurial ecosystem in the region that is recognized as second to none in the world.
Key Responsibilities:

  • Lead the design and development of optimal data pipeline architecture and provide technical guidance to the team.
  • Collaborate with cross-functional teams, including the Product, Data, and Design teams, to identify, design, and implement internal process improvements that optimize data delivery, automate manual processes, and enhance infrastructure scalability.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and cloud 'big data' technologies.
  • Develop analytics tools that utilize the data pipeline to provide actionable insights into
    customer acquisition, operational efficiency, and other key business performance metrics.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Lead efforts to strive for greater functionality in our data systems and collaborate with data and analytics experts to identify areas for improvement.


Experience:

  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL), as well as working familiarity with a variety of non-relational databases (MongoDB)
  • Proven track record of building and optimizing 'big data' data pipelines, architectures, and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytics skills related to working with structured and unstructured datasets.
  • Ability to build processes supporting data transformation, data structures, metadata dependency, and workload management.
  • Successful history of manipulating, processing, and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Strong project management and organizational skills.
  • Experience leading and supporting cross-functional teams in a dynamic environment.


Required Qualifications:

  • Bachelor's or Graduate degree in Computer Science, Information Systems, or another quantitative field.
  • 4+ years of relevant work experience in data engineering, data architecture, or a related field such as software engineering
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
  • Experience with cloud services such as AWS, Azure, or GCP.
  • Expertise in object-oriented/object function scripting languages such as Python, Java, C++, Scala, etc.
  • Experience leading and managing technical teams.
  • Data pipeline
  • Big data tools such as Hadoop, Spark, Kafka, etc.
  • Stream-processing systems such as Storm, Spark-Streaming, etc.


In order to thrive at VentureDive, you
…are intellectually smart and curious
…have the passion for and take pride in your work
…deeply believe in VentureDive’s mission, vision, and values
…have a no-frills attitude
…are a collaborative team player
…are ethical and honest
Are you ready to put your ideas into products and solutions that will be used by millions?
You will find VentureDive to be a quick pace, high standards, fun and a rewarding place to work at. Not only will your work reach millions of users worldwide, you will also be rewarded with competitive salaries and benefits. If you think you have what it takes to be a VenDian, come join us ... we're having a ball!
#LI-Hybrid

Top Skills

SQL
The Company
HQ: Mountain View, California
379 Employees
On-site Workplace
Year Founded: 2012

What We Do

VentureDive is an award-winning digital development company that builds cutting-edge technology solutions to improve lives globally. Since its inception in 2012, the firm has enabled two tech unicorns and successfully driven digital transformation initiatives for large enterprises. Led by co-founders Atif Azim and Shehzaad Nakhoda, VentureDive has a presence in Silicon Valley, London, Portugal, Dubai, and Pakistan. To learn more, visit https://www.venturedive.com.

Similar Jobs

BlackLine Logo BlackLine

Principal Data Engineer - Snowflake

Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Hybrid
Pleasanton, CA, USA
1810 Employees
201K-269K Annually

Snap Inc. Logo Snap Inc.

Data Engineer, 7+ Years of Experience

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
4 Locations
5000 Employees
172K-303K Annually

Snap Inc. Logo Snap Inc.

Data Engineer, 3+ Years of Experience

Artificial Intelligence • Cloud • Machine Learning • Mobile • Software • Virtual Reality • App development
5 Locations
5000 Employees
129K-228K Annually

Navan Logo Navan

Data Engineer

Fintech • Information Technology • Payments • Productivity • Software • Travel • Automation
Easy Apply
Palo Alto, CA, USA
3000 Employees
94K-165K Annually

Similar Companies Hiring

Silverfort Thumbnail
Security • Sales • Information Technology • Cybersecurity • Automation
GB
357 Employees
Jobba Trade Technologies, Inc. Thumbnail
Software • Professional Services • Productivity • Information Technology • Cloud
Chicago, IL
45 Employees
InCommodities Thumbnail
Renewable Energy • Machine Learning • Information Technology • Energy • Automation • Analytics
Austin, TX
234 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account