Data Engineer (Databricks)

| Chicago, IL
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Azure Data Engineer (Databricks)

3Cloud is a technology services firm helping clients transform their business through the power of the cloud. We leverage Microsoft Azure to help clients speed up innovation, operate more efficiently and be more responsive to their client’s needs. As a Microsoft partner, we specialize in Azure migration, cloud-scale custom application development, Internet of Things (IoT), analytics, and managed development (DevOps) achieved through Azure-enabled infrastructure automation. 3Cloud is headquartered in Chicago with an additional office in Dallas. Remote based, US only. 

As a consultant in the Data and Analytics Practice you will be responsible for delivering quality solutions using the Microsoft’s Azure suite of tools. This position has a focus on Databricks development, using Python, Scala, and Apache Spark. As a Databricks Developer, you will be able to demonstrate knowledge and expertise in data engineering best practices and concepts using Databricks. You will have intermediate to advanced knowledge with Spark architecture, including the Spark DataFrames API, and use of that API to explore, preprocess, join, and ingest data in Spark. You will also know how to read source data from a variety of formats and save data in Delta tables. You will be able to work with streaming data using various streaming APIs. You will also use your skills in SQL, including syntax expertise, performance tuning, identity management, and data access control. You will also understand Azure DevOps for structured development, including task management, and managed code deployment (including CI/CD pipelines). If you are an individual who is highly interested in Azure and Databricks technologies, you may be just who we are looking for to join our team.  This is a remote based role in US only. 

Responsibilities                                                                                                            

  • Support the development of high performing, reliable and scalable solutions
  • Clearly communicate technical details to business and management personnel
  • Work independently or on a team to design and develop database solutions
  • Assist business development team with pre-sales activities and RFPs

Qualifications

  • Bachelor’s Degree desired in Computer Science, Information Technology, or related field
  • Minimum of 5 years of experience with database design, at least 2 years with Azure technologies, and previous Consulting experience
  • Knowledge of Databricks development, including Scala, Python, and Spark
  • Advanced knowledge of SQL, including ability to write stored procedures, triggers, analytic functions, and performance tuning for Synapse
  • Ability to develop utilizing the following technologies:
    • Data Movement (Apache Spark, plus Azure Data Factory and legacy SSIS)
    • Data Warehousing (Azure Synapse, CosmosDB)
    • Azure Storage Technologies (Data Lake, Blob Storage)
  • Expertise in Spark DataFrames API and architecture to ingest and manipulate data, including exploring, preprocessing, joining, filtering, dropping sorting, partitioning, and renaming/manipulating columns in the dataset
  • Understanding of network infrastructure and security including
    • Workspace Deployment
    • Azure Cloud Concepts
    • Network Security

Professional Skills:

  • Eagerness to contribute in a team-oriented environment
  • Desire to work in an information systems environment
  • Excellent communication (written and oral) and interpersonal skills for both technical and non-technical teams
  • Passionate about learning new technologies
  • Analytical approach to problem-solving; ability to use technology to solve business problems
  • Ability to work in a fast-paced environment

Additional Preferred Experience:

  • Machine Learning/AI Practitioner expertise, including
    • Predictive, Prescription, and Descriptive Analytics using Data Science tools and technologies
    • Experience with Azure ML Studio/Services, and R programming language
    • Understanding of analysis models, including Supervised vs Unsupervised, Regression vs Classification, clustering, and cross-validation
    • Building, Tuning, and deploying analysis models with Spark ML and ML Flow
  • Knowledge of Power BI is a plus
  • Certifications are a plus
Read Full Job Description
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.

Technology we use

  • Engineering
    • .NETLanguages
    • C#Languages
    • JavaLanguages
    • JavascriptLanguages
    • PythonLanguages
    • SqlLanguages
    • Microsoft AzureLanguages

An Insider's view of 3Cloud

How would you describe the company’s work-life balance?

3Cloud has an excellent work-life balance. With the unlimited work from home policy, I have the ability to save myself time from a rather long, tedious commute and utilize that time to get more work done with higher quality. In addition to that, being closer to home allows me to spend more time with family, focus on things such as fitness, etc.

Sully

Associate Azure Consultant

What does your typical day look like?

My days are never the same - I juggle time, cost and quality to ensure all clients’ goals are met. Having exposure to open collaboration between teams that work with diverse technologies enables new growth opportunities. One thing stays consistent every day, though - I get to work on challenging projects with brilliant people.

Martyna

Senior Project Manager

How has your career grown since starting at the company?

I joined 3Cloud as a senior consultant. With the rapid pace at which 3Cloud has grown, the leaders recognized my leadership contributions and fast-tracked my career advancement to Delivery Director of our Cloud Infrastructure & Operations team. I lead seven seasoned architects that drive market leading Azure solutions for our clients.

Joe

Delivery Director

What is your vision for the company?

Our vision is to be the leading Microsoft Azure partner, both trusted by our clients and loved by our employees.

Mike

CEO

What are 3Cloud Perks + Benefits

3Cloud Benefits Overview

We believe our biggest perk is that we get to work with great clients on cutting-edge projects; our team members are challenged and develop amazing skills as they create. Our full benefits package targets life balance and connection.

Health Insurance & Wellness Benefits
Flexible Spending Account (FSA)
Dental Benefits
Health Insurance Benefits
Life Insurance
Onsite Gym
Retirement & Stock Options Benefits
401(K)
401(K) Matching
Performance Bonus
Child Care & Parental Leave Benefits
Generous Parental Leave
Remote Work Program
Vacation & Time Off Benefits
Generous PTO
Paid Holidays
Paid Sick Days
Perks & Discounts
Casual Dress
Company Outings
Stocked Kitchen
Some Meals Provided
Happy Hours
Parking
Professional Development Benefits
Job Training & Conferences
Lunch and learns
Cross functional training encouraged
Promote from within
Mentorship program
Time allotted for learning
Online course subscriptions available
Customized development tracks
Paid industry certifications
More Jobs at 3Cloud32 open jobs
All Jobs
Finance
Data + Analytics
Dev + Engineer
HR + Recruiting
Operations
Project Mgmt
Sales
Operations
new
Chicago, IL
Data + Analytics
new
Remote
Developer
new
Remote
Data + Analytics
new
Chicago, IL
Developer
new
Chicago, IL
Developer
new
Remote
Finance
new
Remote
Data + Analytics
new
Remote
Data + Analytics
new
Remote
Developer
new
Remote
Developer
new
Chicago, IL
Developer
new
Chicago, IL
Developer
new
Chicago, IL
Developer
new
Remote
Developer
new
Remote
Data + Analytics
new
Remote
Data + Analytics
new
Remote
Apply now
By clicking continue you agree to Built In’s Privacy Policy and Terms of Use.
Save jobView 3Cloud's full profileSee more 3Cloud jobs