Senior Software Engineer

Posted 7 Days Ago
Be an Early Applicant
Redmond, WA, USA
In-Office
120K-261K Annually
Senior level
Software • Quantum Computing • Metaverse • Infrastructure as a Service (IaaS)
The Role
Design, build, and own large-scale, fault-tolerant data processing pipelines (batch and streaming) using Spark/Flink and Azure. Optimize performance, implement data quality/anomaly detection, ensure governance/compliance, collaborate with data scientists and product teams, and apply AI tools across coding, testing, and validation for PiB-scale Bing/MSN logs.
Summary Generated by Built In
Overview

Are you a Senior Software Engineer who thrives in a cutting-edge environment where you get to work with some of the largest data volumes processing?  Are you excited to craft the most reliable data processing pipelines with Spark and Flink to process PiB level data every day? Are you passionate about using artificial intelligence tools and practices across the software development lifecycle and data processing? 

The Data and Insight team in Search Foundation organization leverages open-source technology to process our petabyte scale data of Bing and MSN logs and provide comprehensive insight into experiments. The team also supports the grounding business with Realtime signals and insight information and protects the Bing search through offline bot protection analysis and model training. 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. 


Responsibilities

You are a seasonal leader in building scalable data analytics/insights platform with PiB level data processing every day. You have a growth mindset to learn the cut-edge technology and apply it in daily work to change the status quo. You dive deep and resolve the challenging technical problem. You insist on the highest standard for system performance and reliability. You will be working on Bing mission critical analytical data and support the grounding business; processing at big data scale and need for generating real-time insights. You will be working in a hybrid technology space that combines the best from Azure and open-source world.  Other responsibilities may include:    

  • Design, build and own the optimal data processing architecture and systems for new data and analytics pipelines, dashboards and metrics leveraging Azure and open-source technologies.
  •    Build core datasets as well as scalable and fault-tolerant pipelines
  •    Build data anomaly detection, data quality checks, and optimize pipelines for ideal compute and storage systems while guaranteeing high quality and SLA datasets  
  • Understand the data compliance and data governance
  • Collaborate with cross functional partners including data scientists and product managers to design and develop end-to-end data assets that help improve our products.  
  • Hand on at least one data process technology like Spark, Flink, and message queue technology like Kafka, EventHub
  • Hand on data storage technology like HDFS, Azure blob etc
  • Leverage AI technology in coding/testing/Data processing/data validation. 

Qualifications

Required Qualifications: 

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
    • OR equivalent experience.

Preferred Qualification:

  • 6+ years of experience in one or more coding languages (C#, C++, Java)   
  • Familiar at least one data process technology like Spark, Flink, and message queue technology like Kafka, EventHub 
  • Have experience on cloud environment like Azure 
  • Have experience on data storage technology like HDFS, Azure blob etc 
  • Have experience in leveraging AI technology in coding or testing work. 
  • Fluence verbal and written English communication. 
  • 6+ years’ experience in backend service development, 2+ years’ experience in batch or streaming data processing to process the PiB level data. 
  • Domain expert on Spark or Flink to handle PiB level data every day. 
  • Experience in data pipeline performance optimization 
  • Experience to use AI in data processing and data validation 
  • Data compliance or governance experience is a plus 

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $160,200 - $261,000 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay


This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.



Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Skills Required

  • Bachelor's degree in Computer Science or related field AND 4+ years technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python (or equivalent experience)
  • 6+ years experience in one or more coding languages (C#, C++, Java)
  • Hands-on experience with at least one data processing technology (e.g., Apache Spark or Apache Flink)
  • Hands-on experience with message queue/streaming technologies (e.g., Kafka, Azure Event Hubs)
  • Experience with cloud environments, specifically Microsoft Azure
  • Experience with data storage technologies (e.g., HDFS, Azure Blob Storage)
  • Experience in backend service development and batch or streaming data processing at PiB scale (6+ years backend; 2+ years streaming/batch)
  • Domain expertise in optimizing Spark or Flink for PiB-scale data processing and pipeline performance optimization
  • Experience leveraging AI technologies in coding, testing, data processing, or data validation
  • Data compliance and data governance experience
  • Fluent verbal and written English communication

Microsoft Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Microsoft and has not been reviewed or approved by Microsoft.

  • Fair & Transparent Compensation Pay is presented as broadly competitive overall, with clear role/level/location variation and an emphasis on using posted ranges and band information for apples-to-apples comparisons.
  • Retirement Support Retirement benefits are described as a standout, highlighted by a strong 401(k) match structure and immediate vesting, plus additional plan features for tax-advantaged saving.
  • Parental & Family Support Family-oriented benefits are portrayed as a meaningful strength, with substantial paid parental leave and added supports like back-up care and adoption/surrogacy assistance.

Microsoft Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Redmond, WA
206,870 Employees
Year Founded: 1975

What We Do

At Microsoft, our mission is to empower every person and every organization on the planet to achieve more. Our mission is grounded in both the world in which we live and the future we strive to create. Today, we live in a mobile-first, cloud-first world, and the transformation we are driving across our businesses is designed to enable Microsoft and our customers to thrive in this world.

Similar Jobs

Metropolis Technologies Logo Metropolis Technologies

Senior Software Engineer

Artificial Intelligence • Computer Vision • Machine Learning • Payments • Real Estate • PropTech
Easy Apply
In-Office
Seattle, WA, USA
23100 Employees
170K-200K Annually

Motive Logo Motive

Senior Software Engineer

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Easy Apply
In-Office
2 Locations
4000 Employees
140K-193K Annually

Samsara Logo Samsara

Senior Software Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
United States
4000 Employees
155K-208K Annually

DFIN Logo DFIN

Senior Software Engineer

Fintech • Software
Remote or Hybrid
United States
1750 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account