Senior Data Engineer

Posted Yesterday
Be an Early Applicant
2 Locations
In-Office
Senior level
Professional Services
The Role
Design, build, and optimize scalable Azure cloud data platforms and high-performance ETL pipelines using Synapse, ADF, Spark, SQL, and Python. Implement data models, DataOps/CI-CD, quality checks, cost and performance optimizations, troubleshoot production issues, and collaborate with clients and stakeholders while mentoring junior engineers.
Summary Generated by Built In

At ProArch, we partner with businesses around the world to turn big ideas into better outcomes through IT services that span cybersecurity, cloud, data, AI, and app development. We’re 400+ team members strong across 3 countries (we call ourselves ProArchians)—and here’s what connects us all:

  • A love for solving real business problems
  • A belief in doing what’s right

What’s it like to work here?

  • You’ll keep growing. You’ll work alongside domain experts who love to share what they know.
  • You’ll be supported, heard, and trusted to make an impact.
  • You’ll take on projects that touch industries, communities, and lives.
  • You’ll have the time to focus on what matters most in your life outside of work.

At ProArch, you’ll be part of teams that design and deliver technology solutions solving real business challenges for our clients. With services spanning AI, Data, Application Development, Cybersecurity, Cloud & Infrastructure, and Industry Solutions, your work may involve building intelligent applications, securing business‑critical systems, or supporting cloud migrations and infrastructure modernization. 

Every role here contributes to shaping outcomes for global clients and driving meaningful impact. You’ll collaborate with experts across data, AI, engineering, cloud, cybersecurity, and infrastructure—solving complex problems with creativity, precision, and purpose. You’ll join a culture rooted in technology, curiosity, and continuous learning. A place where we move fast, trust you to make an impact, encourage innovation, and support your growth.

Job Summary:

ProArch is seeking a Senior Data Engineer with 5–8 years of experience to join our Data & Analytics practice. In this role, you will design, develop, and optimize scalable cloud-based data solutions that support enterprise analytics, reporting, and AI initiatives. You will work with large-scale datasets using Azure Data Platform technologies, build high-performance data pipelines, and collaborate directly with business and client stakeholders to deliver reliable, secure, and scalable data solutions.

The ideal candidate has strong expertise in SQL, Python, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, and Microsoft Fabric (preferred), along with solid experience in data modelling, DataOps, and client-facing engagements.

Responsibilities:

  • Design, develop, and optimize scalable data pipelines using Azure Synapse Analytics, Spark Pools, Azure Data Factory (ADF), and Azure Data Lake.
  • Develop high-performance solutions using SQL and Python, ensuring scalability, maintainability, and optimized query performance.
  • Build and manage modern data platforms on Microsoft Azure, supporting structured and unstructured data ingestion at enterprise scale.
  • Design and implement robust data models, including dimensional modelling and Slowly Changing Dimensions (SCD), to support reporting and analytics.
  • Optimize data partitioning, indexing, storage, versioning, and compute costs for large-scale cloud workloads.
  • Implement CI/CD pipelines and adopt DataOps best practices for automated deployment, testing, and monitoring.
  • Ensure data quality through unit testing, validation frameworks, and automated quality checks.
  • Collaborate directly with clients, business stakeholders, architects, and cross-functional teams to gather requirements, design solutions, and provide technical guidance.
  • Troubleshoot production issues, perform root cause analysis, and recommend performance improvements.
  • Mentor junior engineers by promoting engineering best practices, code quality, and technical excellence.

Requirements
  • Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field.
  • 5–8 years of experience in Data Engineering with strong expertise in enterprise cloud data platforms.
  • Strong hands-on experience with SQL and Python, including performance tuning and optimization.
  • Extensive experience with Azure Synapse Analytics, Azure Data Factory (ADF), Azure Data Lake, and other Azure data services.
  • Good understanding of Microsoft Azure architecture and cloud-native data engineering practices.
  • Experience with Microsoft Fabric is preferred.
  • Strong evidence of data modelling expertise, including dimensional modelling, star/snowflake schemas, Slowly Changing Dimensions (SCD), and data warehouse design.
  • Experience working with large-scale datasets involving high volume, velocity, and variety.
  • Hands-on experience implementing CI/CD pipelines and DataOps practices.
  • Strong analytical and troubleshooting skills with a focus on performance optimization.
  • Excellent communication skills with proven experience working directly with clients, understanding business requirements, conducting technical discussions, and delivering customer-focused solutions.

Good to Have Skills:

  • Experience with Microsoft Fabric, Lakehouse, and OneLake.
  • Knowledge of Delta Lake, versioned data, and advanced partitioning strategies.
  • Experience implementing data governance, security, and compliance frameworks.
  • Exposure to cloud cost optimization strategies across storage and compute.
  • Experience with Spark performance tuning and distributed data processing.
  • Familiarity with Power BI integration and enterprise analytics platforms.
  • Experience mentoring junior engineers or leading technical initiatives.

Skills Required

  • Bachelor's degree in Computer Science, IT, Data Engineering or related field.
  • 5-8 years of experience in Data Engineering with enterprise cloud data platforms.
  • Strong hands-on experience with SQL, including performance tuning and optimization.
  • Strong hands-on experience with Python.
  • Extensive experience with Azure Synapse Analytics.
  • Experience with Spark / Synapse Spark Pools and distributed data processing.
  • Extensive experience with Azure Data Factory (ADF).
  • Extensive experience with Azure Data Lake.
  • Good understanding of Microsoft Azure architecture and cloud-native data engineering practices.
  • Evidence of data modelling expertise (dimensional modelling, star/snowflake, SCD, data warehouse design).
  • Experience working with large-scale, high-volume datasets.
  • Hands-on experience implementing CI/CD pipelines and DataOps practices.
  • Strong analytical and troubleshooting skills focused on performance optimization.
  • Excellent communication skills and proven experience working directly with clients and stakeholders.
  • Experience with Microsoft Fabric, Lakehouse, and OneLake.
  • Knowledge of Delta Lake, versioned data, and advanced partitioning strategies.
  • Experience implementing data governance, security, and compliance frameworks.
  • Exposure to cloud cost optimization strategies across storage and compute.
  • Experience with Spark performance tuning.
  • Familiarity with Power BI integration and enterprise analytics platforms.
  • Experience mentoring junior engineers or leading technical initiatives.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Atlanta, GA
409 Employees
Year Founded: 2006

What We Do

ProArch was founded on the belief that a future where change is ‘business as usual’ is fundamentally more exciting than one where it is not. We accelerate value and increase resilience for our clients with consulting and technology - enabled by cloud, guided by data, fueled by apps, and secured by design

Similar Jobs

CDW Logo CDW

Senior Data Engineer

Information Technology
Hybrid
Hyderabad, Telangana, IND
15100 Employees

Capco Logo Capco

Senior Data Engineer

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Micron Technology Logo Micron Technology

Senior Data Engineer

Artificial Intelligence • Hardware • Information Technology • Machine Learning
In-Office
Hyderabad, Telangana, IND
45000 Employees

JPMorganChase Logo JPMorganChase

Data Engineer

Financial Services
Hybrid
Hyderabad, Telangana, IND
289097 Employees

Similar Companies Hiring

ABN AMRO Clearing USA LLC Thumbnail
Information Technology • Professional Services • Financial Services
Chicago, IL
215 Employees
Fora Thumbnail
Agency • On-Demand • Professional Services • Sales • Software • Travel • Hospitality
New York, NY
200 Employees
Energy CX Thumbnail
Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Chicago, IL
108 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account