Senior Data Engineer

Posted Yesterday
Be an Early Applicant
2 Locations
In-Office
Senior level
Information Technology • Consulting
The Role
Build and optimize enterprise data engineering solutions using Oracle, Azure Databricks, SQL, PL/SQL, Python, and PySpark. Design ETL/ELT pipelines, complex transformations, and Silver and Gold data layers within a Delta Lakehouse architecture. Migrate Oracle business logic and data warehouse workloads to Databricks, implement governance through Unity Catalog, and perform schema analysis, validation, reconciliation, lineage, and performance optimization, including Finance datasets and reporting pipelines.
Summary Generated by Built In
Required Skills & Experience
    • 6-8 years of experience in Data Engineering, Data Warehousing.
    • Strong hands-on experience with Oracle databases, including Oracle ADW.
    • Strong expertise in SQL and PL/SQL, including:
    • Complex SQL queries.
    • Stored procedures and functions.
    • Views and database transformations.
    • Query optimization and performance tuning.
    • Hands-on experience with Azure Databricks.
    • Strong programming experience in Python and PySpark.
    • Experience building ETL/ELT pipelines and implementing complex data transformations.
    • Strong understanding of Delta Lake and Lakehouse architecture.
    • Experience designing and implementing Silver and Gold data layers.
    • Experience analysing existing database schemas, dependencies and transformation logic.
    • Ability to migrate or restructure Oracle SQL/PL/SQL business logic into Databricks.
    • Understanding of data governance and data access management using Unity Catalog.
    • Experience with data validation, reconciliation and performance optimization.
Preferred Skills
    • Experience with Oracle Autonomous Data Warehouse (ADW).
    • Hands-on experience with Databricks Lakehouse Federation.
    • Understanding of zero-copy or federated data access patterns.
    • Experience migrating enterprise data warehouse workloads from Oracle to Databricks.
    • Experience working with Finance datasets, including:
    • General Ledger (GL).
    • Actuals and financial transactions.
    • Budget and forecast data.
    • Cost centres and account structures.
    • Financial reporting datasets.
    • Experience optimizing large-scale Finance data pipelines and reporting datasets.
    • Understanding of enterprise data governance, lineage and data quality practices.

Skills Required

  • 6-8 years of experience in data engineering and data warehousing
  • Strong hands-on experience with Oracle databases, including Oracle ADW
  • Expertise in SQL and PL/SQL, including complex queries, stored procedures, functions, views, transformations, optimization, and performance tuning
  • Hands-on experience with Azure Databricks
  • Strong programming experience in Python and PySpark
  • Experience building ETL/ELT pipelines and implementing complex data transformations
  • Strong understanding of Delta Lake and Lakehouse architecture
  • Experience designing and implementing Silver and Gold data layers
  • Experience analyzing database schemas, dependencies, and transformation logic
  • Ability to migrate or restructure Oracle SQL/PLSQL business logic into Databricks
  • Understanding of data governance and data access management using Unity Catalog
  • Experience with data validation, reconciliation, and performance optimization
  • Experience with Oracle Autonomous Data Warehouse
  • Hands-on experience with Databricks Lakehouse Federation
  • Understanding of zero-copy or federated data access patterns
  • Experience migrating enterprise data warehouse workloads from Oracle to Databricks
  • Experience working with Finance datasets, including general ledger, actuals, financial transactions, budgets, forecasts, cost centers, account structures, and financial reporting datasets
  • Experience optimizing large-scale Finance data pipelines and reporting datasets
  • Understanding of enterprise data governance, lineage, and data quality practices
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Vaughan, Ontario
345 Employees
Year Founded: 2007

What We Do

@TechBlocks we power the software defined industries (SDI) of today and tomorrow. We are a software engineering and consulting firm. We build modern digital value chains and businesses reimagined to create frictionless experiences for innovative monetization methods and drive unforeseen efficiencies. We are known to build world class custom platforms and products that are cloud native for some of the worlds largest brands. We are the go to technology partners for born in digital businesses that grew with us from "Concept to Commercialization" and have revenues between $100M - $10B. We help modern businesses transition just from a technology outsourcing mentality to help create globally distributed digital COEs and mature them. Our converged COEs that we create in partnership with our clients help power software factories that are extremely dynamic. We have created modern digital COEs and factories that are created with a single minded goal to future proof our clients businesses. Everything we do is centred around two philosophies and practices - Design Thinking and Lean Engineering. Whether it is building digital commerce platforms, marketplace for worlds largest retailers or smart utilities applications and products or digital health products/platforms that power wearables, patches or devices across healthcare landscape; we do it all with speed and sophistication that is unmatched in the industry

Similar Jobs

TechBlocks Logo TechBlocks

Senior Data Engineer

Information Technology • Consulting
In-Office
2 Locations
345 Employees

Ciklum Logo Ciklum

Senior Data Engineer

Information Technology • Consulting
Remote or Hybrid
India
2995 Employees

Simform Logo Simform

Senior Data Engineer

Information Technology
In-Office
Ahmedabad, Gujarat, IND
845 Employees

TechBlocks Logo TechBlocks

Senior Data Engineer

Information Technology • Consulting
In-Office
2 Locations
345 Employees

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity • Defense • Defense Technology
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account