Discover Technata Job board

Find your next tech job in Kanata North, Canada’s largest technology park. Then explore endless international opportunities and dream about where your career will take you. With the Country’s largest density of technology companies ranging from promising startups to leading global giants, Kanata North is the place to be if you are serious about a career in tech.

Lead Data Engineer - (Databricks) - Remote Ontario

Quarry Consulting

Quarry Consulting

Data Science
Canada · Toronto, ON, Canada · Remote
Posted 6+ months ago

Role: Lead Data Engineer (Databricks)

Duration: 1-year remote contract (Ontario ONLY)

This client requires a Lead Data Engineer to architect, develop, and guide the implementation of modern data pipelines and cloud-native analytics solutions. Must have experience in Databricks, PySpark, and Azure cloud platforms.

MUST HAVES to be considered:

  • Hands-on experience in Databricks architecture, administration, and performance optimization
  • 7+ years of experience in data engineering, with a strong background in cloud-native data architecture.
  • Strong knowledge of Spark performance tuning and job optimization.
  • Proven expertise in Databricks SQL, PySpark, Delta Lake, and large-scale data pipelines.
  • Building reusable Python libraries with Pandas, Openpyxl, XLSXWriter, and PySpark.
  • Practical experience working with Unity Catalog for security and governance.
  • SQL expertise and hands-on experience with PostgreSQL, SQL Server, or similar.
  • DevOps expertise with tools like Azure DevOps, Git, and pipeline automation.