Senior Data Engineer
Quarry Consulting
Quarry Consulting Inc. is currently seeking an Senior Data Engineer for one of our clients.
I’ve included the position requirements below. If you’re available immediately and interested in the opportunity, please reach out with your resume and I'd be happy to discuss next steps.
Looking forward to hearing from you!
Title: Senior Data Engineer
Location: Remote
Term: June 2025 to June 2026
Must be eligible for a Canadian Enhanced Reliability Security Clearance
Description of Service
The Senior Data Engineer Service Provider will lead the delivery of data solutions on a cloud-native analytics platform, driving the data engineering practice. This role requires experience in leading, designing, and implementing solutions while collaborating with stakeholders to deliver optimal results.
Specific Project Requirements:
- Increase the overall speed in which data is onboarded to the Data and Analytics platform.
- Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform
- Increase the overall quality of data pipeline development through DevSecOps
Top Skills Required:
- Programming experience in Spark using modern languages such as Python, Scala
- 2 to 3 projects developing Data Vault
- Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes
- Experience leading Data Engineering principles within an organization/team.
Other Skills Required:
- Experience working with Integration patterns and technologies such as Azure Event Hub, Function App and C#
- Knowledge and expertise of database modeling techniques: Data Vaults, Star, Snowflake, 3NF, etc.
- Experience working with streaming data architecture and technologies for real-time: Spark Streaming, Kafka, Flink, Storm
- Experience working with relational and non-relational database technologies: SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase
- Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus