Role: Senior Data Engineer

Contract: 1 year

Location: Remote within Canada

Clearance: Must be in Canada for the past 5 years to be eligible for 1st level clearance

Requirements:

• Programming experience in Spark using modern languages such as Python and Scala
• Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes
• Experience leading Data Engineering principles within an organization/team.
• Experience working with Integration patterns and technologies such as Azure Event Hub, Function App and C#
• Knowledge and expertise of database modelling techniques: Data Vaults, Star, Snowflake, 3NF, etc.
• Experience working with streaming data architecture and technologies for real-time: Spark Streaming, Kafka, Flink, Storm
• Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform
• Increase the overall quality of data pipeline development through DevSecOps
• Experience working with relational and non-relational database technologies: SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase
• Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, and Nexus
• Experience within the Azure environment
• Strong Python, Scala and Spark experience
• Experience modernizing data platforms.
• Experience with Azure Functions and C#
• 2 to 3 projects developing Data Vault