Title: Data Engineer

Location: Old Toronto, ON - 2/3 times a week on-site

Duration: 6-month contract to start, Permanent role FT after

Key Responsibilities:

• Design, develop, and maintain data pipelines for handling large volumes of data streams using Apache Kafka.
• Implement real-time data processing solutions using Apache Flink or Apache Spark.
• Build and maintain RESTful APIs using Spring Boot to support data integration across systems.
• Design and implement workflow orchestration solutions using Temporal IO to ensure fault-tolerant, scalable, and reliable distributed systems.
• Develop and manage Temporal workflows for orchestrating complex data pipelines and processes.
• Work with NoSQL databases, ensuring optimal performance and scalability.
• Collaborate with cross-functional teams to deliver high-quality data solutions for business needs.
• Troubleshoot and optimize existing data pipelines and workflows to ensure efficiency and reliability.

Required Skills:

• Experience in data engineering or a related field.
• Strong proficiency in Apache Kafka for handling large-scale data streams.
• Expertise in Apache Flink or Apache Spark for real-time and batch data processing.
• Proven experience with Temporal IO or similar workflow orchestration frameworks (e.g., Cadence).
• Good understanding of Java and its related concepts.
• Experience building RESTful APIs with Spring Boot.
• Solid understanding of NoSQL databases (e.g., MongoDB, Cassandra).
• Familiarity with cloud environments and containerization (e.g., AWS, Docker) is a plus.