Senior Data Engineer - Google Cloud Platform
Scotiabank
Requisition ID: 205976
Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.
The Wealth Data engineering team within the Global Wealth Engineering (GWE) is the key team delivering operational data solutions to various stake holders within Wealth Management.
We are seeking an experienced Lead Data Engineer with deep expertise in Google Cloud Platform (GCP) to join our growing team. In this role, you will be responsible for designing, building, and maintaining scalable data architectures that support our data-driven initiatives. You will lead a team of engineers, collaborate with cross-functional teams including data architects, solution architects, business systems analysts and data engineers and ensure that our data infrastructure is robust, secure, and optimized for performance.
Is this role right for you? In this role you will:
- Designing, building, operationalizing the Wealth Data Hub (WDH) using Google Cloud Platform (GCP) data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner in combination with third parties such as Spark, Apache Beam/ composer, DBT, Cloud PubSub, Confluent Kafka, Cloud storage Cloud Functions & Github
- Lead, mentor, and develop a team of data engineers, fostering a culture of continuous learning and technical excellence. Oversee project timelines, resource allocation, and deliverables to ensure successful project completion. Drive the adoption of best practices in code quality, testing, and deployment
- Designing and implementing data ingestion patterns that will support batch, streaming and API interface on both the Ingress and Egress
- Lead in designing and building production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, BigQuery, DBT, SQL etc.
- Experience using Cloud Dataflow and Java/Python for deploying streaming jobs in GCP as well as batch jobs using text/JSON files and writing them to BigQuery
- Ability to do proof of technology using GCP technologies and work with data architects, solution architects to achieve the desired results and performance
- Communicate complex technical concepts to non-technical stakeholders, providing insights and recommendations. Collaborate with the DevOps team to automate and streamline CI/CD processes for data pipelines
- Optimize data processing performance, ensure high availability, scalability, and fault tolerance of data systems. Implement monitoring and alerting mechanisms to proactively identify and resolve issues. Conduct regular performance tuning and capacity planning
- Stay up to date with the latest trends and technologies in data engineering and cloud computing. Evaluate new tools and technologies to enhance the efficiency and effectiveness of our data infrastructure. Continuously improve processes and workflows to drive operational excellence
Do you have the skills that will enable you to succeed in this role? We’d love to work with you if you have:
- 10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developer
- Proven experience leading and mentoring engineering teams
- Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.
- Experience with data streaming and technologies such as Kafka, Spark-streaming etc.
- Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform
- Knowledge of Java microservices and Spring Boot
- Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure
- Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams
- Understanding of Wealth business line and the various data domains required for building an end-to-end solution
- Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field
- Active Google Cloud Data Engineer certification or Google Professional Cloud Architect certification
What's in it for you?
- Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
- Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.
- Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
- Competitive Rewards program including bonus, flexible vacation, personal, sick days and benefits will start on day one.
- Dynamic Ecosystem - Free tea & coffee, universal washrooms, and lots of space for team collaboration.
- Community Engagement - No matter where you choose to work from; we offer opportunities for community engagement & belonging with our various programs such as hackathons, contests, cooking with friends, Humans of Digital and much more!
Working location condition: Hybrid
#LI-Hybrid
Location(s): Canada : Ontario : Toronto
Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.
At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance, please click here. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.