Manager, Data Engineering
RBC Capital
Job Description
What is the opportunity?
We are seeking a talented Data Engineer to join the Operational Data, Information, and AI team in Personal and Commercial Operations. The candidate will play a critical role in the design, implementation, and optimization of our cloud data lakehouse. You'll work with cutting-edge technologies to design, develop, and optimize scalable data pipelines that handle large volumes of structured and unstructured data and serve as the data foundation for transformational Business Intelligence, Machine Learning, and AI initiatives.
What will you do?
- Build and maintain data pipelines: Design, develop, and optimize robust ELT pipelines using technologies such as Snowflake, Airflow, and Spark to process large-scale datasets
- Migrate legacy data pipelines: Leverage LLMs to simplify the migration of existing data pipelines from legacy platforms such as our Unix, SQL Server, SAS, Hadoop, and Datameer to Snowflake.
- Monitoring and maintenance: Implement comprehensive monitoring, logging, and alerting for data pipelines; troubleshoot issues and ensure high availability of data systems
- Data quality and governance: Implement data validation, quality checks, and governance practices to ensure data integrity and compliance with enterprise policy
- Collaboration: Work in Agile squads with product owners, data scientists, BI developers, and engineers to deliver data solutions within agile frameworks.
What you need to succeed
Must-Haves
- 2+ years of experience in Data Engineering roles
- Strong programming skills in Python and SQL with experience in shell scripting and Unix environments
- Database expertise working with relational databases and data warehouses
- Data pipeline expertise with technologies such as Apache Spark, Airflow, or similar orchestration tools
- Experience with cloud platforms and version control systems
- Problem-solving mindset with attention to detail and ability to troubleshoot data issues
- Eagerness to learn new technologies and data engineering best practices
- Communication skills to work effectively with technical and business stakeholders
Nice-to-Haves
- Experience with Snowflake or completion of Snowflake certification
- Understanding of data governance frameworks, data quality monitoring practices, and data lineage tracking for enterprise data management
- Experience with Unix/Linux system maintenance and troubleshooting in enterprise environments.
- Containerization experience with Docker and enterprise container platforms
- Experience with LLM-based applications, vector databases, or GenAI frameworks
- Familiarity with prompt engineering, optimization, etc.
- Knowledge of machine learning deployment pipelines, model versioning, automated testing, and deployment automation frameworks.
What’s in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
- A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions and stocks where applicable.
- Leaders who support your development through coaching and managing opportunities.
- Ability to make a difference and lasting impact.
- Work in a dynamic, collaborative, progressive and high-performing teams
- Opportunities to take on progressively greater accountabilities
Job Skills
CBO, Concept of Operations, Critical Thinking, Datameer, Microsoft Excel, Microsoft PowerPoint, PySpark, Python for Data Analysis, Strategic Thinking, Structured Query Language (SQL), Workforce Management (WFM)Additional Job Details
Address:
City:
Country:
Work hours/week:
Employment Type:
Platform:
Job Type:
Pay Type:
Posted Date:
Application Deadline:
Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above
Inclusion and Equal Opportunity Employment
At RBC, we believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.
Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.