Senior Bigdata Quality Engineer
RBC Capital
Job Description
What's the opportunity?
As part of the Global Functions Technology (GFT) within RBC's Technology and Operations division, you'll be at the heart of a team that extends its services across the organization, offering IT solutions that drive transformation and efficiency. Our collaborative efforts span various domains including Risk, Finance, HR, CAO, Audit, Legal, Compliance, Financial Crime, Capital Markets, Personal and Commercial Banking, and Wealth Management. Moreover, we're at the forefront of creating digital tools and platforms that foster better collaboration across the board.
In this dynamic environment, you'll have the opportunity to work closely with leadership that values the recognition of achievements and the sharing of insights across teams to fuel continuous improvement.
Joining our Finance IT Data As a Service team, you'll play a crucial role in overseeing Test Implementation and Test Automation on our cutting-edge Big Data Platform. This role involves working with the latest technologies and programming languages such as Cloudera, Spark, Scala, Unix, SQL, Python, and leveraging GenAI.
Your primary responsibility will be to lead the team in supporting QE Automation for our diverse client groups, alongside managing test execution. This position offers a unique chance to showcase and further develop your technical and architectural expertise, as well as your leadership capabilities, all while delivering IT solutions in a fast-paced and ever-changing business landscape.
What you will do?
Lead QE strategy for data pipelines from ingestion to consumption, aligning quality gates, KPIs, and SLAs with business priorities.
Design and automate ETL testing using Python (Pandas, PySpark) and SQL, validating transformations, aggregations, and business rules across HDFS, Hive, and Spark.
Build and maintain robust automated test suites (Robot Framework, Selenium) with CI/CD integration (GitHub Actions, Jenkins, UrbanCode Deploy).
Implement data quality assurance: reconciliation of source vs target, accuracy/completeness/consistency validation, lineage checks, and Tableau-based quality dashboards.
Test Spark jobs, Hive queries, and YARN performance; validate real-time streaming pipelines; conduct load and performance testing at scale; ensure data masking and privacy compliance.
Introduce Generative AI and Agentic AI in QE: AI-generated test cases and SQL, autonomous test agents for data validations, self-healing pipelines, intelligent triage and root-cause analysis, and AI-assisted documentation.
Partner with data engineers, SRE, and product teams to improve testability, resilience, and observability; participate in code reviews for application and test code.
Own test environment strategy and data management (qTest, JIRA), drive shift-left testing, and enable continuous testing in Agile/Scrum workflows.
Mentor QE engineers, standardize frameworks and reusable components, and scale best practices across portfolios.
What you’ll impact
Reliability and accuracy of critical data processing that powers Finance, Risk, Audit, Compliance, and enterprise reporting.
Faster, predictable releases through standardized automation, early validation, and AI-enabled quality acceleration.
Reduced operational risk via proactive defect prevention, audit-ready artifacts, and governance-aligned controls.
What you’ll need to thrive
Must-Haves
5+ years hands-on QE in Big Data environments, with ownership of end-to-end automation and release quality.
Strong foundation: Computer Science degree or equivalent experience.
Test automation mastery: Robot Framework, Selenium, CI/CD pipelines (GitHub Actions/Jenkins), quality gates, and reporting.
Code & automation expertise: Python (Pandas, PySpark), Scala, Shell scripting, SQL; reusable libraries and modular frameworks.
Big Data excellence: HDFS, Hive, YARN, Spark; automated testing across ingestion → enrichment → transformation → consumption; lineage validation; scale performance testing.
Generative AI and Agentic AI: practical use of GitHub Copilot or similar, prompt engineering for test generation, autonomous agents for validations and triage, guardrail design, model/result validation, and responsible AI practices.
Quality leadership: risk-based testing, compliance-aware validation, performance benchmarking, data masking in non-prod, and executive-ready reporting.
DevOps/toolchain: JIRA, qTest, GitHub, Jenkins, UrbanCode Deploy; observability and issue remediation with SRE.
Bonus points
Experience with data governance, audit readiness, and privacy-preserving testing.
AI/ML ops exposure: dataset curation, validation, synthetic data generation for tests.
Experience with streaming (Kafka/Flink) and lakehouse/medallion architectures (Delta/Hudi/Iceberg).
What’s in it for you
Total Rewards: competitive compensation, bonuses, flexible benefits, stock (where applicable).
Coaching-based leadership, world-class training, and opportunities to grow responsibility.
High-impact work in a collaborative, progressive, high-performing team delivering trusted solutions across RBC.
Ability to make a lasting impact on enterprise data quality and accelerate digital transformation.
#LIASPOST
#TechPJ
Job Skills
Application Testing, Decision Making, Detail-Oriented, Group Problem Solving, IT Quality Assurance, Long Term Planning, Predictive Analytics, Programming Languages, Software Product Testing, Test AutomationAdditional Job Details
Address:
City:
Country:
Work hours/week:
Employment Type:
Platform:
Job Type:
Pay Type:
Posted Date:
Application Deadline:
Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above
Our Employment Opportunities
At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.
Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.
RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.