Lead Data Engineer – Scotiabank

Title of the Job: Lead Data Engineer

Location: Toronto, ON

Job Description: Requisition ID: 208957Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.Data Engineer role will be responsible for designing, building, monitoring, tuning, and troubleshooting data pipelines for Global Finance & Risk Technology.Is this role right for you? In this role, you will:

• Develop and maintain robust data pipelines for the ingestion, transformation, and distribution of large datasets.
• Utilize services and tools to automate data workflows and streamline the data engineering process.
• Collaborate with other stakeholders to support data analysis, data mapping and reporting needs.
• Monitor application performance, identifying bottlenecks, and implementing improvements to enhance efficiency.
• Conduct data quality checks and implementing measures to ensure data accuracy and integrity.
• Stay current with emerging technologies and data engineering practices to recommend and adopt innovations that improve data systems.
• Provide technical expertise and support for data-related issues, including troubleshooting and resolving data pipeline failures.
• Document data engineering processes, creating data flow diagrams, and maintaining metadata for data lineage and cataloging.

Do you have the skills that will enable you to succeed in this role? We’d love to work with you if you have experience with:

• Experience using Streaming Architecture (Kafka) and Big Data Platform (Hadoop) is required.
• Strong SQL knowledge is needed.
• Experience in NiFi is desired.
• General Understanding of continuous integration/continuous deployment (CI/CD) pipelines
• Experience building CI/CD pipelines using GitHub, Artifactory etc. to reduce cycle times and ensure quality.
• Strong scripting skills (i. e. shell scripting for automation.
• Working experience with source control systems like Git.
• Exposure to working on cloud platforms like Azure/GCP/AWS
• Experience with Agile/Scrum development methodologies
• Team player with effective communication skills (verbal and written)
• Able to see tasks through to completion without significant guidance.
• Self-managed and results-oriented with sense of ownership is required.
• A university degree in Mathematics, Science, Engineering, Management or relevant.

What’s in it for you?

• We have an inclusive and collaborative working environment that encourages creativity, curiosity, and celebrates success!
• We provide you with the tools and technology needed to create beautiful customer experiences.
• You’ll get to work with and learn from diverse industry leaders, who have hailed from top technology companies around the world.
• Onsite cafeteria.
• Dress codes don’t apply here, being comfortable does.
• We offer a competitive total rewards package that includes a base salary, a performance bonus, company matching programs (pension & profit sharing), generous vacation, personal & sick days, personal development funding, maternity leave top-up, parental leave and much more.

Location(s): Canada : Ontario : TorontoScotiabank is a leading bank in the Americas. Guided by our purpose: “for every future”, we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. If you require technical assistance, please . Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.

Company Name: Scotiabank

Salary:

Apply for the job!