Data Engineering Manager - Confidential
  • N/A, canada, Canada
  • via Whatjobs
CAD - CAD
Job Description

The Toronto hub will serve as the base of our new Data/AI team, dedicated to building a modern data infrastructure for advanced analytics and the development of responsible AI. This strategic investment is integral to for organization's vision for the future, aiming to develop cutting-edge Generative AI and analytical capabilities that will underpin the organization's Next-Gen research enablement platform and data products.This role demands exceptional leadership and technical prowess to drive the development of next-generation research enablement platforms and advanced data products leveraging AI/ML technologies.Provide technical leadership to implement a strategic data foundation roadmap on Azure Databricks, ranging from architectural design to data engineering to feature engineeringArchitect and implement production level data pipelines, including end-to-end pipeline load performance testing and optimizationResident technical expert in Lakehouse technology and delta lake, data governance, data ingestion and processing, data modeling and warehousingLead proof of concept use cases, estimating workload sizing, and custom architecturesMentor and train junior data engineersMinimum Qualifications:5-10 years experience in a technical role with balanced expertise in both these areas: Data Engineering/Lakehouse - Data Applications EngineeringExtensive experience with Azure Databricks for data engineering and ML pipelinesExperience maintaining and extending production data systems to evolve with complex needsExperience scaling big data workloads that are performant and cost-effectiveExperience designing data solutions on cloud infrastructure and services, such as AWS, Azure, or GCP using best practices in cloud security, data privacy and data governanceProduction programming experience in SQL and Python or ScalaBachelor's or Master’s degree in Computer Science, Information Systems, EngineeringProven leadership skills, a strategic mindset, and a passion for driving innovation in Data Engineering and AI/ML technologyExceptional stakeholder management and communication skills to effectively communicate across global teams.

;