Senior Data Engineer (AI Systems & ML)
<img src="https://app.gurulink.ca/img/gl_logo_112x112.jpg" border="0"><br><br><b>Location:</b> REMOTE / Toronto, Ontario - Canada<br><b>Job Type:</b> Permanent<br><br><b>Description:</b><p>We're looking for a Senior Data Engineer to join a team responsible for building the data infrastructure that powers large-scale machine learning and recommendation systems. You'll help design, develop, and optimize the data platform behind billions of intelligent decisions each day, supporting enterprise customers across a wide range of digital experiences.<br><br>In this role, you'll own the Spark-based data pipelines that feed production machine learning models, working closely with ML engineers, data scientists, and software engineers to build reliable, scalable, and high-performance data systems. You'll play a key role in developing the infrastructure that enables advanced AI-driven products and personalization capabilities, with the opportunity to influence architecture and solve complex data engineering challenges at scale.<br><br>What You'll Do<br><br>- Design, build, maintain, and optimize production data pipelines supporting AI and machine learning workloads at enterprise scale.<br>- Develop and scale Apache Spark batch processing pipelines, including cluster configuration, performance tuning, and optimization within Google Cloud.<br>- Build and maintain a centralized data platform that supports machine learning training, experimentation, and production inference.<br>- Partner closely with Machine Learning Engineers and Data Scientists to provide high-quality, reliable datasets for model development and evaluation.<br>- Monitor, troubleshoot, and improve the performance, reliability, and scalability of data processing systems.<br>- Collaborate with platform and distributed systems engineers to evolve the overall data architecture.<br>- Continuously improve the efficiency, reliability, and maintainability of the data infrastructure.<br>- Deliver data solutions and platform enhancements that provide measurable business impact.</p><br><b>Must Have skills:</b><p>What We're Looking For<br><br>- 5+ years of professional experience in Data Engineering.<br>- Strong expertise with Apache Spark, including extensive experience using the PySpark DataFrame API to solve large-scale data processing challenges.<br>- Experience designing, optimizing, and operating distributed data processing pipelines.<br>- Strong Python development skills, including unit testing, version control, code reviews, and CI/CD practices.<br>- Experience working with modern data storage formats such as Parquet and Delta Lake.<br>- Experience building or consuming streaming data pipelines using technologies such as Kafka.<br>- Hands-on experience with cloud infrastructure, preferably Google Cloud Platform.<br>- Strong understanding of query optimization and data processing performance tuning.<br>- Experience working with modern software development practices, including Docker, Kubernetes, GitHub Actions, and automated deployment pipelines.<br>- Excellent collaboration skills with cross-functional engineering teams, including Machine Learning Engineers, Data Scientists, and Platform Engineers.<br>- Comfortable working in a fast-moving, highly collaborative environment where ownership and continuous improvement are valued.<br><br>The base pay range for this position is $144K CAD - 188K CAD</p><br><b>Job Function:</b> Data Engineer<br><br><br>