Job Description Toast is recruiting on behalf of this company for a Senior Software Engineer, AI to join their Engineering team in Toronto. They are looking for an experienced backend engineer who is excited to build and optimize LLM-powered systems that help users uncover meaningful business insights.
Responsibilities
Design, build, and maintain backend systems that power LLM-driven and agentic workflows
Develop retrieval pipelines, orchestration layers, and multi‑step agent architectures that support scalable AI‑powered search experiences
Lead the evaluation of agentic systems using automated, offline, and human‑in‑the‑loop frameworks to measure relevance, quality, latency, and task success
Improve retrieval and ranking systems across hybrid retrieval, re‑ranking, query rewriting, and post‑retrieval synthesis
Optimize LLM‑powered workflows for speed, accuracy, reliability, and production readiness