Multi-task Learning

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2025 Mar 5 12:22
Editor
Edited
Edited
2025 Mar 5 12:44
Refs
Refs

MTL, Multi Task Model

Business needs:

  • Fresh Content CG
  • Trending Content CG
  • Tail Creator CG
  • Revenue Margin CG

MoE
way

  • Individual gating network for each task, rather than a single one for the entire model
  • Learn a per-task and per-sample weighting of each of the expert networks (instead of just a per-sample weighting)
 
 
 
 
 

Leveraging relationships across tasks

Cross-Task Knowledge Distillation in Multi-Task Recommendation
Multi-task learning (MTL) has been widely used in recommender systems, wherein predicting each type of user feedback on items (e.g, click, purchase) are treated as individual tasks and jointly...
Cross-Task Knowledge Distillation in Multi-Task Recommendation
Modeling the Sequential Dependence among Audience Multi-step...
In most real-world large-scale online applications (e.g., e-commerce or finance), customer acquisition is usually a multi-step conversion process of audiences. For example, an...
Modeling the Sequential Dependence among Audience Multi-step...
Behavior
Multi-task Ranking with User Behaviors for Text-video Search | Companion Proceedings of the Web Conference 2022
The signals used for ranking in local search are very different from web search: in addition to (textual) relevance, measures of (geographic) distance between the user and the search result, as well as measures of popularity of the result are important ...
Multi-task Ranking with User Behaviors for Text-video Search | Companion Proceedings of the Web Conference 2022
Multi-Scale User Behavior Network for Entire Space Multi-Task Learning
Modelling the user's multiple behaviors is an essential part of modern e-commerce, whose widely adopted application is to jointly optimize click-through rate (CTR) and conversion rate (CVR)...
Multi-Scale User Behavior Network for Entire Space Multi-Task Learning

Graph Recommender system

Multi-Task Learning of Graph-based Inductive Representations of Music Content - Spotify Research
Music streaming platforms rely heavily on learning meaningful representations of tracks to surface apt recommendations to users in a number of different use cases. In this work, we consider the task of learning music track representations by leveraging three rich heterogeneous sources of information: (i) organizational information (e.g., playlist co-occurrence), (ii) content information (e.g., audio... View Article

RL

Multi-Task Fusion via Reinforcement Learning for Long-Term User...
Recommender System (RS) is an important online application that affects billions of users every day. The mainstream RS ranking framework is composed of two parts: a Multi-Task Learning model (MTL)...
Multi-Task Fusion via Reinforcement Learning for Long-Term User...
 
 
 

Recommendations