Sampling based two-tower

Creator
Creator
Seonglae Cho
Created
Created
2025 Mar 5 2:10
Editor
Edited
Edited
2025 Mar 5 12:13
Refs
Refs

Mixed negative sampling

Negative Sampling
for learning scores from large-scale data corpus. Dataset from the world is also unbalanced (positive interactions << negative interactions), so it tends to sample proper negative points rather than all negative pairs.
 
 

Batch Negatives (Unigram Sampling)

Uses other items in the same mini-batch as negative samples, which speeds up training but leads to popularity bias due to insufficient long-tail items.

2020 Google MNS (Unigram + Uniform Sampling)

Adding diverse negative samples improves recommendation quality.
 
 
 

Recommendations