Self-Supervised Learning

Self-Supervised Learning

Creator
Creator
Seonglae ChoSeonglae Cho
Created
Created
2021 Apr 14 1:36
Editor
Edited
Edited
2025 Mar 24 12:27
Self-supervised learning (self-directed learning) is considered the efficient method for generating intelligence. Supervised learning have low efficiency in forming intellectual information through trials. Children also build their world model through observation rather than supervised learning.
Self-supervised learning defines a pretext task based on unlabeled inputs to produce descriptive and intelligible representations (Balestriero et al., 2023). This approach enables AI systems to learn from limited data by systematically generating and learning from self-created training examples.
Key characteristics:
  • Allows AI to learn efficiently from small datasets through self-generated systematic data
  • Example: From a single dog image, AI can:
    • Generate multiple rotated versions
    • Automatically extract and learn from distinctive features
 
 
 
 

Cookbook

 
 

Recommendations