Zero-Shot Learning
576 papers with code • 19 benchmarks • 29 datasets
Zero-shot learning (ZSL) is a model's ability to detect classes never seen during training. The condition is that the classes are not known during supervised learning.
Earlier work in zero-shot learning use attributes in a two-step approach to infer unknown classes. In the computer vision context, more recent advances learn mappings from image feature space to semantic space. Other approaches learn non-linear multimodal embeddings. In the modern NLP context, language models can be evaluated on downstream tasks without fine tuning.
Benchmark datasets for zero-shot learning include aPY, AwA, and CUB, among others.
( Image credit: Prototypical Networks for Few shot Learning in PyTorch )
Further readings:
Benchmarks
These leaderboards are used to track progress in Zero-Shot Learning
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
Libraries
Use these libraries to find Zero-Shot Learning models and implementations
CUB-200-2011
Oxford 102 Flower
PASCAL Context
AwA
SNIPS
AwA2
aPY
TVQA
LSMDC
MIT-States
Subtasks
Most implemented papers
Learning Transferable Visual Models From Natural Language Supervision
openai/CLIP
•
•
State-of-the-art computer vision systems are trained to predict a fixed set of predetermined object categories.
Language Models are Few-Shot Learners
By contrast, humans can generally perform a new language task from only a few examples or from simple instructions - something which current NLP systems still largely struggle to do.
LLaMA: Open and Efficient Foundation Language Models
facebookresearch/llama
•
•
arXiv 2023
We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters.
Prototypical Networks for Few-shot Learning
jakesnell/prototypical-networks
•
•
NeurIPS 2017
We propose prototypical networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each new class.
BioBERT: a pre-trained biomedical language representation model for biomedical text mining
dmis-lab/biobert
•
•
Biomedical text mining is becoming increasingly important as the number of biomedical documents rapidly grows.
Learning to Compare: Relation Network for Few-Shot Learning
floodsung/LearningToCompare_FSL
•
•
CVPR 2018
Once trained, a RN is able to classify images of new classes by computing relation scores between query images and the few examples of each new class without further updating the network.
Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Ugly
Due to the importance of zero-shot learning, i. e. classifying images where there is a lack of labeled training data, the number of proposed approaches has recently increased steadily.
Learning Deep Representations of Fine-grained Visual Descriptions
hanzhanggit/StackGAN-v2
•
•
CVPR 2016
State-of-the-art methods for zero-shot visual recognition formulate learning as a joint embedding problem of images and side information.
GPT-4 Technical Report
We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs.
Sampling Matters in Deep Embedding Learning
CompVis/metric-learning-divide-and-conquer
•
•
ICCV 2017
In addition, we show that a simple margin based loss is sufficient to outperform all other loss functions.
