SentenceTransformer Pretrained Models

	A	B	C	D	E	F	G
1	Model Name	Base Model	Pooling	Training Data	STSb Performance (Higher = Better)	Speed (Sent. / Sec on V100 GPU)	Comments

2	stsb-mpnet-base-v2	mpnet-base	Mean Pooling	NLI+STSb	88,57	2800
3	stsb-roberta-base-v2	roberta-base	Mean Pooling	NLI+STSb	87,21	2300
4	stsb-distilroberta-base-v2	distilroberta-base	Mean Pooling	NLI+STSb	86,41	4000
5	nli-mpnet-base-v2	mpnet-base	Mean Pooling	NLI	86,53	2800
6	stsb-roberta-large	roberta-base	Mean Pooling	NLI+STSb	86,39	830
7	nli-roberta-base-v2	roberta-base	Mean Pooling	NLI	85,54	2300
8	stsb-roberta-base	roberta-base	Mean Pooling	NLI+STSb	85,44	2300
9	stsb-bert-large	bert-large-uncased	Mean Pooling	NLI+STSb	85,29	830
10	stsb-distilbert-base	distilbert-base-uncased	Mean Pooling	NLI+STSb	85,16	4000
11	stsb-bert-base	bert-base-uncased	Mean Pooling	NLI+STSb	85,14	2300
12	nli-distilroberta-base-v2	distilroberta-base	Mean Pooling	NLI	84,38	4000
13	paraphrase-xlm-r-multilingual-v1	XLM-R	Mean Pooling	Paraphrase Data	83,50	2300
14	paraphrase-distilroberta-base-v1	distilroberta-base	Mean Pooling	Paraphrase Data	81,81	4000
15	nli-bert-large	bert-large-uncased	Mean Pooling	NLI	79,19	830
16	nli-distilbert-base	distilbert-base-uncased	Mean Pooling	NLI	78,69	4000
17	nli-roberta-large	roberta-large	Mean Pooling	NLI	78,69	830
18	nli-bert-large-max-pooling	bert-large-uncased	Max Pooling	NLI	78,41	830
19	nli-bert-large-cls-pooling	bert-large-uncased	CLS Token	NLI	78,29	830
20	nli-distilbert-base-max-pooling	distilbert-base-uncased	Max Pooling	NLI	77,61	4000
21	nli-roberta-base	roberta-base	Mean Pooling	NLI	77,49	2300
22	nli-bert-base-max-pooling	bert-base-uncased	Max Pooling	NLI	77,21	2300
23	nli-bert-base	bert-base-uncased	Mean Pooling	NLI	77,12	2300
24	nli-bert-base-cls-pooling	bert-base-uncased	CLS Token	NLI	76,3	2300
25	average_word_embeddings_glove.6B.300d	Word Embeddings: GloVe	Mean Pooling	-	61,77	34000	Average word embeddings with GloVe (6B, 300 dimension). Without stop-words
26	average_word_embeddings_komninos	Word Embeddings: Komninos et al.	Mean Pooling	-	61,56	22000	Average word embeddings with Komninos et al. embeddings (300 dimension). Without stop-words
27	average_word_embeddings_levy_dependency	Word Embeddings: Levy et al.	Mean Pooling	-	59,22	22000	Average word embeddings with Levy et al. dependency tree based embeddings (300 dimension). Without stop-words
28	average_word_embeddings_glove.840B.300d	Word Embeddings: GloVe	Mean Pooling		52,54	34000	Average word embeddings with GloVe (840B, 300 dimension). Without stop-words
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100