SC2 영한번역 성능 비교

	A	B	C	D	E	F	G	H	I	J	K	L
1	모델	prompting	num examples	example groups	speaker info	Chr ROUGE-2	Chr ROUGE-3	Chr ROUGE-L	Mor ROUGE-1	Mor ROUGE-2	Mor ROUGE-L	Elapsed Sec.

2	Llama3.1 8B Inst	Default	0	-	-	0.3436	0.2338	0.4493	0.3697	0.1798	0.3295	158.69
3	Llama3.1 8B Inst	Default	10	1	FALSE	0.3634	0.2987	0.4405	0.3631	0.2422	0.3318	265.97
4	Llama3.1 8B Inst	Default	10	1	TRUE	0.3566	0.2956	0.4281	0.3738	0.2472	0.3424	278.81
5	Llama3.1 8B Inst	Default	10	3	FALSE	0.3589	0.2950	0.4378	0.3555	0.2375	0.3234	238.01
6	Llama3.1 8B Inst	Default	10	3	TRUE	0.3528	0.2939	0.4258	0.3639	0.2416	0.3323	244.94
7	Llama3.1 8B Inst	Default	10	5	FALSE	0.3535	0.2913	0.4318	0.3502	0.2350	0.3201	227.70
8	Llama3.1 8B Inst	Default	10	5	TRUE	0.3508	0.2923	0.4240	0.3610	0.2392	0.3301	239.75
9	Llama3.1 8B Inst	Alternative	10	1	FALSE	0.5795	0.4760	0.6510	0.5874	0.4027	0.5445	286.85
10	Llama3.1 8B Inst	Alternative	10	1	TRUE	0.5928	0.4913	0.6608	0.6007	0.4194	0.5582	300.06
11	Llama3.1 8B Inst	Alternative	10	3	FALSE	0.5854	0.4817	0.6548	0.5940	0.4065	0.5515	248.70
12	Llama3.1 8B Inst	Alternative	10	3	TRUE	0.5963	0.4944	0.6631	0.6045	0.4210	0.5602	266.28
13	Llama3.1 8B Inst	Alternative	10	5	FALSE	0.5855	0.4821	0.6550	0.5929	0.4072	0.5492	246.81
14	Llama3.1 8B Inst	Alternative	10	5	TRUE	0.5989	0.4967	0.6670	0.6056	0.4225	0.5621	261.80
15	Llama3.1 8B Inst	Numbered	10	1	FALSE	0.5839	0.4816	0.6519	0.5925	0.4096	0.5476	273.41
16	Llama3.1 8B Inst	Numbered	10	1	TRUE	0.5976	0.4984	0.6629	0.6068	0.4290	0.5639	286.80
17	Llama3.1 8B Inst	Numbered	10	3	FALSE	0.5912	0.4894	0.6590	0.6000	0.4163	0.5564	237.43
18	Llama3.1 8B Inst	Numbered	10	3	TRUE	0.6025	0.5035	0.6677	0.6116	0.4326	0.5678	253.50
19	Llama3.1 8B Inst	Numbered	10	5	FALSE	0.5944	0.4923	0.6622	0.6018	0.4191	0.5593	235.54
20	Llama3.1 8B Inst	Numbered	10	5	TRUE	0.6034	0.5032	0.6696	0.6116	0.4326	0.5694	251.32
21	Bllossom 8B Inst	Default	0	-	-	0.3634	0.2489	0.4706	0.3847	0.1885	0.3443	156.71
22	Bllossom 8B Inst	Default	10	1	FALSE	0.5235	0.4279	0.5930	0.5327	0.3585	0.4907	415.91
23	Bllossom 8B Inst	Default	10	1	TRUE	0.4848	0.4025	0.5475	0.5111	0.3429	0.4692	438.52
24	Bllossom 8B Inst	Default	10	3	FALSE	0.5118	0.4181	0.5803	0.5233	0.3510	0.4803	517.19
25	Bllossom 8B Inst	Default	10	3	TRUE	0.4655	0.3853	0.5308	0.4938	0.3306	0.4533	604.49
26	Bllossom 8B Inst	Default	10	5	FALSE	0.5245	0.4301	0.5927	0.5340	0.3626	0.4917	601.38
27	Bllossom 8B Inst	Default	10	5	TRUE	0.4774	0.3967	0.5406	0.5032	0.3397	0.4626	562.64
28	Bllossom 8B Inst	Alternative	10	1	FALSE	0.5812	0.4789	0.6523	0.5874	0.4029	0.5450	532.66
29	Bllossom 8B Inst	Alternative	10	1	TRUE	0.5953	0.4942	0.6627	0.6014	0.4188	0.5582	560.82
30	Bllossom 8B Inst	Alternative	10	3	FALSE	0.5852	0.4820	0.6548	0.5928	0.4064	0.5497	470.26
31	Bllossom 8B Inst	Alternative	10	3	TRUE	0.5982	0.4955	0.6649	0.6063	0.4215	0.5638	472.31
32	Bllossom 8B Inst	Alternative	10	5	FALSE	0.5861	0.4828	0.6551	0.5929	0.4073	0.5494	446.12
33	Bllossom 8B Inst	Alternative	10	5	TRUE	0.5987	0.4970	0.6657	0.6071	0.4231	0.5637	468.73
34	Bllossom 8B Inst	Numbered	10	1	FALSE	0.5855	0.4835	0.6556	0.5944	0.4131	0.5524	496.35
35	Bllossom 8B Inst	Numbered	10	1	TRUE	0.5971	0.4980	0.6626	0.6056	0.4263	0.5628	514.12
36	Bllossom 8B Inst	Numbered	10	3	FALSE	0.5883	0.4857	0.6576	0.5962	0.4095	0.5527	442.47
37	Bllossom 8B Inst	Numbered	10	3	TRUE	0.5999	0.4989	0.6662	0.6105	0.4269	0.5661	466.85
38	Bllossom 8B Inst	Numbered	10	5	FALSE	0.5896	0.4870	0.6580	0.5968	0.4123	0.5539	441.92
39	Bllossom 8B Inst	Numbered	10	5	TRUE	0.6002	0.4992	0.6662	0.6084	0.4259	0.5660	457.96
40	Qwen2 7B Inst	Default	0	-	-	0.3408	0.2300	0.4516	0.3873	0.1736	0.3469	163.26
41	Qwen2 7B Inst	Default	10	1	FALSE	0.5657	0.4644	0.6343	0.5795	0.3934	0.5323	277.16
42	Qwen2 7B Inst	Default	10	1	TRUE	0.5666	0.4681	0.6320	0.5807	0.3973	0.5337	286.17
43	Qwen2 7B Inst	Default	10	3	FALSE	0.5729	0.4702	0.6386	0.5858	0.3973	0.5372	239.98
44	Qwen2 7B Inst	Default	10	3	TRUE	0.5741	0.4750	0.6384	0.5883	0.4038	0.5400	248.67
45	Qwen2 7B Inst	Default	10	5	FALSE	0.5780	0.4754	0.6423	0.5895	0.4015	0.5412	236.79
46	Qwen2 7B Inst	Default	10	5	TRUE	0.5750	0.4759	0.6397	0.5896	0.4042	0.5428	247.26
47	Qwen2 7B Inst	Alternative	10	1	FALSE	0.5668	0.4629	0.6403	0.5733	0.3865	0.5289	287.27
48	Qwen2 7B Inst	Alternative	10	1	TRUE	0.5796	0.4776	0.6497	0.5862	0.4025	0.5410	301.97
49	Qwen2 7B Inst	Alternative	10	3	FALSE	0.5697	0.4648	0.6415	0.5775	0.3874	0.5299	254.37
50	Qwen2 7B Inst	Alternative	10	3	TRUE	0.5847	0.4805	0.6529	0.5937	0.4041	0.5461	267.39
51	Qwen2 7B Inst	Alternative	10	5	FALSE	0.5739	0.4684	0.6459	0.5790	0.3888	0.5316	252.32
52	Qwen2 7B Inst	Alternative	10	5	TRUE	0.5861	0.4814	0.6545	0.5920	0.4022	0.5445	259.72
53	Qwen2 7B Inst	Numbered	10	1	FALSE	0.5847	0.4847	0.6522	0.5963	0.4137	0.5507	287.41
54	Qwen2 7B Inst	Numbered	10	1	TRUE	0.5924	0.4930	0.6586	0.6032	0.4238	0.5594	300.26
55	Qwen2 7B Inst	Numbered	10	3	FALSE	0.5883	0.4862	0.6558	0.5989	0.4140	0.5526	248.82
56	Qwen2 7B Inst	Numbered	10	3	TRUE	0.5996	0.4986	0.6632	0.6100	0.4266	0.5629	258.12
57	Qwen2 7B Inst	Numbered	10	5	FALSE	0.5905	0.4886	0.6579	0.6006	0.4170	0.5558	244.54
58	Qwen2 7B Inst	Numbered	10	5	TRUE	0.6014	0.5009	0.6663	0.6119	0.4309	0.5667	254.08
59	Solar Ko 11B	Default	0	-	-	0.0006	0.0001	0.0013	0.0000	0.0000	0.0000	31.27
60	Solar Ko 11B	Default	10	1	FALSE	0.0203	0.0017	0.1246	0.0009	0.0003	0.0007	1649.35
61	Solar Ko 11B	Default	10	1	TRUE	0.0268	0.0070	0.1296	0.0048	0.0022	0.0044	1734.97
62	Solar Ko 11B	Default	10	3	FALSE	0.0234	0.0038	0.1300	0.0025	0.0011	0.0025	1231.26
63	Solar Ko 11B	Default	10	3	TRUE	0.0357	0.0145	0.1424	0.0102	0.0046	0.0097	1491.40
64	Solar Ko 11B	Default	10	5	FALSE	0.0232	0.0035	0.1301	0.0025	0.0010	0.0024	1216.85
65	Solar Ko 11B	Default	10	5	TRUE	0.0356	0.0140	0.1412	0.0099	0.0041	0.0093	1374.53
66	Solar Ko 11B	Alternative	10	1	FALSE	0.6058	0.5098	0.6683	0.6169	0.4447	0.5778	1705.69
67	Solar Ko 11B	Alternative	10	1	TRUE	0.6215	0.5268	0.6800	0.6330	0.4632	0.5930	1797.56
68	Solar Ko 11B	Alternative	10	3	FALSE	0.6095	0.5119	0.6705	0.6225	0.4448	0.5801	1269.33
69	Solar Ko 11B	Alternative	10	3	TRUE	0.6296	0.5355	0.6856	0.6433	0.4714	0.6017	1428.34
70	Solar Ko 11B	Alternative	10	5	FALSE	0.6116	0.5146	0.6739	0.6232	0.4484	0.5830	1304.94
71	Solar Ko 11B	Alternative	10	5	TRUE	0.6287	0.5340	0.6868	0.6405	0.4684	0.6002	1362.16
72	Solar Ko 11B	Numbered	10	1	FALSE	0.6045	0.5079	0.6671	0.6144	0.4412	0.5749	1666.70
73	Solar Ko 11B	Numbered	10	1	TRUE	0.6204	0.5274	0.6779	0.6298	0.4626	0.5890	1772.83
74	Solar Ko 11B	Numbered	10	3	FALSE	0.6112	0.5149	0.6740	0.6208	0.4479	0.5822	1318.63
75	Solar Ko 11B	Numbered	10	3	TRUE	0.6286	0.5357	0.6868	0.6400	0.4716	0.6010	1411.70
76	Solar Ko 11B	Numbered	10	5	FALSE	0.6097	0.5136	0.6726	0.6188	0.4454	0.5799	1351.18
77	Solar Ko 11B	Numbered	10	5	TRUE	0.6272	0.5340	0.6868	0.6383	0.4677	0.5974	1419.07
78	Mistral 12B Inst	Default	0	-	-	0.0326	0.0117	0.1280	0.0074	0.0028	0.0074	284.80
79	Mistral 12B Inst	Default	10	1	FALSE	0.5475	0.4555	0.6169	0.5555	0.3894	0.5163	693.38
80	Mistral 12B Inst	Default	10	1	TRUE	0.5232	0.4413	0.5901	0.5313	0.3796	0.4941	720.83
81	Mistral 12B Inst	Default	10	3	FALSE	0.5637	0.4714	0.6295	0.5706	0.4029	0.5302	596.61
82	Mistral 12B Inst	Default	10	3	TRUE	0.5375	0.4550	0.5996	0.5464	0.3936	0.5084	620.78
83	Mistral 12B Inst	Default	10	5	FALSE	0.5596	0.4670	0.6263	0.5670	0.3984	0.5259	613.60
84	Mistral 12B Inst	Default	10	5	TRUE	0.5358	0.4524	0.5998	0.5466	0.3913	0.5067	613.90
85	Mistral 12B Inst	Alternative	10	1	FALSE	0.5856	0.4856	0.6520	0.5970	0.4142	0.5521	710.83
86	Mistral 12B Inst	Alternative	10	1	TRUE	0.6053	0.5074	0.6701	0.6178	0.4384	0.5748	732.90
87	Mistral 12B Inst	Alternative	10	3	FALSE	0.5933	0.4937	0.6594	0.6036	0.4212	0.5611	585.25
88	Mistral 12B Inst	Alternative	10	3	TRUE	0.6114	0.5133	0.6750	0.6201	0.4405	0.5784	606.88
89	Mistral 12B Inst	Alternative	10	5	FALSE	0.5905	0.4916	0.6547	0.6011	0.4200	0.5581	589.59
90	Mistral 12B Inst	Alternative	10	5	TRUE	0.6084	0.5106	0.6714	0.6170	0.4394	0.5751	600.49
91	Mistral 12B Inst	Numbered	10	1	FALSE	0.6028	0.5049	0.6651	0.6136	0.4341	0.5701	766.83
92	Mistral 12B Inst	Numbered	10	1	TRUE	0.6153	0.5192	0.6756	0.6257	0.4497	0.5811	768.61
93	Mistral 12B Inst	Numbered	10	3	FALSE	0.6047	0.5067	0.6680	0.6133	0.4366	0.5713	644.65
94	Mistral 12B Inst	Numbered	10	3	TRUE	0.6197	0.5242	0.6794	0.6291	0.4557	0.5861	633.95
95	Mistral 12B Inst	Numbered	10	5	FALSE	0.6085	0.5101	0.6710	0.6174	0.4401	0.5759	602.21
96	Mistral 12B Inst	Numbered	10	5	TRUE	0.6199	0.5246	0.6804	0.6293	0.4560	0.5867	638.41
97	EXAONE 3.0 8B Inst	Default	0	-	-	0.1722	0.1254	0.2794	0.1815	0.1001	0.1653	100.64
98	EXAONE 3.0 8B Inst	Default	10	1	FALSE	0.5497	0.4537	0.6227	0.5681	0.3953	0.5305	312.92
99	EXAONE 3.0 8B Inst	Default	10	1	TRUE	0.5424	0.4534	0.6070	0.5799	0.4029	0.5401	331.12
100	EXAONE 3.0 8B Inst	Default	10	3	FALSE	0.5519	0.4553	0.6229	0.5735	0.3984	0.5333	280.72