| A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Username | Task | Team | Submission Description: | ROUGE | BLEU | METEOR | BERTScore | FKGL | DCRS | CLI | LENS(Task1) | AlignScore(Task1) | SummaC(Task1) | ||||||||||||
2 | jcols-291372 | SubTask 1.1 | SUWMIT | 2 separate summarization models | 0.3704646644 | 10.06702578 | 0.3079956055 | 0.8642405859 | 11.74049296 | 9.082676056 | 12.58246479 | 72.607968 | 0.7497251217 | 0.6817477078 | ||||||||||||
3 | www123-283453 | SubTask 1.1 | Baseline-llama3-8B-sft | Baseline-llama3-8B-sft | 0.365724094 | 9.862437528 | 0.3138578127 | 0.8632391471 | 12.2056338 | 9.225140845 | 12.98440141 | 72.85923035 | 0.7216703775 | 0.6435311565 | ||||||||||||
4 | iramzi_uc3m-288467 | SubTask 1.1 | BDA-UC3M | No external data was used. | 0.3533949447 | 8.075049312 | 0.2939212943 | 0.8696542359 | 12.32464789 | 9.257816901 | 13.16961268 | 64.09698429 | 0.6913597245 | 0.5390019624 | ||||||||||||
5 | www123-283495 | SubTask 1.1 | Baseline-qwen2.5-7B-sft | Baseline-qwen2.5-7B-sft | 0.3518542247 | 8.737016262 | 0.3030265735 | 0.8693586294 | 12.71338028 | 9.65306338 | 13.70052817 | 60.21873129 | 0.7539888213 | 0.6438751254 | ||||||||||||
6 | hopems7-286691 | SubTask 1.1 | TLPIQ | second iteration for subtask 1.1 | 0.3353842707 | 7.162556148 | 0.2678121673 | 0.8615671409 | 13.43802817 | 10.58616197 | 13.42823944 | 43.67558783 | 0.7624569112 | 0.6422238888 | ||||||||||||
7 | callum-chan-290154 | SubTask 1.1 | 5cNLP | Llama 3.3 Few Shot Prompting | 0.3334242163 | 6.135423874 | 0.2676496595 | 0.8585660678 | 16.07183099 | 10.39757042 | 15.33580986 | 76.05186543 | 0.6307268746 | 0.4549793862 | ||||||||||||
8 | egecanevgin-284123 | SubTask 1.1 | MetninOzU | Qwen3:4B model + Trim_10 + LoRA Fine Tuning | 0.3300379793 | 6.946667965 | 0.2903588549 | 0.856749526 | 16.4528169 | 11.21570423 | 17.00535211 | 34.85779997 | 0.8807738375 | 0.9203375815 | ||||||||||||
9 | linf545-291362 | SubTask 1.1 | LaySummX | Experiment24 | 0.3206904634 | 5.442784604 | 0.2531891514 | 0.8554332431 | 12.27887324 | 9.506549296 | 13.38327465 | 80.45908498 | 0.6753871409 | 0.521024681 | ||||||||||||
10 | aaradhyagupta-280271 | SubTask 1.1 | Aard | no additional data used. langgraph agent using llama3 70b | 0.3189127319 | 5.448826084 | 0.2931807791 | 0.8511478429 | 14.56443662 | 10.0193662 | 15.36359155 | 71.51319021 | 0.6946161614 | 0.5088798004 | ||||||||||||
11 | sushvin-281050 | SubTask 1.1 | LTRC | subtask-1.1-llama-3.2-WOFT-IN | 0.287980178 | 4.26513022 | 0.222247166 | 0.8498532856 | 13.36197183 | 9.297394366 | 13.28897887 | 79.3443314 | 0.6014536152 | 0.4759215726 | ||||||||||||
12 | benjaminpwh-287497 | SubTask 1.1 | MIRAGES | Impact of using title and keyword information for lay summarization | 0.2877319903 | 4.632317501 | 0.2304805458 | 0.8460885985 | 11.71091549 | 8.459577465 | 11.98985915 | 71.27138088 | 0.6810818147 | 0.6046602492 | ||||||||||||
13 | jw_48264-290237 | SubTask 1.1 | RainCityNLP | med_summarization | 0.2844611838 | 4.868612017 | 0.2405111996 | 0.8395703217 | 16.74014085 | 11.65957746 | 16.23690141 | 9.410939323 | 0.6118289283 | 0.6530755789 | ||||||||||||
14 | saranyar-291753 | SubTask 1.1 | CUTN_Bio | tree | 0.2681919676 | 3.24775969 | 0.2263706053 | 0.8484312852 | 10.52429577 | 8.835915493 | 11.43105634 | 84.14457219 | 0.5888629015 | 0.5489283793 | ||||||||||||
15 | explcre-287036 | SubTask 1.1 | x2z | lma3 | 0.1823066331 | 1.177655156 | 0.1681808915 | 0.8035890685 | 12.59929577 | 8.556197183 | 12.64869718 | 63.22367322 | 0.367818371 | 0.4681687049 | ||||||||||||
16 | explcre-290422 | SubTask 1.1 | sxz | biobart,paragraph summary | 0.1648664622 | 1.327783087 | 0.1530177538 | 0.8011153674 | 12.58767606 | 11.83193662 | 13.28792254 | 6.555184182 | 0.8620931045 | 0.5278729823 | ||||||||||||
17 | demo1357-291673 | SubTask 1.1 | demo | the plos.txt and elife.txt | 0.1648664622 | 1.327783087 | 0.1530177538 | 0.8011153674 | 12.58767606 | 11.83193662 | 13.28792254 | 6.555184182 | 0.8620931045 | 0.5278729823 | ||||||||||||
18 | ||||||||||||||||||||||||||
19 | min-max normalisation = (score_i - min(score)) / (max(score) - min(score)) | |||||||||||||||||||||||||
20 | min | 0.1648664622 | 1.177655156 | 0.1530177538 | 0.8011153674 | 10.52429577 | 8.459577465 | 11.43105634 | 6.555184182 | 0.367818371 | 0.4549793862 | |||||||||||||||
21 | max | 0.3704646644 | 10.06702578 | 0.3138578127 | 0.8696542359 | 16.74014085 | 11.83193662 | 17.00535211 | 84.14457219 | 0.8807738375 | 0.9203375815 | |||||||||||||||
22 | ||||||||||||||||||||||||||
23 | ||||||||||||||||||||||||||
24 | Username | Task | Team | Submission Description: | ROUGE | BLEU | METEOR | BERTScore | FKGL(1-) | DCRS(1-) | CLI(1-) | LENS(Task1) | AlignScore(Task1) | SummaC(Task1) | ||||||||||||
25 | jcols-291372 | SubTask 1.1 | SUWMIT | 2 separate summarization models | 1 | 1 | 0.9635525674 | 0.921013432 | 0.8043392058 | 0.8152336205 | 0.7934432443 | 0.8513120867 | 0.7445222356 | 0.4872984378 | ||||||||||||
26 | www123-283453 | SubTask 1.1 | Baseline-llama3-8B-sft | Baseline-llama3-8B-sft | 0.9769425494 | 0.9769850695 | 1 | 0.9064021782 | 0.7295077324 | 0.7729887758 | 0.7213378814 | 0.8545504465 | 0.6898298773 | 0.4051755663 | ||||||||||||
27 | iramzi_uc3m-288467 | SubTask 1.1 | BDA-UC3M | No external data was used. | 0.9169753455 | 0.7759147921 | 0.876047556 | 1 | 0.7103608452 | 0.7632993996 | 0.6881119323 | 0.7416194609 | 0.6307396541 | 0.1805546288 | ||||||||||||
28 | www123-283495 | SubTask 1.1 | Baseline-qwen2.5-7B-sft | Baseline-qwen2.5-7B-sft | 0.9094815057 | 0.8503820382 | 0.9326583236 | 0.9956870239 | 0.6478219 | 0.6460976246 | 0.5928684227 | 0.6916351383 | 0.7528342625 | 0.405914715 | ||||||||||||
29 | hopems7-286691 | SubTask 1.1 | TLPIQ | second iteration for subtask 1.1 | 0.829374025 | 0.6732648742 | 0.7137178032 | 0.8820071709 | 0.5312411488 | 0.3694074654 | 0.6417156213 | 0.4784211424 | 0.7693426934 | 0.4023664018 | ||||||||||||
30 | callum-chan-290154 | SubTask 1.1 | 5cNLP | Llama 3.3 Few Shot Prompting | 0.8198406032 | 0.5577187553 | 0.7127074342 | 0.8382207302 | 0.1075171359 | 0.425330201 | 0.2995072958 | 0.8956982783 | 0.512536703 | 0 | ||||||||||||
31 | egecanevgin-284123 | SubTask 1.1 | MetninOzU | Qwen3:4B model + Trim_10 + LoRA Fine Tuning | 0.8033704348 | 0.6489787699 | 0.8538985999 | 0.8117169107 | 0.04622443778 | 0.1827303576 | 0 | 0.364774314 | 1 | 1 | ||||||||||||
32 | linf545-291362 | SubTask 1.1 | LaySummX | Experiment24 | 0.7579054658 | 0.4798010602 | 0.6228012989 | 0.7925119992 | 0.7177250326 | 0.6895432002 | 0.6497820731 | 0.9525001124 | 0.5996013104 | 0.1419235665 | ||||||||||||
33 | aaradhyagupta-280271 | SubTask 1.1 | Aard | no additional data used. langgraph agent using llama3 70b | 0.7492588362 | 0.4804806899 | 0.8714435089 | 0.7299868906 | 0.3500254914 | 0.5374784651 | 0.2945234034 | 0.837202196 | 0.6370880354 | 0.1158256473 | ||||||||||||
34 | sushvin-281050 | SubTask 1.1 | LTRC | subtask-1.1-llama-3.2-WOFT-IN | 0.5988073557 | 0.3473221216 | 0.4304239421 | 0.7110989613 | 0.5434770294 | 0.7515635604 | 0.6666982503 | 0.9381327665 | 0.4554688652 | 0.04500229417 | ||||||||||||
35 | benjaminpwh-287497 | SubTask 1.1 | MIRAGES | Impact of using title and keyword information for lay summarization | 0.5976002065 | 0.3886284522 | 0.4816138003 | 0.6561711928 | 0.8090976038 | 1 | 0.8997536479 | 0.8340856702 | 0.6107030028 | 0.3216465607 | ||||||||||||
36 | jw_48264-290237 | SubTask 1.1 | RainCityNLP | med_summarization | 0.5816914755 | 0.4152101447 | 0.5439779518 | 0.5610678312 | 0 | 0.05110937091 | 0.1378561051 | 0.03680600162 | 0.4756954029 | 0.4256854069 | ||||||||||||
37 | saranyar-291753 | SubTask 1.1 | CUTN_Bio | tree | 0.5025603546 | 0.2328741396 | 0.4560608346 | 0.6903516039 | 1 | 0.8884051161 | 1 | 1 | 0.4309234328 | 0.2018853306 | ||||||||||||
38 | explcre-287036 | SubTask 1.1 | x2z | lma3 | 0.08482647569 | 0 | 0.09427463409 | 0.0360919454 | 0.6661757208 | 0.9713495171 | 0.7815614933 | 0.730363913 | 0 | 0.02834229381 | ||||||||||||
39 | explcre-290422 | SubTask 1.1 | sxz | biobart,paragraph summary | 0 | 0.01688847692 | 0 | 0 | 0.6680450915 | 0 | 0.6668877519 | 0 | 0.9635821544 | 0.1566397602 | ||||||||||||
40 | demo1357-291673 | SubTask 1.1 | demo | the plos.txt and elife.txt | 0 | 0.01688847692 | 0 | 0 | 0.6680450915 | 0 | 0.6668877519 | 0 | 0.9635821544 | 0.1566397602 | ||||||||||||
41 | ||||||||||||||||||||||||||
42 | ||||||||||||||||||||||||||
43 | ||||||||||||||||||||||||||
44 | ||||||||||||||||||||||||||
45 | Username | Task | Team | Submission Description: | Relevance | Readability | Factuality | overall | ||||||||||||||||||
46 | jcols-291372 | SubTask 1.1 | SUWMIT | 2 separate summarization models | 0.9711414999 | 0.8160820393 | 0.6159103367 | 0.8010446253 | ||||||||||||||||||
47 | www123-283453 | SubTask 1.1 | Baseline-llama3-8B-sft | Baseline-llama3-8B-sft | 0.9650824493 | 0.769596209 | 0.5475027218 | 0.7607271267 | ||||||||||||||||||
48 | iramzi_uc3m-288467 | SubTask 1.1 | BDA-UC3M | No external data was used. | 0.8922344234 | 0.7258479095 | 0.4056471414 | 0.6745764914 | ||||||||||||||||||
49 | www123-283495 | SubTask 1.1 | Baseline-qwen2.5-7B-sft | Baseline-qwen2.5-7B-sft | 0.9220522228 | 0.6446057714 | 0.5793744887 | 0.715344161 | ||||||||||||||||||
50 | hopems7-286691 | SubTask 1.1 | TLPIQ | second iteration for subtask 1.1 | 0.7745909683 | 0.5051963445 | 0.5858545476 | 0.6218806201 | ||||||||||||||||||
51 | callum-chan-290154 | SubTask 1.1 | 5cNLP | Llama 3.3 Few Shot Prompting | 0.7321218807 | 0.4320132277 | 0.2562683515 | 0.47346782 | ||||||||||||||||||
52 | egecanevgin-284123 | SubTask 1.1 | MetninOzU | Qwen3:4B model + Trim_10 + LoRA Fine Tuning | 0.7794911788 | 0.1484322773 | 1 | 0.6426411521 | ||||||||||||||||||
53 | linf545-291362 | SubTask 1.1 | LaySummX | Experiment24 | 0.663254956 | 0.7523876046 | 0.3707624385 | 0.595468333 | ||||||||||||||||||
54 | aaradhyagupta-280271 | SubTask 1.1 | Aard | no additional data used. langgraph agent using llama3 70b | 0.7077924814 | 0.504807389 | 0.3764568414 | 0.5296855706 | ||||||||||||||||||
55 | sushvin-281050 | SubTask 1.1 | LTRC | subtask-1.1-llama-3.2-WOFT-IN | 0.5219130952 | 0.7249679016 | 0.2502355797 | 0.4990388588 | ||||||||||||||||||
56 | benjaminpwh-287497 | SubTask 1.1 | MIRAGES | Impact of using title and keyword information for lay summarization | 0.531003413 | 0.8857342305 | 0.4661747817 | 0.6276374751 | ||||||||||||||||||
57 | jw_48264-290237 | SubTask 1.1 | RainCityNLP | med_summarization | 0.5254868508 | 0.05644286941 | 0.4506904049 | 0.3442067084 | ||||||||||||||||||
58 | saranyar-291753 | SubTask 1.1 | CUTN_Bio | tree | 0.4704617332 | 0.972101279 | 0.3164043817 | 0.5863224646 | ||||||||||||||||||
59 | explcre-287036 | SubTask 1.1 | x2z | lma3 | 0.0537982638 | 0.7873626611 | 0.01417114691 | 0.2851106906 | ||||||||||||||||||
60 | explcre-290422 | SubTask 1.1 | sxz | biobart,paragraph summary | 0.004222119229 | 0.3337332108 | 0.5601109573 | 0.2993554291 | ||||||||||||||||||
61 | demo1357-291673 | SubTask 1.1 | demo | the plos.txt and elife.txt | 0.004222119229 | 0.3337332108 | 0.5601109573 | 0.2993554291 | ||||||||||||||||||
62 | ||||||||||||||||||||||||||
63 | ||||||||||||||||||||||||||
64 | rank | Team | Relevance | |||||||||||||||||||||||
65 | 1 | SUWMIT | 0.9711414999 | |||||||||||||||||||||||
66 | 2 | Baseline-llama3-8B-sft | 0.9650824493 | |||||||||||||||||||||||
67 | 3 | Baseline-qwen2.5-7B-sft | 0.9220522228 | |||||||||||||||||||||||
68 | 4 | BDA-UC3M | 0.8922344234 | |||||||||||||||||||||||
69 | 5 | MetninOzU | 0.7794911788 | |||||||||||||||||||||||
70 | 6 | TLPIQ | 0.7745909683 | |||||||||||||||||||||||
71 | 7 | 5cNLP | 0.7321218807 | |||||||||||||||||||||||
72 | 8 | Aard | 0.7077924814 | |||||||||||||||||||||||
73 | 9 | LaySummX | 0.663254956 | |||||||||||||||||||||||
74 | 10 | MIRAGES | 0.531003413 | |||||||||||||||||||||||
75 | 11 | RainCityNLP | 0.5254868508 | |||||||||||||||||||||||
76 | 12 | LTRC | 0.5219130952 | |||||||||||||||||||||||
77 | 13 | CUTN_Bio | 0.4704617332 | |||||||||||||||||||||||
78 | 14 | x2z | 0.0537982638 | |||||||||||||||||||||||
79 | 15 | sxz | 0.004222119229 | |||||||||||||||||||||||
80 | 16 | demo | 0.004222119229 | |||||||||||||||||||||||
81 | ||||||||||||||||||||||||||
82 | ||||||||||||||||||||||||||
83 | rank | Team | Readability | |||||||||||||||||||||||
84 | 1 | CUTN_Bio | 0.972101279 | |||||||||||||||||||||||
85 | 2 | MIRAGES | 0.8857342305 | |||||||||||||||||||||||
86 | 3 | SUWMIT | 0.8160820393 | |||||||||||||||||||||||
87 | 4 | x2z | 0.7873626611 | |||||||||||||||||||||||
88 | 5 | Baseline-llama3-8B-sft | 0.769596209 | |||||||||||||||||||||||
89 | 6 | LaySummX | 0.7523876046 | |||||||||||||||||||||||
90 | 7 | BDA-UC3M | 0.7258479095 | |||||||||||||||||||||||
91 | 8 | LTRC | 0.7249679016 | |||||||||||||||||||||||
92 | 9 | Baseline-qwen2.5-7B-sft | 0.6446057714 | |||||||||||||||||||||||
93 | 10 | TLPIQ | 0.5051963445 | |||||||||||||||||||||||
94 | 11 | Aard | 0.504807389 | |||||||||||||||||||||||
95 | 12 | 5cNLP | 0.4320132277 | |||||||||||||||||||||||
96 | 13 | sxz | 0.3337332108 | |||||||||||||||||||||||
97 | 14 | demo | 0.3337332108 | |||||||||||||||||||||||
98 | 15 | MetninOzU | 0.1484322773 | |||||||||||||||||||||||
99 | 16 | RainCityNLP | 0.05644286941 | |||||||||||||||||||||||
100 | ||||||||||||||||||||||||||