Domain Crawler.xlsx

	A	B	C	D	E	F
1	List domain web crawler
2
3	STT	Web	Finish	Size	Notes	Cần crawl
4	1	http://www.is.vnu.edu.vn/ is	x	11,5 MB
5	2	https://vnu.edu.vn/ VNU			in progress
6	3	https://ueb.edu.vn/ ueb	x	11821 bài viết - 108,5 MB
7	4	https://ttgdtc.vnu.edu.vn/ ttgdtc			Trang web không crawl được do các bài biết cần phải đang nhập để xem
8	5	https://press.vnu.edu.vn/ press	x	975 bài viết - 1,8 MB
9	6	https://hus.vnu.edu.vn/ hus	x
10	7	https://education.vnu.edu.vn/ education	X	11,8MB
11	8	https://ysip.vnu.edu.vn/ ysip				x
12	9	https://vju.ac.vn/ vju	x	640 bài viết		x
13	10	https://iti.vnu.edu.vn/vi/ iti	x
14	11	https://hsb.edu.vn/ hsb	x			x
15	12	https://tnti.vnu.edu.vn/ tnti	x
16	13	https://ulis.vnu.edu.vn/ ulis	x
17	14	https://ump.vnu.edu.vn/ ump	x
18	15	https://alumni.vnu.edu.vn/ alumni	x
19	16	https://law.vnu.edu.vn/ law	x			x
20	17	https://sis.vnu.edu.vn/ sis	x			x
21	18	https://cea.vnu.edu.vn/ cea	x			x
22	19	https://hdc.vnu.edu.vn/ hdc	x			x
23	20	https://cmc.vnu.edu.vn/ cmc	x
24	21	https://ussh.vnu.edu.vn/vi/ ussh	x			x
25	22	https://imbt.vnu.edu.vn/ imbt	x			x
26	23	https://infeqa.vnu.edu.vn/ infeqa	x
27	24	https://cet.vnu.edu.vn cet	x			x
28	25	https://ivides.vnu.edu.vn/ ivides	x
29	26	https://css.vnu.edu.vn/ css	x
30	27	http://www.ifi.vnu.edu.vn/ ifi	x
31	28	https://www.is.vnu.edu.vn/ is	x
32	29	https://www.uet.vnu.edu.vn/ uet	x			news + tuyensinh: 100MB ???
33		https://lic.vnu.edu.vn/
34		https://ulis.vnu.edu.vn/
35		https://saudaihoc.ulis.vnu.edu.vn/
36		https://dangbo.ulis.vnu.edu.vn/
37		https://tuyensinh.ussh.edu.vn/
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100