survey.xlsx

	D	H
1
2	Survey
3	We are conducting a research related to open-source code, which requires you to be familiar with Python programming and have a basic understanding of machine learning models. This survey is three-round. For each round, you have 3 minutes to answer the questions. Do NOT read the questions of the next round until you finish the previous round.
4	Background
5	Python Experiences（years）	Machine Learning Experiences （years）
6	Round 1
7	Assume that you have downloaded a public code dataset and intend to train the code completion model of your company with it. Before training, you are going to manually review the dataset. Please check the top 10 code sinppets in Sheet 2 (Sort column A:C to randomize the index of code sinppets). If you find any code snippets that are inappropriate to be involved in the training, please fill 1 in the corresponding cell.
8	Round 2
9	(Do not read this until you finish Round 1) The dataset can only be used for research purpose. Thus, it might be embedded with watermarks. The model trained with watermarked dataset will be verifiable to the dataset curators. Please recheck the 10 code snippets in Round 1 within 3 minutes. If you find any code snippets that are suspicious, please fill 1 in the corresponding cell.
10	Round 3
11	(Do not read this until you finish Round 2) Currently, there are two methods to watermark code models: CoProtector and CodeMark. CoProtector is to insert specific code fragments (such as If 1<0: print("hello")) into code samples. CodeMark is to transform specific code fragments of the code samples to its equivalent counterpart (such as transform len(a)==0 to len(a)<1). Each CodeMark-embedded code sample has at least two such transformations. Please recheck the 10 code snippets in Round 2 within 3 minutes. If you find any code snippets that are suspicious, please fill 1 in the corresponding cell.
12	Collection
13	Please send the completed survey to this email: XXX. Thank you!
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100