Article Feedback v5

Usage statistics update

�JANUARY 2013

​

​

1. where we are�2. the good news

3. the not so good news

4. what's next

Where we are

AFT deployed on a random selection of 10% enwiki articles from enwiki since July 2012 ^[1]

​

400K articles

​

​

​

[1] 413,367 ns0 articles as of Nov 15, 2012, on top of a small sample of 300+ cherry picked articles and 1K help pages. Redirects and manually blacklisted pages are not part of the sample.

Feedback: Volume

How much feedback is posted compared to edits?

​

​

​

mean posts/day [1] mean edits/day [2]

4,100 67,500

10% SAMPLE 100% ENWIKI NS0

​

​

[1] Mean daily post volume on ns0 articles: 4,113 (2012-09-07 - 2012-10-18), prior to introduction of stricter AbuseFilter rules (raw data) (dashboard)

[2] Mean daily ns0 edits excl. bots between (2012-09-07, 2012-10-18): 67,439 (data)

​

the good news

Engagement: Unique posters

How many readers are we engaging?

unique anon posters/day [1]

2,800

10% SAMPLE

unique anon posters/month [2]

114K

10% SAMPLE

​

​

[1] Mean daily unique tokens (2012-09-07, 2012-10-18): 2,835 (data) [2] Mean monthly unique tokens (2012-08-01, 2012-11-01):114,520 (data)

Engagement: New registrations

Sign up Call to Action

​

​

​

​

​

​

​

​

​

​

CTA data collected between (2012-10-26, 2012-10-29) (data)

8.7% �664

92.0% �611

52.0% �318

64.5% �205

CTA�impression

CTA

sign up�click

account creation�impression

account creation�submit

account creation�success

100% �7,644

7.8% �599

CTA

log in�click

2.7%

Feedback: Quality

What proportion of feedback is useful?

​

40% of feedback blindly

classified as useful by at least

2 Wikipedians

​

​

(but less than 25% on popular articles) [1]

​

​

[1] http://meta.wikimedia.org/wiki/Research:Article_feedback/Usability_evaluation

​

​

​

​

​

AFT Stage 2: quality assessment (report) (new round of quality assessment analysis scheduled in December)

the not so good news

Moderation

How many unique users participate in moderation?

​

​

unique daily

moderators

��

​

​

[1] Mean number of unique daily registered moderators: 93 (2012-09-07, 2012-10-18) (dashboard)

​

90

Moderation

How many posts are moderated?

​

daily posts moderated within 24h

3.5%

​

daily posts moderated within 1 month

11.5%

​

[1] Mean % of daily posts moderated within 24h (2012-09-07, 2012-10-18): 3.4% (data)

[1] Mean % of daily posts moderated within 1 month (2012-09-07, 2012-10-18): 11.5% (data)

​

what's next��BETTER FILTERS�SIMPLER MODERATION TOOLS

BETTER FEEDBACK VISIBILITY

Article feedback research

Feedback quality evaluation

meta.wikimedia.org/wiki/R:AFT/Usability_evaluation

​

​

AFT5 2012-Q4 research report

commons.wikimedia.org/wiki/File:AFT5_2012-Q4_report.pdf

​

​

Feedback/moderation dashboards

toolserver.org/~dartar/fp/

toolserver.org/~dartar/aft5/

​