Taking up the mop

Statistical model identifies potential RfA candidates

Researchers from Carnegie Mellon University's Human-Computer Interaction Institute have developed a statistical model for identifying potential administrator candidates, and propose an "AdminFinderBot" to automatically identify users likely to pass the Requests for adminship (RfA) process.

In their contribution to the 2008 Conference on Human Factors in Computing Systems, held in Florence, Italy this April, social psychologist Robert E. Kraut and Ph.D. student Moira Burke (User:Grammarnerd) describe the problem of increasing administrative backlogs (not currently a significant problem) and the shrinking ratio of administrators to non-administrators. They also argue that "people are more likely to contribute to a collective good such as Wikipedia when they know that they are uniquely qualified for the task, or that the likelihood of success is good", and that "[d]espite protestations that admins are lowly janitors mopping up, in many ways election to admin is a promotion, distinguishing an elite core group from the larger mass of editors." Thus, they suggest their model could be useful for both identifying editors with strong potential and as a "self-evaluation tool" for admin hopefuls.

The model takes into account users' detailed edit histories, including per-namespace edit counts, edits to specific page types such as deletion discussions, policy pages, WikiProjects and the administrators' noticeboard, and the presence of keywords (e.g., "POV", "revert") in edit summaries. For 2006 and 2007, during which 42% of adminship requests were successful, the model predicts with 75% accuracy whether candidates were successful or not.

According to the model, diversity of editing—and in particular, edits to Wikipedia policy pages, WikiProjects, and article talk pages—are the strongest indicators of likely success at RfA. Every 1000 edits to articles increases the probability of success by 1.8%, while edits to Wikipedia policy pages or WikiProjects have about ten times that effect. Every 1000 article talk edits boosts a candidates chances by 6.3%, while excessive userpage, user talk, and deletion discussion edits actually decrease chances for success. Comparing changes in the weighting of the model's factors from the pre-2006 period to the 2006-2007 period, the authors conclude that "the community as a whole is beginning to prioritize policymaking and organization experience over simple article-level coordination" when it comes to selecting administrators.

Another contribution to the conference, by researchers at the University of Pittsburgh and the University of Pennsylvania, analyzes the roles of rules and policies on Wikipedia. The authors conclude that, despite the reputation of wikis as venues for "peer-based, nonhierarchical, non-bureaucratic, emergent, complex, and communal" work, the key feature of wikis is that they "allow for, and in fact facilitate, the creation of policies and procedures that serve a wide variety of functions."

Also this week:
  • ArbCom and Orangemarlin
  • ArbCom announcements
  • Taking up the mop
  • WikiWorld
  • News and notes
  • In the news
  • Dispatches
  • Features and admins
  • Technology report
  • Arbitration report

  • Signpost archives

    + Add a comment

    Discuss this story

    "the community as a whole is beginning to prioritize policymaking and organization experience over simple article-level coordination"

    A sad, sad day. - Tbsdy lives (talk) 01:00, 6 July 2008 (UTC)[reply]

    That's the opinion of the authors, anyway. I think it's more the case that the community is increasingly fractured and now consists of many subcommunities. Article-level coordination is usually only observed by the small number of other editors who work in the same subject area, while policymaking and other meta-work is seen by a large group that participates heavily at RfA. I think most editors would say they do value article-level coordination, it's just that it's easier to evaluate candidates based on areas of common editing experience.--ragesoss (talk) 01:16, 6 July 2008 (UTC)[reply]
    It's interesting anyway, whichever way you look at it. Has there been further discussion of this anywhere? Was a link posted at WT:RFA? Seems not. I've done that now. Carcharoth (talk) 12:26, 8 July 2008 (UTC)[reply]


    The Signpost · written by many · served by Sinepost V0.9 · 🄯 CC-BY-SA 4.0