Wikipedia:Wikipedia Signpost/2012-10-08/From the editors Wikipedia:Wikipedia Signpost/2012-10-08/Traffic report Wikipedia:Wikipedia Signpost/2012-10-08/In the media
“ | In September:
|
” |
—Adapted from Engineering metrics, Wikimedia blog |
The Wikimedia Foundation's engineering report for September 2012 was published this week on the Wikimedia Techblog and on the MediaWiki wiki, giving an overview of all Foundation-sponsored technical operations in that month (as well as brief coverage of progress on Wikimedia Deutschland's Wikidata project, phase 1 of which is edging its way towards its first deployment). Three of the seven headline items in the report have already been covered in the Signpost: problems with the corruption of several Gerrit (code) repositories, the introduction of widespread translation memory across Wikimedia wikis, and the launch of the "Page Curation" tool on the English Wikipedia, with development work on that project now winding down. The report also drew attention to the end of Google Summer of Code 2012, the deployment to the English Wikipedia of a new ePUB (electronic book) export feature, and improvements to the Wiki Loves Monuments app aimed at more serious photographers.
It was also a strong month for the Labs and Database Download projects (as detailed in previous editions of the Signpost) as well as the "Micro Design" team that seems to have received something of an ad-hoc consensus for its changes to the English Wikipedia's edit window (albeit with the promise of future fixes). OpenPath, external contractors working on a J2ME app (designed for low end mobile devices) presented their final app during the month, which was verified as working properly and is now awaiting improvements to its memory footprint before release.
By contrast, one of the big disappointments of the month was the unexpected difficulty in "closing out" the long-proposed swap in primary datacentre from the WMF facility in Tampa, Florida to its base in Ashburn, Virginia. Detailed in both the report and a followup post on the wikitech-l mailing list, that move, with its promise of better stability and expansion capability, is now scheduled for the new year. Progress on the VisualEditor (VE) was also strictly non-visual in September, (though it is worth noting for the benefit of regular readers that the current schedule only puts the first VE deployment in June 2013 in any case). By contrast, a deployment of the TimedMediaHandler is expected "soon", notes the report.
Following on from the recent report on code review times for changes to core MediaWiki code, The Signpost can this week publish its own figures for the code review state of the many MediaWiki extensions in use on both Wikimedia wikis and elsewhere. Nevertheless, the figures for extensions are (relatively speaking) of inferior quality to those for core, given that approximately half of all extensions are not yet in Gerrit; some were late joiners (skewing the time series statistics) and some of those that are on Gerrit choose not to use its code review system on one or more branches. It is also necessary to exclude certain sets of "mass edits", although they do not greatly affect the aggregate figures in any case.
Despite these difficulties, it is still possible to gain a sense of how extensions are faring in a post-Gerrit world (correct as of 19 September). The headline figures, in particular, seem strong: the median patchset (of the 4823 sampled) waits 2 hours 30 minutes for a first review and 95% are reviewed within a week. Of those two figures, the median was stable across May, June, July and August, within the 95th percentile improving significantly over the period.
Despite a large disparity between WMF-authored and volunteer-authored code, the latter of which waits three times longer on average for its first review (whether or not the sample is limited to WMF-deployed extensions), patches for WMF-deployed extensions wait longer for their first review than patches to those extensions which have not been deployed to any WMF wikis. Such evidence lends tentative support to the notion that individuals are put off from reviewing WMF-deployed code for fear of giving an incorrect judgement. Naturally, there are many possible confounding variables to consider: the amount of new code included in every commit, for example, or the quality of the reviews themselves, all of which prevent a more insightful analysis.
In related news, discussions continue about refocussing WMF "20%" time from direct code review to skill sharing, the impact of which is expected to be overwhelmingly negative on all short-term indicators. That initiative is expected to focus on extensions with few active maintainers, contributors to which often struggle to find a proper reviewer.
Not all fixes may have gone live to WMF sites at the time of writing; some may not be scheduled to go live for several weeks.
Wikipedia:Wikipedia Signpost/2012-10-08/Essay Wikipedia:Wikipedia Signpost/2012-10-08/Opinion
2009 marked a turning point in this narrative, when the Wikimedia Foundation launched the Public Policy Initiative (PPI) for 2010–11 with support from the Stanton Foundation. The pilot received relatively wide media coverage and was seen as highly successful in improving its target articles, on American public policy. This success emboldened the organizers to expand the pilot worldwide. The Cairo pilot appears to have met with greater success, but a second pilot in India ran into significant difficulties and ended in failure. The considerable community backlash from the debacle in India—including many calls for its closure—threw the program's future into doubt.
More recently, an Education Working Group has been formed to look at reforming the coordination of the US and Canada Education Programs and to organize an eventual transition to a fully volunteer-run system.
The working group is now attempting to move into a new phase with a request for comment seeking community consensus to form a Wikimedia thematic organization—an independent organization recognized by the WMF as supporting Wikimedia's mission in relation to a specific topic area. This would be a non-profit entity incorporated as a 501(c) in the United States. The scope of the proposed organization would focus solely on American and Canadian institutions and leave open the option of assisting collaborations with any WMF site. The aims of the thematic organization would be to "advance teaching and learning; (b) bring in new editors, from university students to professors to content experts outside academia; (c) improve the breadth, scope, documentation, and accuracy of Wikipedia articles; and (d) promote the flow of free information and knowledge."
The RfC, however, has partly developed into a referendum on the education program itself, with a split between working group members and educators supporting, and Wikipedia community members opposing. Mike Cline, a supporter, working group coordinator, and long-time English Wikipedia editor, strongly stated:
This RfC is about the future—the Future of the Wikimedia movement, Wikimedia Outreach and the US Canada Education Program. This RfC is not about, and should not be about the past. ... Those who have opposed this new organization to date, and indeed are calling for the elimination of the Education Program are focused on the past. ... [They] only cite the mistakes, the missteps and rarely give credit to the successes, to the good works by all sorts of ambassadors, students, faculty and WMF Education Program staff. ... I realize there have been missteps in the Education Program, but for opposers to characterize all the work done under [it] as a failure is not supported by the facts. ... Why is this partnership essential for the future of Wikipedia? If we truly believe in the mantra—the sum of all knowledge for the human race, and if we want to create an encyclopedia of world class quality and scope, we have to involve the Academic Community. It is doubtful we can continue robustly growing the encyclopedia without them.
Education professionals who support the program believe that without this form of outreach (assuming that professors will continue to assign their students to edit Wikipedia), their students will not receive the on-wiki interaction necessary for them or their articles to succeed. Theredproject commented that editing the site opened his students' eyes to the "questions of Free Culture, collaboration, and wikis." Ocaasi took a different approach, believing that the previous problems with the program have been addressed and that it deserves a "second chance" over one to two years to prove itself.
Opposers have largely focused on whether there is a need for the program. Fluffernutter commented that there is a "lack of evidence of any material benefit from the existence of the program. All signs I've seen have indicated that the program creates a lot of cleanup work for the community and very little in the way of useful content or new long-term contributors."
Other editors echoed her post: MER-C believes that the program "needs a massive haircut to bring it back to a scale where it is a net positive for the encyclopedia—i.e. similar to the Public Policy Initiative. Developing a formal, self-justifying bureaucracy around the program to further expand it is exactly the wrong way to go." At least one further oppose believed that spinning the program off from the WMF as planned would lead to less accountability for the program as a whole.
This contrast in views begs the question: is the education program worth the effort? The WMF published a US–Canada results page a few days after Fluffernutter's oppose, detailing the effects of the education program on Wikipedia over the first half of 2012 and including detailed graphs of the changes in quality. As assessed by a volunteer group of Wikipedia editors, 87.9% of articles were improved by student editing. On a 26-point quality scale, the articles were improved on average by 2.94 points; only eight articles saw a decrease in quality, with the worst dropping by two points. The report notes that existing articles were usually improved from the equivalent of weak Start-class articles to strong Start-class or C-class articles. New articles fell into the same area.
Another supporting view has come from a previously published and highly publicized op-ed written by English Wikipedia editor and current working group member Mike Christie for the Signpost last December. There, Christie concluded that the education program was necessary, because "if we manage the influx of academic interest correctly, Wikipedia will acquire an institutional connection to academia that will be a source of new content for our articles and an intellectual resource to assist with long-term growth. Wikipedia does not need to beg for respectability any more; it is already widely used by academics as a starting point for research, and sometimes for more than that. We need to accept our respectability, and plan to learn from—and teach—the academic community."
Opposing arguments mainly stem from experiences with the Indian pilot. The most notable document produced after its closure was by consultant Tory Read, which the Signpost covered in January. The results were stunning: a quantitative analysis done simultaneously with the report showed that only 21% of student-produced content survived after the necessary clean-up. The report itself chronicled the failures in communication and scale; the Indian pilot was five times larger than the Public Policy Initiative. Wikipedians voiced their opposition on the talk page, such as Theo10011:
With the sole exception of [Frank Schulenburg, the Global Education Program director], there isn't a single person who designed and implemented this program that I would be confident about editing themselves. They barely know how to edit themselves, who to ask for help, or how, what is the right and wrong practice. ... they are not versed in the en.wp policies and general editing culture, they were hired as consultants by WMF. ... This is a really important point, when the students and CAs they are overseeing, have the same or more experience than them, that is likely to be a bad start. I honestly believe they need more experience and time to learn the ropes first, before they design and run any future iteration of the education program here.
Yet while the opposition stemming from the Indian pilot is based on solid facts, it does not account for modifications made to the program over the last year. The Working Group RfC is still open for comments from the community, and the Signpost welcomes comments on the Education Program as a whole on the talk page.
Wikipedia:Wikipedia Signpost/2012-10-08/Serendipity Wikipedia:Wikipedia Signpost/2012-10-08/Op-ed Wikipedia:Wikipedia Signpost/2012-10-08/In focus Wikipedia:Wikipedia Signpost/2012-10-08/Arbitration report Wikipedia:Wikipedia Signpost/2012-10-08/Humour