This article was originally posted on the author's blog and is republished with his permission. The views expressed in this article are his alone and do not reflect any official opinions of this publication.
The Wikimedia Foundation is in open revolt. While the day-to-day volunteer efforts of editing Wikipedia pages continue as ever, the non-profit Foundation, or WMF, is in the midst of a crisis it’s never seen before. In recent weeks, WMF staff departures have accelerated. Within just the past 48 hours, employees have begun speaking openly on the web about their lack of confidence in the leadership of executive director Lila Tretikov.
All in all, it’s been a terrible, horrible, no good, very bad start to 2016. Controversy in the first weeks of the year focused on the unexplained dismissal from the WMF Board of Trustees of James Heilman, a popular representative of Wikipedia’s volunteer base, before shifting to the unpopular appointment to the WMF Board of Arnnon Geshuri, whose involvement in an anti-competitive scheme as a Google executive led him to resign the position amidst outcry from the staff and community (see previous Signpost coverage).
But other issues remained unresolved: WMF employee dissatisfaction with Tretikov was becoming better known beyond the walls of its San Francisco headquarters, while questions mounted about the origin, status and intent of a little-known initiative officially called Discovery, but previously (and more notoriously) known as the “Knowledge Engine”. What was it all about? How do all these things tie together? What on Earth is going on here?
Deep breath.
The strange thing about the Knowledge Engine is that, until very recently, basically nobody knew anything about it—including the vast majority of WMF staff. Not until Heilman identified it as a central issue surrounding his departure from the Board had anyone outside the WMF staff ever heard of it—though in May 2015, Risker observed that a team called “Search and Discovery” was “extraordinarily well-staffed with a disproportionate number of engineers at the same time as other areas seem to be wanting for them”. This despite the fact that, as we know now, the WMF had sought funding from the Knight Foundation of many millions of dollars, receiving just $250,000 in a grant not disclosed until months later. As recently as this month, a well-considered but still in-the-dark Signpost article asked: “So, what’s a knowledge engine anyway?”
After several months of not knowing anything was amiss, followed by weeks of painful acrimony, we think we have the answer: as of February 2016, the mysterious project is in fact a WMF staff-run project to improve Wikipedia’s on-site search with some modest outside funding, which sounds like a good idea; sure, Wikipedia’s on-site search engine isn’t maybe the best, but we also know at some point it was an ambitious project to create a brand new search engine as an alternative to Google. Sometime in 2015, the WMF submitted a proposal to the Knight Foundation asking for a substantial amount of money to fund this project. It is described in still-emerging documents from this grant request as a “search engine”, and several early mock-ups seemed to suggest this was in fact the idea, as seen in internal documents revealed for the first time by the Signpost last week.
Why would Wikipedia consider building a search engine, anyway? The most likely answer is fear of being too dependent on Google, which sends Wikipedia at least a third of its total traffic. In recent years, Google has started providing answers to queries directly on the search engine results page (SERPs), often powered by Wikipedia, thereby short-circuiting visits to Wikipedia itself. Tretikov herself, in a rambly January 29 comment on her Meta-Wiki account page, identified “readership decline” as Wikipedia’s most recent challenge.[1]
It’s an understandable position: if you are the leader of an organization whose success has been largely described in terms of its overall traffic, any decline in traffic may be equated with a decline in Wikimedia’s ability to fulfill its mission. I submit this is short-sighted: that Wikipedia has an educational mission whose impact cannot be measured solely in terms of traffic. That Google borrows information from Wikipedia—though they are not alone in this—in such a way that it answers people’s questions before they have to actually click through to en.wikipedia.org is still a win for Wikipedia, even if it reduces the (already low) probability that a reader will become a Wikipedia contributor.[2]
The logic is twisted, but you can follow it: most readers find Wikipedia through a search engine, so if the search engine that helped make Wikipedia the success it is today changes its mind and starts pointing elsewhere, better to get ahead of things and create a new alternative that people will use. I guess? If we accept this reasoning, we still have to confront questions like: Is this actually something the WMF can accomplish? Is this within the WMF’s scope? Is this something that will help Wikipedia accomplish its mission? These are much harder questions for WMF to answer—in part because the answers are “no”, “no”, and “no”—and would absolutely have to be shared with the Wikimedia Board of Trustees ahead of time and, for political reasons, socialized within the Wikipedia community itself. The incident surrounding Heilman’s departure suggests the former was an issue, and the ongoing furor is because the latter obviously did not occur.
Meanwhile, the extreme unwillingness of Lila Tretikov and even Jimmy Wales to talk about it is, in fact, tearing the Wikimedia Foundation apart. Tretikov has lost all remaining credibility with Wikimedia staff and close community observers, not that she had much to begin with. As this week comes to an end, more staffers are quitting, remaining ones are complaining in public, and it seems impossible to imagine Lila Tretikov remaining in charge much longer.
If you need a detailed timeline of events to understand how we got here, I am pleased to say you’ll find just what you’re looking for below, although I’m afraid this whole thing is too large and multifaceted to do proper justice within the space of this already very long article. A full accounting may go back to the mid-2000s, when Jimmy Wales harbored ambitions of building his own search engine—Wikiasari in 2006 and Wikia Search in 2008. It certainly would include a full accounting of the many high-profile WMF staffers to leave since late 2014, and the role Tretikov played in each. It would include a careful examination of what the WMF can and should do in Wikipedia’s name, and an evaluation of how the evolving app-focused Internet raises questions about Wikipedia’s own future.
I think that’s more than I can accomplish here.
Instead I want to focus on what’s happening this week. But first we have to fill in some of the blanks. To do so, you’ll want to wind back the clock a few weeks:
Whether Wikimedia’s plans just naturally evolved [away from the search engine project] or whether it was responding to the community’s response is difficult to say, but the organization is now, at least, claiming it does not want to square up to Google, but just improve its own product.
Transparency, integrity, community and free knowledge remain deeply important to me, and I believe I will be better placed to represent those values in a volunteer capacity at this time.
Finally, on February 16, Lila Tretikov published an open letter (co-authored by Vice President of Product Wes Moran) on the Wikimedia blog titled “Clarity on the future of Wikimedia search”. Alas, it wasn’t terribly clarifying: it seemed aimed at the clueless mainstream journalists like the one at Newsweek, and not at the Wikipedia community who knew which information gaps actually needed to be filled in. It began:
Over the past few weeks, the Wikimedia community has engaged in a discussion of the Wikimedia Foundation’s plans for search and discovery on the Wikimedia projects.
Well, that is certainly one way to put it! Put another way, you have been backed into a corner defending the untenable proposition that Wikipedia has never considered building a search engine, and now that the mainstream press is reporting, based on your own documents, that you are building a search engine, one certainly has to say something about it.
After much boilerplate about the growth of Wikipedia and its many achievements, Tretikov and Moran finally get around to the point:
What are we not doing? We’re not building a global crawler search engine. We’re not building another, separate Wikimedia project. … Despite headlines, we are not trying to compete with other platforms, including Google.
This seems to be true, insofar as there is no search project currently. However, Wales had previously locked himself into the position that there was never a search project originating from WMF, and by now we know that is obviously false. Without any acknowledgement in this letter, it is useless. But it’s worse than that:
Community feedback was planned as part of the Knowledge Engine grant, and is essential to identifying the opportunities for improvement in our existing search capacity.
We are 10 months past the initial plans for this far-reaching, mission statement-busting project, six months past the award of a grant to pursue this quixotic effort, and not two months removed from the violent ejection of a Board trustee over the matter… and all you can say is “feedback was planned”?
Finally, the closest thing to acknowledging the Knowledge Engine was, at some point, actually a search engine:
It is true that our path to this point has not always been smooth, especially through the ideation phase.
And nothing more.
The first comment on the post was brutal, bordering on uncivil, from a retired editor. It concluded:
You are either:
a. Flat out lying, and hoping we don’t actually read the grant,
b. Have misled the Knight Foundation as to your intentions for their grant money, or
c. Seriously incompetent and should never be put in charge of writing a grant application
None of these options look good for the WMF.
A few hours later, a member of WMF’s Discovery team gamely stepped forward and tried to offer a plausible explanation for how the grant request did not necessarily imply a Google-competitive search engine project—damage control, essentially—but still had to concede the wording of the grant did not make Tretikov or WMF look good: “It is ambiguous. I can’t speak to the intent of the authors and while there are current WMF staff listed, they are not the sole authors of the document.”
Finally, a day later a true hero emerged in Max Semenik, another Discovery team engineer, mostly unknown to the community, and who was willing to take off his PR hat to say what everyone pretty much knew:
Yes, there were plans of making an internet search engine. I don’t understand why we’re still trying to avoid giving a direct answer about it. …
The whole project didn’t live long and was ditched soon after the Search team was created, after FY15/16 budget was finalized, and it did not have the money allocated for such work … However, ideas and wording from that search engine plan made their way to numerous discovery team documents and were never fully expelled. …
In the hindsight, I think our continued use of Knowledge Engine name is misleading and should have ended when internet search engine plans were ditched. No, we’re really not working on internet search engine.
Now that sounds like a real answer! What’s more, it also provides the outlines of a believable story as to why the Knight Foundation grant included language about the search engine, even if it wasn’t then the plan. This is transparency of a sort! But it’s transparency of the last-ditch kind. That it had to come from a low-level engineer indicates there is a major problem, and speaks to the fact that the WMF simply cannot go on this way.
At a time when Wikipedia has already-existing problems, the WMF was asking for money to basically create a whole new set of problems. That is the mark of an organization, if not a movement, adrift. Clearly, they pitched a search engine to Knight, and they asked for millions—I have heard the number placed at $100 million over 5 years—later reduced to $12 million, of which Knight provided $250K to build a plan—essentially a pat on the head: ‘since we like you, here’s a few bucks to come up with a better idea’.
Mysteries remain: where did the idea come from, who championed it, when did it die—or when did it recede and what happened afterward? One answer is supplied in another comment on this public thread (!) from yet another WMF team member (!) pointing a finger at former VP of Engineering Damon Sicore as having “secretly shopped around grandiose ideas about a free knowledge search engine, which eventually evolved into the reorg creating the Discovery team.” Sicore left in July 2015. A big remaining question, for which there is no answer at this time: when the actual grant was submitted to the Knight Foundation.
An argument I have heard in recent days is that it’s common in grant-making to try for everything you can and see what actually sticks. This may be true, but if so, it doesn’t seem to have been worth it. That WMF leadership felt they had to hide the fact later on also underlines the mistake they knew they were making.
Another big question: how does this affect Wikipedia’s public reputation, particularly among donors, most especially among foundations? You have to think the answer is a lot. The WMF looks like the Keystone Kops. Why would you give it money? And right now, the Knight Foundation specifically must be asking what it’s got itself into.
Within the last 24 hours, the trickle of public criticism about Tretikov has become a widening stream. Some of it is taking place in the above comment thread, plenty is still happening at Wikimedia-l, but a lot of it has moved to a semi-private Facebook group called Wikipedia Weekly, where staffers previously not known for voicing internal dissent have been speaking quite frankly about how bad things are at 149 New Montgomery Street.
Yesterday afternoon on the mailing list, a developer named Ori Livneh replied to a plea for calm by community Board trustee Dariusz Jemielniak by explaining why they could not remain silent:
My peers in the Technology department work incredibly hard to provide value for readers and editors, and we have very good results to show for it. Less than two years ago it took an average of six seconds to save an edit to an article; it is about one second now. (MediaWiki deployments are currently halted over a 200-300ms regression!). Page load times improved by 30-40% in the past year, which earned us plaudits in the press and in professional circles.
…
This is happening in spite of — not thanks to — dysfunction at the top. If you don’t believe me, all you have to do is wait: an exodus of people from Engineering won’t be long now. Our initial astonishment at the Board’s unwillingness to acknowledge and address this dysfunction is wearing off. The slips and failures are not generalized and diffuse. They are local and specific, and their location has been indicated to you repeatedly.
Shortly thereafter Asaf Bartov—one of WMF’s more outspoken staffers, even prior to the last 48 hours—voiced his agreement and turned his comments back to Jemielniak:
Thank you, Ori. +1 to everything you said. We have been laboring under significant dysfunction for more than a year now, and are now in crisis. We are losing precious colleagues, time, money, *even more* community trust than we had previously squandered, and health (literally; the board HR committee has been sent some details). Please act. If for some reason the board cannot act, please state that reason. Signal to us, community and staff, by concrete words if not by deeds, that you understand the magnitude of the problem.
And then, about 10 minutes later, Lila Tretikov posted to this very conversation thread, and this is all she had to say:
For a few 2015 accomplishments by the product/technical teams you can see them listed here:
https://meta.wikimedia.org/wiki/2015_Wikimedia_Foundation_Product_and_Technology_Highlights
That is the complete text of her emailed post. That is really all she had to say, in a public thread specifically criticizing her leadership and all but explicitly calling for her removal. One gets the feeling, at this point, even Lila Tretikov just wants it to be over.
In the early morning hours of February 19, a WMF software engineer named Kunal Mehta wrote an impassioned, rather forlorn post on his personal blog, titled: “Why am I still here?”:
Honestly, I don’t understand why the current leadership hasn’t left yet. Why would you want to work at a place where 93% of your employees don’t believe you’re doing a good job, and others have called you a liar (with proof to back it up) to your face, in front of the entire staff? I don’t know everything that’s going on right now, but we’re sick right now and desperately need to move on. …
I love, and will always love Wikimedia, but I can’t say the same about the current state of the Wikimedia Foundation. I’ve been around for nearly nine years now (nearly half my life), and it feels like that world is slowly crumbling away and I’m powerless to stop it.
And that’s why there is really just no way Lila Tretikov can continue to lead the WMF. A week ago, the thinking was: the Board of Trustees chose her over James Heilman, so they’re really sticking with her. At the time it also seemed like the Knowledge Engine was a going concern, and their support for her owed to their insistence on moving ahead with the project above community and staff objections. Knowing what we do now, it’s inexplicable. The thinking now is: she obviously has to go, and the only reason the Board might have for not acting on it would be legal considerations.
For the sake of Wikipedia’s future, the Wikimedia Foundation needs new leadership. Lila Tretikov must resign, or she must be replaced. This is the most challenging article I’ve ever had to write. The next one, I hope, will be about the start of the turnaround.
Welcome to this new column, which highlights awesome articles and other content created or expanded to fight systemic bias in the previous month! This first column will highlight content created in the first two months of 2016, because why the fuck not. People wrote some great stuff:
This month in systemic bias, we had to write a whole bunch of shit that should have been written forever ago and generally made the world a better place. Go read these articles and learn about some badass people.
After reading this, if you feel inspired to write something yourself, let me know. I’ll feature it next time.
One featured article was promoted this week.
Three featured lists were promoted this week.
Five featured pictures were promoted this week.
The Super Bowl (#20) returns for its annual domination of this chart with Super Bowl 50 (#8) having been played on February 7, placing thirteen articles in our top 25, only slightly off last year's showing of fifteen articles. Aside from American football, the new film Deadpool takes two slots in the top 10, as did two Reddit "Today I Learned" threads. The American domination of the chart this week also saw Donald Trump high again at #4 after easily winning the Republican New Hampshire primary, and Bernie Sanders at #9 for winning the Democratic side of that contest.
For the full top-25 list, see WP:TOP25. See this section for an explanation of any exclusions. For a list of the most edited articles of the week, see here.
For the week of February 7 to 13, the ten most popular articles on Wikipedia, as determined from the report of the most viewed pages, were:
Rank | Article | Class | Views | Image | Notes |
---|---|---|---|---|---|
1 | Peyton Manning | 2,454,310 | In what may have been his final hurrah after a long career, the American football quarterback led the Denver Broncos (#25) to a solid victory over Cam Newton (#7) and the Carolina Panthers in Super Bowl 50 (#8) on February 7. | ||
2 | Deadpool (film) | 1,939,593 | The Marvel Comics antihero film starring Ryan Reynolds (pictured) was released on February 12. | ||
3 | Omayra Sánchez | 1,871,179 | As Reddit learned this week, a photo of this young girl, taken before she died in a volcanic eruption in Colombia (see Armero tragedy), was the World Press Photo of the Year for 1985. | ||
4 | Donald Trump | 1,504,756 | Trump won the Republican New Hampshire primary for U.S. President on February 9. He roundly clobbered his opponents with over 35% of the vote. His promises of winning so well we could not not believe it have become reality, and as improbable as it once seemed, the prospect of Trump winning the party's nomination is now being taken very seriously. | ||
5 | Deadpool | 1,452,087 | The character on which #2 is based. | ||
6 | Christopher Paul Neil | 1,445,649 | Reddit learned this week that Neil is a notorious pedophile known as "Mr. Swirl" or "Swirl Face" who was tracked down and arrested in 2007 after police were able to digitially "unswirl" photos of his face available online. | ||
7 | Cam Newton | 1,411,026 | Cam Newton, the quarterback for the Carolina Panthers, lost in Super Bowl 50 (#8) to the Denver Broncos (#25), primarily because the Broncos' defense was able to shut down Newton unlike any other team had this season. | ||
8 | Super Bowl 50 | 1,283,341 | Up from #17 and 636,927 views last week, it was played on February 7 at the Levi's Stadium outside San Francisco (pictured). Last year's Super Bowl XLIX placed fourth on this report with about 110,000 more views than this year. Personally I blame the drop on the failure to use Roman numerals this year. | ||
9 | Bernie Sanders | 1,272,272 | The lovable democratic socialist easily won the Democratic Party New Hampshire primary over Hillary Clinton. While even some in his own party view his plans as quixotic at best and confrontational at worst, his idealism has proven catnip to disenchanted young voters. | ||
10 | List of Super Bowl champions | 999,486 | This list invariably pops up once a year, as Americans first scramble for facts to determine which team will win, then rush back to see if their dream/nightmare came true. |
Latest tech news from the Wikimedia technical community. Please tell other users about these changes. Not all changes will affect you. Translations are available.
Recent changes
Problems
Changes this week
Meetings
Future changes
Tech news prepared by tech ambassadors and posted by bot • Contribute • Translate • Get help • Give feedback • Subscribe or unsubscribe.
For nearly thirty years, he was one of the most-recognized and influential members of the United States’ highest court.
Antonin Scalia, who died on the weekend while at a West Texan ranch resort, was a Justice on the Supreme Court of the United States—which holds supreme jurisdiction over all other courts in the country—for nearly thirty years following his appointment by Ronald Reagan in 1986.
We spoke to Wikipedia editor Gary Greenbaum, a lawyer in Virginia who is better known on the site by his username “Wehwalt.” He wrote the article on Antonin Scalia and got it up to “featured” status—an indication of its quality.
Though Greenbaum didn’t agree with everything Scalia said, he does say he admired the justice’s delivery.
“In [Scalia’s] years on the bench, no one was under as bright a spotlight as Scalia, and in part he shone it on himself,” Greenbaum says. “He will be long remembered for giving constitutional originalism powerful support and for making it sexy.”
Scalia was a staunch believer of textualism and originalism—the view that a law’s original wording should be followed to the letter—and during his time as a justice, espoused a consistently conservative stance both in voting and in ideology.
His death means the outgoing Barack Obama has the opportunity to nominate a new justice before the next president is elected—something now influencing the race for the presidential nominations on both sides.
Being featured, Scalia’s Wikipedia article has been peer-reviewed by other editors, and has been found to meet several strict criteria marking it as one of Wikipedia’s highest-quality articles. It was promoted in 2010 following around two weeks of discussion and tweaking, during which Greenbaum polished it to meet reviewers’ demands.
“I was inspired to improve his Wikipedia article by reading a biography of him, and having long admired his dissents, which were blunt, often funny, and never minced words,” he says. “I attended a talk he gave at my law school, George Washington, in the late 80s. The place was packed, but I found a perch on a garbage can. All I remember of what he said is the constitution which was stuffed with the greatest guarantee of rights was the Soviet one.”
Wikipedia’s article on Scalia was updated as news of his death broke. An anonymous editor was the first to edit the article to reflect the death, with an interesting choice of edit summary. In part due to the high quality and importance of the article, the update took some time to mix into the prose; Wikipedia works on verifiability, so editors waited for respected publication to report on the death.
“I quickly realized that [Scalia’s death] would put a whole new intensity into this year’s election, but more immediate need was trying to keep the article from going out of control,” Greenbaum recalls. “There are times when the public truly takes over a Wikipedia article, and this is one of those times.
“Think of it as a huge heavy object sliding across ice. You don’t want to get in front of it because you’ll wind up underneath, but by pushing and hitting it at an angle, you can sometimes keep the article from exploding.”
Readers certainly did flock to Scalia and other related articles in the wake of his death. Pageviews on his article jumped by 33,710% and 49,730%—or in actual terms, from about 1,876 per day to over 634,269 and 934,798 on February 13 and 14, respectively. You can see and play with this (and related) data yourself on Wikimedia Labs.
With Scalia’s death, it is widely commented that Obama, as a fairly liberal President, would likely nominate a liberal-minded justice to fill Scalia’s conservative seat. The Republicans, however, have threatened to block Obama’s nomination, arguing that Obama’s selection would not represent the wishes of voters (and that, instead, that of his successor, to be elected in November, would). The Republicans run the Senate, making Obama’s job harder still.
The American press has already identified several potential candidates for the role, all of which you can read about on Wikipedia. The highest-profile include Sri Srinivasan, Merrick Garland, and Paul Watford.
Greenbaum suggests that, whomever he opts for, Obama will likely get his way based on the history of these situations. “The stakes are very high, and [the Senate] might prefer just refusing to confirm and hoping for the next president,” he explains. “I don’t see Obama compromising though, he doesn’t in this sort of thing. Whoever it is, it will be uncomfortable for the Republicans to refuse.
“The record of the nominee will be gone over in very close detail and the nomination will be tried in the public eye before ever the Senate weighs in.” Indeed, the Senate’s Committee on the Judiciary, which debates the president’s nominated candidate, holds its hearings on television as of 1987.
“Basically it will be a war of public relations,” he adds.
The situation is complex, but throws another issue into what has already proven a quite remarkable presidential race. Candidates not given much chance only months ago are giving once runaway favorites a run for their money.
“In my younger days, I enjoyed political novels such as those of Allen Drury,” Greenbaum says. “But he would have strained to imagine someone like Justice Scalia, and strained even more to invent a situation like this. But we are living it, and there is no way to flip to the end early.”