In short
Podcast Summary: The 404 Media Podcast - Episode: How Wikipedia Will Survive in the Age of AI
Episode Overview In this episode of The 404 Media Podcast, host Joseph interviews Selena Deckelmann, the Chief Product and Technology Officer at the Wikimedia Foundation. With Wikipedia celebrating its 25th anniversary, the discussion focuses on the site's unique governance model, its resilience against the rise of generative AI, and the challenges and opportunities that lie ahead.
Key Themes and Discussions
- Importance of Wikipedia
- Wikipedia is one of the most visited websites globally, serving approximately 15 billion page views per month.
- It has a vast community of about 250,000 editors who contribute to over 65 million articles in more than 300 languages.
- Governance and Community Model
- Wikipedia operates on a community-led model, where content is created and moderated by volunteers.
- The line between the Wikimedia Foundation and the Wikipedia community is defined; volunteers focus on content creation, while the Foundation supports the technical infrastructure and legal aspects.
- Wikipedia's Resilience Against AI Threats
- There is a growing concern that generative AI could lead to misinformation, with AI-generated content diluting the quality of information available online.
- Several issues emerged regarding AI, including:
- AI Hoaxes: The community's efforts to protect Wikipedia from misinformation.
- Backlash: Editors opposed AI-generated summaries due to concerns about maintaining quality and reliability.
- Collaboration Between Foundation and Editors
- Deckelmann emphasizes the communication channels between the Foundation and the editing community, highlighting ongoing efforts to improve collaboration.
- Tools and systems are being developed to enhance the editing experience and maintain content quality.
- Machine Learning Integration
- Wikipedia currently employs machine learning for improving edits, such as identifying peacock language (overly positive language) and ensuring citations are included.
- Future prospects include enhancing these tools to assist editors in real-time, making the editing process more efficient.
- AI in the Future of Wikipedia
- While emphasizing the human-led aspect of Wikipedia, Deckelmann acknowledges the potential for AI to play a role in future operations, provided it aligns with the platform’s values of transparency and community involvement.
- The need for a reciprocal relationship in the AI age is emphasized, where human contributions remain essential to knowledge creation.
- Concerns About AI and Content Quality
- The growing reliance on AI tools raises concerns about the decline in human visitors to Wikipedia and the potential reduction in contributions from editors.
- The Foundation is exploring partnerships with AI companies to ensure that Wikipedia’s content is respected and integrated into AI systems responsibly.
- Future Aspirations for Wikipedia
- Deckelmann expresses hope that Wikipedia’s governance model could be replicated across other areas of the internet, promoting collaborative knowledge-sharing.
- The importance of understanding Wikipedia’s operational model to inspire similar initiatives is crucial for the future.
Key Takeaways
- Wikipedia’s model is unique in its ability to collaboratively create and manage content, and this model is resilient in the age of generative AI.
- The Wikimedia Foundation's role is vital in supporting the community and ensuring the site's integrity against misinformation.
- As AI continues to evolve, maintaining a human-centered approach to content creation and ensuring quality will be paramount for the longevity of Wikipedia.
Conclusion In summary, Selena Deckelmann provides insights into how Wikipedia is adapting to the challenges posed by AI while maintaining its foundational principles. The episode highlights the importance of community, the role of technology in enhancing content quality, and the vision for a collaborative future on the internet.
Written by AI. May contain mistakes. Listen to the episode to check what was said.
Chapters
Tap a time to open that second in VOUnderstanding Wikipedia's Unique Structure
2:15 to 4:23
Discussion on Wikipedia's functioning and community impact.
“across about 300 languages, more than 300 languages.”
The Importance of the Edit Button
4:23 to 4:50
Exploration of the edit button's significance in Wikipedia.
“But I would add to that that it is a website with an edit button, but good.”
Wikimedia Foundation vs. Wikipedia Community
4:50 to 8:36
Examination of the relationship and roles of the Foundation and editors.
“But before we get to that, something that I always find pretty interesting and complicated is the line between Wikipedia, the community-led, editor-led project and the Wikimedia Foundation.”
Communication and Collaboration in Wikipedia
8:36 to 11:48
Insights into communication channels between the Foundation and editors.
“And have you ever experienced tension between these two separate, but obviously cooperative groups?”
Research on Political Neutrality in Edits
11:48 to 13:15
Discussion on research findings regarding the political neutrality of Wikipedia edits.
“And one of the more fascinating pieces of research that I've come across, it was from 2017 and it was trying to study what happens when different people of different like political persuasion.”
Role of the Cyclone Group in Wikipedia
13:15 to 14:03
Highlighting the significance of community groups like the Cyclone Group.
“And obviously, if you're on an extreme political end, that is not something you like.”
Hurricane Response and Wikipedia's Role
14:03 to 15:00
Learn how Wikipedia editors play a crucial role in responding to disasters.
“I'm sorry, I don't have like the name of it, like top of mind, but like last year I did a little check-in on them and they were all working together.”
AI's Impact on Wikipedia: A Reflection
15:00 to 17:00
Discover how Selena Deckelmann's views on AI and Wikipedia have evolved over time.
“And there are other ways to find out whether different news sources are the best in the moment.”
Sustainability and Human Contribution
17:00 to 19:14
Explore the importance of sustainability and human contributions to knowledge systems.
“and reducing toil for people who are trying to detect cancer.”
Reciprocity in AI and the Web
19:14 to 21:54
Understand the challenges of reciprocity in AI compared to the original web design.
“What do you think about agentic AI that kind of messes with the incentives or removes this link system you mentioned?”
Show all 23 chapters
The Role of Wikipedia in AI Training
21:54 to 23:15
Learn about the significance of Wikipedia as a training resource for AI models.
“Because, you know, there's another study that I just, it's only a couple years old.”
The Impact of AI on Wikipedia's Traffic
28:00 to 29:54
Discover how chatbots affect Wikipedia's editor pool and partnerships with AI companies.
“about the foundation noting that the different chatbots appear to be sending less referral traffic to Wikipedia directly.”
Challenges of Bot Traffic and Scraping
29:54 to 31:37
Learn about the challenges Wikipedia faces from bot traffic and scraping behavior.
“As I mentioned at the beginning, we have our own data centers, right?”
Encouraging Contributions to the Commons
31:37 to 33:48
Explore efforts to encourage contributions to knowledge creation projects like Wikipedia.
“So, so I would just say like the, the partnership that we need, like, first of all, an enterprise for sure.”
Machine Learning in Wikipedia Editing
33:48 to 36:06
Understand how Wikipedia employs machine learning to enhance the editing process.
“So machine learning has been part of the work, not just of the foundation, but volunteers themselves have run machine learning algorithms to correct errors, you know, to look at different kinds of data.”
Community-Led Efforts Against AI-Generated Content
36:06 to 37:55
Discover the community efforts to detect and remove inaccurate AI-generated articles.
“But, you know, what if they decline, then it's most important that we make each editor as productive as they possibly can be.”
Foundation’s Support for Editor Communities
37:55 to 42:05
Learn how the Wikipedia foundation collaborates with editors to improve content quality.
“In general, that doesn't work in my line of work.”
Evolving Wikipedia: Community Engagement and AI
42:05 to 43:01
Learn about Wikipedia's adaptability and community involvement in the face of AI.
“It is not designed to be perfect from the beginning.”
Diverse Perspectives in Wikipedia's Community
43:01 to 44:49
Discover the variety of opinions within Wikipedia's community regarding AI integration.
“scheme of things are minor, but are a big deal to editors.”
Navigating AI Tools in Wikipedia's Framework
44:49 to 46:45
Explore the challenges and considerations of implementing AI tools at Wikipedia.
“And my experience, you know, having worked in this area for the past, you know, three and a half or so years and being part of open source communities for decades.”
The Practicality of AI in Knowledge Sharing
46:45 to 48:37
Examine the balance between AI usage and moral considerations in knowledge sharing.
“tool, you know, I don't know, you know, and it's, it's like a, it's like a hard, I'll just say, like, I don't think that that's super helpful.”
Future of Wikipedia and AI: A Vision
48:37 to 50:21
Consider the potential trajectory of Wikipedia over the next century amidst AI advancements.
“It's part of my job to support the mission, which is to get as much knowledge as possible to as many people for as long as I possibly can.”
Lessons from Wikipedia's Governance Model
50:21 to 52:24
Learn how Wikipedia's governance could inform other systems on the internet.
“And then I guess a lot of what we've talked about is essentially the governance model and how successful it has been.”
Transcript
Automatic transcript. May contain errors.0:04Hello, and welcome to the 4forMedia podcast, where we bring you unparalleled access to hidden worlds, both online and IRL. 4-4 Media is a journalist-founded company and needs your support. To subscribe, go to 4-4media.co. As well as bonus content every single week, subscribers also get access to additional episodes where we respond to their best comments. And they get early access to our interview series, too. Gain access to that content at 4-4media.co. This week, we're joined by Selena Dekelman. Selena is the Chief Product and Technology Officer at the Wikimedia Foundation, the nonprofit organization that operates Wikipedia.
0:45That means Selena oversees the technical infrastructure and product strategy for one of the most visited sites in the world and one of the most comprehensive repositories of human knowledge ever assembled. Wikipedia is turning 25 this month, so I wanted to talk to Selena about how Wikipedia works and how it plans to continue to work in the age of generative AI.
1:12Everyone knows what Wikipedia is, but something that I've encountered in my writing is that it's actually harder to describe comprehensively than you might think. It's a website, it's a technology, it's a community. I was wondering, what is your best definition of what Wikipedia is and what do you do there? That's a great question. I find that too, honestly. So I'm the chief product and technology officer at the Wikimedia Foundation, and we support Wikipedia and a number of sister projects like Commons, Wikidata and Wiktionary. I think when I think about it, I think about the websites and the number of page views that we're serving.
2:00So we're serving like 15 billion page views a month, about 1.5 billion unique devices. and the work that I do is to support 250 ,000 editors who are creating and maintaining over 65 million articles across about 300 languages, more than 300 languages. And in that work, when I think about what it is, we're unique, you know, we still have our own data centers. You know, there's stuff that we do in the cloud, but for the size of organization that we are, we're pretty small, it's about 650 people and my team's maybe like half of that. There's even fewer developers. We're really small for a top 10 website and we're using a lot of open source software, mostly open source software.
2:47And some of the staff that I work with, including the people that I work the closest with, they've been around since the very beginning. So we're here to talk about, you know, 25 years of this project. And there are people who, you know, At the same time as they were working on racking servers for the first versions of the website, they were running paper routes and writing their theses. And this is a global community of supporters, developers, editors from the very beginning as well. So it's just pretty incredible what that started out as and kind of the dream of creating a web page with a button that just says edit and letting the whole internet click that button and being like, okay, let's see what happens with that.
3:40If you told someone you were going to do that from the very beginning, I don't think they would have thought that would work very well, but it has. And when I think about what it is, it's that button, it's that edit button that anyone can press. It's all of these people who have worked together to produce the corpus of knowledge that exists now. And it's the principles and processes that those volunteers have created together that creates such an incredibly reliable, verifiable, transparent system for knowledge. Yeah, that's how I would describe it. I love that description of a website with an edit button.
4:23But I would add to that that it is a website with an edit button, but good. Because a lot of the internet is basically what you're saying, but bad. And I think something that I want to get into in our conversation is what has been done on your end to make sure that it's still a productive, net positive force in the world where so many others have failed. But before we get to that, something that I always find pretty interesting and complicated is the line between Wikipedia, the community-led, editor-led project and the Wikimedia Foundation. How do you explain where one begins and the other ends?
5:07Well, from a content creation perspective, I see a very clear line. You know, the volunteers, they self-organize and they create and edit the content. And it's just an incredible system because like I said before, we put up this webpage, anybody gets to click the edit button. And from the sound of that, it doesn't really sound like it's going to work. But it works because of the people who contribute. They're really good people, like you said. They've worked together to create a system that's designed to improve that content and add to it over time, not be 100 % perfect from the very beginning.
5:52It's designed for iterative improvement. And there's a lot of grace that goes into that and assumptions of good faith among the people who are choosing to contribute. You know, when I think about this, I think about like the many individuals and that's how they think of themselves as well. You know, it's not just like one community of people. It's like all of these individuals doing things. and they go by funny handles. Like there's this guy named Hurricane Hink. He wrote an article about a typhoon that's really important to my origin story was Typhoon Pamela that hit Guam in 1976. And he works with a community of people in a group, a wiki project that is called Project Tropical Cyclone.
6:32And they're part of this international group. It's, you know, when I think about one of the incredible aspects of Wikipedia, it's this these different groups of people that form gigantic basically newsrooms that are like clearing houses for all of the things that are being published on certain topics at any point in time like when Queen Elizabeth it was apparent that you know she was probably going to pass away pretty soon a group of these editors got together they named themselves I think the project was named London Bridge and they got together and they made lists of all the articles that were going to change.
7:08They were all like ready to like come and start just immediately making the changes as the news became available. It's just, it's just a very surprisingly like fast and accurate system for getting that information to the public, you know, in what the public feels is like a very trustworthy way. So yeah, so that, that's, that's like how I think about, you know, what the volunteers are and what they're responsible for and what they do. And from the foundation side, you know, we're accountable for the infrastructure to support all of that. So we enable help with like fundraising, legal partnerships.
7:44You know, in my case, I'm providing the technical infrastructure that enables all that global collaboration. And it's a little bit different, you know, from other platforms in that we also have a lot of volunteers who contribute to the technical infrastructure. And our guess is that maybe there's like 50 ,000 of these that have contributed from the beginning. You know, there may be more, maybe less. I don't have an exact number on that. But there's probably about 10 ,000 of them that are active worldwide today. And so unlike the content, though, I am ultimately responsible for the technical systems, including those data centers I talked about before.
8:23I guess two questions. Because I know you interact, right? There has to be a line of communication between the foundation and the editors. I'm wondering where's that line of communication for you? Where do you interact with them? And have you ever experienced tension between these two separate, but obviously cooperative groups? Yeah, there are many, many lines of communication. So there are some primary ones, but I want to share just how I felt when I started my job. So I've been here, you know, a little over three years. And when I started, I just went on, you know, different pages about the foundation and Wikipedia and searched for different communication channels because I was like, oh, maybe I should subscribe to a few mailing lists.
9:14You know, maybe I should get on some IRC channels because I assumed that people were using IRC and things like that at the time. And what I discovered is that there were thousands, thousands and thousands of channels, you know, in all sorts of communication mediums like Telegram is a very popular medium. Now there's many discords. There's lots of mailing lists. So many, many different communication channels for like rapid and open and very frank communication between people. So that's like one aspect of it. I definitely have like more like official channels, you know. So we created this thing called the Product and Technology Advisory Council.
9:53And that's a group of, you know, longtime, very trusted volunteers and trusted in terms of their reputation in the communities who come together with me and talk about ways that we can improve the infrastructure together. And one of the ways that we've talked about it, and when I say infrastructure, it's both the technical things, but also the ways that we do things. So like, how do we communicate about experiments that we're running? That's been an important topic recently. And so we come together and talk to them about what would be the best way for us to do that. And they make recommendations because the ways that people communicate on Wiki, that's what we call it.
10:33On Wiki is like when you type a message into a talk page or some other forum where you're actually trying to interact with a person instead of writing an article. And so when we're on wiki, there are different ways, you know, to share things. There's different forums that are more comfortable or more recognized than others. And so we like talk to the other human beings to find out, you know, where those places are and, you know, what the best way it would be, you know, what is the best way for us to introduce a new topic? Yeah, I think that that pretty accurately describes the broad scope of it.
11:10And I think, you know, it's a human system. And it is not without conflict. so you know and i i i was like thinking about before you know before i came on the the kinds of research that has been done on wikipedia these are so much you know it's like an incredible system because it's so open and all of the edits that have been done by all of the different editors they're like available to look at you know and you can see the time stamps you can see like what the person edited, you can see whether it was reverted. So there's all this like very rich information there. And one of the more fascinating pieces of research that I've come across, it was from 2017 and it was trying to study what happens when different people of different like political persuasion.
12:00So like, you know, in the US, if you've got a Democrat or Republican, what happens if they come together and edit on a particular topic together? And so what this research says is that over time, when folks do that, when they express those political points of view on Wikipedia and then they edit together, their editing becomes more neutral over time, likely as a result of being exposed to these different ideas. I think that's really incredible because there's not very many social media platforms or internet platforms where that is the case, right? Like the algorithms might like push you more toward a particular point of view, but here you're interacting with other human beings.
12:44And, and as a result, it seems like people get more moderate. And I, I think that's like such an amazing finding, you know, this is like a very simple tool, you know, it's an article with a talk page and then a set of policies that say that we're going to make pages about a topic not from a particular point of view, but as a summary of different points of view. And that tool, I think, has resulted in something quite special and unique. Yeah, it's an amazing finding and it's very congruous with the time, obviously. Yeah. And this is not something I want to get into, but I feel like that's an obvious reason that people on the extreme ends of the political spectrum are often upset with Wikipedia is because it is by, I don't know if by design, but the result is something kind of in the middle or kind of neutral.
13:42And obviously, if you're on an extreme political end, that is not something you like. Sorry, I completely forgot to follow up. How is the Cyclone Group related to your origin story? They're great. They're so amazing. They still like, they do such amazing coverage. Yeah, I, they have multiple different projects, but there was a hurricane that happened in Florida. I'm sorry, I don't have like the name of it, like top of mind, but like last year I did a little check-in on them and they were all working together. Hurricane Hank actually had like edited the page, but there were other people, you know, that had been mentored into taking the lead, But they respond immediately to disasters.
14:23And I think what's so helpful about that kind of work, you know, is that it's a clearinghouse for accurate information, you know, and they're helping sift through a lot of different reports that might be coming out that, you know, are or are not accurate or are not reliable. and they find the best and summarize it there. And I think that that human judgment in those moments is like incredibly valuable, especially right now. And I think as different news sources become more or less reliable, it's helpful to have a group of people that are commenting on that. And there are other ways to find out whether different news sources are the best in the moment.
15:09But I do think that Wikipedia editors have done a pretty good job. of keeping up with that as times have changed. So in 2023, he wrote a great post about AI and Wikipedia. I'm going to oversimplify here. So feel free to expand on any point if you want or correct me. But my reading of it is that essentially your message was that Wikipedia is inherently a human-led project. This is something I think has already emerged from our conversation. but that Wikipedia already uses machine learning in some ways and that it may be useful in the future. So this is 2023, given the rapid development of AI, that kind of feels like a long time ago.
15:58So I just wanted to check in and ask, has your perspective changed at all since then? And is that an accurate summation of how you feel about AI and Wikipedia? I think it's an accurate summation. There are some things that have definitely changed in that time. I went back and looked at that post as I do pretty regularly to see if there's, should I substantially revise it? I think we're probably about due, not necessarily for a substantial revision, but just like a reflection on what I and my colleagues thought then and what we think now. I think the heart of what I said then, you know, about sustainability, about equity, about transparency, those qualities remaining crucial, you know, to information on the Internet and the spread of knowledge on the Internet.
16:49Those things are so important. And that part of it hasn't changed. And I still believe that we have a sustainability crisis on our hands. And a thing that I hope for and advocate for is that companies that are, you know, creating new AI systems, some of them just incredible, you know, doing amazing things, advances in medicine and reducing toil for people who are trying to detect cancer. I mean, there's so many incredible applications of the technology that are obviously good for society. So I think that that is going to continue to be true. And the systems for gathering knowledge, I think, are going to continue to improve.
17:34And they already are much better than they were when I wrote that post. But the sustainability of human contributions to those systems, that is what I think we have not solved. And that's the question everyone needs to grapple with. I think Wikipedia has done a really good job, first of all, providing a mission and a purpose that people feel so good about contributing to. They want to come and share what they know. They want to collaborate with other people on doing that. And they're continuing to do it. So that's good. And then for these other systems, we have to think about what is the way that we're going to motivate people to contribute to the common good here.
18:22because the web, when it was originally conceived, it was built on links, which is, it builds that reciprocity into the system inherently. That was the web. Like an agentic AI system, I'm not really sure where the reciprocity is. That's the big question. How are we going to think about that system in the same way that we conceived the web? And I think it's totally possible. Human beings conceived the web, conceived the internet, created this system, created the rules around it, created all of the enterprises around it. The nonprofit systems and the profit systems all got created on top of that.
19:01And I think this is the question for the AI age. How do we also create systems of reciprocity that are for the common good at the same time as we have these commercial systems? And I think it's a little unbalanced right now. Say more about that. What do you think about agentic AI that kind of messes with the incentives or removes this link system you mentioned? Is it because you're locked into one specific LLM? Why do you think that has that impact? Well, if we just look at the link system, there's an assumption that a person is going to follow those links to learn more. Right. And in the agentic system, that is not the assumption.
19:47You know, it's very convenient and I know why it's compelling. And it's useful. You know, I use AI systems both to like vibe code things also to ask it, you know, what is the best like way that I can arrange my office to make it more pleasing and more, you know, whatever. How many more plants should I add? But what is not there is so I just gathered all of this information, but where did it come from? Sometimes, you know, that over time, what I have seen with, you know, chatbots in particular, I'm not seeing it as much with the agents, but you see the need to share the links, you know, because people want to verify is that information correct.
20:32they want to feel I would guess like the the producers of those systems want to help people feel like they can trust the you know the the content that's produced and if I compare it to what's evolved you know in wikipedia over time there's all these requirements you know when when you create an article you are required to offer citations you know and that is one of the ways that educators, you know, look to Wikipedia. They don't say to kids, go quote Wikipedia. They say, go to Wikipedia and look at all of those sources at the bottom of every article. Learn from those, you know, quote from those, you know, read the article to get a sense of this topic, but then go to those sources.
21:17And I think that's like a fundamental challenge. Like the reciprocity of the web is also built into Wikipedia. But, you know, how are we going to do that? And I'm not here to like mandate that it's links. You know, like, I don't think that there's only one way to create systems like this. But I do think we need to put some like real imaginative thought into what that's going to be. Because what we want is for people to continue to contribute to incredible projects like Wikipedia. We want them to be motivated to do so, so that the value, you know, of human knowledge creation continues to be part of these systems, right?
21:58Because, you know, there's another study that I just, it's only a couple years old. It's from 2023. I guess that's three years now. So there's a study that was done about the pile, you know, this is a source of training data. And some researchers, they looked at what happens when you remove different things from the pile. And how does the model respond differently? What does it produce that's different? And when you remove Wikipedia, the responses suddenly become much more toxic. And I think that's so interesting. What is it? And it'd be fascinating to dig even further into that and be like, why?
22:41You know, why exactly? I mean, I have my theories about why I think it's a really well written, high quality, neutral source of information. I think that's why. But I think there's more to know, you know, about that. I think there's so much to know. I think we haven't devoted enough time or energy to this idea about reciprocity because in the end, like these AI models, they are dependent on human generated content to know new things. And that's either through training or through accessing new content that's produced through agents. And that's going to continue to be important no matter what.
23:24Here's the thing about New Year's resolutions. Nearly 80 % of them fail by February. And it's not because people lack willpower. It's because they lack data. You can't fix what you can't see. Real, lasting change starts when you actually understand what's happening inside your body. Things like leptin resistance, thyroid dysfunction, chronic inflammation, or hormone imbalances. These hidden issues can derail even your best efforts to get healthier, feel better, before you realize what's going wrong. That's why I chose Function Health. This year, I want to focus on figuring out more about how my body processes food, what types of exercises I should focus on, and honestly, I want to know why I feel tired all the time.
24:04Function is the only platform that will actually show me what's happening inside my body. I just scheduled my test on the Function Health platform so I can figure out what's going on and I couldn't be more excited. Function Health is the only platform that gives you access to over 160 biomarkers covering hormones, metabolism, heart health, inflammation, stress markers, and toxins, all tracked in one secure place over time. You can even add MRI and chest CT imaging, the type of holistic look at your health, most people never have access to. There's a reason why doctors like Mark Hyman, Andrew Huberman, and Jeremy London are behind function.
24:41When you stop guessing and start measuring, everything changes. I'm looking forward to seeing how my current lifestyle, diet, and exercise routine are affecting important biomarkers. And I'm hoping to be able to make resolutions based on my biology and actual data. Own your help for$365 a year. That's a dollar a day. Learn more and join using my link. Visit functionhelp.com slash 404media or use gift code 404media25 for a$25 credit toward your membership. A new year, colder days. This is the moment your winter wardrobe really has to deliver. If you're craving a winter reset, start with pieces truly made to last season after season.
25:23Quince brings together premium materials, thoughtful design, and enduring quality so you stay warm, look sharp, and feel your best all season long. Quince has everything you need. Men's Mongolian cashmere sweaters, wool coats, leather and suede outerwear that actually hold up to daily wear and still look good. Their outerwear is especially impressive. Think down jackets, wool coats, and Italian leather outerwear that keep you warm when it's actually cold. Each piece is made from premium materials by trusted factories that meet rigorous standards for craftsmanship and ethical production. By cutting out middlemen and traditional markups, Quince delivers the same quality as luxury brands at a fraction of the price.
26:04The result is classic styles you'll love that hold up year after year. I've been wearing this 100 % cotton sweater basically every day. It's stylish, held up great in the wash, and always gets me compliments. Honestly, it's become one of my favorite pieces. Refresh your winter wardrobe with Quince. Go to quince.com slash 404media for free shipping on your order and 365 day returns. Now available in Canada too. That's quince.com slash 404media. Free shipping and 365 day returns. quince.com slash 404media. This episode is sponsored by BetterHelp. It's January. We're all back to work. The holiday season is over.
26:45And boom, anxiety is back. It's 2026. The news is what the news is. And friends are always asking me, how do you do this? How do you stare into the abyss every day? It helps to have a professional to talk to. And that's where BetterHelp comes in. BetterHelp makes it easier to get an outside, unbiased perspective from a licensed therapist. Someone who's there to help you identify what's weighing you down, what's scaring you, what's holding you back. Whether that's fear, doubt, pressure, the state of the world today. Their therapists are fully licensed. They work under a strict code of conduct. And BetterHelp does the matching for you.
27:26So you can focus on what you actually want to work on, not on filling out paperwork or calling around. And if your first match isn't the right fit, you can switch therapists at any time. BetterHelp makes it easy to get matched online with a qualified therapist. Sign up and get 10 % off at betterhelp.com slash 404media. media. That's B-E-T-T-E-R-H-E-L-P.com slash 404media.
27:59Yeah, I should mention, I don't have the article in front of me, but I did write a few months ago about the foundation noting that the different chatbots appear to be sending less referral traffic to Wikipedia directly. And that is a concern because, as you mentioned, that is kind of reducing the pool of potential editors that we need in order to keep the fire burning, to keep the flame alive. And it does mention in the post that the foundation is thinking about and talking to the AI companies about how we might be able to improve that situation. I'm wondering, generally, do you think OpenAI, Anthropic, Google, are they able to be good stewards or good partners in this project?
Read the full transcript
28:54So I think that we are partners already. And as far as are they good partners, you know, I think that every single person goes to work every day and tries to do a good job. That's what I fundamentally believe, right? And I think that, you know, the incentives in the current system are to take as much as possible as fast as possible. So that's hard. That's a hard dynamic to be operating within. It is, I think, the greatest challenge that I face every day, like in this environment. And, you know, the reason why we create it. So there's like a project called Enterprise that we run. And what it is, is it's a set of APIs that we're asking commercial users to use instead so that they can support our infrastructure.
29:54As I mentioned at the beginning, we have our own data centers, right? And we don't have the capacity of AWS to just dynamically respond to, you know, hundreds of thousands of bots, like attacking our infrastructure effectively. You know, the scraping behavior starts to just look like a denial of service attack in the end. And many have responded well. And I think that the project is going well in partnering with them on that front. And there are incentives are aligned. You know, they want fast, reliable access to the content. And we can provide a much better service level agreement, you know, with, you know, service level to them if they partner with us in that way.
30:39And we do find sometimes that when we try to reach out to companies, they don't respond to us. And this is, you know, and this goes back to something like from the early internet that, you know, people would create bots that scraped websites. And they didn't necessarily update the content, contact information, you know, or they put bogus contact information in there. Not even maliciously, but just because somebody like, you know, took some code off the internet and copied it and then like let her rip, you know. So there's a little bit of that and people are moving like really fast. So sometimes I think that's the issue.
31:20But when we reach out to these bot developers, yeah, sometimes they don't respond and we just have to block them. And that's been a challenge. I think another thing that, I don't know if you saw the recent post from Brian Krebs about residential proxies. I have not. Oh, this is a good one. You're going to have a good time. So you should go read this.
31:47it's talking about the rise of residential proxies to it's it's sometimes they're being used for denial of service attacks but also increasingly there are like third-party commercial resellers they're using them to do things like scrape the internet so um to make the traffic seem authentic yes yeah yeah okay got it yeah and i so anyway so this is not really like a thing that i would imagine um you know marquee brands companies are doing but enough companies of some kind are doing it that it's a problem for us and it's not just a problem for us it's a problem for for many organizations that are trying to understand the difference between authentic and, you know, human, inauthentic and human traffic.
32:40So, so I would just say like the, the partnership that we need, like, first of all, an enterprise for sure. And then looking forward, the partnership that, that we want is how do we encourage people to contribute to the commons, you know, for the common good? Because I think these kinds of knowledge creation projects and Wikipedia is only one, You know, there's like OpenStreetMap. There's, you know, the Creative Commons, like archives. There's many, many of these kinds of projects that have small and large data sets, and they're all amazing. So how do we keep that alive on the internet? You know, so one of the things like looking back, you know, to the very beginning, Wikipedia, I think, is delivering on the promise, the early promise of the original internet and how people conceived of the web.
33:28It's like a place where people are coming to collaborate. They're producing an amazing thing together and it's been durable for a long time. And I think we are in a moment where that's at risk if we don't find ways to sustainably support people contributing to the commons. Can you talk a bit more about how Wikipedia is currently using machine learning? So machine learning has been part of the work, not just of the foundation, but volunteers themselves have run machine learning algorithms to correct errors, you know, to look at different kinds of data. Like, for example, can we predict whether or not an edit is good or bad?
34:14You know, that's like such an interesting problem, you know, and we have a model for that called the revert risk score. so is it likely if a human being sees that edit you know are they going to revert it or let it remain so so those are those are like some some ways that have existed for a very long time more than 10 years and we've continued to improve those models ourselves and with volunteers over time more recently we've been looking at ways that you know as an editor is doing their work in the same way that you might experience, you know, a word processing editor today, you know, where you'll get like a little squiggle line if you like misspell something or if the grammar doesn't seem quite right.
34:57We have different things specific to Wikipedia that we can prompt people with, like, did you include a citation? You know, that's like a really good one. Another one is, there's like a funny phrase for this in English Wikipedia, it's called peacock language. So it's like something that's overly complimentary or positive. So we don't like to do that because it's not neutral. And so we'll have like a little prompt that like looks at the language and tries to give feedback to the user as they are typing. You know, hey, like this looks like, you know, a tone that's not encyclopedic. Would you like some suggestions or, you know, could you revise that sentence?
35:36So we're doing things like that, that really help the editing process and help a user, you know, that's editing in real time be more successful in their edits. And I think in general, that's like how we think about the ways that we can use machine learning, you know, now and into the future. How can we make an individual editor like that much more effective, you know, in a moment, make them more powerful? Because, you know, we have quite a few editors, my hope, you know, and my dream and the work that I'm doing right now, it's to increase that number. But, you know, what if they decline, then it's most important that we make each editor as productive as they possibly can be.
36:20Yeah, that's great. I just want to, it's important for me that you lay that out because something that we struggle with as a publication that is very critical of AI, and I think our readership is very critical of AI, Machine learning, very broad term, has many applications that people might not realize that they use and enjoy and rely on. So just want to make that clear before we kind of move further into some AI conversation. You mentioned wiki projects where are these working groups within the editor community that come together for specific purposes. I wrote about one last year or two years ago now called WikiProject AI Cleanup.
37:02And basically what they do is they go around Wikipedia and they try to detect, confirm, and then remove AI-generated articles, which I think there are many reasons why you might want to remove them, but the obvious one is that they have incorrect information, like completely fabricated, not factual information. And that is a huge problem across the web. That's something we cover a lot. and is obviously something that is very important for Wikipedia's integrity. But this is a community, again, this is an editor-led effort. I am wondering, is the foundation able to do anything about it? Does it want to do anything about it?
37:45Is there ways that you're thinking about supporting this wiki project or doing your own things separately? I definitely don't think of it as doing our own things separately. In general, that doesn't work in my line of work. And at the foundation, we always have to be collaborating with the volunteers on nearly everything that we do, to be honest. Right. But I really love that coverage. I love that you talked to the volunteers directly. I think that they always have such a, you know, just clarity, you know, as professional writers, like basically, you know, they're volunteers, but like their writing is incredible.
38:35And they spend a lot of time, you know, dealing with the front lines of this phenomenon, right? Like they know exactly what is happening and they're dealing with it in real time and at scale. And they mentioned some of this, you know, like that there's, you know, automatic detection tools, you know, that you can try to use. It's like varying effectiveness, you know, it's like use AI to fight AI. I don't know. You know, some of it's good. I think some of the tools that they have produced, like, and when I say tools, I mean, just like documentation, they've created like an incredible compendium of like how to identify AI generated text.
39:13And it's the most authoritative thing that I've ever seen. You know, it's very long. And it's part of the AI cleanup text. And, you know, I refer to it. We can look at that for hints about automation that can be created. Because of the large volunteer community, those volunteers have created a number of tools. There was one more than six months ago that was mentioned by one of the founders of Wikimedia Deutschland. and he and I talked a bit about it and we kind of did a mini study as a result of his presentation. But he looked into ISBNs, like fake ISBNs that were showing up and its prevalence.
39:56And he started with German Wikipedia but then kind of expanded his study to a couple other Wikipedias. I'm just going to jump in. ISBNs are like the ID numbers for books, publications, right? Yes. Yeah, yeah, yeah. Sorry. Yeah. my library bias like coming into play there but but um that was like a super interesting one right so so i guess like just to to kind of go to your main question like what are we what are we doing about it i think you know from an editorial perspective you know some of the different wikipedias so so there's all these different language editions of wikipedias they have different rules and some of them have actually done work to generate a large number of articles using generative AI tooling.
40:43And then what the question to the community is, is like whether those articles are high quality enough to keep them. And for some of the languages, they're like, yes, like it's high quality enough to keep it. But on English Wikipedia, that is like just not really been the case. And so for them, you know, they have a different set of rules. And my role is to support these different communities and the choices that they're making. And then to help them with things like tooling that tells them, like gives them an indication of how high quality articles are or not. So that's, I think the main way that I can help.
41:19And if they ask me, they're like, you know, can you just like block, you know, some particular, you know, large group of users or something like that. That's honestly like a thing that they like largely control as well, but I can help with that. But that's not what they've asked for. Like what they've asked for are things like, can you help us detect this better? Can you give us tooling that helps us like find these particular things that we're noticing that are problematic? And, you know, I think that's a pretty rational and grounded way to approach the problem. And I think that human beings here have done like a pretty good job, but I would not say that it's like 100 % perfect, But that is true of the entirety of this project.
42:05It is not designed to be perfect from the beginning. What it is designed to be is something that can become better over time with a lot of attention from a lot of humans. and that's that's my job is to keep making it an enjoyable place to do that so so i would say like what would tip me into even greater action first of all requests from the community to do more stuff like i'm i'm always happy to do that and as responsive as i can be to that um but if increasingly people feel extremely demoralized by it like that is you know that's again like something that i am obligated to act on as a like a steward of the mission and and you know whatever my role is in it.
42:47I did notice a couple of instances of friction or divergence between editors and the foundation regarding AI in the last 12 months. Things that I think in the overall scheme of things are minor, but are a big deal to editors. One of them is that Wikipedia was going to test, do a limited test of AI summaries at the top of articles. Editors reacted very negatively to that. And then, you know, an even more minor incident is Jimmy Wales, which is a co-founder of Wikipedia, wrote about, made a point that I think is not that different than your point, which is, hey, like, some machine learning tools might be useful in the future, and we should be aware of that and maybe thinking about that, people really reacted negatively to that.
43:43I'm just wondering, do you think that there's actually a difference of opinion between the foundation and the editor community? Or is it like a difference in attitude about AI and its inclusion or the exclusion from the process? I think that when we talk about Wikipedia, you know, and this kind of comes back to like the very beginning, what you were saying about like understanding what is this thing? You know, what is this? it's such a important place to start and the people that I talk to you know the individuals that I talk to that work on wikimedia projects they do not see themselves as one thing you know they do not see themselves as like a community you know it's a a collective in a sense but there There are many communities, many individuals.
44:49And my experience, you know, having worked in this area for the past, you know, three and a half or so years and being part of open source communities for decades. Most of these folks, they really want to be treated as individuals. there are times when they express opinions as groups like through like rfcs you know for example or there's been open letters that groups of people have have produced that i think represent some version of the consensus in a moment but but i wouldn't say that there's just like one perspective and i wouldn't say like that the foundation itself you know which is made up of a lot of individuals too like that there's just like one opinion about how to use ai tooling or exactly what to do.
45:36I mean, just like a minor, you know, difference of opinion is, you know, whether we should, you know, as a matter of policy, do vibe-coded prototypes. Should we do that or not, right? Not everybody feels the same way. And is that stopping people from creating vibe-coded prototypes? No. You know, it's tolerated. But there are some people that They're like, I don't know, this might be kind of leading us down a bad path, you know, and people have that conversation. And I think that's true, like, in a lot of organizations, not just ours. So just like to speak specifically to the summaries problem, you know, it was just a mistake to produce it and introduce the idea the way that we did.
46:21and you know I I do think that Jimmy's point about the way that the world is changing the way that the internet has already changed the way that people are changing it's coming whether we want it to or not and like our ability to understand and use tools that's like a basic human condition thing like we have to be able to understand and use tools so demonizing a particular tool, you know, I don't know, you know, and it's, it's like a, it's like a hard, I'll just say, like, I don't think that that's super helpful. Like, I don't think that, for example, I should tell my staff, you can't use AI tools.
47:07And what does that even mean? Right? Like, it's like, once you get like to the bottom of it, it's like really a tough line. No, I'll complete an email. I know. Well, yeah. And, and it's like, it's, and we have that and it's, that's like a trivial example, you know, but, but there, there are more concrete, like, should I tell all the engineers that they can't ever five code anything? I don't think I should, you know, and so far my, my answer to that has been, no, I think that people should try to use these tools. They're complicated, you know, they don't always work. And I think the, that experts find a lot of value in these things.
47:45You know, it can really make your life easier when you know exactly what to ask in exactly the right way. And they're increasingly becoming better at like asking them sort of like, you know, more vibey things and doing like a pretty good job. You know, I think that that is just all true. So I just don't believe that we should just like ban this particular technology. But I do hear the moral issue there. I understand it. It's not that I don't understand it. And And for the moment, I think our place, you know, it's like that coming back to like what Wikipedia itself is, you know, being neutral. I think I have to remain neutral on this point, regardless of like specific moral qualms that I, you know, have with particular tools or particular things that are happening with particular tools.
48:30And that is just part of my job. You know, I have to support this project. It's part of my job to support the mission, which is to get as much knowledge as possible to as many people for as long as I possibly can. And that to me means I have to be practical. I'm not going to be, you know, dumb about it, but I do need to be practical. And that, yeah, I don't know, that was kind of a little bit rambly. But I just, I think it's a complex situation. And I think everybody sees that it's a complex situation. And so I just don't want to be like glib about, yes, this, no, that. Like, I don't, you know, I'm not always like the best person to say.
49:15And I do listen to the editors and like what they, you know, what they believe and what they're comfortable with. So, yeah, so we've been really responsive to that. And that is part of why we're thinking about the ways to make editors as productive as they can be, and to introduce them to important rules that are crucial, you know, to the voice and the tone and the quality of Wikipedia's today. And that has been really uncontroversial, you know, when we introduce the tools in the right way and when we test them really well before we deploy. I think that's a great answer. I swear I'm going to let you go in a minute.
49:56No, it's okay. I think this will be very un-Wikipedia-like, but lightning round, yes or no questions. Do you think Wikipedia will be around in 100 years? Yes. Do you think Wikipedia's article generation process will always have a human in the loop? Yes, but... Okay, I'll take it. I'll take it. And then I guess a lot of what we've talked about is essentially the governance model and how successful it has been. and something that i think has emerged out of our ai reporting over the last few years is that wikipedia's importance has only increased given the generative ai age and its governance model has only emerged as more sustainable as you've said uh given like the rise of social media.
50:58And something that I often wonder is how come more of the internet doesn't have a similar governance model because it seems to be so strong and helpful and productive. Do you think that in the future, like let's say Wikipedia is still around in 100 years, as you said, does more of the internet look like Wikipedia in the future? I hope so. I really hope so. To your point, you said at the beginning that many people don't really understand how it works. I think it's so precious and magical, like how it has worked, that there wasn't a lot of motivation to really understand it. But I think now is a moment to really understand.
51:43I appreciate that Jimmy wrote a book, you know, about his process. I think more can be done. There's other people that have written books about how Wikipedia works and how it functions. And I think more of that to like help people understand it so that they can replicate it, it won't be exactly the same because this is very much like specific to, I would say, encyclopedic content and what it takes to write encyclopedia articles, which is like a really weird, funny way to get to like a egalitarian, you know, governance system. You know, I mean, it's very, very funny when you like think about the whole thing.
52:17And I just that's another thing that I think is crucial to creating systems like this. You have to have a sense of humor and be okay with things like not going the way that you planned and to meet people where they're at and to assume good faith. That's, I think, the ingredients to what has emerged. But understanding it more, that's the way. That is the way that we will produce more systems like this. And I absolutely think it's possible other systems like this exist, just not maybe at the same scale. So I do think that there's hope for that. And yeah, I'm here. I'm here to help people that want to do that because it's really worthwhile, even if it's hard.
53:01Okay, Selena, thank you so much for your time. Thank you. This was great. As a reminder, 4-4 Media is journalist-founded and supported by subscribers. If you wish to subscribe to 4-4 Media and directly support our work, please go to 44media.co. You'll get unlimited access to our articles and an ad-free version of this podcast. You'll also get to listen to the subscribers only section, where we talk about a bonus story each week. This podcast is made in partnership with Kaleidoscope. Another way to support us is by leaving a five-star rating and review for the podcast. That stuff really helps. This has been 4Four Media.
53:42We'll see you again next time.
54:09Big Mac Donald's Hunger Probier the new Big Gouda Und den Big Tasty Red Steakhouse Mit 100 % Rindfleisch aus Deutschland I'll never die fellas come from working away. I don't know whenre the dog takes!
From the publisher
The Wikimedia Foundation’s chief technology and product officer explains how she helps manage one of the most visited sites in the world in the age of generative AI.
Wikipedia is turning 25 this month, and it’s never been more important.
The online, collectively created encyclopedia has been a cornerstone of the internet decades, but as generative AI started flooding every platform with AI-generated slop over the last couple of years, Wikipedia’s governance model, editing process, and dedication to citing reliable sources has emerged as one of the most reliable and resilient models we have.
And yet, as successful as the model is, it’s almost never replicated.
This week on the podcast we’re joined by Selena Deckelmann, the Chief Product and Technology Officer at the Wikimedia Foundation, the nonprofit organization that operates Wikipedia. That means Selena oversees the technical infrastructure and product strategy for one of the most visited sites in the world, and one the most comprehensive repositories of human knowledge ever assembled. Wikipedia is turning 25 this month, so I wanted to talk to Selena about how Wikipedia works and how it plans to continue to work in the age of generative AI.
YouTube Version: https://youtu.be/39LR9ouJR3c
Subscribe at 404media.co for bonus content.
Listen to the weekly podcast on Apple Podcasts, Spotify, or YouTube.
Wikipedia’s value in the age of generative AI
The Editors Protecting Wikipedia from AI Hoaxes
Wikipedia Pauses AI-Generated Summaries After Editor Backlash
Wikipedia Says AI Is Causing a Dangerous Decline in Human Visitors
Jimmy Wales Says Wikipedia Could Use AI. Editors Call It the 'Antithesis of Wikipedia'
Learn more about your ad choices. Visit megaphone.fm/adchoices
