I've been doing a lot of things that keep making me think a machine could do it: Fixing typos, editing out noise, flagging obvious non-answers, flagging noisy comments, etc. I'm not of the position that AI is the solution to everything (far from it). But while we're getting so many bad / dubious ideas about AI and this platform from SE Inc., how about we try to come up with some potentially good ones? There are some staff at SE that are actually interested in hearing what the community thinks about this (Ex. Yaakov). Let's feed the people who want to listen to us our ideas.
How could AI be used to improve our curation tools and workflows? (emphasis on "improve"- not "supplant". I'm not advocating for dropping human supervision / involvement in curation activity) Note that when I say "AI", I'm not just talking about the types of AI that are popular right now (I.e. not just large language models).
We've got plenty of curation tools:
- possible duplicate suggestions in the Ask Question module (a more "user-facing" curation tool)
- review queues
- the 10k rep mod tools
- comment "auto-deletion" (and patterns for single-flag auto-deletion)
- Smoke Detector
- Natty (the New Answer to Old Questions bot operating on SO)
- and some more manual "tools" like coordinated "closure chatrooms" such as SOCVR
Here's what I'm interested in discussing here:
- In what ways have we already been using AI in curation tools, and roughly speaking, how effective has it been?
- How could AI be potentially used to improve / augment those tools? Or what specific curation tasks are well suited to some sort of application of AI assistance?
- Do we have data to train such an AI to suit our needs?
- Is there any existing data that could be used to estimate how much marginal benefit we could get from leveraging AI in those ways?
- When I hear people suggest AI as a solution to a problem, I always jump to think- "is there a simpler / "dumber" / cheaper way?". For example, one thing I've been pushing for is better promotion of the Help Center pages. A lot of curation I do is to fix simple "violations" of Help Center guidance. Is there evidence or reasoning to suggest that AI could be more effective and/or more efficient than other possibly-simpler alternatives?
I encourage you to also consider the following question before posting a suggestion: Would AI used in such a way be working around a deeper problem that would/could be better addressed by chopping closer to the roots of the problem?
(We don't have to wait for SE to come up with ideas to try coming up with our own).