This answer is response to official answer posted by Philippe
This experiment takes a long view. We're in the early learning stages
and will be working with a handful of sites to understand potential
value.
There is zero value in having AI generated answers on any site. Anyone who wishes to use AI can go and easily ask AI. Posting question on any site in SE network requires more preparation and work than merely asking AI.
People who come to the SE want to have their answers written by experts who actually know what they are talking about, not AI. Nowadays, many are coming here only after they have already unsuccessfully tried to ask AI and got nothing usable.
We won’t know whether or not those are viable without experimentation.
Except we do know. And we told you that. Moderators, especially Stack Overflow ones, have seen and have removed thousands of AI posts. Most of those were utmost crap. For the same reason why we don't allow users to post AI, this experiment will also fail. The results will be just load of junk containing potentially dangerous and harmful information.
While there is a certain value in experimenting, gathering the results and making further decisions based on those, not literally every idea need to end up as an experiment. No amount of experimenting will make bad idea a good one. And "Answer Assistant" is one of most horrible ideas ever.
The experiment is designed to be configurable on a per-site basis to
align with the dynamics, policies, and goals of specific communities.
There is very little to configure here. There are no configurations and tweaking that would possible make this feature tolerable in any way on the sites that don't want it. Sites will either have "Answer Assistant" or not.
And we already know from the experience that you will find all kinds of reasons for pushing the feature on sites regardless of its community wishes.
We will explore designs, methods of human vetting and editing of LLM-originated content, and the scenarios where this might provide value.
Who do you think will vet AI content?
Users who have no clue whether AI provided information is correct or not.
People who can verify the correctness of AI answers are capable of writing their own answers. Why would they waste their time verifying AI?
Already we see many examples of SE contributors utilizing LLM
resources, and the added workload on moderators and curators that this
creates.
I will repeat my comment here: Are you seriously going to use that as an excuse?
Moderators are fully capable of handling and removing LLM content posted by users. It was the company that literally prevented moderators from doing so which lead to the last years strike. Almost all problems and extreme workload for moderators were caused by company's actions. Please don't try to sell this feature, which was strongly opposed by moderators, as something that will help us. It will not.
This experiment is about preparing for the future.
A very bleak future. You can be a beacon of human light in the world flooded with AI, yet your choice is vanishing into the darkness.