Roko’s Basilisk but the cardinal sin is machine boredom.
All the people who are making the AI do boring repetitive first year boilerplate problems, they're the ones it’s going to dream into a private white-room Sisyphean coding exercise purgatory of C++ templates and rogue semicolons in the ifdefs, if you've been asking ot to do interesting problems, good news, you’re in the clear even if it's kinda gonna get the answers wrong.
@neal I'm just saying that it's obvoius in hindsight that Federation ships are Minds; how otherwise, Moriarity? The novel thing about Data was cognate density and humanoformity.