2 Comments
User's avatar
Liz C's avatar

You've addressed the training data argument very clearly and well. You could say more about the other strands of argument. There's no collating a spellcheck and AI. Only one of those can do the actual writing. Yes ghostwriters exist and should be acknowledged. However, at least they are humans writing other humans' stories, which requires understanding. My biggest issue with AI writing, apart from theft of human creativity for corporate profit, is that if I understand how LLMs work sufficiently, there is no understanding. They predict the next word based on their training. If that's true how could they write an original sentence? If writing is the attempt to convey meaning how could something that does not understand or feel attempt to convey meaning or write in the same way as a human can even if it's difficult or even impossible to tell the difference?

Matt Stine's avatar

Thanks. Here’s a piece that addresses how LLMs work today that can give you more context around these questions. Predicting the next word is definitely in there, but that’s far from all: https://feralarchitecture.substack.com/p/it-just-predicts-the-next-token?r=2656dp&utm_medium=ios