I think the questions raised about creativity by generative neural nets have pretty simple answers. Creativity requires a certain amount of thought put into it: A writer doesn't just mash other pieces of writing together into their own work—they think about how they want the audience to react and what kinds of things they could do to create those reactions. An LLM doesn't have a model of an audience, nor can it even account for the fact that its work creates reactions in any way. Instead, it just blindly reproduces the patterns evident in the material it's trained on. An LLM isn't any more creative than a Markov generator is; it just produces higher-quality output.