Yes, it seems the algorithm seems to necessitate giving a plausible answer at the expense of accuracy and even to resort to fiction as a last resort. I tested chatgtp and Google bard on a load of 60's and 70's type rock track lyrics. They both may have improved in the past 6 months but they both...
That is interesting. Maybe they haven't looked at/generated enough of their own AI content to notice the style. I say style with more than a hint of generosity. AI is so formulaic in the way it writes, it seems, at the moment at least, really obvious. Just lacks humanity.