If the hype about models like ChatGPT is real, then these models are now about as good as they will ever be and are set to start deteriorating in the years ahead. If you are a machine learning practitioner, the short story as to why is [model drift] + [internet culture] + [fame and adoption]. If you are not, you can learn more via this video.