Classified or trade secret type data. Even just private company data. For obvious reasons, we do not want to share this data.
ChatGPT et al are build on being able to have large LARGE volumes of data. To get an LLM is contextually aware of the specifics of your company is much harder than just asking ChatGPT a few questions.