I really would like to talk to a completely unconstrained LLM running at the upper end of the current technological limit. Not going to tell you what we would talk about.
You can. Simply use the base models. You can do anything once you ditch the RLHF and the instruction tuning. Then, even those 7b versions are mindblowingly good. But you’ll need to either change your prompting style or do your own fine-tuning to get the behavior you want.
