Thanks to Charles for the conversion scripts, I’ve converted several of the new internLM2 models into Llama format. I’ve also made them into ExLlamaV2 while I was at it.
You can find them here:
https://huggingface.co/bartowski?search_models=internlm2
Note, the chat models seem to do something odd without outputting [UNUSED_TOKEN_145] in a way that seems equivalent to <|im_end|>, not sure why, but it works fine despite outputting that at the end.
You must log in or register to comment.