noneabove1182@sh.itjust.worksM to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

llamacpp has added custom RoPE (#2054) · ggerganov/llama.cpp@6e7cca4

1

8

llamacpp has added custom RoPE (#2054) · ggerganov/llama.cpp@6e7cca4

noneabove1182@sh.itjust.worksM to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

1

llama : add custom RoPE (#2054) · ggerganov/llama.cpp@6e7cca4

* Implement customizable RoPE The original RoPE has pre-defined parameters theta_i = 10000^(−2(i−1)/d), for i in [1, 2, ..., d/2] Our customizable RoPE, ggml_rope_custom_inplace, uses t...

You must log in or register to comment.

Chat

h3ndrik@feddit.de
link
fedilink
English
arrow-up
3·
1 year ago
nice. a bigger context size was my dream for many weeks. seems to work pretty well.

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

9 users / day
11 users / week
17 users / month
359 users / 6 months
28 local subscribers
2.24K subscribers
139 Posts
335 Comments
Modlog