Infosec.Pub
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
cm0002 to AI - Artificial intelligence@programming.devEnglish · 5 days ago

TurboQuant: Reducing LLM Memory Usage With Vector Quantization

hackaday.com

external-link
message-square
0
link
fedilink
4
external-link

TurboQuant: Reducing LLM Memory Usage With Vector Quantization

hackaday.com

cm0002 to AI - Artificial intelligence@programming.devEnglish · 5 days ago
message-square
0
link
fedilink
Large language models (LLMs) aren’t actually giant computer brains. Instead, they are massive vector spaces in which the probabilities of tokens occurring in a specific order is encoded. Bill…
alert-triangle
You must log in or # to comment.

AI - Artificial intelligence@programming.dev

Aii@programming.dev

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !Aii@programming.dev

AI related news and articles.

Rules:

  • No Videos.
  • No self promotion: Don’t post links to your articles.
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 36 users / day
  • 69 users / week
  • 166 users / month
  • 835 users / 6 months
  • 2 local subscribers
  • 258 subscribers
  • 240 Posts
  • 183 Comments
  • Modlog
  • mods:
  • Vacant@programming.dev
  • cm0002@programming.dev
  • BE: 0.19.17
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org