It would be interesting to have a Large Language Model (LLM) fine-tuned on the ProleWiki and leftist books, as it could be very useful for debunking arguments related to leftist ideology. However, local models are not yet doing search and cited sources, which makes it difficult to trust them. With citations, it is possible to check if the model is referencing what it is citing or just making things up. The inclusion of citations would enable users to verify the references and ensure the model is accurately representing the sources it cites. In the future, when a local platform with search capabilities for LLMs becomes available, it would be interesting to prioritize leftist sources in the search results. Collaboratively curating a list of reliable leftist sources could facilitate this process. What are your thoughts on this?

  • rjs001@lemmygrad.ml
    link
    fedilink
    arrow-up
    9
    ·
    1 year ago

    I’ve started working on it but it’s obvious a very difficult project. I’m still in the early stages of setting it up so I don’t know if I’ll work on it to completion though. I’m very excited to see if anyone else made/makes ones

      • rjs001@lemmygrad.ml
        link
        fedilink
        arrow-up
        4
        ·
        1 year ago

        I’m setting up the basics now using the Python Library Lang Chain and the LLM base of Hugging Face. I haven’t started adding the actual Marxists works yet which is the main part but still am at the start of setting up the language part. I’m not great at programming so it s difficult but I’ve been intrested in the idea for a while