Hello sailors,

I have been job hunting for a while and I have felt a great disadvantage in my job search due to my lack of access to high-quality LLMs. Writing cover letters is honestly so bullshit. GPT-3 is honestly quite bad nowadays, but as a true pirate at heart I couldn’t quite get myself to cough up the coin for OpenAI’s GPT4 out of principle. I hate them for putting their cutting edge technology behind a paywall, making it inaccessible for their own gain. I feel like this is not what the internet was supposed to be. So today, call me the great emancipator cuz i’m teaching u how to get that shi for free baby

Requirements: Docker

It’s all gonna be based off of this github repo: gpt4free

Installing through docker (there’s also a way to install with Python PIP if that’s more convenient for you. The docker worked for me though)

  1. docker pull hlohaus789/g4f

  2. docker run -p 8080:8080 -p 1337:1337 -p 7900:7900 --shm-size="2g" -v ${PWD}/hardir:/app/hardir hlohaus789/g4f:latest

  3. Open up the webui in your browser at localhost:8080

  4. In the “Provider” dropdown in the bottom look for “Liaobots”

  5. Choose “gpt-4-plus” under the “Models” dropdown

??? Profit

The cool thing about gpt4free is that there’s a lot of providers and a lot of models to choose from! So if gpt-4-plus from Liaobot doesn’t work for you you can switch to something else easily. Do note that some models require you to provide an authentication token or be logged in. Most of them work right out of the box tho.

*this post was not made with any use of an llm I promise ;)

^^list of gpt4 providers

  • peanuts4life@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    45
    ·
    7 months ago

    There is almost no chance that it is truthfully based on gpt 4. If you want a free, open source llm with 32k context and generous limits, I recommend using huggingface.co/chat/

    The nous-hermes model (you can select different models) is uncensored, and performs really well for a open source model. Plus, they have data controls so you can turn off data gathering per model. Huggingface is a reputable vendor, and doesn’t claim to be something it isn’t.

      • peanuts4life@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        28
        ·
        7 months ago

        I mean, be careful. These llms can be honeypots for data. Like, if you’re using it for cover letters, or work, you’re sending tons of personal info to random websites.

        I would recommend sticking to actual, reputable vendors for llms, or running your own. I have a GTX 1070 and can run some pretty decent models these days locally using koboldai.

        Bing is probably the only way to use gpt 4 without paying for it, and Microsoft probably won’t steal your bank account info.