• @[email protected]
    link
    fedilink
    English
    1099 months ago

    Orbit currently uses a version of Mistral LLM (Mistral 7B) that is locally hosted on Mozilla’s Google Cloud Platform instance.

    Hmm.

    >locally hosted

    >Google Cloud

    Hmmmmmmmmmmmmmmmm.

    • @[email protected]
      link
      fedilink
      45
      edit-2
      9 months ago

      Sounds like they’re running their own LLM instance on googles cloud infrastructure vs using something like OpenAI via API.

      As web dev parlance it makes sense but for marketing it is definitely confusing and they should do better.

      • @[email protected]
        link
        fedilink
        49 months ago

        Yeah, we “self-host” our app at AWS at work, which means we configure everything ourselves. I “self-host” a VPS at Hetzner for personal projects, and my actual data is actually self-hosted on a machine on my LAN.