Do i need industry grade gpu’s or can i scrape by getring decent tps with a consumer level gpu.

  • @Sylovik
    link
    English
    25 hours ago

    You may try Harbor. The description claims to provide an OpenAI-compatible API.