chat with llm model with zero setup!

Reddit r/LocalLLaMA Tools

Summary

Hugging Face 推出零配置、免密钥的 LLM 聊天方式,用户只需运行 `ssh chat.hf.co` 即可通过 Hugging Face Inference Providers 直接与模型对话。

Hey folks! Aritra here from Hugging Face. We introduce a no config, no key, no setup way to directly chat with a model hosted with the Hugging Face Inference Providers. `ssh chat.hf.co` And you are good to go. 🔥 Let us know what you think about this.
Original Article

Similar Articles

huggingface/speech-to-speech

GitHub Trending (daily)

Hugging Face's speech-to-speech is an open-source, modular voice-agent pipeline (VAD->STT->LLM->TTS) with an OpenAI Realtime-compatible WebSocket API, supporting swappable components and local or hosted models.

Run a vLLM Server on HF Jobs in One Command

Hugging Face Blog

Hugging Face Jobs now allows you to spin up a private OpenAI-compatible LLM endpoint with a single command using vLLM, without provisioning servers or Kubernetes.

llm-chat-completions-server 0.1a0

Simon Willison's Blog

Simon Willison releases llm-chat-completions-server 0.1a0, a plugin that runs a local OpenAI Chat Completions-compatible server backed by any installed LLM models, using content-addressable logs for efficient conversation state.