ML

mlx-community/Mistral-7B-Instruct-v0.3-4bit

text-generationmlxapache-2.07.3B params · updated Jun 2024

Inference

Illustrative · scripted stream

Hosted endpoint preview for this checkpoint (7.3B). The output below is a scripted stream that demonstrates the widget; no model is served and the prompt is not sent anywhere.

scripted demo · nothing leaves the browser
Output
Output appears here.