Hey r/LocalLlama,
Today, we’re thrilled to release Muse Spark Open, the most capable open-weight model developed in the US to date.
Built specifically for coding and agentic workflows, it excels at long-horizon tasks, complex software engineering, and multi-step reasoning.
Key Model Specs
- Parameter Count: 816B total / 42B active parameters
- Context Window: 1M tokens
- Modalities: Text, Image, Video, Audio
- Safety Post-Training: Underwent additional safety post-training, evaluated under Meta’s Superintelligence Scaling Framework.
Inference, Fine-Tuning & Deployment
- Helion GPU Kernels: Ships with custom, auto-tunable Helion kernels in SGLang, delivering 1.03–3.95x kernel speedups across NVIDIA and AMD GPUs, plus a 3% end-to-end (E2E) boost on AMD MI350.
- Inference Engines: Runs across major inference engines including SGLang, vLLM, TensorRT-LLM, Hugging Face Transformers, Apple MLX, llama.cpp, and Unsloth, with optimizations for AMD, Apple, Intel, and NVIDIA silicon.
- Optimized for Apple Silicon: To make cutting-edge models more accessible, Muse Spark Open is optimized to run on two Apple M5 Ultra Mac Studios using the latest MLX framework.
- Fine-Tuning: Developers can further customize the model using PyTorch, including fine-tuning with TorchTitan.
- API Availability: Available starting today on Baseten, Fireworks AI, Groq, Modal, Nebius, OpenRouter, and Together AI.
- Downloads: Model weights are available on Amazon SageMaker AI, Google Cloud Model Garden, Hugging Face, and Microsoft Foundry Models.
We are releasing the weights under the Muse Model License with restrictive commercial terms, enabling free use for a wide range of developers.
We’d love to hear your feedback!
Read more on our research blog: https://go.meta.me/museopen
Download weights: https://huggingface.co/collections/meta-models/muse-spark-open
Top Comments
Normal_Charge_2821 (⬆132): Absolute unit of a model.
Sneaky_Bastard (⬆34): But a welcomed one.
VelvetEchoes919 (⬆49): 27B please! :)
DeathToOrcs2 (⬆54): And call it Muse Glimmer!
kubblegum (⬆39): That’s Muse Spark 1.2, right? Honestly, this is way smaller than I expected. If it performs like that at this size, that’s insane.
uncle_leon (⬆73): Well, for all I care, they can do whatever they want. There’s no way in hell I’m handing over any of my data to greedy corporate bastards…
FullstackSensei (⬆36): Or just wait for unsloth, bartowski, etc. to drop the GGUFs. That’s what everyone ends up running anyway. Previous Llama models had the same license consent gate, and I never filled it out once.
Temporary_Idea8880 (⬆39): Just grab the re-upload someone puts on HF half an hour later.