RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • 8B • Updated Jul 10 • 75.8k • 30
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated 12 days ago • 25k • 20
RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8 Text Generation • 4B • Updated Jul 10, 2025 • 1.56k • 1
RedHatAI/Phi-3-mini-128k-instruct-quantized.w4a16 Text Generation • 4B • Updated 12 days ago • 458 • 1
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8 Image-Text-to-Text • 4B • Updated May 1, 2025 • 39.6k • 2
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16 Image-Text-to-Text • 4B • Updated 26 days ago • 255 • 4
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8 Image-Text-to-Text • 8B • Updated Oct 2, 2025 • 7.24k • 9
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16 Image-Text-to-Text • 8B • Updated Apr 3, 2025 • 3.02k • 8
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16 Text Generation • 3B • Updated 26 days ago • 79.6k • 1
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16 Text Generation • 8B • Updated 26 days ago • 1.66k • 1
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16 Text Generation • 8B • Updated 26 days ago • 457