#edgeai #gguf #quantization #aiengineering #llm #ondeviceai #llamacpp #ollama #modeloptimization #aiinfrastructure #huggingface #unsloth #generativeai | Ashraf Nabout
#edgeai #gguf #quantization #aiengineering #llm #ondeviceai #l…
2 months ago
linkedin.com
GGUF versus GGML | IBM
GGUF versus GGML | IBM
Jul 3, 2024
ibm.com
Quantize any LLM with GGUF and Llama.cpp
27:43
Quantize any LLM with GGUF and Llama.cpp
19.3K viewsMar 2, 2024
YouTubeAI Anytime
Quantize Your LLM and Convert to GGUF for llama.cpp/Ollama | Get Faster and Smaller Llama 3.2
Quantize Your LLM and Convert to GGUF for llama.cpp/Ollama | Get F…
2.6K viewsDec 2, 2024
YouTubeVenelin Valkov
LLM Quantization with llama.cpp on Free Google Colab | Llama 3.1 | GGUF
19:06
LLM Quantization with llama.cpp on Free Google Colab | Llama 3.1 | G…
2.2K viewsAug 8, 2024
YouTubeTheAILearner
New Tutorial on LLM Quantization w/ QLoRA, GPTQ and Llamacpp, LLama 2
26:53
New Tutorial on LLM Quantization w/ QLoRA, GPTQ and Llamacpp, LLa…
16.9K viewsSep 9, 2023
YouTubeDiscover AI
LLaMa GPTQ 4-Bit Quantization. Billions of Parameters Made Smaller and Smarter. How Does it Work?
LLaMa GPTQ 4-Bit Quantization. Billions of Parameters Made Small…
28.3K viewsMay 14, 2023
YouTubeAemonAlgiz
GGUF quantization of LLMs with llama cpp
5.6K viewsMar 22, 2024
YouTubeAI Bites
26:21
How to Quantize an LLM with GGUF or AWQ
13.6K viewsOct 3, 2023
YouTubeTrelis Research
11:07
Run Llama 2 Locally On CPU without GPU GGUF Quantized Mo…
8.2K viewsSep 11, 2023
YouTubeAI WITH Rithesh
10:30
AutoQuant - Quantize Any Model in GGUF AWQ EXL2 HQQ
822 viewsApr 3, 2024
YouTubeFahd Mirza
10:11
GGUF FLUX Comfyui Boosting Your Workflow with Quantized Models
13K viewsAug 22, 2024
YouTubegoshnii AI
24:48
Stop Running Out of VRAM! The Beginner's Guide to GGUF Quanti…
410 views3 months ago
YouTubeQuantext
21:36
Run Code Llama 13B GGUF Model on CPU: GGUF is the new GGML
25.4K viewsAug 28, 2023
YouTubeAI Anytime
2:20
GGUF Tensor Slice, Exploring Quantization Artifacts in C++ with …
62 views3 months ago
YouTubeServeurperso Com
2:12:21
LLM Fine-Tuning 12: LLM Quantization Explained( PART 1) | …
5.7K views5 months ago
YouTubeSunny Savita
59:04
LLM Quantization Techniques Explained - GPTQ AWQ GGUF HQ…
357 views6 months ago
YouTubeJoydeep Bhattacharjee
3:21:13
LLM Fine-Tuning 13: LLM Quantization Explained (PART 2) | …
3.6K views4 months ago
YouTubeSunny Savita
9:47
[GGML] Machine learning Tensor Library. GGUF and Quantization fo…
337 views3 months ago
YouTubeAI Podcast Series. Byte Goose AI.
32:01
How to quantize Large Language Models #huggingface #transforme…
1.7K viewsMar 4, 2024
YouTubeSuper Lazy Coder
Which Quantization Method is Right for You? (GPTQ vs. GGUF vs. AWQ)
37.4K viewsNov 23, 2023
YouTubeMaarten Grootendorst
2:00:45
Boost AI Performance with GGUF Quantization on AMD Instinct Mi60…
8 views2 months ago
YouTubeojamboshop
LLMs Naming Convention Explained
1.7K viewsSep 15, 2023
YouTubeAI Readme
4:56
Hugging Face GGUF Models locally with Ollama
37.8K viewsOct 20, 2023
YouTubeLearn Data with Mark
26:26
Quantizing LLMs - How & Why (8-Bit, 4-Bit, GGUF & More)
6.4K viewsNov 18, 2024
YouTubeAdam Lucek
13:20
Run a LLM on your WINDOWS PC | Convert Hugging face model to G…
4.4K viewsJan 27, 2024
YouTubeAyaansh Roy
12:19
Which .GGUF Should You Download? (Hugging Face Quanti…
1.3K views3 months ago
YouTubeNext Tech and AI
1:14
Speed Test: GGUF Quantization on AMD Instinct Mi60 | Boost AI Perfo…
149 views2 months ago
YouTubeojamboshop
6:35
What is Post Training Quantization - GGUF, AWQ, GPTQ - LLM Concept…
1.7K viewsApr 12, 2024
YouTubeAkhil Sharma
6:30
GGUF Q4 vs Q5 - What's The Difference?
1.7K viewsFeb 4, 2024
YouTubeFahd Mirza
See more videos
Static thumbnail place holder