Large Language Model Text Generation Inference
-
Updated
Apr 15, 2025 - Python
#
bloom
Here are 41 public repositories matching this topic...
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
nlp bloom distributed-systems machine-learning deep-learning chatbot pytorch falcon transformer neural-networks llama gpt pretrained-models language-models volunteer-computing pipeline-parallelism guanaco tensor-parallelism large-language-models mixtral
-
Updated
Sep 7, 2024 - Python
🩹Editing large language models within 10 seconds⚡
-
Updated
Aug 13, 2023 - Python
[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.
bloom compression pruning llama language-model vicuna baichuan pruning-algorithms llm chatglm neurips-2023 llama-2 llama3
-
Updated
Oct 7, 2024 - Python
Fast Inference Solutions for BLOOM
-
Updated
Oct 9, 2024 - Python
💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
api bloom distributed-systems chatbot transformer llama gpt language-models volunteer-computing guanaco large-language-models llama2
-
Updated
Apr 22, 2024 - Python
LLMs4OL: Large Language Models for Ontology Learning
bloom transformers knowledge-graph bert ontology-learning gpt-3 gpt-4 large-language-models chatgpt flan-t5 llama-7b
-
Updated
Sep 27, 2024 - Python
Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
nlp bloom pipeline pytorch deepspeed llm full-finetune model-parallization flash-attention llama2 baichuan2-7b chatglm3-6b mixtral-8x7b
-
Updated
Feb 5, 2024 - Python
Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
multilingual nlp bloom natural-language-processing reinforcement-learning chatbot dataset question-answering llama language-model large-language-models rlhf instruction-tuning reinforcement-learning-from-human-feedback
-
Updated
Aug 18, 2023 - Python
一套代码指令微调大模型
-
Updated
Aug 1, 2023 - Python
Finetuning BLOOM on a single GPU using gradient-accumulation
-
Updated
Mar 29, 2023 - Python
Generate README.md with GPT-3 few-shot learning
nlp markdown bloom natural-language-processing deep-learning transformers pytorch copilot language-model black codex few-shot-learning readme-generator huggingface huggingface-transformers gpt-3
-
Updated
Oct 19, 2022 - Python
Scrapy Redis with Bloom Filter，support redis sentinel and cluster
-
Updated
Mar 31, 2023 - Python
Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper here: https://aclanthology.org/2023.emnlp-main.658/
-
Updated
Mar 10, 2025 - Python
Improve this page
Add a description, image, and links to the bloom topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the bloom topic, visit your repo's landing page and select "manage topics."