Skip to content

Pull requests: vllm-project/vllm

New pull request New
479 Open 6,553 Closed
479 Open 6,553 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Neuron][V1] Experimental end-to-end enablement for neuron v1 documentation Improvements or additions to documentation v1
#14648 opened Mar 11, 2025 by liangfu • Draft
1
[V1][Bugfix][Spec Decode] Fix incorrect outputs in V1 speculative decoding due to batch indexing ready ONLY add when PR is ready to merge/full CI is needed v1
#14645 opened Mar 11, 2025 by benchislett Loading…
3
[WIP] [Quant] SupportsQuant handles ignored_modules
#14635 opened Mar 11, 2025 by kylesayrs • Draft
1
Allow dynamic loading of LoRA adapters in a cache dir frontend
#14634 opened Mar 11, 2025 by jberkhahn Loading…
1
1
Fixing a bug in image-tokenization
#14633 opened Mar 11, 2025 by ameyanjarlekar Loading…
1
[WIP] Add SupportsQuant and packed_modules_mapping to all models
#14631 opened Mar 11, 2025 by kylesayrs • Draft
1
[V1][Core] using cached vocab_size for Structured Outputs structured-output v1
#14630 opened Mar 11, 2025 by aarnphm Loading…
4
[ROCm][Bugfix] Ensure that the moe_wna16_gemm kernel is not built on ROCm platforms. ci/build ready ONLY add when PR is ready to merge/full CI is needed rocm Related to AMD ROCm
#14629 opened Mar 11, 2025 by SageMoore Loading…
8
[Kernel] LoRA - Enable CUDAGraphs for V1 v1
#14626 opened Mar 11, 2025 by varun-sundar-rabindranath Loading…
4
[V1][Core] Support MistralTokenizer for Structured Output ready ONLY add when PR is ready to merge/full CI is needed structured-output v1
#14625 opened Mar 11, 2025 by aarnphm Loading…
1
8
[V1] Detokenizer: Respect Stop Tokens v1
#14624 opened Mar 11, 2025 by afeldman-nm Loading…
1
20
[V1] [CI] Enable v1/entrypoints ci/build ready ONLY add when PR is ready to merge/full CI is needed v1
#14619 opened Mar 11, 2025 by robertgshaw2-redhat Loading…
9
Enforce that TP > 1 is not supported for Mamba2 if Quantization is Enabled.
#14617 opened Mar 11, 2025 by fabianlim Loading…
1
[Kernel] GGUF MoE kernel ready ONLY add when PR is ready to merge/full CI is needed
#14613 opened Mar 11, 2025 by SzymonOzog Loading…
11
[Hardware][Intel GPU][WIP] add V1 engine support and chunked_prefill kernel ci/build documentation Improvements or additions to documentation v1
#14612 opened Mar 11, 2025 by jikunshang • Draft
3
[Bugfix] Data parallel example might fail if the users script initializes torch.cuda documentation Improvements or additions to documentation
#14598 opened Mar 11, 2025 by Jackmin801 Loading…
2
[DO NOT MERGE]Varun/v1 lora kernels tuner
#14594 opened Mar 11, 2025 by varun-sundar-rabindranath • Draft
1
fix:set use_beam_search false to aviod trace link broken documentation Improvements or additions to documentation
#14592 opened Mar 11, 2025 by RichardoMrMu Loading…
2
[Core][V0] Add guidance backend for structured output ci/build structured-output
#14589 opened Mar 11, 2025 by russellb Loading…
5
Ray named test documentation Improvements or additions to documentation
#14584 opened Mar 10, 2025 by ruisearch42 • Draft
1
[Quantization][FP8] Adding support for fp8 gemm layer input in fp8
#14578 opened Mar 10, 2025 by gshtras Loading…
1
[V1] Cache logits buffer in sampler v1
#14577 opened Mar 10, 2025 by WoosukKwon • Draft
2
[Bugfix][TPU][V1] Disable StructuredOutputManager import on TPU v1
#14573 opened Mar 10, 2025 by NickLucche Loading…
6
Mseznec/flash attention fp8 ci/build v1
#14570 opened Mar 10, 2025 by mickaelseznec Loading…
@LucasWilkinson
8
permute/unpermute kernel for moe optimization ci/build
#14568 opened Mar 10, 2025 by CalebDu Loading…
1
ProTip! Adding no:label will show everything without a label.