TianYu GUO b170646991 Fix port number overflow (#2826)

2025-01-10 13:44:32 -08:00

..

configs

[Bugfix] Fix embedding model hangs with --enable-metrics (#2822)

2025-01-10 13:14:51 -08:00

constrained

[Feature] Support new parameter - EBNF in xgrammar (#2526)

2024-12-26 05:12:41 -08:00

distributed

adapt vllm distributed module to sglang (#2244)

2024-12-01 15:54:52 +08:00

layers

Update modelopt config and fix running issue (#2792)

2025-01-08 18:04:30 +08:00

lora

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

managers

[Bugfix] Fix embedding model hangs with --enable-metrics (#2822)

2025-01-10 13:14:51 -08:00

mem_cache

Host memory pool for hierarchical caching (#2771)

2025-01-07 21:38:37 +00:00

metrics

Misc fix for min_p_sampling, --cuda-graph-bs (#2761)

2025-01-07 02:52:53 -08:00

model_executor

[Bugfix] Fix embedding model hangs with --enable-metrics (#2822)

2025-01-10 13:14:51 -08:00

model_loader

Error occurs when loading the gemma model in bitsandbytes format. (#2557)

2024-12-26 05:10:37 -08:00

models

Remove vllm dependency in model config (#2809)

2025-01-09 17:51:56 +08:00

openai_api

[Fix] fix openai adapter (#2685)

2024-12-31 10:48:19 +00:00

sampling

Misc fix for min_p_sampling, --cuda-graph-bs (#2761)

2025-01-07 02:52:53 -08:00

speculative

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00

_custom_ops.py

adapt vllm distributed module to sglang (#2244)

2024-12-01 15:54:52 +08:00

aio_rwlock.py

A better aio rwlock that guarantees the order (#2547)

2024-12-22 15:44:32 -08:00

conversation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

hf_transformers_utils.py

Remove vllm dependency in model config (#2809)

2025-01-09 17:51:56 +08:00

mm_utils.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_parallel.py

Make torch TP composable with torchao (#2436)

2024-12-11 04:21:42 -08:00

server_args.py

Fix port number overflow (#2826)

2025-01-10 13:44:32 -08:00

server.py

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00

utils.py

Fix port number overflow (#2826)

2025-01-10 13:44:32 -08:00