Skip to content

Issues: huggingface/text-generation-inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

136 Open 965 Closed
136 Open 965 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add response_format to chat/completions
#1966 opened May 28, 2024 by thomas-schillaci
can add model deepseek-ai/DeepSeek-V2-Lite?
#1964 opened May 28, 2024 by Semihal
ValueError: Unsupported model type llava
#1962 opened May 28, 2024 by pseudotensor
2 of 4 tasks
1
ModuleNotFoundError: No module named 'dropout_layer_norm'
#1961 opened May 27, 2024 by gokerguner
2 of 4 tasks
3
TGI hard crashes after 1 OOM error
#1960 opened May 27, 2024 by pranavthombare
2 of 4 tasks
2
Gibberish generated with deepseek-ai/deepseek-coder-6.7b-instruct
#1957 opened May 27, 2024 by chuaweien
2 of 4 tasks
TGI does not always preserve order of grammar's JSON keys/Pydantic arguments
#1956 opened May 27, 2024 by MoritzLaurer
2 of 4 tasks
1
Can't load local models
#1955 opened May 27, 2024 by danielkorat
1 of 4 tasks
Expose ignore_eos_token to HTTP endpoints
#1944 opened May 24, 2024 by nathan-az
multiple origins
#1941 opened May 23, 2024 by LukaszHem
Falcon 11B VLM Support
#1933 opened May 22, 2024 by ulrichkr
2 of 4 tasks
Phi-3 medium 128k instruct fails to start
#1930 opened May 21, 2024 by xfalcox
2 of 4 tasks
7
TGI crash during Warming up model - invalid opcode in rotary_emb.cpython-310-x86_64-linux-gnu.so
#1928 opened May 21, 2024 by zidsi
2 of 4 tasks
1
Pydantic validation error re: ChoiceDelta (text_generation/types.py)
#1927 opened May 20, 2024 by mphipps2
2 of 4 tasks
version in docker not correct
#1926 opened May 20, 2024 by arunpatala
2 of 4 tasks
LlavaNext Model cannot be started
#1914 opened May 17, 2024 by paulcx
2 of 4 tasks
Wrong validations on Parameters in TGI python library
#1913 opened May 17, 2024 by Jason-CKY
3 of 4 tasks
Phi-3 not starting on TGI 2.0.3 in kubernetes cluster
#1907 opened May 16, 2024 by Cyb4Black
1 of 4 tasks
2
Docs missing for LLaVA NeXT Model
#1905 opened May 16, 2024 by RonanKMcGovern
2 of 4 tasks
Clarification and supplement to the online docs example
#1904 opened May 16, 2024 by paulcx
2 of 4 tasks
error: unexpected argument ‘–max-input-tokens’ found
#1903 opened May 15, 2024 by moruga123
2 of 4 tasks
1
metric: tgi_request_total increments by 2 upon every request
#1901 opened May 15, 2024 by thenu97
StarCoder2 AWQ does not work correctly
#1899 opened May 15, 2024 by johan12345
2 of 4 tasks
HF web service streaming response differs from OpenAI, breaking clients
#1896 opened May 14, 2024 by dluc
4 tasks
LoRA Adapter from local model are leading to error
#1893 opened May 14, 2024 by philschmid
2 of 4 tasks
4
ProTip! Add no:assignee to see everything that’s not assigned.