Skip to content

Issues: bytedance/lightseq

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

176 Open 111 Closed
176 Open 111 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

LightSeq on GCP
#530 opened Nov 19, 2024 by mmcgra21
1
[FeedBack][1.0.8][com.miniclip.eightballpool]-
#529 opened May 30, 2024 by ap0jwd
4
is Baichuan2 model inference available now?
#528 opened Apr 26, 2024 by cg3dland
参数格式不对args format wrong
#527 opened Apr 22, 2024 by whiteSteelRain
Exception: Installed CUDA version 12.3 does not match the version torch was compiled with 12.1, unable to compile cuda/cpp extensions without a matching cuda version.
#526 opened Feb 5, 2024 by skill-diver
identifier "__hisnan" is undefined
#524 opened Nov 9, 2023 by jimmieliu
4
Is it normal that A10 inference speed is lower than 2080ti?
#523 opened Nov 7, 2023 by qinbo23
1
lightseq是否支持clip模型的int8量化？
#522 opened Nov 2, 2023 by shhn1
Can int8 in pre-training large model ???
#521 opened Oct 31, 2023 by zhoumengbo
how to resolve xlm-roberta convert fail
#520 opened Aug 9, 2023 by 520jefferson
question about environment
#519 opened Jul 13, 2023 by etoilestar
[Question] gptj, mpt support.
#518 opened Jul 5, 2023 by DongqiShen
为什么连给的example也有bug？
#517 opened Jul 5, 2023 by Moran232
4
请问lightseq可以支持segmentAnyting的推理优化吗
#516 opened Jun 30, 2023 by sanbuphy
1
llama inference test
#515 opened Jun 29, 2023 by HandH1998
3
Do you have plans to support token_type_ids?
#514 opened Jun 26, 2023 by chenchongthu
Is llama inference available now?
#513 opened Jun 12, 2023 by frankxyy
1
请问lightseq在推理流程中有gemm调参这一步吗？
#512 opened Jun 12, 2023 by frankxyy
lightseq' Transformer expects an extra layer_norm on both encoder and decoder level
#509 opened May 26, 2023 by yuting-wang-1000
ls_torch_hf_quant_gpt2_export.py的使用问题
#508 opened May 21, 2023 by wzh232894
Do you consider supporting the chatglm model?
#507 opened May 19, 2023 by Youggls
How to get output scores for each output tokens of LightSeq BART model when inference
#506 opened May 19, 2023 by quancq
什么时候可以支持bloom的几个版本的模型，比如6b的
#505 opened May 10, 2023 by liuzhipengchd
3
RuntimeError: Ninja is required to load C++ extensions even after pip install ninja
#503 opened Apr 25, 2023 by zt991211
1
请问下可以支持llama和bloom推理加速吗
#502 opened Apr 18, 2023 by HuiResearch
4
ProTip! no:milestone will show everything without a milestone.