Skip to content

Issues: kubernetes-sigs/inference-perf

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

27 Open 19 Closed
27 Open 19 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add shared prefixes to random data generator for benchmarking prefix caching kind/feature Categorizes issue or PR as related to a new feature. triage/accepted Indicates an issue or PR is ready to be actively worked on.
#93 opened May 23, 2025 by achandrasekar v0.1.0
@achandrasekar
Update docs to make sure they cover the usage instructions well kind/documentation Categorizes issue or PR as related to documentation.
#88 opened May 22, 2025 by achandrasekar v0.1.0
@achandrasekar
Unit tests for the core functionality kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt.
#87 opened May 22, 2025 by achandrasekar v0.1.0
@SachinVarghese
1
Add Multiprocess LoadGenerator kind/feature Categorizes issue or PR as related to a new feature.
#86 opened May 22, 2025 by jjk-g v0.1.0
@jjk-g
1
Publish container image for v0.1.0 release kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt.
#85 opened May 22, 2025 by achandrasekar v0.1.0
@wangchen615
1
Update all url fields types from str to pydantics HttpUrl
#78 opened May 19, 2025 by Bslabe123
Add Ability to Query Metrics from Google Managed Prometheus
#76 opened May 13, 2025 by Bslabe123
Report Generation for multi-stage runs kind/feature Categorizes issue or PR as related to a new feature.
#70 opened May 8, 2025 by aish1331 v0.1.0
@aish1331
2
make validate does not catch circular imports
#69 opened May 7, 2025 by Bslabe123
[Feature] Per-request metrics CSV report
#55 opened Apr 25, 2025 by Bslabe123
Publish inference-perf image on GHCR
#52 opened Apr 21, 2025 by surajssd
Ephemeral Port Exhaustion
#50 opened Apr 10, 2025 by Bslabe123
Add a logger with log levels good first issue Denotes an issue ready for a new contributor, according to the "help wanted" guidelines. kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt.
#48 opened Mar 31, 2025 by Bslabe123
[Feature] CSV report for performance testing
#47 opened Mar 31, 2025 by SachinVarghese
3
Calculate Accurate Prompt Tokens for Chat Completions in vLLM Client
#45 opened Mar 31, 2025 by vivekk16
2
[Testing] Add test cases for validating inference perf load generation
#40 opened Mar 26, 2025 by SachinVarghese
[Feature] Improved error handling for LLM requests
#31 opened Mar 4, 2025 by SachinVarghese
[Feature] Collect Latency metrics - compute request time percentiles
#30 opened Mar 4, 2025 by SachinVarghese
[Feature] Define configuration for test runner
#26 opened Feb 20, 2025 by SachinVarghese
2
[Feature] Add a model server client for TGI kind/feature Categorizes issue or PR as related to a new feature.
#24 opened Feb 20, 2025 by SachinVarghese
2
Consolidate perf testing tools lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.
#23 opened Feb 19, 2025 by kfswain
10
Add Kubernetes Orchestration Library for Model Server Deployment and Benchmarking kind/feature Categorizes issue or PR as related to a new feature. lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
#22 opened Feb 13, 2025 by wangchen615
4
[Feature] Add a model server client for Triton using TensorRT-LLM lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.
#18 opened Feb 3, 2025 by achandrasekar
1
[Feature] Add a client to get model server metrics lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale.
#17 opened Feb 3, 2025 by achandrasekar
1
[Feature] Add a load generator which sends a specific QPS
#16 opened Feb 3, 2025 by achandrasekar
1
ProTip! What’s not been updated in a month: updated:<2025-04-28.