Skip to content

Commit a322578

Browse files
committed
update test list name
Signed-off-by: Ivy Zhang <[email protected]>
1 parent 663cb1d commit a322578

12 files changed

+14
-14
lines changed

tests/integration/test_lists/qa/README.md

Lines changed: 14 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# Description
22

3-
This folder contains QA test definitions for TensorRT-LLM, which are executed on a weekly/release schedule. These tests focus on end-to-end validation, accuracy verification, disaggregated testing, and performance benchmarking.
3+
This folder contains QA test definitions for TensorRT-LLM, which are executed on a daily/release schedule. These tests focus on end-to-end validation, accuracy verification, disaggregated testing, and performance benchmarking.
44

55
## Test Categories
66

@@ -47,24 +47,24 @@ pip install mako oyaml rouge_score lm_eval
4747
This directory contains various test configuration files:
4848

4949
### Functional Test Lists
50-
- `examples_test_list.txt` - Primary test list for single node multi-GPU scenarios (all new test cases should be added here)
51-
- `llm_sanity_test.txt` - Subset of examples for quick torch flow validation
52-
- `benchmark_test_list.txt` - Long-running single node test cases
53-
- `llm_multinodes_function_test.txt` - Multi-node functional test cases
54-
- `llm_release_gb20x.txt` - GB20X release test cases
55-
- `llm_release_rtx_pro_6000.txt` - RTX Pro 6000 specific tests
50+
- `llm_function_full.txt` - Primary test list for single node multi-GPU scenarios (all new test cases should be added here)
51+
- `llm_function_sanity.txt` - Subset of examples for quick torch flow validation
52+
- `llm_function_nim.txt` - NIM-specific functional test cases
53+
- `llm_function_multinode.txt` - Multi-node functional test cases
54+
- `llm_function_gb20x.txt` - GB20X release test cases
55+
- `llm_function_rtx6kd.txt` - RTX 6000 Ada specific tests
5656

5757
### Performance Test Files
58-
- `trt_llm_release_perf_test.yml` - Main performance test configuration
59-
- `trt_llm_release_perf_cluster_test.yml` - Cluster-based performance tests
60-
- `trt_llm_release_perf_sanity_test.yml` - Performance sanity checks
61-
- `trt_llm_release_perf_l2_test.yml` - L2 level performance tests
58+
- `llm_perf_full.yml` - Main performance test configuration
59+
- `llm_perf_cluster.yml` - Cluster-based performance tests
60+
- `llm_perf_sanity.yml` - Performance sanity checks
61+
- `llm_perf_l2.yml` - L2 level performance tests
6262
- `trt_llm_integration_perf_test.yml` - Integration performance tests
6363
- `trt_llm_integration_perf_sanity_test.yml` - Integration performance sanity checks
6464
- `llm_release_perf_multinode_test.txt` - Multi-node performance tests
6565

6666
### Triton Backend Tests
67-
- `llm_triton_integration_test.txt` - Triton backend integration tests
67+
- `llm_triton_integration.txt` - Triton backend integration tests
6868

6969
### Release-Specific Tests
7070
- `llm_release_digits_func.txt` - Functional tests for DIGITS release
@@ -88,7 +88,7 @@ To run specific test categories:
8888
# direct to defs folder
8989
cd tests/integration/defs
9090
# Run all fp8 functional test
91-
pytest --no-header -vs --test-list=../test_lists/qa/examples_test_list.txt -k fp8
91+
pytest --no-header -vs --test-list=../test_lists/qa/llm_function_full.txt -k fp8
9292
# Run a single test case
9393
pytest -vs accuracy/test_cli_flow.py::TestLlama3_1_8B::test_auto_dtype
9494
```
@@ -104,6 +104,6 @@ QA tests are typically executed through CI/CD pipelines with appropriate test se
104104
## Test Guidelines
105105

106106
### Adding New Test Cases
107-
- **Primary Location**: For functional testing, new test cases should be added to `examples_test_list.txt` first
107+
- **Primary Location**: For functional testing, new test cases should be added to `llm_function_full.txt` first
108108
- **Categorization**: Test cases should be categorized based on their scope and execution time
109109
- **Validation**: Ensure test cases are properly validated before adding to any test list

0 commit comments

Comments
 (0)