12 lines
435 B
Markdown
12 lines
435 B
Markdown
# Code Structure
|
|
|
|
- `backend`: Various backends for the language interpreter.
|
|
- `lang`: The frontend language.
|
|
- `srt`: The serving engine for running local models. (SRT = SGLang Runtime).
|
|
- `test`: Test utilities.
|
|
- `api.py`: Public API.
|
|
- `bench_latency.py`: Benchmark utilities.
|
|
- `global_config.py`: The global configs and constants.
|
|
- `launch_server.py`: The entry point of launching local server.
|
|
- `utils.py`: Common utilities.
|