Docs: add torch compile cache

[zhaochenyang20]

Motivation

Modifications

Checklist

• Format your code according to the Code Formatting with Pre-Commit.
• Add unit tests as outlined in the Running Unit Tests.
• Update documentation / docstrings / example tutorials as needed, according to Writing Documentation.
• Provide throughput / latency benchmark results and accuracy evaluation results as needed, according to Benchmark and Profiling and Accuracy Results.
• For reviewers: If you haven't made any contributions to this PR and are only assisting with merging the main branch, please remove yourself as a co-author when merging the PR.
• Please feel free to join our Slack channel at https://slack.sglang.ai to discuss your PR.

[diggle001]

Hi, can anyone tell me Why doesn't torch-compile support FP8 models?
When I deployed the deepseek model of fp8, I added the --enable-torch-compile parameter to the startup command, which worked fine, but the startup still took a long time.

[ispobock]

Hi, can anyone tell me Why doesn't torch-compile support FP8 models? When I deployed the deepseek model of fp8, I added the --enable-torch-compile parameter to the startup command, which worked fine, but the startup still took a long time.

The torch.compile has supported FP8 since torch 2.5. The doc should be updated. @zhaochenyang20