[Feature]: Support for guided decoding in speculative decoding mode

[Pernekhan]

🚀 The feature, motivation and pitch

Currently, the guided decoding is not supported when speculative decoding mode is turned on.

TensorRT-LLM/tensorrt_llm/_torch/pyexecutor/py_executor_creator.py

Line 344 in 425dad0

"Guided decoding is only supported with speculative decoding that has a dedicated drafter (two-model engine)."

Alternatives

No response

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

[karljang]

@Pernekhan ,
Closing the ticket because #6948 implemented the feature. Please feel free to open a new one if you find any issue with the feature.