importantThis component is available only for LLM Controls users with NVIDIA GPUs on Windows systems.
"What is my current GPU temperature?" or "Show me the available GPU memory" to get information, and then tell G-Assist to modify your GPU settings.
For more information, see the NVIDIA G-assist project repository.
Prerequisites
- Windows operating system
- NVIDIA GPU
gassist.risepackage installed. This package is already installed with LLM Controls.
Use the G-Assist component in a flow
- Create a flow with a Chat input component, a G-Assist component, and a Chat output component.
- Connect the Chat input component to the G-Assist component’s Prompt input, and then connect the G-Assist component’s output to the Chat output component.
- Open the Playground, and then ask a question about your GPU. For example, “What is my current GPU temperature?”. The G-Assist component queries your GPU, and the response appears in the Playground.
Inputs
The NVIDIA G-Assist component accepts a single input:prompt: A human-readable prompt processed by NVIDIA G-Assist.
Outputs
The NVIDIA G-Assist component outputs a Message object that contains:text: The response from NVIDIA G-Assist containing the completed operation result.- The NVIDIA G-Assist message response is wrapped in an LLM Controls Message object.