Exam Generative-AI-Leader Topic 3 Question 98 Discussion

The objective is to make the generated summaries concise--that is, to control their length. In the configuration of a generative AI model, particularly a large language model (LLM), the parameter used to directly control the maximum size of the response is the Output Length parameter (often referred to as max_output_tokens or max_tokens). By setting a low limit on this parameter, the team can ensure that the model is forced to terminate its response once that limit is reached, resulting in a shorter, more concise summary that is "easy to digest," as requested.