ContextWindowCompressionConfig
class ContextWindowCompressionConfig(val triggerTokens: Int? = null, val slidingWindow: SlidingWindow? = null)(source)
Enables context window compression to manage the model's context window.
This mechanism prevents the context from exceeding a given length.