ContextWindowCompressionConfig

class ContextWindowCompressionConfig(val triggerTokens: Int? = null, val slidingWindow: SlidingWindow? = null)(source)

Enables context window compression to manage the model's context window.

This mechanism prevents the context from exceeding a given length.

Constructors

Link copied to clipboard
constructor(triggerTokens: Int? = null, slidingWindow: SlidingWindow? = null)

Properties

Link copied to clipboard

The sliding window compression mechanism.

Link copied to clipboard

The number of tokens (before running a turn) that triggers the context window compression.