SlidingWindow

class SlidingWindow(val targetTokens: Int? = null)(source)

Configures the sliding window context compression mechanism.

The context window will be truncated by keeping only a suffix of it.

Constructors

constructor(targetTokens: Int? = null)

The session reduction target, specifically, how many tokens to keep.