Packages

package LogitProcess

Type Members

  1. class ForcedTokenLogitProcessor extends LogitProcessor

    Forces specific token ids to be sampled at specific indexes.

    Forces specific token ids to be sampled at specific indexes. Note that the order of the of the ids is relevant, as only the last forced token at the index will be the result.

  2. abstract class LogitProcessor extends Logit
  3. class MinLengthLogitProcessor extends LogitProcessor
  4. class NoRepeatNgramsLogitProcessor extends LogitProcessor
  5. class RepetitionPenaltyLogitProcessor extends LogitProcessor
  6. class SuppressLogitProcessor extends LogitProcessor

    Sets the probability to -inf for provided tokenIds, so they are not sampled.

Ungrouped