Generate

class composer.callbacks.Generate(prompts, interval, batch_size=None, **kwargs)

Periodically log generations from a set of prompts.

Parameters

• prompts (list[str]) – The list of prompts you would like to produce generations for

• interval (Union[str, int, Time]) – The interval describing how often checkpoints should be saved. If an integer, it will be assumed to be in TimeUnit.EPOCH. Otherwise, the unit must be either TimeUnit.EPOCH, TimeUnit.BATCH, TimeUnit.TOKEN, or TimeUnit.SAMPLE.

• batch_size (Optional[int]) – Size of a prompt batch for generation. If None, defaults to the number of prompts.

• kwargs – All kwargs will be passed along to the call to generate. This is for things like do_sample, top_p, etc