Skip to main content

Module attention

Module attention 

Source
Expand description

ยงStochastic Attention

Rate-mode and SC-mode attention primitives used by the Python bridge.

Structsยง

StochasticAttention

Functionsยง

extract_head_columns ๐Ÿ”’
Extract one head slice from a row-major matrix.
flatten_rows ๐Ÿ”’
validate_multihead_shapes ๐Ÿ”’
validate_shapes ๐Ÿ”’