DriftTexture · function

attention

out[batch][queries][channels] from q of that shape and k and v of [batch][keys][channels]. scratch holds at least queries × keys values and is overwritten.

Explained in DriftTexture.

function attention(out: Float32Array, q: Float32Array, k: Float32Array, v: Float32Array, queries: number, keys: number, channels: number, heads: number, scratch: Float32Array, bias?: Float32Array | null, batch?: number): void

import { attention } from '@driftengine/texture';

Parameters

Parameter	Type	Description
`out`	`Float32Array`
`q`	`Float32Array`
`k`	`Float32Array`
`v`	`Float32Array`
`queries`	`number`
`keys`	`number`
`channels`	`number`
`heads`	`number`
`scratch`	`Float32Array`
`bias?`	`Float32Array \| null`
`batch?`	`number`