In the Transformer architecture, which of the following statements about the Q (query), K (key),...

In the transformer architecture, the Q (query), K (key), and V (value) matrices are used in the self-attention mechanism to compute relationships between tokens in a sequence. According to "Attention is All You Need" (Vaswani et al., 2017) and NVIDIA’s NeMo documentation, the query vector (Q) represents the token seeking relevant information, the key vector (K) is used to compute compatibility with other tokens, and the value vector (V) provides the information to be retrieved. The attention score is calculated as a scaled dot-product of Q and K, and the output is a weighted sum of V. Option C is correct, as Q retrieves relevant information. Option A is incorrect, as Q, K, and V are not used for positional encoding. Option B is wrong, as attention scores are computed using both Q and K, not K alone. Option D is false, as positional embeddings are separate from V.