II-D Encoding Positions The attention modules will not think about the buy of processing by structure. Transformer [62] launched “positional encodings” to feed specifics of the placement in the tokens in input sequences.It’s also really worth noting that LLMs can create outputs in structured formats like JSON, facilitating the extraction of