Pregunta:
Transformer - Positional encoding
Autor: Christian NRespuesta:
Key idea: add a new vector containing positional information to current vectors Checklist: 1) Unique encoding for each time-step 2) Consistent distance between any two time-steps 3) Should generalize to longer sentences 4) Deterministic
0 / 5 (0 calificaciones)
1 answer(s) in total