The model produces grammatically correct text.But it keeps repeating the same phrases.The output never moves forward.It feels stuck in a loop?
Home/language models
Decode Trail Latest Questions
Asked: July 30, 2025In: Deep Learning
I trained an LSTM for next-word prediction on text data.The training loss decreases normally.But when I generate text, it repeats the same token again and again.It feels like the model is ignoring the sentence.