transformers - Decode Trail

Forgot Password

Lost your password? Please enter your email address. You will receive a link and will create a new password via email.

Username* Please type your username.

E-Mail* Please type your E-Mail.

Question Title* Please choose an appropriate title for the question so it can be answered easily.

Category* Please choose the appropriate section so the question can be searched easily.

Tags Please choose suitable Keywords Ex: question, poll.

Is this question is a poll? If you want to be doing a poll click here.

Image poll?

Featured image

Browse

Details*

Type the description thoroughly and in details.

Ask Anonymously

Add a Video to describe the problem better.

Video type Choose from here the video type.

Video ID Put Video ID here: https://www.youtube.com/watch?v=sdUUx5FdySs Ex: "sdUUx5FdySs".

Get notified by email when someone answers this question.

By asking your question, you agree to the Terms of Service and Privacy Policy .*

Asked: January 3, 2026In: AI & Machine Learning

How do I debug incorrect token alignment in transformer outputs?

MaximilianBegginer

transformers

Asked: December 22, 2025In: Deep Learning

Why does my Transformer run out of GPU memory only during text generation?

I fine-tuned a Transformer model without any memory issues.But when I call model.generate(), CUDA runs out of memory.This happens even for short prompts.Training worked fine, so this feels confusing.

Asked: December 14, 2025In: Deep Learning

Why does my Transformer’s training loss decrease but translation quality stays poor?

Nishant MishraBegginer

The training loss drops steadily during fine-tuning.But the translated sentences are grammatically wrong.BLEU and other quality metrics do not improve.It feels like the model is optimizing the wrong thing.

Asked: August 5, 2025In: AI & Machine Learning

How do I debug a transformer model that always predicts the same output?

MaximilianBegginer

transformer model debugging