Short sequences work fine.Longer sequences cause GPU crashes.No code changes were made.Only input size increased.
Decode Trail Latest Questions
My model gives great accuracy on my laptop.When deployed on a server, predictions become inconsistent.The same input sometimes produces different outputs.Nothing crashes, but the behavior is unreliable.
Transactions sometimes fail with CPU time limit errors, even though no single piece of logic seems expensive. These failures are hard to reproduce consistently. I want to understand what causes this.
non scaled autoscaler
