DiScoFormer: One transformer for density and score, across distributions
DiScoFormer introduces a single transformer that models both density and score across multiple distributions.
Hugging Face published a blog introducing DiScoFormer, a unified transformer architecture that jointly handles density estimation and score modeling across different distributions. It is a notable research/engineering contribution to generative modeling but is a niche technical result rather than a broad industry-defining signal.