4 Commits (9953f22fce0ba899da0676a0b374e5d1f72bf259)

Author SHA1 Message Date
comfyanonymous a5f4292f9f
Basic hunyuan dit implementation. (#4102)
* Let tokenizers return weights to be stored in the saved checkpoint.

* Basic hunyuan dit implementation.

* Fix some resolutions not working.

* Support hydit checkpoint save.

* Init with right dtype.

* Switch to optimized attention in pooler.

* Fix black images on hunyuan dit.
7 months ago
comfyanonymous 10c919f4c7 Make it possible to load tokenizer data from checkpoints. 7 months ago
comfyanonymous 88ed893034 Allow SPieceTokenizer to load model from a byte string. 7 months ago
comfyanonymous 14764aa2e2 Rename LLAMATokenizer to SPieceTokenizer. 7 months ago