This is an automated archive made by the Lemmit Bot.
The original was posted on /r/singularity by /u/FeltSteam on 2024-04-10 03:31:12.
It looks like another MoE, 8x22b params and a sequence length of 65536 tokens.
You must log in or register to comment.