dropout based PyTorch implementation for llama dropout.

Input

7074-dim embedding

Encoder

115 x VAE with 22 heads

Output

accuracy projection