xlstm-jax documentation# Installation Repository Installation Conda environment Dataset Preparation Convert Huggingface Datasets to ArrayRecord Splitting DCLM dataset Preprocess Validation Datasets DCLM dataset Training large language models in xlstm-jax Training without Hydra Training with a Hydra configuration Default configurations Experiment configuration Configuring Experiments with Hydra Configuration Structure The Config Dataclasses The Config yaml files How to Run Experiments Using Experiment Files Type Checking of the Configurations How to run experiments on a SLURM cluster How to Resume an Experiment? Distributed Training Distributed Computing in JAX JIT vs Shard Map Multi-Host Training Parallelization Strategies Data Parallelism Fully-Sharded Data Parallelism Pipeline Parallelism Tensor Parallelism Miscellaneous API Reference xlstm_jax Submodules lmeval_extended_evaluation Attributes Classes Functions Module Contents Indices and tables# Index Module Index Search Page
