Mistral 7B
Mistral 7B is a 7.3B parameter model that outperforms Llama 2 13B on all benchmarks and approaches CodeLlama 7B performance on code while remaining good at English tasks. It uses Grouped-query attention (GQA) for faster inference and Sliding Window Attention (SWA) to handle long…