Skip Navigation

LocalLLaMA @sh.itjust.works

noneabove1182 @sh.itjust.works

1y ago

Dolphin 2.0 based on mistral-7b released by Eric Hartford

huggingface.co ehartford/dolphin-2.0-mistral-7b · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

ehartford/dolphin-2.0-mistral-7b · Hugging Face

Model is trained on his own orca style dataset as well as some airoboros apparently to increase creativity

Quants:

https://huggingface.co/TheBloke/dolphin-2.0-mistral-7B-GPTQ

https://huggingface.co/TheBloke/dolphin-2.0-mistral-7B-GGUF

https://huggingface.co/TheBloke/dolphin-2.0-mistral-7B-AWQ

1 comments

- It depends on the learning rate, typically it's ideal and higher quality to learn really slowly over a lot of epochs but it's cheaper and obviously faster to learn fast over fewer epochs
  Also the dataset size is important to consider