Mamba Codestral
###############

Build
*****

.. literalinclude:: mamba-codestral/Containerfile
   :language: Docker
   :caption: Containerfile

.. literalinclude:: mamba-codestral/download.py
   :language: python
   :caption: download.py


.. code-block:: console

   podman build \
      --cap-add=SYS_PTRACE \
      --security-opt seccomp=unconfined \
      --group-add keep-groups \
      --shm-size 8G \
      --device=/dev/kfd \
      --device=/dev/dri \
      --tag codestral:mamba \
      .

Téléchargement du modéle
************************

.. seealso:: https://huggingface.co/mistralai/Mamba-Codestral-7B-v0.1
.. seealso:: Read token: https://huggingface.co/settings/tokens

.. code-block:: console

   podman run --rm -it \
         --cap-add=SYS_PTRACE \
         --security-opt seccomp=unconfined \
         --group-add keep-groups \
         --shm-size 8G \
         --device=/dev/kfd \
         --device=/dev/dri \
         -v ${HOME}/codestral/mistral_models:/root/mistral_models \
         -e TOKEN="<TOKEN>" \
         codestral:mamba \
         python /opt/download.py

Prompt
******

.. code-block:: console

   podman run --rm -it \
         --cap-add=SYS_PTRACE \
         --security-opt seccomp=unconfined \
         --group-add keep-groups \
         --shm-size 8G \
         --device=/dev/kfd \
         --device=/dev/dri \
         -v ${HOME}/codestral/mistral_models:/root/mistral_models \
         codestral:mamba

Makefile
********

.. literalinclude:: mamba-codestral/Makefile
   :language: Makefile
   :caption: Makefile