In [1]:
!git clone https://github.com/PhoebusSi/Alpaca-CoT.git code
Cloning into 'code'... remote: Enumerating objects: 750, done. remote: Counting objects: 100% (86/86), done. remote: Compressing objects: 100% (70/70), done. remote: Total 750 (delta 47), reused 28 (delta 16), pack-reused 664 Receiving objects: 100% (750/750), 127.12 MiB | 16.22 MiB/s, done. Resolving deltas: 100% (401/401), done.
In [2]:
# install basic python package
# 安装必要的python库
!python -m pip install bitsandbytes
!python -m pip install datasets
!python -m pip install git+https://github.com/huggingface/transformers.git
!python -m pip install peft
!python -m pip install sentencepiece
!python -m pip install gradio
Requirement already satisfied: bitsandbytes in /usr/local/lib/python3.10/dist-packages (0.38.1) WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [notice] A new release of pip is available: 23.0.1 -> 23.1 [notice] To update, run: python -m pip install --upgrade pip Requirement already satisfied: datasets in /usr/local/lib/python3.10/dist-packages (2.11.0) Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from datasets) (23.0) Requirement already satisfied: aiohttp in /usr/local/lib/python3.10/dist-packages (from datasets) (3.8.4) Requirement already satisfied: xxhash in /usr/local/lib/python3.10/dist-packages (from datasets) (3.2.0) Requirement already satisfied: multiprocess in /usr/local/lib/python3.10/dist-packages (from datasets) (0.70.14) Requirement already satisfied: huggingface-hub<1.0.0,>=0.11.0 in /usr/local/lib/python3.10/dist-packages (from datasets) (0.13.3) Requirement already satisfied: fsspec[http]>=2021.11.1 in /usr/local/lib/python3.10/dist-packages (from datasets) (2023.3.0) Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from datasets) (6.0) Requirement already satisfied: pandas in /usr/local/lib/python3.10/dist-packages (from datasets) (1.5.3) Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.10/dist-packages (from datasets) (1.24.2) Requirement already satisfied: pyarrow>=8.0.0 in /usr/local/lib/python3.10/dist-packages (from datasets) (11.0.0) Requirement already satisfied: responses<0.19 in /usr/local/lib/python3.10/dist-packages (from datasets) (0.18.0) Requirement already satisfied: dill<0.3.7,>=0.3.0 in /usr/local/lib/python3.10/dist-packages (from datasets) (0.3.6) Requirement already satisfied: requests>=2.19.0 in /usr/local/lib/python3.10/dist-packages (from datasets) (2.28.2) Requirement already satisfied: tqdm>=4.62.1 in /usr/local/lib/python3.10/dist-packages (from datasets) (4.65.0) Requirement already satisfied: aiosignal>=1.1.2 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (1.3.1) Requirement already satisfied: yarl<2.0,>=1.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (1.8.2) Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (6.0.4) Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (22.2.0) Requirement already satisfied: charset-normalizer<4.0,>=2.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (3.0.1) Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (1.3.3) Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /usr/local/lib/python3.10/dist-packages (from aiohttp->datasets) (4.0.2) Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0.0,>=0.11.0->datasets) (4.5.0) Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0.0,>=0.11.0->datasets) (3.10.4) Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests>=2.19.0->datasets) (2019.11.28) Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests>=2.19.0->datasets) (2.8) Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests>=2.19.0->datasets) (1.26.15) Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas->datasets) (2022.7.1) Requirement already satisfied: python-dateutil>=2.8.1 in /usr/local/lib/python3.10/dist-packages (from pandas->datasets) (2.8.2) Requirement already satisfied: six>=1.5 in /usr/lib/python3/dist-packages (from python-dateutil>=2.8.1->pandas->datasets) (1.14.0) WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [notice] A new release of pip is available: 23.0.1 -> 23.1 [notice] To update, run: python -m pip install --upgrade pip Collecting git+https://github.com/huggingface/transformers.git Cloning https://github.com/huggingface/transformers.git to /tmp/pip-req-build-w7rcp87u Running command git clone --filter=blob:none --quiet https://github.com/huggingface/transformers.git /tmp/pip-req-build-w7rcp87u Resolved https://github.com/huggingface/transformers.git to commit abbc96a2148da0c91fa078bd021984b2cc10ef85 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from transformers==4.29.0.dev0) (2.28.2) Requirement already satisfied: pyyaml>=5.1 in /usr/local/lib/python3.10/dist-packages (from transformers==4.29.0.dev0) (6.0) Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.10/dist-packages (from transformers==4.29.0.dev0) (4.65.0) Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from transformers==4.29.0.dev0) (3.10.4) Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.10/dist-packages (from transformers==4.29.0.dev0) (1.24.2) Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.10/dist-packages (from transformers==4.29.0.dev0) (23.0) Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /usr/local/lib/python3.10/dist-packages (from transformers==4.29.0.dev0) (0.13.2) Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/dist-packages (from transformers==4.29.0.dev0) (2023.3.23) Requirement already satisfied: huggingface-hub<1.0,>=0.11.0 in /usr/local/lib/python3.10/dist-packages (from transformers==4.29.0.dev0) (0.13.3) Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0,>=0.11.0->transformers==4.29.0.dev0) (4.5.0) Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests->transformers==4.29.0.dev0) (2019.11.28) Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests->transformers==4.29.0.dev0) (2.8) Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->transformers==4.29.0.dev0) (3.0.1) Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->transformers==4.29.0.dev0) (1.26.15) Building wheels for collected packages: transformers Building wheel for transformers (pyproject.toml) ... done Created wheel for transformers: filename=transformers-4.29.0.dev0-py3-none-any.whl size=6929166 sha256=2b2f738ad74a9abef609bb009f6f2e1ed9accb56c423b2b7c56056b72106beba Stored in directory: /tmp/pip-ephem-wheel-cache-p8msirxh/wheels/e7/9c/5b/e1a9c8007c343041e61cc484433d512ea9274272e3fcbe7c16 Successfully built transformers Installing collected packages: transformers Attempting uninstall: transformers Found existing installation: transformers 4.28.1 Uninstalling transformers-4.28.1: Successfully uninstalled transformers-4.28.1 Successfully installed transformers-4.29.0.dev0 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [notice] A new release of pip is available: 23.0.1 -> 23.1 [notice] To update, run: python -m pip install --upgrade pip Requirement already satisfied: peft in /usr/local/lib/python3.10/dist-packages (0.3.0.dev0) Requirement already satisfied: psutil in /usr/local/lib/python3.10/dist-packages (from peft) (5.9.4) Requirement already satisfied: torch>=1.13.0 in /usr/local/lib/python3.10/dist-packages (from peft) (1.13.1+cu116) Requirement already satisfied: transformers in /usr/local/lib/python3.10/dist-packages (from peft) (4.29.0.dev0) Requirement already satisfied: packaging>=20.0 in /usr/local/lib/python3.10/dist-packages (from peft) (23.0) Requirement already satisfied: numpy>=1.17 in /usr/local/lib/python3.10/dist-packages (from peft) (1.24.2) Requirement already satisfied: accelerate in /usr/local/lib/python3.10/dist-packages (from peft) (0.18.0) Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/dist-packages (from peft) (6.0) Requirement already satisfied: typing-extensions in /usr/local/lib/python3.10/dist-packages (from torch>=1.13.0->peft) (4.5.0) Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from transformers->peft) (3.10.4) Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/dist-packages (from transformers->peft) (2023.3.23) Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from transformers->peft) (2.28.2) Requirement already satisfied: huggingface-hub<1.0,>=0.11.0 in /usr/local/lib/python3.10/dist-packages (from transformers->peft) (0.13.3) Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.10/dist-packages (from transformers->peft) (4.65.0) Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /usr/local/lib/python3.10/dist-packages (from transformers->peft) (0.13.2) Requirement already satisfied: certifi>=2017.4.17 in /usr/lib/python3/dist-packages (from requests->transformers->peft) (2019.11.28) Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->transformers->peft) (1.26.15) Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->transformers->peft) (3.0.1) Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests->transformers->peft) (2.8) WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [notice] A new release of pip is available: 23.0.1 -> 23.1 [notice] To update, run: python -m pip install --upgrade pip Requirement already satisfied: sentencepiece in /usr/local/lib/python3.10/dist-packages (0.1.97) WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [notice] A new release of pip is available: 23.0.1 -> 23.1 [notice] To update, run: python -m pip install --upgrade pip Requirement already satisfied: gradio in /usr/local/lib/python3.10/dist-packages (3.25.0) Requirement already satisfied: fastapi in /usr/local/lib/python3.10/dist-packages (from gradio) (0.95.0) Requirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from gradio) (1.24.2) Requirement already satisfied: semantic-version in /usr/local/lib/python3.10/dist-packages (from gradio) (2.10.0) Requirement already satisfied: python-multipart in /usr/local/lib/python3.10/dist-packages (from gradio) (0.0.6) Requirement already satisfied: huggingface-hub>=0.13.0 in /usr/local/lib/python3.10/dist-packages (from gradio) (0.13.3) Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from gradio) (2.28.2) Requirement already satisfied: markdown-it-py[linkify]>=2.0.0 in /usr/local/lib/python3.10/dist-packages (from gradio) (2.2.0) Requirement already satisfied: websockets>=10.0 in /usr/local/lib/python3.10/dist-packages (from gradio) (10.4) Requirement already satisfied: pillow in /usr/local/lib/python3.10/dist-packages (from gradio) (9.5.0) Requirement already satisfied: typing-extensions in /usr/local/lib/python3.10/dist-packages (from gradio) (4.5.0) Requirement already satisfied: orjson in /usr/local/lib/python3.10/dist-packages (from gradio) (3.8.8) Requirement already satisfied: markupsafe in /usr/local/lib/python3.10/dist-packages (from gradio) (2.1.2) Requirement already satisfied: pandas in /usr/local/lib/python3.10/dist-packages (from gradio) (1.5.3) Requirement already satisfied: matplotlib in /usr/local/lib/python3.10/dist-packages (from gradio) (3.7.1) Requirement already satisfied: aiohttp in /usr/local/lib/python3.10/dist-packages (from gradio) (3.8.4) Requirement already satisfied: pydub in /usr/local/lib/python3.10/dist-packages (from gradio) (0.25.1) Requirement already satisfied: altair>=4.2.0 in /usr/local/lib/python3.10/dist-packages (from gradio) (4.2.2) Requirement already satisfied: gradio-client>=0.0.8 in /usr/local/lib/python3.10/dist-packages (from gradio) (0.1.3) Requirement already satisfied: mdit-py-plugins<=0.3.3 in /usr/local/lib/python3.10/dist-packages (from gradio) (0.3.3) Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/dist-packages (from gradio) (6.0) Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from gradio) (3.1.2) Requirement already satisfied: aiofiles in /usr/local/lib/python3.10/dist-packages (from gradio) (22.1.0) Requirement already satisfied: ffmpy in /usr/local/lib/python3.10/dist-packages (from gradio) (0.3.0) Requirement already satisfied: pydantic in /usr/local/lib/python3.10/dist-packages (from gradio) (1.10.7) Requirement already satisfied: uvicorn in /usr/local/lib/python3.10/dist-packages (from gradio) (0.21.1) Requirement already satisfied: httpx in /usr/local/lib/python3.10/dist-packages (from gradio) (0.23.3) Requirement already satisfied: entrypoints in /usr/local/lib/python3.10/dist-packages (from altair>=4.2.0->gradio) (0.4) Requirement already satisfied: jsonschema>=3.0 in /usr/local/lib/python3.10/dist-packages (from altair>=4.2.0->gradio) (4.17.3) Requirement already satisfied: toolz in /usr/local/lib/python3.10/dist-packages (from altair>=4.2.0->gradio) (0.12.0) Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from gradio-client>=0.0.8->gradio) (2023.3.0) Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from gradio-client>=0.0.8->gradio) (23.0) Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.13.0->gradio) (3.10.4) Requirement already satisfied: tqdm>=4.42.1 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub>=0.13.0->gradio) (4.65.0) Requirement already satisfied: mdurl~=0.1 in /usr/local/lib/python3.10/dist-packages (from markdown-it-py[linkify]>=2.0.0->gradio) (0.1.2) Requirement already satisfied: linkify-it-py<3,>=1 in /usr/local/lib/python3.10/dist-packages (from markdown-it-py[linkify]>=2.0.0->gradio) (2.0.0) Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas->gradio) (2022.7.1) Requirement already satisfied: python-dateutil>=2.8.1 in /usr/local/lib/python3.10/dist-packages (from pandas->gradio) (2.8.2) Requirement already satisfied: multidict<7.0,>=4.5 in /usr/local/lib/python3.10/dist-packages (from aiohttp->gradio) (6.0.4) Requirement already satisfied: aiosignal>=1.1.2 in /usr/local/lib/python3.10/dist-packages (from aiohttp->gradio) (1.3.1) Requirement already satisfied: attrs>=17.3.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->gradio) (22.2.0) Requirement already satisfied: async-timeout<5.0,>=4.0.0a3 in /usr/local/lib/python3.10/dist-packages (from aiohttp->gradio) (4.0.2) Requirement already satisfied: frozenlist>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from aiohttp->gradio) (1.3.3) Requirement already satisfied: yarl<2.0,>=1.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->gradio) (1.8.2) Requirement already satisfied: charset-normalizer<4.0,>=2.0 in /usr/local/lib/python3.10/dist-packages (from aiohttp->gradio) (3.0.1) Requirement already satisfied: starlette<0.27.0,>=0.26.1 in /usr/local/lib/python3.10/dist-packages (from fastapi->gradio) (0.26.1) Requirement already satisfied: rfc3986[idna2008]<2,>=1.3 in /usr/local/lib/python3.10/dist-packages (from httpx->gradio) (1.5.0) Requirement already satisfied: sniffio in /usr/local/lib/python3.10/dist-packages (from httpx->gradio) (1.3.0) Requirement already satisfied: httpcore<0.17.0,>=0.15.0 in /usr/local/lib/python3.10/dist-packages (from httpx->gradio) (0.16.3) Requirement already satisfied: certifi in /usr/lib/python3/dist-packages (from httpx->gradio) (2019.11.28) Requirement already satisfied: kiwisolver>=1.0.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gradio) (1.4.4) Requirement already satisfied: fonttools>=4.22.0 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gradio) (4.39.2) Requirement already satisfied: contourpy>=1.0.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gradio) (1.0.7) Requirement already satisfied: pyparsing>=2.3.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gradio) (3.0.9) Requirement already satisfied: cycler>=0.10 in /usr/local/lib/python3.10/dist-packages (from matplotlib->gradio) (0.11.0) Requirement already satisfied: idna<4,>=2.5 in /usr/lib/python3/dist-packages (from requests->gradio) (2.8) Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->gradio) (1.26.15) Requirement already satisfied: h11>=0.8 in /usr/local/lib/python3.10/dist-packages (from uvicorn->gradio) (0.14.0) Requirement already satisfied: click>=7.0 in /usr/local/lib/python3.10/dist-packages (from uvicorn->gradio) (8.1.3) Requirement already satisfied: anyio<5.0,>=3.0 in /usr/local/lib/python3.10/dist-packages (from httpcore<0.17.0,>=0.15.0->httpx->gradio) (3.6.2) Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.10/dist-packages (from jsonschema>=3.0->altair>=4.2.0->gradio) (0.19.3) Requirement already satisfied: uc-micro-py in /usr/local/lib/python3.10/dist-packages (from linkify-it-py<3,>=1->markdown-it-py[linkify]>=2.0.0->gradio) (1.0.1) Requirement already satisfied: six>=1.5 in /usr/lib/python3/dist-packages (from python-dateutil>=2.8.1->pandas->gradio) (1.14.0) WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv [notice] A new release of pip is available: 23.0.1 -> 23.1 [notice] To update, run: python -m pip install --upgrade pip
In [3]:
# download data git repository
# 拉取数据仓库
!GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/datasets/QingyiSi/Alpaca-CoT data
Cloning into 'data'... remote: Enumerating objects: 2167, done. remote: Counting objects: 100% (2160/2160), done. remote: Compressing objects: 100% (1971/1971), done. remote: Total 2167 (delta 145), reused 2055 (delta 133), pack-reused 7 Receiving objects: 100% (2167/2167), 21.86 MiB | 18.96 MiB/s, done. Resolving deltas: 100% (145/145), done.
In [5]:
# pull specify data and move it，change <alpaca/> to your preference
# 从仓库中拉取指定文件放入训练目录下，你可以在 https://huggingface.co/datasets/QingyiSi/Alpaca-CoT 查看数据详情
!cd /workspace/data && git config core.sparsecheckout true && git config lfs.fetchinclude alpaca/
!cd /workspace/data && git lfs pull
!cp /workspace/data/alpaca/*.json /workspace/code/data/
!ls -lh /workspace/code/data/
total 44Mng LFS objects: 100% (2/2), 46 MB | 20 MB/s -rw-r--r-- 1 root root 22M Apr 17 13:56 alpaca_data.json -rw-r--r-- 1 root root 22M Apr 17 13:56 alpaca_data_cleaned.json drwxr-xr-x 2 root root 4.0K Apr 17 13:54 formatted_cot_data drwxr-xr-x 2 root root 4.0K Apr 17 13:54 origin_cot_data
In [6]:
# instruction finetuning
# 进行指令微调，如果你想直接体验已有checkpoint，可忽略此步
!cd /workspace/code && python uniform_finetune.py --model_type llama --model_name_or_path decapoda-research/llama-7b-hf --data alpaca --lora_target_modules q_proj v_proj --per_gpu_train_batch_size 4 --learning_rate 3e-4 --epochs 1
===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please run
python -m bitsandbytes
and submit this information together with your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
================================================================================
bin /usr/local/lib/python3.10/dist-packages/bitsandbytes/libbitsandbytes_cuda116.so
/usr/local/lib/python3.10/dist-packages/bitsandbytes/cuda_setup/main.py:145: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('/usr/local/nvidia/lib'), PosixPath('/usr/local/nvidia/lib64')}
warn(msg)
/usr/local/lib/python3.10/dist-packages/bitsandbytes/cuda_setup/main.py:145: UserWarning: /usr/local/nvidia/lib:/usr/local/nvidia/lib64 did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths...
warn(msg)
/usr/local/lib/python3.10/dist-packages/bitsandbytes/cuda_setup/main.py:145: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('module'), PosixPath('//matplotlib_inline.backend_inline')}
warn(msg)
/usr/local/lib/python3.10/dist-packages/bitsandbytes/cuda_setup/main.py:145: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('PygmalionAI/pygmalion-6b')}
warn(msg)
/usr/local/lib/python3.10/dist-packages/bitsandbytes/cuda_setup/main.py:145: UserWarning: WARNING: The following directories listed in your path were found to be non-existent: {PosixPath('noninteractiveSHELL=/bin/bash')}
warn(msg)
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths...
/usr/local/lib/python3.10/dist-packages/bitsandbytes/cuda_setup/main.py:145: UserWarning: Found duplicate ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] files: {PosixPath('/usr/local/cuda/lib64/libcudart.so'), PosixPath('/usr/local/cuda/lib64/libcudart.so.11.0')}.. We'll flip a coin and try one of these, in order to fail forward.
Either way, this might cause trouble in the future:
If you get `CUDA error: invalid device function` errors, the above might be the cause and the solution is to make sure only one ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] in the paths that we search based on your env.
warn(msg)
CUDA SETUP: CUDA runtime path found: /usr/local/cuda/lib64/libcudart.so
CUDA SETUP: Highest compute capability among GPUs detected: 8.6
CUDA SETUP: Detected CUDA version 116
CUDA SETUP: Loading binary /usr/local/lib/python3.10/dist-packages/bitsandbytes/libbitsandbytes_cuda116.so...
Namespace(size=None, data='alpaca', local_rank=-1, model_type='llama', model_name_or_path='decapoda-research/llama-7b-hf', per_gpu_train_batch_size=4, gradient_accumulation_steps=32, epochs=1, learning_rate=0.0003, cutoff_len=512, lora_r=8, lora_alpha=16, lora_dropout=0.05, val_set_size=2000, lora_target_modules=['q_proj', 'v_proj'])
Downloading and preparing dataset json/default to /root/.cache/huggingface/datasets/json/default-f8a343789e1df39c/0.0.0/fe5dd6ea2639a6df622901539cb550cf8797e5a6b2dd7af1cf934bed8e233e6e...
Downloading data files: 100%|███████████████████| 1/1 [00:00<00:00, 5907.47it/s]
Extracting data files: 100%|████████████████████| 1/1 [00:00<00:00, 1109.60it/s]
Dataset json downloaded and prepared to /root/.cache/huggingface/datasets/json/default-f8a343789e1df39c/0.0.0/fe5dd6ea2639a6df622901539cb550cf8797e5a6b2dd7af1cf934bed8e233e6e. Subsequent calls will reuse this data.
100%|████████████████████████████████████████████| 1/1 [00:00<00:00, 218.64it/s]
DatasetDict({
train: Dataset({
features: ['instruction', 'input', 'output'],
num_rows: 51942
})
})
Overriding torch_dtype=None with `torch_dtype=torch.float16` due to requirements of `bitsandbytes` to enable model loading in mixed int8. Either pass torch_dtype=torch.float16 or don't pass this argument at all to remove this warning.
Downloading (…)lve/main/config.json: 100%|██████| 427/427 [00:00<00:00, 199kB/s]
Downloading (…)model.bin.index.json: 100%|█| 25.5k/25.5k [00:00<00:00, 11.5MB/s]
Downloading shards: 0%| | 0/33 [00:00<?, ?it/s]
Downloading (…)l-00001-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00001-of-00033.bin: 3%| | 10.5M/405M [00:00<00:09, 42.6MB/s]
Downloading (…)l-00001-of-00033.bin: 5%| | 21.0M/405M [00:00<00:07, 52.2MB/s]
Downloading (…)l-00001-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:06, 54.8MB/s]
Downloading (…)l-00001-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:06, 57.6MB/s]
Downloading (…)l-00001-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:07, 48.7MB/s]
Downloading (…)l-00001-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:06, 51.3MB/s]
Downloading (…)l-00001-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:06, 50.9MB/s]
Downloading (…)l-00001-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:05, 54.2MB/s]
Downloading (…)l-00001-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:05, 55.5MB/s]
Downloading (…)l-00001-of-00033.bin: 26%|▊ | 105M/405M [00:01<00:05, 54.7MB/s]
Downloading (…)l-00001-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:05, 53.0MB/s]
Downloading (…)l-00001-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:04, 56.4MB/s]
Downloading (…)l-00001-of-00033.bin: 34%|█ | 136M/405M [00:02<00:04, 59.1MB/s]
Downloading (…)l-00001-of-00033.bin: 36%|█ | 147M/405M [00:02<00:04, 58.7MB/s]
Downloading (…)l-00001-of-00033.bin: 39%|█▏ | 157M/405M [00:02<00:05, 48.6MB/s]
Downloading (…)l-00001-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:04, 51.3MB/s]
Downloading (…)l-00001-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:04, 52.4MB/s]
Downloading (…)l-00001-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:04, 52.5MB/s]
Downloading (…)l-00001-of-00033.bin: 49%|█▍ | 199M/405M [00:03<00:03, 52.6MB/s]
Downloading (…)l-00001-of-00033.bin: 52%|█▌ | 210M/405M [00:03<00:03, 55.5MB/s]
Downloading (…)l-00001-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:03, 54.2MB/s]
Downloading (…)l-00001-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:03, 49.0MB/s]
Downloading (…)l-00001-of-00033.bin: 60%|█▊ | 241M/405M [00:04<00:03, 52.3MB/s]
Downloading (…)l-00001-of-00033.bin: 62%|█▊ | 252M/405M [00:04<00:02, 52.3MB/s]
Downloading (…)l-00001-of-00033.bin: 65%|█▉ | 262M/405M [00:04<00:02, 50.9MB/s]
Downloading (…)l-00001-of-00033.bin: 67%|██ | 273M/405M [00:05<00:02, 51.9MB/s]
Downloading (…)l-00001-of-00033.bin: 70%|██ | 283M/405M [00:05<00:02, 53.3MB/s]
Downloading (…)l-00001-of-00033.bin: 73%|██▏| 294M/405M [00:05<00:01, 55.8MB/s]
Downloading (…)l-00001-of-00033.bin: 75%|██▎| 304M/405M [00:05<00:01, 51.1MB/s]
Downloading (…)l-00001-of-00033.bin: 78%|██▎| 315M/405M [00:05<00:01, 50.6MB/s]
Downloading (…)l-00001-of-00033.bin: 80%|██▍| 325M/405M [00:06<00:01, 55.1MB/s]
Downloading (…)l-00001-of-00033.bin: 83%|██▍| 336M/405M [00:06<00:01, 52.0MB/s]
Downloading (…)l-00001-of-00033.bin: 85%|██▌| 346M/405M [00:06<00:01, 47.8MB/s]
Downloading (…)l-00001-of-00033.bin: 88%|██▋| 357M/405M [00:06<00:01, 47.1MB/s]
Downloading (…)l-00001-of-00033.bin: 91%|██▋| 367M/405M [00:07<00:00, 44.9MB/s]
Downloading (…)l-00001-of-00033.bin: 93%|██▊| 377M/405M [00:07<00:00, 47.4MB/s]
Downloading (…)l-00001-of-00033.bin: 96%|██▉| 388M/405M [00:07<00:00, 50.7MB/s]
Downloading (…)l-00001-of-00033.bin: 98%|██▉| 398M/405M [00:07<00:00, 49.5MB/s]
Downloading (…)l-00001-of-00033.bin: 100%|███| 405M/405M [00:07<00:00, 51.7MB/s]
Downloading shards: 3%|▋ | 1/33 [00:08<04:17, 8.06s/it]
Downloading (…)l-00002-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00002-of-00033.bin: 3%| | 10.5M/405M [00:00<00:13, 28.2MB/s]
Downloading (…)l-00002-of-00033.bin: 5%| | 21.0M/405M [00:00<00:09, 40.8MB/s]
Downloading (…)l-00002-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:07, 51.0MB/s]
Downloading (…)l-00002-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:06, 57.1MB/s]
Downloading (…)l-00002-of-00033.bin: 13%|▎ | 52.4M/405M [00:00<00:05, 64.9MB/s]
Downloading (…)l-00002-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:05, 63.9MB/s]
Downloading (…)l-00002-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:05, 66.2MB/s]
Downloading (…)l-00002-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:04, 67.0MB/s]
Downloading (…)l-00002-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:04, 68.0MB/s]
Downloading (…)l-00002-of-00033.bin: 26%|▊ | 105M/405M [00:01<00:04, 69.2MB/s]
Downloading (…)l-00002-of-00033.bin: 28%|▊ | 115M/405M [00:01<00:04, 64.2MB/s]
Downloading (…)l-00002-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:04, 63.5MB/s]
Downloading (…)l-00002-of-00033.bin: 34%|█ | 136M/405M [00:02<00:04, 63.7MB/s]
Downloading (…)l-00002-of-00033.bin: 36%|█ | 147M/405M [00:02<00:04, 60.4MB/s]
Downloading (…)l-00002-of-00033.bin: 39%|█▏ | 157M/405M [00:02<00:04, 60.8MB/s]
Downloading (…)l-00002-of-00033.bin: 41%|█▏ | 168M/405M [00:02<00:03, 62.0MB/s]
Downloading (…)l-00002-of-00033.bin: 44%|█▎ | 178M/405M [00:02<00:03, 60.2MB/s]
Downloading (…)l-00002-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:03, 61.1MB/s]
Downloading (…)l-00002-of-00033.bin: 49%|█▍ | 199M/405M [00:03<00:03, 64.5MB/s]
Downloading (…)l-00002-of-00033.bin: 52%|█▌ | 210M/405M [00:03<00:02, 67.9MB/s]
Downloading (…)l-00002-of-00033.bin: 54%|█▋ | 220M/405M [00:03<00:02, 66.0MB/s]
Downloading (…)l-00002-of-00033.bin: 57%|█▋ | 231M/405M [00:03<00:02, 67.4MB/s]
Downloading (…)l-00002-of-00033.bin: 60%|█▊ | 241M/405M [00:03<00:02, 65.7MB/s]
Downloading (…)l-00002-of-00033.bin: 62%|█▊ | 252M/405M [00:04<00:02, 66.0MB/s]
Downloading (…)l-00002-of-00033.bin: 65%|█▉ | 262M/405M [00:04<00:02, 60.8MB/s]
Downloading (…)l-00002-of-00033.bin: 67%|██ | 273M/405M [00:04<00:02, 65.1MB/s]
Downloading (…)l-00002-of-00033.bin: 70%|██ | 283M/405M [00:04<00:01, 65.6MB/s]
Downloading (…)l-00002-of-00033.bin: 73%|██▏| 294M/405M [00:04<00:01, 61.4MB/s]
Downloading (…)l-00002-of-00033.bin: 75%|██▎| 304M/405M [00:04<00:01, 61.2MB/s]
Downloading (…)l-00002-of-00033.bin: 78%|██▎| 315M/405M [00:05<00:01, 60.5MB/s]
Downloading (…)l-00002-of-00033.bin: 80%|██▍| 325M/405M [00:05<00:01, 54.6MB/s]
Downloading (…)l-00002-of-00033.bin: 83%|██▍| 336M/405M [00:05<00:01, 57.1MB/s]
Downloading (…)l-00002-of-00033.bin: 85%|██▌| 346M/405M [00:05<00:01, 56.4MB/s]
Downloading (…)l-00002-of-00033.bin: 88%|██▋| 357M/405M [00:05<00:00, 54.3MB/s]
Downloading (…)l-00002-of-00033.bin: 91%|██▋| 367M/405M [00:06<00:00, 55.6MB/s]
Downloading (…)l-00002-of-00033.bin: 93%|██▊| 377M/405M [00:06<00:00, 57.2MB/s]
Downloading (…)l-00002-of-00033.bin: 96%|██▉| 388M/405M [00:06<00:00, 50.8MB/s]
Downloading (…)l-00002-of-00033.bin: 98%|██▉| 398M/405M [00:06<00:00, 51.0MB/s]
Downloading (…)l-00002-of-00033.bin: 100%|███| 405M/405M [00:06<00:00, 59.2MB/s]
Downloading shards: 6%|█▍ | 2/33 [00:15<03:53, 7.53s/it]
Downloading (…)l-00003-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00003-of-00033.bin: 3%| | 10.5M/405M [00:00<00:23, 16.6MB/s]
Downloading (…)l-00003-of-00033.bin: 5%| | 21.0M/405M [00:00<00:17, 22.3MB/s]
Downloading (…)l-00003-of-00033.bin: 8%|▏ | 31.5M/405M [00:01<00:15, 23.4MB/s]
Downloading (…)l-00003-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:14, 25.7MB/s]
Downloading (…)l-00003-of-00033.bin: 13%|▎ | 52.4M/405M [00:02<00:14, 24.3MB/s]
Downloading (…)l-00003-of-00033.bin: 16%|▎ | 62.9M/405M [00:02<00:13, 24.5MB/s]
Downloading (…)l-00003-of-00033.bin: 18%|▎ | 73.4M/405M [00:03<00:13, 24.2MB/s]
Downloading (…)l-00003-of-00033.bin: 21%|▍ | 83.9M/405M [00:03<00:12, 25.8MB/s]
Downloading (…)l-00003-of-00033.bin: 23%|▍ | 94.4M/405M [00:03<00:12, 25.0MB/s]
Downloading (…)l-00003-of-00033.bin: 26%|▊ | 105M/405M [00:04<00:12, 23.9MB/s]
Downloading (…)l-00003-of-00033.bin: 28%|▊ | 115M/405M [00:04<00:10, 26.9MB/s]
Downloading (…)l-00003-of-00033.bin: 31%|▉ | 126M/405M [00:05<00:10, 25.8MB/s]
Downloading (…)l-00003-of-00033.bin: 34%|█ | 136M/405M [00:05<00:10, 24.6MB/s]
Downloading (…)l-00003-of-00033.bin: 36%|█ | 147M/405M [00:06<00:12, 21.2MB/s]
Downloading (…)l-00003-of-00033.bin: 39%|█▏ | 157M/405M [00:06<00:12, 20.5MB/s]
Downloading (…)l-00003-of-00033.bin: 41%|█▏ | 168M/405M [00:07<00:10, 22.3MB/s]
Downloading (…)l-00003-of-00033.bin: 44%|█▎ | 178M/405M [00:07<00:10, 21.1MB/s]
Downloading (…)l-00003-of-00033.bin: 47%|█▍ | 189M/405M [00:08<00:09, 23.5MB/s]
Downloading (…)l-00003-of-00033.bin: 49%|█▍ | 199M/405M [00:08<00:09, 22.0MB/s]
Downloading (…)l-00003-of-00033.bin: 52%|█▌ | 210M/405M [00:08<00:08, 23.3MB/s]
Downloading (…)l-00003-of-00033.bin: 54%|█▋ | 220M/405M [00:09<00:07, 24.5MB/s]
Downloading (…)l-00003-of-00033.bin: 57%|█▋ | 231M/405M [00:09<00:06, 26.0MB/s]
Downloading (…)l-00003-of-00033.bin: 60%|█▊ | 241M/405M [00:10<00:06, 25.8MB/s]
Downloading (…)l-00003-of-00033.bin: 62%|█▊ | 252M/405M [00:10<00:05, 27.3MB/s]
Downloading (…)l-00003-of-00033.bin: 65%|█▉ | 262M/405M [00:10<00:04, 28.9MB/s]
Downloading (…)l-00003-of-00033.bin: 67%|██ | 273M/405M [00:11<00:04, 27.3MB/s]
Downloading (…)l-00003-of-00033.bin: 70%|██ | 283M/405M [00:11<00:04, 25.8MB/s]
Downloading (…)l-00003-of-00033.bin: 73%|██▏| 294M/405M [00:11<00:03, 28.1MB/s]
Downloading (…)l-00003-of-00033.bin: 75%|██▎| 304M/405M [00:12<00:03, 28.4MB/s]
Downloading (…)l-00003-of-00033.bin: 78%|██▎| 315M/405M [00:12<00:02, 31.4MB/s]
Downloading (…)l-00003-of-00033.bin: 80%|██▍| 325M/405M [00:12<00:02, 31.6MB/s]
Downloading (…)l-00003-of-00033.bin: 83%|██▍| 336M/405M [00:13<00:02, 30.8MB/s]
Downloading (…)l-00003-of-00033.bin: 85%|██▌| 346M/405M [00:13<00:02, 28.6MB/s]
Downloading (…)l-00003-of-00033.bin: 88%|██▋| 357M/405M [00:14<00:01, 28.1MB/s]
Downloading (…)l-00003-of-00033.bin: 91%|██▋| 367M/405M [00:14<00:01, 28.8MB/s]
Downloading (…)l-00003-of-00033.bin: 93%|██▊| 377M/405M [00:14<00:00, 28.9MB/s]
Downloading (…)l-00003-of-00033.bin: 96%|██▉| 388M/405M [00:15<00:00, 31.7MB/s]
Downloading (…)l-00003-of-00033.bin: 98%|██▉| 398M/405M [00:15<00:00, 29.1MB/s]
Downloading (…)l-00003-of-00033.bin: 100%|███| 405M/405M [00:15<00:00, 25.8MB/s]
Downloading shards: 9%|██▏ | 3/33 [00:31<05:41, 11.38s/it]
Downloading (…)l-00004-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00004-of-00033.bin: 3%| | 10.5M/405M [00:00<00:06, 56.8MB/s]
Downloading (…)l-00004-of-00033.bin: 5%| | 21.0M/405M [00:00<00:06, 56.0MB/s]
Downloading (…)l-00004-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:06, 59.7MB/s]
Downloading (…)l-00004-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:05, 61.8MB/s]
Downloading (…)l-00004-of-00033.bin: 13%|▎ | 52.4M/405M [00:00<00:05, 62.0MB/s]
Downloading (…)l-00004-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:06, 55.5MB/s]
Downloading (…)l-00004-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:05, 56.6MB/s]
Downloading (…)l-00004-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:05, 60.1MB/s]
Downloading (…)l-00004-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:04, 62.3MB/s]
Downloading (…)l-00004-of-00033.bin: 26%|▊ | 105M/405M [00:01<00:04, 61.6MB/s]
Downloading (…)l-00004-of-00033.bin: 28%|▊ | 115M/405M [00:01<00:04, 62.0MB/s]
Downloading (…)l-00004-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:04, 61.1MB/s]
Downloading (…)l-00004-of-00033.bin: 34%|█ | 136M/405M [00:02<00:04, 61.1MB/s]
Downloading (…)l-00004-of-00033.bin: 36%|█ | 147M/405M [00:02<00:04, 58.8MB/s]
Downloading (…)l-00004-of-00033.bin: 39%|█▏ | 157M/405M [00:02<00:04, 54.7MB/s]
Downloading (…)l-00004-of-00033.bin: 41%|█▏ | 168M/405M [00:02<00:04, 58.1MB/s]
Downloading (…)l-00004-of-00033.bin: 44%|█▎ | 178M/405M [00:02<00:03, 59.9MB/s]
Downloading (…)l-00004-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:03, 55.9MB/s]
Downloading (…)l-00004-of-00033.bin: 49%|█▍ | 199M/405M [00:03<00:03, 54.7MB/s]
Downloading (…)l-00004-of-00033.bin: 52%|█▌ | 210M/405M [00:03<00:03, 54.1MB/s]
Downloading (…)l-00004-of-00033.bin: 54%|█▋ | 220M/405M [00:03<00:03, 57.6MB/s]
Downloading (…)l-00004-of-00033.bin: 57%|█▋ | 231M/405M [00:03<00:02, 59.3MB/s]
Downloading (…)l-00004-of-00033.bin: 60%|█▊ | 241M/405M [00:04<00:02, 61.3MB/s]
Downloading (…)l-00004-of-00033.bin: 62%|█▊ | 252M/405M [00:04<00:02, 55.4MB/s]
Downloading (…)l-00004-of-00033.bin: 65%|█▉ | 262M/405M [00:04<00:02, 51.3MB/s]
Downloading (…)l-00004-of-00033.bin: 67%|██ | 273M/405M [00:04<00:02, 49.7MB/s]
Downloading (…)l-00004-of-00033.bin: 70%|██ | 283M/405M [00:04<00:02, 52.2MB/s]
Downloading (…)l-00004-of-00033.bin: 73%|██▏| 294M/405M [00:05<00:02, 53.8MB/s]
Downloading (…)l-00004-of-00033.bin: 75%|██▎| 304M/405M [00:05<00:01, 53.3MB/s]
Downloading (…)l-00004-of-00033.bin: 78%|██▎| 315M/405M [00:05<00:01, 55.9MB/s]
Downloading (…)l-00004-of-00033.bin: 80%|██▍| 325M/405M [00:05<00:01, 56.3MB/s]
Downloading (…)l-00004-of-00033.bin: 83%|██▍| 336M/405M [00:05<00:01, 55.3MB/s]
Downloading (…)l-00004-of-00033.bin: 85%|██▌| 346M/405M [00:06<00:01, 56.1MB/s]
Downloading (…)l-00004-of-00033.bin: 88%|██▋| 357M/405M [00:06<00:00, 59.0MB/s]
Downloading (…)l-00004-of-00033.bin: 91%|██▋| 367M/405M [00:06<00:00, 56.9MB/s]
Downloading (…)l-00004-of-00033.bin: 93%|██▊| 377M/405M [00:06<00:00, 54.9MB/s]
Downloading (…)l-00004-of-00033.bin: 96%|██▉| 388M/405M [00:06<00:00, 51.0MB/s]
Downloading (…)l-00004-of-00033.bin: 98%|██▉| 398M/405M [00:07<00:00, 50.3MB/s]
Downloading (…)l-00004-of-00033.bin: 100%|███| 405M/405M [00:07<00:00, 55.7MB/s]
Downloading shards: 12%|██▉ | 4/33 [00:38<04:46, 9.88s/it]
Downloading (…)l-00005-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00005-of-00033.bin: 3%| | 10.5M/405M [00:00<00:06, 65.4MB/s]
Downloading (…)l-00005-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:03, 97.2MB/s]
Downloading (…)l-00005-of-00033.bin: 13%|▍ | 52.4M/405M [00:00<00:03, 106MB/s]
Downloading (…)l-00005-of-00033.bin: 18%|▌ | 73.4M/405M [00:00<00:03, 110MB/s]
Downloading (…)l-00005-of-00033.bin: 23%|▋ | 94.4M/405M [00:00<00:02, 112MB/s]
Downloading (…)l-00005-of-00033.bin: 28%|█▏ | 115M/405M [00:01<00:02, 101MB/s]
Downloading (…)l-00005-of-00033.bin: 31%|▉ | 126M/405M [00:01<00:03, 79.3MB/s]
Downloading (…)l-00005-of-00033.bin: 34%|█ | 136M/405M [00:01<00:03, 67.5MB/s]
Downloading (…)l-00005-of-00033.bin: 39%|█▏ | 157M/405M [00:01<00:03, 80.6MB/s]
Downloading (…)l-00005-of-00033.bin: 44%|█▎ | 178M/405M [00:01<00:02, 90.3MB/s]
Downloading (…)l-00005-of-00033.bin: 49%|█▍ | 199M/405M [00:02<00:02, 97.6MB/s]
Downloading (…)l-00005-of-00033.bin: 54%|██▏ | 220M/405M [00:02<00:01, 103MB/s]
Downloading (…)l-00005-of-00033.bin: 60%|██▍ | 241M/405M [00:02<00:01, 107MB/s]
Downloading (…)l-00005-of-00033.bin: 65%|██▌ | 262M/405M [00:02<00:01, 109MB/s]
Downloading (…)l-00005-of-00033.bin: 70%|██ | 283M/405M [00:03<00:01, 67.2MB/s]
Downloading (…)l-00005-of-00033.bin: 75%|██▎| 304M/405M [00:03<00:01, 76.5MB/s]
Downloading (…)l-00005-of-00033.bin: 80%|██▍| 325M/405M [00:03<00:00, 85.3MB/s]
Downloading (…)l-00005-of-00033.bin: 85%|██▌| 346M/405M [00:03<00:00, 92.5MB/s]
Downloading (…)l-00005-of-00033.bin: 91%|██▋| 367M/405M [00:04<00:00, 98.5MB/s]
Downloading (…)l-00005-of-00033.bin: 96%|███▊| 388M/405M [00:04<00:00, 103MB/s]
Downloading (…)l-00005-of-00033.bin: 100%|███| 405M/405M [00:04<00:00, 93.2MB/s]
Downloading shards: 15%|███▋ | 5/33 [00:43<03:43, 7.98s/it]
Downloading (…)l-00006-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00006-of-00033.bin: 3%| | 10.5M/405M [00:00<00:07, 52.1MB/s]
Downloading (…)l-00006-of-00033.bin: 5%| | 21.0M/405M [00:00<00:08, 43.5MB/s]
Downloading (…)l-00006-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:07, 50.5MB/s]
Downloading (…)l-00006-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:06, 53.8MB/s]
Downloading (…)l-00006-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:06, 54.1MB/s]
Downloading (…)l-00006-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:05, 58.3MB/s]
Downloading (…)l-00006-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:05, 56.3MB/s]
Downloading (…)l-00006-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:05, 55.8MB/s]
Downloading (…)l-00006-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:05, 57.6MB/s]
Downloading (…)l-00006-of-00033.bin: 26%|▊ | 105M/405M [00:01<00:04, 61.1MB/s]
Downloading (…)l-00006-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:04, 61.3MB/s]
Downloading (…)l-00006-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:05, 55.5MB/s]
Downloading (…)l-00006-of-00033.bin: 34%|█ | 136M/405M [00:02<00:05, 49.7MB/s]
Downloading (…)l-00006-of-00033.bin: 36%|█ | 147M/405M [00:02<00:05, 47.1MB/s]
Downloading (…)l-00006-of-00033.bin: 39%|█▏ | 157M/405M [00:02<00:05, 47.9MB/s]
Downloading (…)l-00006-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:04, 48.6MB/s]
Downloading (…)l-00006-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:04, 48.3MB/s]
Downloading (…)l-00006-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:04, 48.9MB/s]
Downloading (…)l-00006-of-00033.bin: 49%|█▍ | 199M/405M [00:03<00:04, 50.2MB/s]
Downloading (…)l-00006-of-00033.bin: 52%|█▌ | 210M/405M [00:04<00:04, 48.7MB/s]
Downloading (…)l-00006-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:03, 47.1MB/s]
Downloading (…)l-00006-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:03, 48.1MB/s]
Downloading (…)l-00006-of-00033.bin: 60%|█▊ | 241M/405M [00:04<00:03, 47.8MB/s]
Downloading (…)l-00006-of-00033.bin: 62%|█▊ | 252M/405M [00:04<00:03, 47.3MB/s]
Downloading (…)l-00006-of-00033.bin: 65%|█▉ | 262M/405M [00:05<00:03, 40.4MB/s]
Downloading (…)l-00006-of-00033.bin: 67%|██ | 273M/405M [00:05<00:02, 44.3MB/s]
Downloading (…)l-00006-of-00033.bin: 70%|██ | 283M/405M [00:05<00:02, 48.5MB/s]
Downloading (…)l-00006-of-00033.bin: 73%|██▏| 294M/405M [00:05<00:02, 51.4MB/s]
Downloading (…)l-00006-of-00033.bin: 75%|██▎| 304M/405M [00:05<00:01, 53.9MB/s]
Downloading (…)l-00006-of-00033.bin: 78%|██▎| 315M/405M [00:06<00:01, 55.8MB/s]
Downloading (…)l-00006-of-00033.bin: 80%|██▍| 325M/405M [00:06<00:01, 57.3MB/s]
Downloading (…)l-00006-of-00033.bin: 83%|██▍| 336M/405M [00:06<00:01, 55.3MB/s]
Downloading (…)l-00006-of-00033.bin: 85%|██▌| 346M/405M [00:06<00:01, 58.6MB/s]
Downloading (…)l-00006-of-00033.bin: 88%|██▋| 357M/405M [00:06<00:00, 54.6MB/s]
Downloading (…)l-00006-of-00033.bin: 91%|██▋| 367M/405M [00:07<00:00, 54.7MB/s]
Downloading (…)l-00006-of-00033.bin: 93%|██▊| 377M/405M [00:07<00:00, 56.2MB/s]
Downloading (…)l-00006-of-00033.bin: 96%|██▉| 388M/405M [00:07<00:00, 60.1MB/s]
Downloading (…)l-00006-of-00033.bin: 100%|███| 405M/405M [00:07<00:00, 52.6MB/s]
Downloading shards: 18%|████▎ | 6/33 [00:51<03:35, 7.97s/it]
Downloading (…)l-00007-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00007-of-00033.bin: 3%| | 10.5M/405M [00:00<00:10, 37.5MB/s]
Downloading (…)l-00007-of-00033.bin: 5%| | 21.0M/405M [00:00<00:08, 43.1MB/s]
Downloading (…)l-00007-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:07, 47.1MB/s]
Downloading (…)l-00007-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:06, 52.7MB/s]
Downloading (…)l-00007-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:06, 54.7MB/s]
Downloading (…)l-00007-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:06, 54.2MB/s]
Downloading (…)l-00007-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:06, 49.8MB/s]
Downloading (…)l-00007-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:06, 49.8MB/s]
Downloading (…)l-00007-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:06, 51.1MB/s]
Downloading (…)l-00007-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:06, 49.6MB/s]
Downloading (…)l-00007-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:05, 51.5MB/s]
Downloading (…)l-00007-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:05, 51.9MB/s]
Downloading (…)l-00007-of-00033.bin: 34%|█ | 136M/405M [00:02<00:05, 52.9MB/s]
Downloading (…)l-00007-of-00033.bin: 36%|█ | 147M/405M [00:02<00:04, 54.7MB/s]
Downloading (…)l-00007-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:04, 52.9MB/s]
Downloading (…)l-00007-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:04, 55.9MB/s]
Downloading (…)l-00007-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:04, 55.1MB/s]
Downloading (…)l-00007-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:03, 56.5MB/s]
Downloading (…)l-00007-of-00033.bin: 49%|█▍ | 199M/405M [00:03<00:03, 56.2MB/s]
Downloading (…)l-00007-of-00033.bin: 52%|█▌ | 210M/405M [00:03<00:03, 58.4MB/s]
Downloading (…)l-00007-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:03, 59.1MB/s]
Downloading (…)l-00007-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:03, 54.5MB/s]
Downloading (…)l-00007-of-00033.bin: 60%|█▊ | 241M/405M [00:04<00:02, 56.6MB/s]
Downloading (…)l-00007-of-00033.bin: 62%|█▊ | 252M/405M [00:04<00:02, 55.9MB/s]
Downloading (…)l-00007-of-00033.bin: 65%|█▉ | 262M/405M [00:04<00:02, 57.6MB/s]
Downloading (…)l-00007-of-00033.bin: 67%|██ | 273M/405M [00:05<00:02, 58.6MB/s]
Downloading (…)l-00007-of-00033.bin: 70%|██ | 283M/405M [00:05<00:02, 56.6MB/s]
Downloading (…)l-00007-of-00033.bin: 73%|██▏| 294M/405M [00:05<00:02, 53.9MB/s]
Downloading (…)l-00007-of-00033.bin: 75%|██▎| 304M/405M [00:05<00:01, 55.4MB/s]
Downloading (…)l-00007-of-00033.bin: 78%|██▎| 315M/405M [00:05<00:01, 58.5MB/s]
Downloading (…)l-00007-of-00033.bin: 80%|██▍| 325M/405M [00:05<00:01, 60.0MB/s]
Downloading (…)l-00007-of-00033.bin: 83%|██▍| 336M/405M [00:06<00:01, 53.5MB/s]
Downloading (…)l-00007-of-00033.bin: 85%|██▌| 346M/405M [00:06<00:01, 56.7MB/s]
Downloading (…)l-00007-of-00033.bin: 88%|██▋| 357M/405M [00:06<00:00, 53.0MB/s]
Downloading (…)l-00007-of-00033.bin: 91%|██▋| 367M/405M [00:06<00:00, 55.8MB/s]
Downloading (…)l-00007-of-00033.bin: 93%|██▊| 377M/405M [00:06<00:00, 54.2MB/s]
Downloading (…)l-00007-of-00033.bin: 96%|██▉| 388M/405M [00:07<00:00, 57.2MB/s]
Downloading (…)l-00007-of-00033.bin: 100%|███| 405M/405M [00:07<00:00, 54.8MB/s]
Downloading shards: 21%|█████ | 7/33 [00:58<03:24, 7.87s/it]
Downloading (…)l-00008-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00008-of-00033.bin: 3%| | 10.5M/405M [00:00<00:21, 18.5MB/s]
Downloading (…)l-00008-of-00033.bin: 5%| | 21.0M/405M [00:01<00:19, 19.3MB/s]
Downloading (…)l-00008-of-00033.bin: 8%|▏ | 31.5M/405M [00:01<00:16, 22.8MB/s]
Downloading (…)l-00008-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:14, 25.9MB/s]
Downloading (…)l-00008-of-00033.bin: 13%|▎ | 52.4M/405M [00:02<00:14, 25.0MB/s]
Downloading (…)l-00008-of-00033.bin: 16%|▎ | 62.9M/405M [00:02<00:12, 28.1MB/s]
Downloading (…)l-00008-of-00033.bin: 18%|▎ | 73.4M/405M [00:02<00:12, 27.2MB/s]
Downloading (…)l-00008-of-00033.bin: 21%|▍ | 83.9M/405M [00:03<00:12, 26.5MB/s]
Downloading (…)l-00008-of-00033.bin: 23%|▍ | 94.4M/405M [00:03<00:12, 25.5MB/s]
Downloading (…)l-00008-of-00033.bin: 26%|▊ | 105M/405M [00:04<00:11, 26.5MB/s]
Downloading (…)l-00008-of-00033.bin: 28%|▊ | 115M/405M [00:04<00:11, 26.2MB/s]
Downloading (…)l-00008-of-00033.bin: 31%|▉ | 126M/405M [00:04<00:10, 25.7MB/s]
Downloading (…)l-00008-of-00033.bin: 34%|█ | 136M/405M [00:05<00:10, 25.3MB/s]
Downloading (…)l-00008-of-00033.bin: 36%|█ | 147M/405M [00:05<00:11, 22.4MB/s]
Downloading (…)l-00008-of-00033.bin: 39%|█▏ | 157M/405M [00:06<00:10, 24.7MB/s]
Downloading (…)l-00008-of-00033.bin: 41%|█▏ | 168M/405M [00:06<00:08, 26.8MB/s]
Downloading (…)l-00008-of-00033.bin: 44%|█▎ | 178M/405M [00:07<00:09, 25.0MB/s]
Downloading (…)l-00008-of-00033.bin: 47%|█▍ | 189M/405M [00:07<00:08, 26.9MB/s]
Downloading (…)l-00008-of-00033.bin: 49%|█▍ | 199M/405M [00:07<00:07, 29.1MB/s]
Downloading (…)l-00008-of-00033.bin: 52%|█▌ | 210M/405M [00:08<00:07, 27.5MB/s]
Downloading (…)l-00008-of-00033.bin: 54%|█▋ | 220M/405M [00:08<00:06, 29.4MB/s]
Downloading (…)l-00008-of-00033.bin: 57%|█▋ | 231M/405M [00:08<00:06, 26.7MB/s]
Downloading (…)l-00008-of-00033.bin: 60%|█▊ | 241M/405M [00:09<00:05, 28.6MB/s]
Downloading (…)l-00008-of-00033.bin: 62%|█▊ | 252M/405M [00:09<00:05, 29.5MB/s]
Downloading (…)l-00008-of-00033.bin: 65%|█▉ | 262M/405M [00:09<00:05, 28.2MB/s]
Downloading (…)l-00008-of-00033.bin: 67%|██ | 273M/405M [00:10<00:04, 29.3MB/s]
Downloading (…)l-00008-of-00033.bin: 70%|██ | 283M/405M [00:10<00:04, 27.9MB/s]
Downloading (…)l-00008-of-00033.bin: 73%|██▏| 294M/405M [00:11<00:03, 28.1MB/s]
Downloading (…)l-00008-of-00033.bin: 75%|██▎| 304M/405M [00:11<00:03, 27.4MB/s]
Downloading (…)l-00008-of-00033.bin: 78%|██▎| 315M/405M [00:11<00:03, 26.7MB/s]
Downloading (…)l-00008-of-00033.bin: 80%|██▍| 325M/405M [00:12<00:02, 28.7MB/s]
Downloading (…)l-00008-of-00033.bin: 83%|██▍| 336M/405M [00:12<00:02, 30.2MB/s]
Downloading (…)l-00008-of-00033.bin: 85%|██▌| 346M/405M [00:12<00:01, 29.4MB/s]
Downloading (…)l-00008-of-00033.bin: 88%|██▋| 357M/405M [00:13<00:01, 26.0MB/s]
Downloading (…)l-00008-of-00033.bin: 91%|██▋| 367M/405M [00:13<00:01, 25.7MB/s]
Downloading (…)l-00008-of-00033.bin: 93%|██▊| 377M/405M [00:14<00:01, 24.2MB/s]
Downloading (…)l-00008-of-00033.bin: 96%|██▉| 388M/405M [00:14<00:00, 24.1MB/s]
Downloading (…)l-00008-of-00033.bin: 98%|██▉| 398M/405M [00:15<00:00, 25.0MB/s]
Downloading (…)l-00008-of-00033.bin: 100%|███| 405M/405M [00:15<00:00, 26.5MB/s]
Downloading shards: 24%|█████▊ | 8/33 [01:14<04:18, 10.32s/it]
Downloading (…)l-00009-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00009-of-00033.bin: 3%| | 10.5M/405M [00:00<00:09, 42.5MB/s]
Downloading (…)l-00009-of-00033.bin: 5%| | 21.0M/405M [00:00<00:07, 53.5MB/s]
Downloading (…)l-00009-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:06, 54.5MB/s]
Downloading (…)l-00009-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:06, 55.4MB/s]
Downloading (…)l-00009-of-00033.bin: 13%|▎ | 52.4M/405M [00:00<00:06, 54.6MB/s]
Downloading (…)l-00009-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:07, 45.8MB/s]
Downloading (…)l-00009-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:06, 50.7MB/s]
Downloading (…)l-00009-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:06, 51.8MB/s]
Downloading (…)l-00009-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:06, 51.1MB/s]
Downloading (…)l-00009-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:05, 50.5MB/s]
Downloading (…)l-00009-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:05, 49.2MB/s]
Downloading (…)l-00009-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:05, 51.1MB/s]
Downloading (…)l-00009-of-00033.bin: 34%|█ | 136M/405M [00:02<00:05, 51.3MB/s]
Downloading (…)l-00009-of-00033.bin: 36%|█ | 147M/405M [00:02<00:05, 45.2MB/s]
Downloading (…)l-00009-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:05, 48.1MB/s]
Downloading (…)l-00009-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:04, 51.0MB/s]
Downloading (…)l-00009-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:04, 50.9MB/s]
Downloading (…)l-00009-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:04, 48.7MB/s]
Downloading (…)l-00009-of-00033.bin: 49%|█▍ | 199M/405M [00:03<00:04, 50.3MB/s]
Downloading (…)l-00009-of-00033.bin: 52%|█▌ | 210M/405M [00:04<00:03, 50.9MB/s]
Downloading (…)l-00009-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:03, 51.5MB/s]
Downloading (…)l-00009-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:03, 53.1MB/s]
Downloading (…)l-00009-of-00033.bin: 60%|█▊ | 241M/405M [00:04<00:03, 53.0MB/s]
Downloading (…)l-00009-of-00033.bin: 62%|█▊ | 252M/405M [00:04<00:02, 55.1MB/s]
Downloading (…)l-00009-of-00033.bin: 65%|█▉ | 262M/405M [00:05<00:02, 57.2MB/s]
Downloading (…)l-00009-of-00033.bin: 67%|██ | 273M/405M [00:05<00:02, 53.1MB/s]
Downloading (…)l-00009-of-00033.bin: 70%|██ | 283M/405M [00:05<00:02, 50.7MB/s]
Downloading (…)l-00009-of-00033.bin: 73%|██▏| 294M/405M [00:05<00:02, 52.7MB/s]
Downloading (…)l-00009-of-00033.bin: 75%|██▎| 304M/405M [00:05<00:01, 53.6MB/s]
Downloading (…)l-00009-of-00033.bin: 78%|██▎| 315M/405M [00:06<00:01, 48.2MB/s]
Downloading (…)l-00009-of-00033.bin: 80%|██▍| 325M/405M [00:06<00:01, 52.2MB/s]
Downloading (…)l-00009-of-00033.bin: 83%|██▍| 336M/405M [00:06<00:01, 56.8MB/s]
Downloading (…)l-00009-of-00033.bin: 85%|██▌| 346M/405M [00:06<00:01, 48.8MB/s]
Downloading (…)l-00009-of-00033.bin: 88%|██▋| 357M/405M [00:07<00:01, 46.5MB/s]
Downloading (…)l-00009-of-00033.bin: 91%|██▋| 367M/405M [00:07<00:00, 44.8MB/s]
Downloading (…)l-00009-of-00033.bin: 93%|██▊| 377M/405M [00:07<00:00, 46.8MB/s]
Downloading (…)l-00009-of-00033.bin: 96%|██▉| 388M/405M [00:07<00:00, 42.5MB/s]
Downloading (…)l-00009-of-00033.bin: 98%|██▉| 398M/405M [00:07<00:00, 44.6MB/s]
Downloading (…)l-00009-of-00033.bin: 100%|███| 405M/405M [00:08<00:00, 49.9MB/s]
Downloading shards: 27%|██████▌ | 9/33 [01:22<03:53, 9.72s/it]
Downloading (…)l-00010-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00010-of-00033.bin: 3%| | 10.5M/405M [00:00<00:07, 51.7MB/s]
Downloading (…)l-00010-of-00033.bin: 5%| | 21.0M/405M [00:00<00:06, 55.4MB/s]
Downloading (…)l-00010-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:07, 52.1MB/s]
Downloading (…)l-00010-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:07, 49.8MB/s]
Downloading (…)l-00010-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:08, 42.9MB/s]
Downloading (…)l-00010-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:08, 42.0MB/s]
Downloading (…)l-00010-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:06, 47.8MB/s]
Downloading (…)l-00010-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:06, 49.1MB/s]
Downloading (…)l-00010-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:06, 51.2MB/s]
Downloading (…)l-00010-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:06, 47.4MB/s]
Downloading (…)l-00010-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:06, 47.3MB/s]
Downloading (…)l-00010-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:05, 46.7MB/s]
Downloading (…)l-00010-of-00033.bin: 34%|█ | 136M/405M [00:02<00:05, 48.3MB/s]
Downloading (…)l-00010-of-00033.bin: 36%|█ | 147M/405M [00:03<00:05, 50.9MB/s]
Downloading (…)l-00010-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:05, 44.9MB/s]
Downloading (…)l-00010-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:05, 45.7MB/s]
Downloading (…)l-00010-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:05, 41.2MB/s]
Downloading (…)l-00010-of-00033.bin: 47%|█▍ | 189M/405M [00:04<00:04, 44.9MB/s]
Downloading (…)l-00010-of-00033.bin: 49%|█▍ | 199M/405M [00:04<00:04, 47.4MB/s]
Downloading (…)l-00010-of-00033.bin: 52%|█▌ | 210M/405M [00:04<00:03, 50.0MB/s]
Downloading (…)l-00010-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:03, 49.6MB/s]
Downloading (…)l-00010-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:03, 47.6MB/s]
Downloading (…)l-00010-of-00033.bin: 60%|█▊ | 241M/405M [00:05<00:03, 43.0MB/s]
Downloading (…)l-00010-of-00033.bin: 62%|█▊ | 252M/405M [00:05<00:03, 42.6MB/s]
Downloading (…)l-00010-of-00033.bin: 65%|█▉ | 262M/405M [00:05<00:03, 36.4MB/s]
Downloading (…)l-00010-of-00033.bin: 67%|██ | 273M/405M [00:06<00:03, 36.8MB/s]
Downloading (…)l-00010-of-00033.bin: 70%|██ | 283M/405M [00:06<00:02, 41.8MB/s]
Downloading (…)l-00010-of-00033.bin: 73%|██▏| 294M/405M [00:06<00:02, 41.9MB/s]
Downloading (…)l-00010-of-00033.bin: 75%|██▎| 304M/405M [00:06<00:02, 38.8MB/s]
Downloading (…)l-00010-of-00033.bin: 78%|██▎| 315M/405M [00:07<00:02, 41.6MB/s]
Downloading (…)l-00010-of-00033.bin: 80%|██▍| 325M/405M [00:07<00:01, 45.1MB/s]
Downloading (…)l-00010-of-00033.bin: 83%|██▍| 336M/405M [00:07<00:01, 46.9MB/s]
Downloading (…)l-00010-of-00033.bin: 85%|██▌| 346M/405M [00:07<00:01, 47.1MB/s]
Downloading (…)l-00010-of-00033.bin: 88%|██▋| 357M/405M [00:07<00:00, 48.8MB/s]
Downloading (…)l-00010-of-00033.bin: 91%|██▋| 367M/405M [00:08<00:00, 45.1MB/s]
Downloading (…)l-00010-of-00033.bin: 93%|██▊| 377M/405M [00:08<00:00, 42.6MB/s]
Downloading (…)l-00010-of-00033.bin: 96%|██▉| 388M/405M [00:08<00:00, 45.4MB/s]
Downloading (…)l-00010-of-00033.bin: 98%|██▉| 398M/405M [00:08<00:00, 46.2MB/s]
Downloading (…)l-00010-of-00033.bin: 100%|███| 405M/405M [00:08<00:00, 45.4MB/s]
Downloading shards: 30%|██████▉ | 10/33 [01:32<03:39, 9.56s/it]
Downloading (…)l-00011-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00011-of-00033.bin: 3%| | 10.5M/405M [00:00<00:06, 60.1MB/s]
Downloading (…)l-00011-of-00033.bin: 5%| | 21.0M/405M [00:00<00:04, 77.9MB/s]
Downloading (…)l-00011-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:03, 98.0MB/s]
Downloading (…)l-00011-of-00033.bin: 16%|▍ | 62.9M/405M [00:00<00:03, 106MB/s]
Downloading (…)l-00011-of-00033.bin: 21%|▌ | 83.9M/405M [00:00<00:02, 109MB/s]
Downloading (…)l-00011-of-00033.bin: 26%|█ | 105M/405M [00:01<00:02, 111MB/s]
Downloading (…)l-00011-of-00033.bin: 31%|▉ | 126M/405M [00:01<00:02, 93.1MB/s]
Downloading (…)l-00011-of-00033.bin: 34%|█ | 136M/405M [00:01<00:03, 67.2MB/s]
Downloading (…)l-00011-of-00033.bin: 36%|█ | 147M/405M [00:01<00:03, 72.8MB/s]
Downloading (…)l-00011-of-00033.bin: 41%|█▏ | 168M/405M [00:01<00:02, 84.8MB/s]
Downloading (…)l-00011-of-00033.bin: 47%|█▍ | 189M/405M [00:02<00:02, 94.0MB/s]
Downloading (…)l-00011-of-00033.bin: 52%|██ | 210M/405M [00:02<00:01, 100MB/s]
Downloading (…)l-00011-of-00033.bin: 57%|██▎ | 231M/405M [00:02<00:01, 105MB/s]
Downloading (…)l-00011-of-00033.bin: 62%|██▍ | 252M/405M [00:02<00:01, 108MB/s]
Downloading (…)l-00011-of-00033.bin: 67%|██▋ | 273M/405M [00:02<00:01, 110MB/s]
Downloading (…)l-00011-of-00033.bin: 73%|██▏| 294M/405M [00:03<00:01, 79.4MB/s]
Downloading (…)l-00011-of-00033.bin: 78%|██▎| 315M/405M [00:03<00:01, 75.8MB/s]
Downloading (…)l-00011-of-00033.bin: 83%|██▍| 336M/405M [00:03<00:00, 84.7MB/s]
Downloading (…)l-00011-of-00033.bin: 88%|██▋| 357M/405M [00:03<00:00, 92.2MB/s]
Downloading (…)l-00011-of-00033.bin: 93%|██▊| 377M/405M [00:04<00:00, 98.3MB/s]
Downloading (…)l-00011-of-00033.bin: 100%|███| 405M/405M [00:04<00:00, 93.1MB/s]
Downloading shards: 33%|███████▋ | 11/33 [01:36<02:57, 8.05s/it]
Downloading (…)l-00012-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00012-of-00033.bin: 3%| | 10.5M/405M [00:00<00:10, 37.3MB/s]
Downloading (…)l-00012-of-00033.bin: 5%| | 21.0M/405M [00:00<00:13, 27.8MB/s]
Downloading (…)l-00012-of-00033.bin: 8%|▏ | 31.5M/405M [00:01<00:15, 23.9MB/s]
Downloading (…)l-00012-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:14, 25.7MB/s]
Downloading (…)l-00012-of-00033.bin: 13%|▎ | 52.4M/405M [00:02<00:15, 23.5MB/s]
Downloading (…)l-00012-of-00033.bin: 16%|▎ | 62.9M/405M [00:02<00:14, 23.3MB/s]
Downloading (…)l-00012-of-00033.bin: 18%|▎ | 73.4M/405M [00:03<00:15, 21.4MB/s]
Downloading (…)l-00012-of-00033.bin: 21%|▍ | 83.9M/405M [00:03<00:14, 22.4MB/s]
Downloading (…)l-00012-of-00033.bin: 23%|▍ | 94.4M/405M [00:03<00:13, 23.3MB/s]
Downloading (…)l-00012-of-00033.bin: 26%|▊ | 105M/405M [00:04<00:11, 26.2MB/s]
Downloading (…)l-00012-of-00033.bin: 28%|▊ | 115M/405M [00:04<00:11, 25.0MB/s]
Downloading (…)l-00012-of-00033.bin: 31%|▉ | 126M/405M [00:05<00:10, 26.1MB/s]
Downloading (…)l-00012-of-00033.bin: 34%|█ | 136M/405M [00:05<00:09, 28.3MB/s]
Downloading (…)l-00012-of-00033.bin: 36%|█ | 147M/405M [00:05<00:09, 28.4MB/s]
Downloading (…)l-00012-of-00033.bin: 39%|█▏ | 157M/405M [00:06<00:09, 27.1MB/s]
Downloading (…)l-00012-of-00033.bin: 41%|█▏ | 168M/405M [00:06<00:08, 27.8MB/s]
Downloading (…)l-00012-of-00033.bin: 44%|█▎ | 178M/405M [00:06<00:08, 27.3MB/s]
Downloading (…)l-00012-of-00033.bin: 47%|█▍ | 189M/405M [00:07<00:07, 27.5MB/s]
Downloading (…)l-00012-of-00033.bin: 49%|█▍ | 199M/405M [00:07<00:06, 29.4MB/s]
Downloading (…)l-00012-of-00033.bin: 52%|█▌ | 210M/405M [00:08<00:06, 28.4MB/s]
Downloading (…)l-00012-of-00033.bin: 54%|█▋ | 220M/405M [00:08<00:06, 29.2MB/s]
Downloading (…)l-00012-of-00033.bin: 57%|█▋ | 231M/405M [00:08<00:05, 30.8MB/s]
Downloading (…)l-00012-of-00033.bin: 60%|█▊ | 241M/405M [00:09<00:05, 27.7MB/s]
Downloading (…)l-00012-of-00033.bin: 62%|█▊ | 252M/405M [00:09<00:06, 23.6MB/s]
Downloading (…)l-00012-of-00033.bin: 65%|█▉ | 262M/405M [00:10<00:06, 23.4MB/s]
Downloading (…)l-00012-of-00033.bin: 67%|██ | 273M/405M [00:10<00:05, 23.8MB/s]
Downloading (…)l-00012-of-00033.bin: 70%|██ | 283M/405M [00:11<00:05, 23.1MB/s]
Downloading (…)l-00012-of-00033.bin: 73%|██▏| 294M/405M [00:11<00:04, 24.1MB/s]
Downloading (…)l-00012-of-00033.bin: 75%|██▎| 304M/405M [00:11<00:04, 24.7MB/s]
Downloading (…)l-00012-of-00033.bin: 78%|██▎| 315M/405M [00:12<00:03, 25.7MB/s]
Downloading (…)l-00012-of-00033.bin: 80%|██▍| 325M/405M [00:12<00:02, 27.1MB/s]
Downloading (…)l-00012-of-00033.bin: 83%|██▍| 336M/405M [00:12<00:02, 29.0MB/s]
Downloading (…)l-00012-of-00033.bin: 85%|██▌| 346M/405M [00:13<00:01, 30.8MB/s]
Downloading (…)l-00012-of-00033.bin: 88%|██▋| 357M/405M [00:13<00:01, 33.6MB/s]
Downloading (…)l-00012-of-00033.bin: 91%|██▋| 367M/405M [00:13<00:01, 29.1MB/s]
Downloading (…)l-00012-of-00033.bin: 93%|██▊| 377M/405M [00:14<00:00, 27.7MB/s]
Downloading (…)l-00012-of-00033.bin: 96%|██▉| 388M/405M [00:14<00:00, 25.4MB/s]
Downloading (…)l-00012-of-00033.bin: 98%|██▉| 398M/405M [00:15<00:00, 27.6MB/s]
Downloading (…)l-00012-of-00033.bin: 100%|███| 405M/405M [00:15<00:00, 26.4MB/s]
Downloading shards: 36%|████████▎ | 12/33 [01:52<03:37, 10.35s/it]
Downloading (…)l-00013-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00013-of-00033.bin: 3%| | 10.5M/405M [00:00<00:14, 28.1MB/s]
Downloading (…)l-00013-of-00033.bin: 5%| | 21.0M/405M [00:01<00:20, 18.4MB/s]
Downloading (…)l-00013-of-00033.bin: 8%|▏ | 31.5M/405M [00:01<00:17, 21.5MB/s]
Downloading (…)l-00013-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:16, 22.6MB/s]
Downloading (…)l-00013-of-00033.bin: 13%|▎ | 52.4M/405M [00:02<00:14, 25.1MB/s]
Downloading (…)l-00013-of-00033.bin: 16%|▎ | 62.9M/405M [00:02<00:13, 24.4MB/s]
Downloading (…)l-00013-of-00033.bin: 18%|▎ | 73.4M/405M [00:03<00:14, 22.3MB/s]
Downloading (…)l-00013-of-00033.bin: 21%|▍ | 83.9M/405M [00:03<00:13, 23.3MB/s]
Downloading (…)l-00013-of-00033.bin: 23%|▍ | 94.4M/405M [00:04<00:12, 24.4MB/s]
Downloading (…)l-00013-of-00033.bin: 26%|▊ | 105M/405M [00:04<00:11, 26.5MB/s]
Downloading (…)l-00013-of-00033.bin: 28%|▊ | 115M/405M [00:04<00:11, 25.6MB/s]
Downloading (…)l-00013-of-00033.bin: 31%|▉ | 126M/405M [00:05<00:11, 25.3MB/s]
Downloading (…)l-00013-of-00033.bin: 34%|█ | 136M/405M [00:05<00:11, 23.6MB/s]
Downloading (…)l-00013-of-00033.bin: 36%|█ | 147M/405M [00:06<00:10, 24.3MB/s]
Downloading (…)l-00013-of-00033.bin: 39%|█▏ | 157M/405M [00:06<00:09, 26.5MB/s]
Downloading (…)l-00013-of-00033.bin: 41%|█▏ | 168M/405M [00:06<00:09, 25.8MB/s]
Downloading (…)l-00013-of-00033.bin: 44%|█▎ | 178M/405M [00:07<00:09, 25.0MB/s]
Downloading (…)l-00013-of-00033.bin: 47%|█▍ | 189M/405M [00:07<00:08, 25.3MB/s]
Downloading (…)l-00013-of-00033.bin: 49%|█▍ | 199M/405M [00:08<00:07, 26.2MB/s]
Downloading (…)l-00013-of-00033.bin: 52%|█▌ | 210M/405M [00:08<00:07, 26.1MB/s]
Downloading (…)l-00013-of-00033.bin: 54%|█▋ | 220M/405M [00:08<00:07, 26.1MB/s]
Downloading (…)l-00013-of-00033.bin: 57%|█▋ | 231M/405M [00:09<00:06, 27.1MB/s]
Downloading (…)l-00013-of-00033.bin: 60%|█▊ | 241M/405M [00:09<00:05, 28.4MB/s]
Downloading (…)l-00013-of-00033.bin: 62%|█▊ | 252M/405M [00:09<00:05, 28.4MB/s]
Downloading (…)l-00013-of-00033.bin: 65%|█▉ | 262M/405M [00:10<00:04, 29.6MB/s]
Downloading (…)l-00013-of-00033.bin: 67%|██ | 273M/405M [00:10<00:04, 28.5MB/s]
Downloading (…)l-00013-of-00033.bin: 70%|██ | 283M/405M [00:11<00:04, 26.9MB/s]
Downloading (…)l-00013-of-00033.bin: 73%|██▏| 294M/405M [00:11<00:03, 28.6MB/s]
Downloading (…)l-00013-of-00033.bin: 75%|██▎| 304M/405M [00:11<00:03, 26.9MB/s]
Downloading (…)l-00013-of-00033.bin: 78%|██▎| 315M/405M [00:12<00:03, 25.5MB/s]
Downloading (…)l-00013-of-00033.bin: 80%|██▍| 325M/405M [00:12<00:03, 25.4MB/s]
Downloading (…)l-00013-of-00033.bin: 83%|██▍| 336M/405M [00:13<00:02, 24.2MB/s]
Downloading (…)l-00013-of-00033.bin: 85%|██▌| 346M/405M [00:13<00:02, 23.8MB/s]
Downloading (…)l-00013-of-00033.bin: 88%|██▋| 357M/405M [00:13<00:01, 26.4MB/s]
Downloading (…)l-00013-of-00033.bin: 91%|██▋| 367M/405M [00:14<00:01, 23.8MB/s]
Downloading (…)l-00013-of-00033.bin: 93%|██▊| 377M/405M [00:14<00:01, 25.2MB/s]
Downloading (…)l-00013-of-00033.bin: 96%|██▉| 388M/405M [00:15<00:00, 25.3MB/s]
Downloading (…)l-00013-of-00033.bin: 98%|██▉| 398M/405M [00:15<00:00, 26.1MB/s]
Downloading (…)l-00013-of-00033.bin: 100%|███| 405M/405M [00:15<00:00, 25.5MB/s]
Downloading shards: 39%|█████████ | 13/33 [02:08<04:02, 12.11s/it]
Downloading (…)l-00014-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00014-of-00033.bin: 3%| | 10.5M/405M [00:00<00:15, 26.1MB/s]
Downloading (…)l-00014-of-00033.bin: 5%| | 21.0M/405M [00:00<00:14, 27.2MB/s]
Downloading (…)l-00014-of-00033.bin: 8%|▏ | 31.5M/405M [00:01<00:17, 21.7MB/s]
Downloading (…)l-00014-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:15, 23.4MB/s]
Downloading (…)l-00014-of-00033.bin: 13%|▎ | 52.4M/405M [00:02<00:16, 20.8MB/s]
Downloading (…)l-00014-of-00033.bin: 16%|▎ | 62.9M/405M [00:02<00:15, 22.5MB/s]
Downloading (…)l-00014-of-00033.bin: 18%|▎ | 73.4M/405M [00:03<00:16, 20.1MB/s]
Downloading (…)l-00014-of-00033.bin: 21%|▍ | 83.9M/405M [00:03<00:15, 20.7MB/s]
Downloading (…)l-00014-of-00033.bin: 23%|▍ | 94.4M/405M [00:04<00:13, 23.6MB/s]
Downloading (…)l-00014-of-00033.bin: 26%|▊ | 105M/405M [00:04<00:13, 21.9MB/s]
Downloading (…)l-00014-of-00033.bin: 28%|▊ | 115M/405M [00:05<00:12, 23.4MB/s]
Downloading (…)l-00014-of-00033.bin: 31%|▉ | 126M/405M [00:05<00:13, 20.7MB/s]
Downloading (…)l-00014-of-00033.bin: 34%|█ | 136M/405M [00:06<00:12, 20.8MB/s]
Downloading (…)l-00014-of-00033.bin: 36%|█ | 147M/405M [00:06<00:12, 20.3MB/s]
Downloading (…)l-00014-of-00033.bin: 39%|█▏ | 157M/405M [00:07<00:11, 21.5MB/s]
Downloading (…)l-00014-of-00033.bin: 41%|█▏ | 168M/405M [00:07<00:10, 23.0MB/s]
Downloading (…)l-00014-of-00033.bin: 44%|█▎ | 178M/405M [00:08<00:11, 19.6MB/s]
Downloading (…)l-00014-of-00033.bin: 47%|█▍ | 189M/405M [00:08<00:09, 21.9MB/s]
Downloading (…)l-00014-of-00033.bin: 49%|█▍ | 199M/405M [00:09<00:09, 22.5MB/s]
Downloading (…)l-00014-of-00033.bin: 52%|█▌ | 210M/405M [00:09<00:08, 23.1MB/s]
Downloading (…)l-00014-of-00033.bin: 54%|█▋ | 220M/405M [00:10<00:09, 19.0MB/s]
Downloading (…)l-00014-of-00033.bin: 57%|█▋ | 231M/405M [00:10<00:08, 20.0MB/s]
Downloading (…)l-00014-of-00033.bin: 60%|█▊ | 241M/405M [00:11<00:08, 18.6MB/s]
Downloading (…)l-00014-of-00033.bin: 62%|█▊ | 252M/405M [00:11<00:07, 21.4MB/s]
Downloading (…)l-00014-of-00033.bin: 65%|█▉ | 262M/405M [00:12<00:06, 23.6MB/s]
Downloading (…)l-00014-of-00033.bin: 67%|██ | 273M/405M [00:12<00:06, 20.5MB/s]
Downloading (…)l-00014-of-00033.bin: 70%|██ | 283M/405M [00:13<00:05, 22.1MB/s]
Downloading (…)l-00014-of-00033.bin: 73%|██▏| 294M/405M [00:13<00:05, 20.3MB/s]
Downloading (…)l-00014-of-00033.bin: 75%|██▎| 304M/405M [00:14<00:04, 21.3MB/s]
Downloading (…)l-00014-of-00033.bin: 78%|██▎| 315M/405M [00:14<00:04, 19.1MB/s]
Downloading (…)l-00014-of-00033.bin: 80%|██▍| 325M/405M [00:15<00:03, 20.0MB/s]
Downloading (…)l-00014-of-00033.bin: 83%|██▍| 336M/405M [00:15<00:03, 19.8MB/s]
Downloading (…)l-00014-of-00033.bin: 85%|██▌| 346M/405M [00:16<00:02, 20.8MB/s]
Downloading (…)l-00014-of-00033.bin: 88%|██▋| 357M/405M [00:16<00:02, 19.0MB/s]
Downloading (…)l-00014-of-00033.bin: 91%|██▋| 367M/405M [00:17<00:01, 20.0MB/s]
Downloading (…)l-00014-of-00033.bin: 93%|██▊| 377M/405M [00:18<00:01, 18.9MB/s]
Downloading (…)l-00014-of-00033.bin: 96%|██▉| 388M/405M [00:18<00:00, 21.6MB/s]
Downloading (…)l-00014-of-00033.bin: 98%|██▉| 398M/405M [00:18<00:00, 24.2MB/s]
Downloading (…)l-00014-of-00033.bin: 100%|███| 405M/405M [00:19<00:00, 21.0MB/s]
Downloading shards: 42%|█████████▊ | 14/33 [02:28<04:32, 14.35s/it]
Downloading (…)l-00015-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00015-of-00033.bin: 3%| | 10.5M/405M [00:00<00:13, 29.6MB/s]
Downloading (…)l-00015-of-00033.bin: 5%| | 21.0M/405M [00:00<00:13, 27.5MB/s]
Downloading (…)l-00015-of-00033.bin: 8%|▏ | 31.5M/405M [00:01<00:12, 31.1MB/s]
Downloading (…)l-00015-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:13, 26.2MB/s]
Downloading (…)l-00015-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:12, 28.9MB/s]
Downloading (…)l-00015-of-00033.bin: 16%|▎ | 62.9M/405M [00:02<00:12, 28.4MB/s]
Downloading (…)l-00015-of-00033.bin: 18%|▎ | 73.4M/405M [00:02<00:11, 27.9MB/s]
Downloading (…)l-00015-of-00033.bin: 21%|▍ | 83.9M/405M [00:02<00:11, 27.7MB/s]
Downloading (…)l-00015-of-00033.bin: 23%|▍ | 94.4M/405M [00:03<00:11, 27.9MB/s]
Downloading (…)l-00015-of-00033.bin: 26%|▊ | 105M/405M [00:03<00:10, 27.3MB/s]
Downloading (…)l-00015-of-00033.bin: 28%|▊ | 115M/405M [00:04<00:10, 26.9MB/s]
Downloading (…)l-00015-of-00033.bin: 31%|▉ | 126M/405M [00:04<00:11, 23.8MB/s]
Downloading (…)l-00015-of-00033.bin: 34%|█ | 136M/405M [00:05<00:10, 25.5MB/s]
Downloading (…)l-00015-of-00033.bin: 36%|█ | 147M/405M [00:05<00:10, 24.6MB/s]
Downloading (…)l-00015-of-00033.bin: 39%|█▏ | 157M/405M [00:06<00:10, 23.8MB/s]
Downloading (…)l-00015-of-00033.bin: 41%|█▏ | 168M/405M [00:06<00:09, 24.8MB/s]
Downloading (…)l-00015-of-00033.bin: 44%|█▎ | 178M/405M [00:06<00:08, 26.1MB/s]
Downloading (…)l-00015-of-00033.bin: 47%|█▍ | 189M/405M [00:07<00:07, 27.5MB/s]
Downloading (…)l-00015-of-00033.bin: 49%|█▍ | 199M/405M [00:07<00:07, 27.4MB/s]
Downloading (…)l-00015-of-00033.bin: 52%|█▌ | 210M/405M [00:07<00:07, 26.1MB/s]
Downloading (…)l-00015-of-00033.bin: 54%|█▋ | 220M/405M [00:08<00:06, 26.9MB/s]
Downloading (…)l-00015-of-00033.bin: 57%|█▋ | 231M/405M [00:08<00:06, 25.9MB/s]
Downloading (…)l-00015-of-00033.bin: 60%|█▊ | 241M/405M [00:09<00:06, 25.6MB/s]
Downloading (…)l-00015-of-00033.bin: 62%|█▊ | 252M/405M [00:09<00:06, 25.2MB/s]
Downloading (…)l-00015-of-00033.bin: 65%|█▉ | 262M/405M [00:09<00:05, 26.1MB/s]
Downloading (…)l-00015-of-00033.bin: 67%|██ | 273M/405M [00:10<00:04, 29.0MB/s]
Downloading (…)l-00015-of-00033.bin: 70%|██ | 283M/405M [00:10<00:03, 30.7MB/s]
Downloading (…)l-00015-of-00033.bin: 73%|██▏| 294M/405M [00:10<00:03, 30.4MB/s]
Downloading (…)l-00015-of-00033.bin: 75%|██▎| 304M/405M [00:11<00:03, 26.9MB/s]
Downloading (…)l-00015-of-00033.bin: 78%|██▎| 315M/405M [00:11<00:03, 28.7MB/s]
Downloading (…)l-00015-of-00033.bin: 80%|██▍| 325M/405M [00:12<00:03, 23.5MB/s]
Downloading (…)l-00015-of-00033.bin: 83%|██▍| 336M/405M [00:12<00:02, 26.8MB/s]
Downloading (…)l-00015-of-00033.bin: 85%|██▌| 346M/405M [00:12<00:02, 28.6MB/s]
Downloading (…)l-00015-of-00033.bin: 88%|██▋| 357M/405M [00:13<00:01, 28.5MB/s]
Downloading (…)l-00015-of-00033.bin: 91%|██▋| 367M/405M [00:13<00:01, 26.5MB/s]
Downloading (…)l-00015-of-00033.bin: 93%|██▊| 377M/405M [00:13<00:00, 28.5MB/s]
Downloading (…)l-00015-of-00033.bin: 96%|██▉| 388M/405M [00:14<00:00, 26.6MB/s]
Downloading (…)l-00015-of-00033.bin: 98%|██▉| 398M/405M [00:14<00:00, 28.2MB/s]
Downloading (…)l-00015-of-00033.bin: 100%|███| 405M/405M [00:14<00:00, 27.1MB/s]
Downloading shards: 45%|██████████▍ | 15/33 [02:43<04:23, 14.61s/it]
Downloading (…)l-00016-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00016-of-00033.bin: 3%| | 10.5M/405M [00:00<00:07, 50.7MB/s]
Downloading (…)l-00016-of-00033.bin: 5%| | 21.0M/405M [00:00<00:07, 48.1MB/s]
Downloading (…)l-00016-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:07, 50.4MB/s]
Downloading (…)l-00016-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:06, 55.0MB/s]
Downloading (…)l-00016-of-00033.bin: 13%|▎ | 52.4M/405M [00:00<00:06, 57.5MB/s]
Downloading (…)l-00016-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:05, 59.0MB/s]
Downloading (…)l-00016-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:05, 62.4MB/s]
Downloading (…)l-00016-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:05, 63.4MB/s]
Downloading (…)l-00016-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:04, 63.4MB/s]
Downloading (…)l-00016-of-00033.bin: 26%|▊ | 105M/405M [00:01<00:05, 60.0MB/s]
Downloading (…)l-00016-of-00033.bin: 28%|▊ | 115M/405M [00:01<00:04, 58.3MB/s]
Downloading (…)l-00016-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:06, 46.2MB/s]
Downloading (…)l-00016-of-00033.bin: 34%|█ | 136M/405M [00:02<00:07, 37.2MB/s]
Downloading (…)l-00016-of-00033.bin: 36%|█ | 147M/405M [00:02<00:06, 39.1MB/s]
Downloading (…)l-00016-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:06, 41.0MB/s]
Downloading (…)l-00016-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:05, 42.9MB/s]
Downloading (…)l-00016-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:04, 45.8MB/s]
Downloading (…)l-00016-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:04, 46.2MB/s]
Downloading (…)l-00016-of-00033.bin: 49%|█▍ | 199M/405M [00:04<00:05, 40.2MB/s]
Downloading (…)l-00016-of-00033.bin: 52%|█▌ | 210M/405M [00:04<00:04, 42.9MB/s]
Downloading (…)l-00016-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:04, 42.0MB/s]
Downloading (…)l-00016-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:04, 39.8MB/s]
Downloading (…)l-00016-of-00033.bin: 60%|█▊ | 241M/405M [00:05<00:04, 37.4MB/s]
Downloading (…)l-00016-of-00033.bin: 62%|█▊ | 252M/405M [00:05<00:03, 38.6MB/s]
Downloading (…)l-00016-of-00033.bin: 65%|█▉ | 262M/405M [00:05<00:03, 41.7MB/s]
Downloading (…)l-00016-of-00033.bin: 67%|██ | 273M/405M [00:05<00:03, 42.9MB/s]
Downloading (…)l-00016-of-00033.bin: 70%|██ | 283M/405M [00:06<00:03, 40.2MB/s]
Downloading (…)l-00016-of-00033.bin: 73%|██▏| 294M/405M [00:06<00:02, 43.4MB/s]
Downloading (…)l-00016-of-00033.bin: 75%|██▎| 304M/405M [00:06<00:02, 44.7MB/s]
Downloading (…)l-00016-of-00033.bin: 78%|██▎| 315M/405M [00:06<00:01, 47.3MB/s]
Downloading (…)l-00016-of-00033.bin: 80%|██▍| 325M/405M [00:07<00:01, 49.7MB/s]
Downloading (…)l-00016-of-00033.bin: 83%|██▍| 336M/405M [00:07<00:01, 49.9MB/s]
Downloading (…)l-00016-of-00033.bin: 85%|██▌| 346M/405M [00:07<00:01, 50.6MB/s]
Downloading (…)l-00016-of-00033.bin: 88%|██▋| 357M/405M [00:07<00:00, 49.1MB/s]
Downloading (…)l-00016-of-00033.bin: 91%|██▋| 367M/405M [00:07<00:00, 49.1MB/s]
Downloading (…)l-00016-of-00033.bin: 93%|██▊| 377M/405M [00:08<00:00, 51.2MB/s]
Downloading (…)l-00016-of-00033.bin: 96%|██▉| 388M/405M [00:08<00:00, 54.9MB/s]
Downloading (…)l-00016-of-00033.bin: 98%|██▉| 398M/405M [00:08<00:00, 54.8MB/s]
Downloading (…)l-00016-of-00033.bin: 100%|███| 405M/405M [00:08<00:00, 47.4MB/s]
Downloading shards: 48%|███████████▏ | 16/33 [02:52<03:38, 12.87s/it]
Downloading (…)l-00017-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00017-of-00033.bin: 3%| | 10.5M/405M [00:00<00:12, 32.8MB/s]
Downloading (…)l-00017-of-00033.bin: 5%| | 21.0M/405M [00:00<00:15, 24.2MB/s]
Downloading (…)l-00017-of-00033.bin: 8%|▏ | 31.5M/405M [00:01<00:17, 21.8MB/s]
Downloading (…)l-00017-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:16, 21.6MB/s]
Downloading (…)l-00017-of-00033.bin: 13%|▎ | 52.4M/405M [00:02<00:15, 22.6MB/s]
Downloading (…)l-00017-of-00033.bin: 16%|▎ | 62.9M/405M [00:02<00:14, 23.1MB/s]
Downloading (…)l-00017-of-00033.bin: 18%|▎ | 73.4M/405M [00:03<00:14, 23.6MB/s]
Downloading (…)l-00017-of-00033.bin: 21%|▍ | 83.9M/405M [00:03<00:13, 24.3MB/s]
Downloading (…)l-00017-of-00033.bin: 23%|▍ | 94.4M/405M [00:03<00:12, 24.4MB/s]
Downloading (…)l-00017-of-00033.bin: 26%|▊ | 105M/405M [00:04<00:11, 25.2MB/s]
Downloading (…)l-00017-of-00033.bin: 28%|▊ | 115M/405M [00:04<00:11, 25.2MB/s]
Downloading (…)l-00017-of-00033.bin: 31%|▉ | 126M/405M [00:05<00:11, 24.4MB/s]
Downloading (…)l-00017-of-00033.bin: 34%|█ | 136M/405M [00:05<00:10, 24.9MB/s]
Downloading (…)l-00017-of-00033.bin: 36%|█ | 147M/405M [00:06<00:10, 23.8MB/s]
Downloading (…)l-00017-of-00033.bin: 39%|█▏ | 157M/405M [00:06<00:10, 23.5MB/s]
Downloading (…)l-00017-of-00033.bin: 41%|█▏ | 168M/405M [00:06<00:09, 24.1MB/s]
Downloading (…)l-00017-of-00033.bin: 44%|█▎ | 178M/405M [00:07<00:09, 25.0MB/s]
Downloading (…)l-00017-of-00033.bin: 47%|█▍ | 189M/405M [00:07<00:07, 27.1MB/s]
Downloading (…)l-00017-of-00033.bin: 49%|█▍ | 199M/405M [00:08<00:07, 27.6MB/s]
Downloading (…)l-00017-of-00033.bin: 52%|█▌ | 210M/405M [00:08<00:07, 27.0MB/s]
Downloading (…)l-00017-of-00033.bin: 54%|█▋ | 220M/405M [00:08<00:06, 28.2MB/s]
Downloading (…)l-00017-of-00033.bin: 57%|█▋ | 231M/405M [00:09<00:05, 29.5MB/s]
Downloading (…)l-00017-of-00033.bin: 60%|█▊ | 241M/405M [00:09<00:05, 31.0MB/s]
Downloading (…)l-00017-of-00033.bin: 62%|█▊ | 252M/405M [00:09<00:05, 29.1MB/s]
Downloading (…)l-00017-of-00033.bin: 65%|█▉ | 262M/405M [00:10<00:05, 27.5MB/s]
Downloading (…)l-00017-of-00033.bin: 67%|██ | 273M/405M [00:10<00:04, 27.0MB/s]
Downloading (…)l-00017-of-00033.bin: 70%|██ | 283M/405M [00:11<00:04, 26.9MB/s]
Downloading (…)l-00017-of-00033.bin: 73%|██▏| 294M/405M [00:11<00:04, 25.8MB/s]
Downloading (…)l-00017-of-00033.bin: 75%|██▎| 304M/405M [00:11<00:03, 26.3MB/s]
Downloading (…)l-00017-of-00033.bin: 78%|██▎| 315M/405M [00:12<00:03, 25.7MB/s]
Downloading (…)l-00017-of-00033.bin: 80%|██▍| 325M/405M [00:12<00:03, 26.2MB/s]
Downloading (…)l-00017-of-00033.bin: 83%|██▍| 336M/405M [00:13<00:02, 25.2MB/s]
Downloading (…)l-00017-of-00033.bin: 85%|██▌| 346M/405M [00:13<00:02, 23.7MB/s]
Downloading (…)l-00017-of-00033.bin: 88%|██▋| 357M/405M [00:14<00:02, 22.9MB/s]
Downloading (…)l-00017-of-00033.bin: 91%|██▋| 367M/405M [00:14<00:01, 24.7MB/s]
Downloading (…)l-00017-of-00033.bin: 93%|██▊| 377M/405M [00:14<00:01, 23.8MB/s]
Downloading (…)l-00017-of-00033.bin: 96%|██▉| 388M/405M [00:15<00:00, 23.3MB/s]
Downloading (…)l-00017-of-00033.bin: 98%|██▉| 398M/405M [00:15<00:00, 23.0MB/s]
Downloading (…)l-00017-of-00033.bin: 100%|███| 405M/405M [00:16<00:00, 25.1MB/s]
Downloading shards: 52%|███████████▊ | 17/33 [03:08<03:43, 13.94s/it]
Downloading (…)l-00018-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00018-of-00033.bin: 3%| | 10.5M/405M [00:00<00:07, 55.2MB/s]
Downloading (…)l-00018-of-00033.bin: 5%| | 21.0M/405M [00:00<00:08, 45.7MB/s]
Downloading (…)l-00018-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:08, 44.7MB/s]
Downloading (…)l-00018-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:07, 46.5MB/s]
Downloading (…)l-00018-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:08, 41.3MB/s]
Downloading (…)l-00018-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:08, 41.2MB/s]
Downloading (…)l-00018-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:07, 44.7MB/s]
Downloading (…)l-00018-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:06, 48.8MB/s]
Downloading (…)l-00018-of-00033.bin: 23%|▍ | 94.4M/405M [00:02<00:06, 45.0MB/s]
Downloading (…)l-00018-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:06, 48.3MB/s]
Downloading (…)l-00018-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:05, 49.0MB/s]
Downloading (…)l-00018-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:05, 52.1MB/s]
Downloading (…)l-00018-of-00033.bin: 34%|█ | 136M/405M [00:02<00:05, 53.7MB/s]
Downloading (…)l-00018-of-00033.bin: 36%|█ | 147M/405M [00:03<00:05, 47.0MB/s]
Downloading (…)l-00018-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:04, 50.4MB/s]
Downloading (…)l-00018-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:04, 50.0MB/s]
Downloading (…)l-00018-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:04, 52.8MB/s]
Downloading (…)l-00018-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:04, 48.2MB/s]
Downloading (…)l-00018-of-00033.bin: 49%|█▍ | 199M/405M [00:04<00:04, 46.5MB/s]
Downloading (…)l-00018-of-00033.bin: 52%|█▌ | 210M/405M [00:04<00:04, 48.5MB/s]
Downloading (…)l-00018-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:03, 51.2MB/s]
Downloading (…)l-00018-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:03, 53.4MB/s]
Downloading (…)l-00018-of-00033.bin: 60%|█▊ | 241M/405M [00:04<00:03, 49.8MB/s]
Downloading (…)l-00018-of-00033.bin: 62%|█▊ | 252M/405M [00:05<00:03, 42.0MB/s]
Downloading (…)l-00018-of-00033.bin: 65%|█▉ | 262M/405M [00:05<00:03, 41.4MB/s]
Downloading (…)l-00018-of-00033.bin: 67%|██ | 273M/405M [00:05<00:03, 41.3MB/s]
Downloading (…)l-00018-of-00033.bin: 70%|██ | 283M/405M [00:06<00:02, 44.0MB/s]
Downloading (…)l-00018-of-00033.bin: 73%|██▏| 294M/405M [00:06<00:02, 45.7MB/s]
Downloading (…)l-00018-of-00033.bin: 75%|██▎| 304M/405M [00:06<00:02, 50.3MB/s]
Downloading (…)l-00018-of-00033.bin: 78%|██▎| 315M/405M [00:06<00:01, 53.9MB/s]
Downloading (…)l-00018-of-00033.bin: 80%|██▍| 325M/405M [00:06<00:01, 54.7MB/s]
Downloading (…)l-00018-of-00033.bin: 83%|██▍| 336M/405M [00:07<00:01, 49.1MB/s]
Downloading (…)l-00018-of-00033.bin: 85%|██▌| 346M/405M [00:07<00:01, 48.7MB/s]
Downloading (…)l-00018-of-00033.bin: 88%|██▋| 357M/405M [00:07<00:00, 48.6MB/s]
Downloading (…)l-00018-of-00033.bin: 91%|██▋| 367M/405M [00:07<00:00, 46.6MB/s]
Downloading (…)l-00018-of-00033.bin: 93%|██▊| 377M/405M [00:07<00:00, 49.5MB/s]
Downloading (…)l-00018-of-00033.bin: 96%|██▉| 388M/405M [00:08<00:00, 51.1MB/s]
Downloading (…)l-00018-of-00033.bin: 98%|██▉| 398M/405M [00:08<00:00, 51.2MB/s]
Downloading (…)l-00018-of-00033.bin: 100%|███| 405M/405M [00:08<00:00, 48.1MB/s]
Downloading shards: 55%|████████████▌ | 18/33 [03:17<03:05, 12.36s/it]
Downloading (…)l-00019-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00019-of-00033.bin: 3%| | 10.5M/405M [00:00<00:10, 39.3MB/s]
Downloading (…)l-00019-of-00033.bin: 5%| | 21.0M/405M [00:00<00:10, 38.0MB/s]
Downloading (…)l-00019-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:09, 40.9MB/s]
Downloading (…)l-00019-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:07, 46.5MB/s]
Downloading (…)l-00019-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:07, 44.1MB/s]
Downloading (…)l-00019-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:07, 44.2MB/s]
Downloading (…)l-00019-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:07, 47.1MB/s]
Downloading (…)l-00019-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:07, 45.5MB/s]
Downloading (…)l-00019-of-00033.bin: 23%|▍ | 94.4M/405M [00:02<00:06, 48.5MB/s]
Downloading (…)l-00019-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:06, 48.9MB/s]
Downloading (…)l-00019-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:06, 44.8MB/s]
Downloading (…)l-00019-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:05, 46.6MB/s]
Downloading (…)l-00019-of-00033.bin: 34%|█ | 136M/405M [00:02<00:05, 47.5MB/s]
Downloading (…)l-00019-of-00033.bin: 36%|█ | 147M/405M [00:03<00:05, 44.4MB/s]
Downloading (…)l-00019-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:05, 46.4MB/s]
Downloading (…)l-00019-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:04, 47.9MB/s]
Downloading (…)l-00019-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:04, 49.2MB/s]
Downloading (…)l-00019-of-00033.bin: 47%|█▍ | 189M/405M [00:04<00:04, 50.5MB/s]
Downloading (…)l-00019-of-00033.bin: 49%|█▍ | 199M/405M [00:04<00:04, 48.7MB/s]
Downloading (…)l-00019-of-00033.bin: 52%|█▌ | 210M/405M [00:04<00:04, 44.3MB/s]
Downloading (…)l-00019-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:04, 41.5MB/s]
Downloading (…)l-00019-of-00033.bin: 57%|█▋ | 231M/405M [00:05<00:03, 43.5MB/s]
Downloading (…)l-00019-of-00033.bin: 60%|█▊ | 241M/405M [00:05<00:03, 45.7MB/s]
Downloading (…)l-00019-of-00033.bin: 62%|█▊ | 252M/405M [00:05<00:03, 44.3MB/s]
Downloading (…)l-00019-of-00033.bin: 65%|█▉ | 262M/405M [00:05<00:03, 44.8MB/s]
Downloading (…)l-00019-of-00033.bin: 67%|██ | 273M/405M [00:05<00:02, 48.1MB/s]
Downloading (…)l-00019-of-00033.bin: 70%|██ | 283M/405M [00:06<00:02, 49.8MB/s]
Downloading (…)l-00019-of-00033.bin: 73%|██▏| 294M/405M [00:06<00:02, 52.4MB/s]
Downloading (…)l-00019-of-00033.bin: 75%|██▎| 304M/405M [00:06<00:02, 50.3MB/s]
Downloading (…)l-00019-of-00033.bin: 78%|██▎| 315M/405M [00:06<00:01, 48.3MB/s]
Downloading (…)l-00019-of-00033.bin: 80%|██▍| 325M/405M [00:07<00:01, 47.6MB/s]
Downloading (…)l-00019-of-00033.bin: 83%|██▍| 336M/405M [00:07<00:01, 45.1MB/s]
Downloading (…)l-00019-of-00033.bin: 85%|██▌| 346M/405M [00:07<00:01, 48.0MB/s]
Downloading (…)l-00019-of-00033.bin: 88%|██▋| 357M/405M [00:07<00:01, 45.2MB/s]
Downloading (…)l-00019-of-00033.bin: 91%|██▋| 367M/405M [00:07<00:00, 49.4MB/s]
Downloading (…)l-00019-of-00033.bin: 93%|██▊| 377M/405M [00:08<00:00, 53.4MB/s]
Downloading (…)l-00019-of-00033.bin: 96%|██▉| 388M/405M [00:08<00:00, 54.9MB/s]
Downloading (…)l-00019-of-00033.bin: 98%|██▉| 398M/405M [00:08<00:00, 55.8MB/s]
Downloading (…)l-00019-of-00033.bin: 100%|███| 405M/405M [00:08<00:00, 47.5MB/s]
Downloading shards: 58%|█████████████▏ | 19/33 [03:26<02:38, 11.29s/it]
Downloading (…)l-00020-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00020-of-00033.bin: 3%| | 10.5M/405M [00:00<00:11, 33.7MB/s]
Downloading (…)l-00020-of-00033.bin: 5%| | 21.0M/405M [00:00<00:12, 29.9MB/s]
Downloading (…)l-00020-of-00033.bin: 8%|▏ | 31.5M/405M [00:01<00:12, 30.4MB/s]
Downloading (…)l-00020-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:12, 30.2MB/s]
Downloading (…)l-00020-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:11, 31.6MB/s]
Downloading (…)l-00020-of-00033.bin: 16%|▎ | 62.9M/405M [00:02<00:12, 28.3MB/s]
Downloading (…)l-00020-of-00033.bin: 18%|▎ | 73.4M/405M [00:02<00:12, 27.4MB/s]
Downloading (…)l-00020-of-00033.bin: 21%|▍ | 83.9M/405M [00:03<00:12, 25.3MB/s]
Downloading (…)l-00020-of-00033.bin: 23%|▍ | 94.4M/405M [00:03<00:12, 24.1MB/s]
Downloading (…)l-00020-of-00033.bin: 26%|▊ | 105M/405M [00:03<00:12, 24.0MB/s]
Downloading (…)l-00020-of-00033.bin: 28%|▊ | 115M/405M [00:04<00:13, 21.2MB/s]
Downloading (…)l-00020-of-00033.bin: 31%|▉ | 126M/405M [00:04<00:12, 22.8MB/s]
Downloading (…)l-00020-of-00033.bin: 34%|█ | 136M/405M [00:05<00:10, 26.6MB/s]
Downloading (…)l-00020-of-00033.bin: 36%|█ | 147M/405M [00:05<00:08, 29.1MB/s]
Downloading (…)l-00020-of-00033.bin: 39%|█▏ | 157M/405M [00:05<00:07, 31.0MB/s]
Downloading (…)l-00020-of-00033.bin: 41%|█▏ | 168M/405M [00:06<00:07, 30.8MB/s]
Downloading (…)l-00020-of-00033.bin: 44%|█▎ | 178M/405M [00:06<00:07, 29.2MB/s]
Downloading (…)l-00020-of-00033.bin: 47%|█▍ | 189M/405M [00:06<00:07, 30.0MB/s]
Downloading (…)l-00020-of-00033.bin: 49%|█▍ | 199M/405M [00:07<00:06, 31.8MB/s]
Downloading (…)l-00020-of-00033.bin: 52%|█▌ | 210M/405M [00:07<00:05, 33.8MB/s]
Downloading (…)l-00020-of-00033.bin: 54%|█▋ | 220M/405M [00:07<00:05, 31.9MB/s]
Downloading (…)l-00020-of-00033.bin: 57%|█▋ | 231M/405M [00:08<00:05, 29.4MB/s]
Downloading (…)l-00020-of-00033.bin: 60%|█▊ | 241M/405M [00:08<00:05, 29.0MB/s]
Downloading (…)l-00020-of-00033.bin: 62%|█▊ | 252M/405M [00:08<00:05, 30.0MB/s]
Downloading (…)l-00020-of-00033.bin: 65%|█▉ | 262M/405M [00:09<00:04, 30.3MB/s]
Downloading (…)l-00020-of-00033.bin: 67%|██ | 273M/405M [00:09<00:04, 28.7MB/s]
Downloading (…)l-00020-of-00033.bin: 70%|██ | 283M/405M [00:10<00:04, 27.0MB/s]
Downloading (…)l-00020-of-00033.bin: 73%|██▏| 294M/405M [00:10<00:03, 28.2MB/s]
Downloading (…)l-00020-of-00033.bin: 75%|██▎| 304M/405M [00:10<00:03, 27.9MB/s]
Downloading (…)l-00020-of-00033.bin: 78%|██▎| 315M/405M [00:11<00:03, 27.5MB/s]
Downloading (…)l-00020-of-00033.bin: 80%|██▍| 325M/405M [00:11<00:03, 26.0MB/s]
Downloading (…)l-00020-of-00033.bin: 83%|██▍| 336M/405M [00:12<00:02, 24.5MB/s]
Downloading (…)l-00020-of-00033.bin: 85%|██▌| 346M/405M [00:12<00:02, 23.0MB/s]
Downloading (…)l-00020-of-00033.bin: 88%|██▋| 357M/405M [00:13<00:02, 22.9MB/s]
Downloading (…)l-00020-of-00033.bin: 91%|██▋| 367M/405M [00:13<00:01, 22.8MB/s]
Downloading (…)l-00020-of-00033.bin: 93%|██▊| 377M/405M [00:13<00:00, 27.3MB/s]
Downloading (…)l-00020-of-00033.bin: 96%|██▉| 388M/405M [00:14<00:00, 26.9MB/s]
Downloading (…)l-00020-of-00033.bin: 98%|██▉| 398M/405M [00:14<00:00, 28.7MB/s]
Downloading (…)l-00020-of-00033.bin: 100%|███| 405M/405M [00:14<00:00, 27.5MB/s]
Downloading shards: 61%|█████████████▉ | 20/33 [03:41<02:41, 12.40s/it]
Downloading (…)l-00021-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00021-of-00033.bin: 3%| | 10.5M/405M [00:00<00:10, 38.0MB/s]
Downloading (…)l-00021-of-00033.bin: 5%| | 21.0M/405M [00:00<00:08, 45.3MB/s]
Downloading (…)l-00021-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:08, 44.9MB/s]
Downloading (…)l-00021-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:10, 33.2MB/s]
Downloading (…)l-00021-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:10, 33.2MB/s]
Downloading (…)l-00021-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:08, 38.1MB/s]
Downloading (…)l-00021-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:07, 42.7MB/s]
Downloading (…)l-00021-of-00033.bin: 21%|▍ | 83.9M/405M [00:02<00:07, 41.7MB/s]
Downloading (…)l-00021-of-00033.bin: 23%|▍ | 94.4M/405M [00:02<00:07, 43.9MB/s]
Downloading (…)l-00021-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:06, 45.6MB/s]
Downloading (…)l-00021-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:06, 44.8MB/s]
Downloading (…)l-00021-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:05, 48.3MB/s]
Downloading (…)l-00021-of-00033.bin: 34%|█ | 136M/405M [00:03<00:05, 49.7MB/s]
Downloading (…)l-00021-of-00033.bin: 36%|█ | 147M/405M [00:03<00:05, 51.0MB/s]
Downloading (…)l-00021-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:04, 54.7MB/s]
Downloading (…)l-00021-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:04, 50.8MB/s]
Downloading (…)l-00021-of-00033.bin: 44%|█▎ | 178M/405M [00:04<00:04, 45.6MB/s]
Downloading (…)l-00021-of-00033.bin: 47%|█▍ | 189M/405M [00:04<00:06, 35.1MB/s]
Downloading (…)l-00021-of-00033.bin: 49%|█▍ | 199M/405M [00:04<00:05, 35.2MB/s]
Downloading (…)l-00021-of-00033.bin: 52%|█▌ | 210M/405M [00:05<00:05, 34.5MB/s]
Downloading (…)l-00021-of-00033.bin: 54%|█▋ | 220M/405M [00:05<00:05, 31.1MB/s]
Downloading (…)l-00021-of-00033.bin: 57%|█▋ | 231M/405M [00:05<00:05, 31.7MB/s]
Downloading (…)l-00021-of-00033.bin: 60%|█▊ | 241M/405M [00:06<00:04, 33.4MB/s]
Downloading (…)l-00021-of-00033.bin: 62%|█▊ | 252M/405M [00:06<00:04, 31.5MB/s]
Downloading (…)l-00021-of-00033.bin: 65%|█▉ | 262M/405M [00:06<00:04, 29.1MB/s]
Downloading (…)l-00021-of-00033.bin: 67%|██ | 273M/405M [00:07<00:04, 28.5MB/s]
Downloading (…)l-00021-of-00033.bin: 70%|██ | 283M/405M [00:07<00:04, 28.5MB/s]
Downloading (…)l-00021-of-00033.bin: 73%|██▏| 294M/405M [00:08<00:04, 26.5MB/s]
Downloading (…)l-00021-of-00033.bin: 75%|██▎| 304M/405M [00:08<00:03, 25.9MB/s]
Downloading (…)l-00021-of-00033.bin: 78%|██▎| 315M/405M [00:08<00:03, 28.0MB/s]
Downloading (…)l-00021-of-00033.bin: 80%|██▍| 325M/405M [00:09<00:02, 30.1MB/s]
Downloading (…)l-00021-of-00033.bin: 83%|██▍| 336M/405M [00:09<00:02, 32.8MB/s]
Downloading (…)l-00021-of-00033.bin: 85%|██▌| 346M/405M [00:09<00:01, 30.5MB/s]
Downloading (…)l-00021-of-00033.bin: 88%|██▋| 357M/405M [00:10<00:01, 29.5MB/s]
Downloading (…)l-00021-of-00033.bin: 91%|██▋| 367M/405M [00:10<00:01, 33.4MB/s]
Downloading (…)l-00021-of-00033.bin: 93%|██▊| 377M/405M [00:10<00:00, 35.0MB/s]
Downloading (…)l-00021-of-00033.bin: 96%|██▉| 388M/405M [00:10<00:00, 37.4MB/s]
Downloading (…)l-00021-of-00033.bin: 98%|██▉| 398M/405M [00:11<00:00, 35.4MB/s]
Downloading (…)l-00021-of-00033.bin: 100%|███| 405M/405M [00:11<00:00, 35.6MB/s]
Downloading shards: 64%|██████████████▋ | 21/33 [03:52<02:25, 12.17s/it]
Downloading (…)l-00022-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00022-of-00033.bin: 3%| | 10.5M/405M [00:00<00:08, 46.9MB/s]
Downloading (…)l-00022-of-00033.bin: 5%| | 21.0M/405M [00:00<00:08, 45.2MB/s]
Downloading (…)l-00022-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:09, 41.4MB/s]
Downloading (…)l-00022-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:07, 46.8MB/s]
Downloading (…)l-00022-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:08, 43.8MB/s]
Downloading (…)l-00022-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:07, 46.0MB/s]
Downloading (…)l-00022-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:07, 45.8MB/s]
Downloading (…)l-00022-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:06, 48.3MB/s]
Downloading (…)l-00022-of-00033.bin: 23%|▍ | 94.4M/405M [00:02<00:07, 43.5MB/s]
Downloading (…)l-00022-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:06, 44.8MB/s]
Downloading (…)l-00022-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:07, 39.5MB/s]
Downloading (…)l-00022-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:07, 38.3MB/s]
Downloading (…)l-00022-of-00033.bin: 34%|█ | 136M/405M [00:03<00:07, 38.0MB/s]
Downloading (…)l-00022-of-00033.bin: 36%|█ | 147M/405M [00:03<00:06, 39.3MB/s]
Downloading (…)l-00022-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:06, 39.9MB/s]
Downloading (…)l-00022-of-00033.bin: 41%|█▏ | 168M/405M [00:04<00:06, 36.8MB/s]
Downloading (…)l-00022-of-00033.bin: 44%|█▎ | 178M/405M [00:04<00:05, 40.2MB/s]
Downloading (…)l-00022-of-00033.bin: 47%|█▍ | 189M/405M [00:04<00:04, 44.0MB/s]
Downloading (…)l-00022-of-00033.bin: 49%|█▍ | 199M/405M [00:04<00:04, 45.2MB/s]
Downloading (…)l-00022-of-00033.bin: 52%|█▌ | 210M/405M [00:04<00:04, 48.0MB/s]
Downloading (…)l-00022-of-00033.bin: 54%|█▋ | 220M/405M [00:05<00:03, 47.3MB/s]
Downloading (…)l-00022-of-00033.bin: 57%|█▋ | 231M/405M [00:05<00:03, 47.0MB/s]
Downloading (…)l-00022-of-00033.bin: 60%|█▊ | 241M/405M [00:05<00:03, 48.8MB/s]
Downloading (…)l-00022-of-00033.bin: 62%|█▊ | 252M/405M [00:05<00:03, 48.2MB/s]
Downloading (…)l-00022-of-00033.bin: 65%|█▉ | 262M/405M [00:06<00:03, 43.5MB/s]
Downloading (…)l-00022-of-00033.bin: 67%|██ | 273M/405M [00:06<00:03, 40.1MB/s]
Downloading (…)l-00022-of-00033.bin: 70%|██ | 283M/405M [00:06<00:02, 45.0MB/s]
Downloading (…)l-00022-of-00033.bin: 73%|██▏| 294M/405M [00:06<00:02, 42.7MB/s]
Downloading (…)l-00022-of-00033.bin: 75%|██▎| 304M/405M [00:06<00:02, 46.6MB/s]
Downloading (…)l-00022-of-00033.bin: 78%|██▎| 315M/405M [00:07<00:01, 46.8MB/s]
Downloading (…)l-00022-of-00033.bin: 80%|██▍| 325M/405M [00:07<00:02, 37.8MB/s]
Downloading (…)l-00022-of-00033.bin: 83%|██▍| 336M/405M [00:07<00:01, 39.5MB/s]
Downloading (…)l-00022-of-00033.bin: 85%|██▌| 346M/405M [00:08<00:01, 42.5MB/s]
Downloading (…)l-00022-of-00033.bin: 88%|██▋| 357M/405M [00:08<00:01, 46.0MB/s]
Downloading (…)l-00022-of-00033.bin: 91%|██▋| 367M/405M [00:08<00:00, 49.1MB/s]
Downloading (…)l-00022-of-00033.bin: 93%|██▊| 377M/405M [00:08<00:00, 37.1MB/s]
Downloading (…)l-00022-of-00033.bin: 96%|██▉| 388M/405M [00:09<00:00, 39.4MB/s]
Downloading (…)l-00022-of-00033.bin: 98%|██▉| 398M/405M [00:09<00:00, 43.5MB/s]
Downloading (…)l-00022-of-00033.bin: 100%|███| 405M/405M [00:09<00:00, 43.0MB/s]
Downloading shards: 67%|███████████████▎ | 22/33 [04:02<02:05, 11.42s/it]
Downloading (…)l-00023-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00023-of-00033.bin: 3%| | 10.5M/405M [00:00<00:12, 32.5MB/s]
Downloading (…)l-00023-of-00033.bin: 5%| | 21.0M/405M [00:00<00:09, 41.8MB/s]
Downloading (…)l-00023-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:09, 41.3MB/s]
Downloading (…)l-00023-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:07, 46.5MB/s]
Downloading (…)l-00023-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:07, 45.3MB/s]
Downloading (…)l-00023-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:07, 47.5MB/s]
Downloading (…)l-00023-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:07, 46.9MB/s]
Downloading (…)l-00023-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:07, 45.5MB/s]
Downloading (…)l-00023-of-00033.bin: 23%|▍ | 94.4M/405M [00:02<00:06, 45.7MB/s]
Downloading (…)l-00023-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:06, 47.2MB/s]
Downloading (…)l-00023-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:05, 48.3MB/s]
Downloading (…)l-00023-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:06, 46.3MB/s]
Downloading (…)l-00023-of-00033.bin: 34%|█ | 136M/405M [00:02<00:05, 47.7MB/s]
Downloading (…)l-00023-of-00033.bin: 36%|█ | 147M/405M [00:03<00:05, 47.2MB/s]
Downloading (…)l-00023-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:05, 47.9MB/s]
Downloading (…)l-00023-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:04, 48.3MB/s]
Downloading (…)l-00023-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:04, 45.4MB/s]
Downloading (…)l-00023-of-00033.bin: 47%|█▍ | 189M/405M [00:04<00:04, 49.2MB/s]
Downloading (…)l-00023-of-00033.bin: 49%|█▍ | 199M/405M [00:04<00:04, 50.3MB/s]
Downloading (…)l-00023-of-00033.bin: 52%|█▌ | 210M/405M [00:04<00:04, 47.7MB/s]
Downloading (…)l-00023-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:03, 49.5MB/s]
Downloading (…)l-00023-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:03, 49.1MB/s]
Downloading (…)l-00023-of-00033.bin: 60%|█▊ | 241M/405M [00:05<00:03, 45.5MB/s]
Downloading (…)l-00023-of-00033.bin: 62%|█▊ | 252M/405M [00:05<00:03, 47.3MB/s]
Downloading (…)l-00023-of-00033.bin: 65%|█▉ | 262M/405M [00:05<00:02, 50.7MB/s]
Downloading (…)l-00023-of-00033.bin: 67%|██ | 273M/405M [00:05<00:02, 51.5MB/s]
Downloading (…)l-00023-of-00033.bin: 70%|██ | 283M/405M [00:05<00:02, 53.1MB/s]
Downloading (…)l-00023-of-00033.bin: 73%|██▏| 294M/405M [00:06<00:02, 51.6MB/s]
Downloading (…)l-00023-of-00033.bin: 75%|██▎| 304M/405M [00:06<00:02, 50.0MB/s]
Downloading (…)l-00023-of-00033.bin: 78%|██▎| 315M/405M [00:06<00:01, 52.9MB/s]
Downloading (…)l-00023-of-00033.bin: 80%|██▍| 325M/405M [00:06<00:01, 55.4MB/s]
Downloading (…)l-00023-of-00033.bin: 83%|██▍| 336M/405M [00:06<00:01, 55.7MB/s]
Downloading (…)l-00023-of-00033.bin: 85%|██▌| 346M/405M [00:07<00:01, 49.9MB/s]
Downloading (…)l-00023-of-00033.bin: 88%|██▋| 357M/405M [00:07<00:01, 48.2MB/s]
Downloading (…)l-00023-of-00033.bin: 91%|██▋| 367M/405M [00:07<00:00, 49.6MB/s]
Downloading (…)l-00023-of-00033.bin: 93%|██▊| 377M/405M [00:07<00:00, 53.4MB/s]
Downloading (…)l-00023-of-00033.bin: 96%|██▉| 388M/405M [00:07<00:00, 54.9MB/s]
Downloading (…)l-00023-of-00033.bin: 98%|██▉| 398M/405M [00:08<00:00, 45.6MB/s]
Downloading (…)l-00023-of-00033.bin: 100%|███| 405M/405M [00:08<00:00, 48.2MB/s]
Downloading shards: 70%|████████████████ | 23/33 [04:10<01:45, 10.59s/it]
Downloading (…)l-00024-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00024-of-00033.bin: 3%| | 10.5M/405M [00:00<00:24, 16.1MB/s]
Downloading (…)l-00024-of-00033.bin: 5%| | 21.0M/405M [00:01<00:23, 16.2MB/s]
Downloading (…)l-00024-of-00033.bin: 8%|▏ | 31.5M/405M [00:01<00:22, 16.4MB/s]
Downloading (…)l-00024-of-00033.bin: 10%|▏ | 41.9M/405M [00:02<00:22, 16.5MB/s]
Downloading (…)l-00024-of-00033.bin: 13%|▎ | 52.4M/405M [00:03<00:22, 15.5MB/s]
Downloading (…)l-00024-of-00033.bin: 16%|▎ | 62.9M/405M [00:03<00:19, 17.2MB/s]
Downloading (…)l-00024-of-00033.bin: 18%|▎ | 73.4M/405M [00:04<00:18, 17.5MB/s]
Downloading (…)l-00024-of-00033.bin: 21%|▍ | 83.9M/405M [00:04<00:17, 18.5MB/s]
Downloading (…)l-00024-of-00033.bin: 23%|▍ | 94.4M/405M [00:05<00:16, 19.0MB/s]
Downloading (…)l-00024-of-00033.bin: 26%|▊ | 105M/405M [00:05<00:15, 19.0MB/s]
Downloading (…)l-00024-of-00033.bin: 28%|▊ | 115M/405M [00:06<00:14, 19.7MB/s]
Downloading (…)l-00024-of-00033.bin: 31%|▉ | 126M/405M [00:06<00:14, 19.8MB/s]
Downloading (…)l-00024-of-00033.bin: 34%|█ | 136M/405M [00:07<00:13, 19.9MB/s]
Downloading (…)l-00024-of-00033.bin: 36%|█ | 147M/405M [00:08<00:13, 19.2MB/s]
Downloading (…)l-00024-of-00033.bin: 39%|█▏ | 157M/405M [00:08<00:12, 19.5MB/s]
Downloading (…)l-00024-of-00033.bin: 41%|█▏ | 168M/405M [00:09<00:12, 19.4MB/s]
Downloading (…)l-00024-of-00033.bin: 44%|█▎ | 178M/405M [00:09<00:11, 19.9MB/s]
Downloading (…)l-00024-of-00033.bin: 47%|█▍ | 189M/405M [00:10<00:11, 19.5MB/s]
Downloading (…)l-00024-of-00033.bin: 49%|█▍ | 199M/405M [00:10<00:11, 18.6MB/s]
Downloading (…)l-00024-of-00033.bin: 52%|█▌ | 210M/405M [00:11<00:10, 18.8MB/s]
Downloading (…)l-00024-of-00033.bin: 54%|█▋ | 220M/405M [00:12<00:10, 17.4MB/s]
Downloading (…)l-00024-of-00033.bin: 57%|█▋ | 231M/405M [00:12<00:10, 17.4MB/s]
Downloading (…)l-00024-of-00033.bin: 60%|█▊ | 241M/405M [00:13<00:09, 17.5MB/s]
Downloading (…)l-00024-of-00033.bin: 62%|█▊ | 252M/405M [00:13<00:08, 17.1MB/s]
Downloading (…)l-00024-of-00033.bin: 65%|█▉ | 262M/405M [00:14<00:08, 17.0MB/s]
Downloading (…)l-00024-of-00033.bin: 67%|██ | 273M/405M [00:15<00:08, 16.5MB/s]
Downloading (…)l-00024-of-00033.bin: 70%|██ | 283M/405M [00:15<00:07, 16.4MB/s]
Downloading (…)l-00024-of-00033.bin: 73%|██▏| 294M/405M [00:16<00:07, 15.6MB/s]
Downloading (…)l-00024-of-00033.bin: 75%|██▎| 304M/405M [00:17<00:06, 15.4MB/s]
Downloading (…)l-00024-of-00033.bin: 78%|██▎| 315M/405M [00:17<00:05, 17.6MB/s]
Downloading (…)l-00024-of-00033.bin: 80%|██▍| 325M/405M [00:18<00:04, 18.1MB/s]
Downloading (…)l-00024-of-00033.bin: 83%|██▍| 336M/405M [00:18<00:03, 19.3MB/s]
Downloading (…)l-00024-of-00033.bin: 85%|██▌| 346M/405M [00:19<00:03, 19.3MB/s]
Downloading (…)l-00024-of-00033.bin: 88%|██▋| 357M/405M [00:19<00:02, 18.3MB/s]
Downloading (…)l-00024-of-00033.bin: 91%|██▋| 367M/405M [00:20<00:02, 18.7MB/s]
Downloading (…)l-00024-of-00033.bin: 93%|██▊| 377M/405M [00:20<00:01, 19.2MB/s]
Downloading (…)l-00024-of-00033.bin: 96%|██▉| 388M/405M [00:21<00:00, 19.8MB/s]
Downloading (…)l-00024-of-00033.bin: 98%|██▉| 398M/405M [00:21<00:00, 20.4MB/s]
Downloading (…)l-00024-of-00033.bin: 100%|███| 405M/405M [00:22<00:00, 18.2MB/s]
Downloading shards: 73%|████████████████▋ | 24/33 [04:33<02:07, 14.17s/it]
Downloading (…)l-00025-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00025-of-00033.bin: 3%| | 10.5M/405M [00:00<00:14, 26.4MB/s]
Downloading (…)l-00025-of-00033.bin: 5%| | 21.0M/405M [00:00<00:18, 20.6MB/s]
Downloading (…)l-00025-of-00033.bin: 8%|▏ | 31.5M/405M [00:01<00:14, 25.1MB/s]
Downloading (…)l-00025-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:15, 23.0MB/s]
Downloading (…)l-00025-of-00033.bin: 13%|▎ | 52.4M/405M [00:02<00:14, 25.2MB/s]
Downloading (…)l-00025-of-00033.bin: 16%|▎ | 62.9M/405M [00:02<00:11, 28.8MB/s]
Downloading (…)l-00025-of-00033.bin: 18%|▎ | 73.4M/405M [00:02<00:12, 27.5MB/s]
Downloading (…)l-00025-of-00033.bin: 21%|▍ | 83.9M/405M [00:03<00:12, 26.1MB/s]
Downloading (…)l-00025-of-00033.bin: 23%|▍ | 94.4M/405M [00:03<00:10, 28.4MB/s]
Downloading (…)l-00025-of-00033.bin: 26%|▊ | 105M/405M [00:04<00:11, 25.7MB/s]
Downloading (…)l-00025-of-00033.bin: 28%|▊ | 115M/405M [00:04<00:11, 25.5MB/s]
Downloading (…)l-00025-of-00033.bin: 31%|▉ | 126M/405M [00:04<00:10, 26.8MB/s]
Downloading (…)l-00025-of-00033.bin: 34%|█ | 136M/405M [00:05<00:10, 26.2MB/s]
Downloading (…)l-00025-of-00033.bin: 36%|█ | 147M/405M [00:05<00:09, 26.5MB/s]
Downloading (…)l-00025-of-00033.bin: 39%|█▏ | 157M/405M [00:05<00:08, 27.7MB/s]
Downloading (…)l-00025-of-00033.bin: 41%|█▏ | 168M/405M [00:06<00:08, 29.1MB/s]
Downloading (…)l-00025-of-00033.bin: 44%|█▎ | 178M/405M [00:06<00:07, 32.1MB/s]
Downloading (…)l-00025-of-00033.bin: 47%|█▍ | 189M/405M [00:06<00:06, 32.6MB/s]
Downloading (…)l-00025-of-00033.bin: 49%|█▍ | 199M/405M [00:07<00:06, 31.6MB/s]
Downloading (…)l-00025-of-00033.bin: 52%|█▌ | 210M/405M [00:07<00:06, 28.6MB/s]
Downloading (…)l-00025-of-00033.bin: 54%|█▋ | 220M/405M [00:08<00:06, 27.3MB/s]
Downloading (…)l-00025-of-00033.bin: 57%|█▋ | 231M/405M [00:08<00:06, 26.8MB/s]
Downloading (…)l-00025-of-00033.bin: 60%|█▊ | 241M/405M [00:08<00:06, 26.4MB/s]
Downloading (…)l-00025-of-00033.bin: 62%|█▊ | 252M/405M [00:09<00:05, 28.0MB/s]
Downloading (…)l-00025-of-00033.bin: 65%|█▉ | 262M/405M [00:09<00:04, 28.6MB/s]
Downloading (…)l-00025-of-00033.bin: 67%|██ | 273M/405M [00:09<00:04, 28.7MB/s]
Downloading (…)l-00025-of-00033.bin: 70%|██ | 283M/405M [00:10<00:04, 28.7MB/s]
Downloading (…)l-00025-of-00033.bin: 73%|██▏| 294M/405M [00:10<00:03, 31.0MB/s]
Downloading (…)l-00025-of-00033.bin: 75%|██▎| 304M/405M [00:10<00:03, 31.1MB/s]
Downloading (…)l-00025-of-00033.bin: 78%|██▎| 315M/405M [00:11<00:03, 28.9MB/s]
Downloading (…)l-00025-of-00033.bin: 80%|██▍| 325M/405M [00:11<00:02, 28.4MB/s]
Downloading (…)l-00025-of-00033.bin: 83%|██▍| 336M/405M [00:12<00:02, 26.5MB/s]
Downloading (…)l-00025-of-00033.bin: 85%|██▌| 346M/405M [00:12<00:02, 26.4MB/s]
Downloading (…)l-00025-of-00033.bin: 88%|██▋| 357M/405M [00:12<00:01, 26.4MB/s]
Downloading (…)l-00025-of-00033.bin: 91%|██▋| 367M/405M [00:13<00:01, 24.7MB/s]
Downloading (…)l-00025-of-00033.bin: 93%|██▊| 377M/405M [00:13<00:01, 24.7MB/s]
Downloading (…)l-00025-of-00033.bin: 96%|██▉| 388M/405M [00:14<00:00, 25.5MB/s]
Downloading (…)l-00025-of-00033.bin: 98%|██▉| 398M/405M [00:14<00:00, 27.5MB/s]
Downloading (…)l-00025-of-00033.bin: 100%|███| 405M/405M [00:14<00:00, 27.3MB/s]
Downloading shards: 76%|█████████████████▍ | 25/33 [04:48<01:55, 14.45s/it]
Downloading (…)l-00026-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00026-of-00033.bin: 3%| | 10.5M/405M [00:00<00:10, 37.4MB/s]
Downloading (…)l-00026-of-00033.bin: 5%| | 21.0M/405M [00:00<00:10, 35.6MB/s]
Downloading (…)l-00026-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:08, 43.2MB/s]
Downloading (…)l-00026-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:07, 47.2MB/s]
Downloading (…)l-00026-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:07, 50.3MB/s]
Downloading (…)l-00026-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:06, 50.1MB/s]
Downloading (…)l-00026-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:06, 51.4MB/s]
Downloading (…)l-00026-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:06, 53.0MB/s]
Downloading (…)l-00026-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:05, 54.6MB/s]
Downloading (…)l-00026-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:05, 55.3MB/s]
Downloading (…)l-00026-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:04, 60.3MB/s]
Downloading (…)l-00026-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:04, 58.3MB/s]
Downloading (…)l-00026-of-00033.bin: 34%|█ | 136M/405M [00:02<00:04, 57.8MB/s]
Downloading (…)l-00026-of-00033.bin: 36%|█ | 147M/405M [00:02<00:04, 61.1MB/s]
Downloading (…)l-00026-of-00033.bin: 39%|█▏ | 157M/405M [00:02<00:03, 63.6MB/s]
Downloading (…)l-00026-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:03, 62.0MB/s]
Downloading (…)l-00026-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:03, 61.3MB/s]
Downloading (…)l-00026-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:03, 63.2MB/s]
Downloading (…)l-00026-of-00033.bin: 49%|█▍ | 199M/405M [00:03<00:03, 59.0MB/s]
Downloading (…)l-00026-of-00033.bin: 52%|█▌ | 210M/405M [00:03<00:03, 59.5MB/s]
Downloading (…)l-00026-of-00033.bin: 54%|█▋ | 220M/405M [00:03<00:03, 59.1MB/s]
Downloading (…)l-00026-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:02, 59.7MB/s]
Downloading (…)l-00026-of-00033.bin: 60%|█▊ | 241M/405M [00:04<00:02, 61.1MB/s]
Downloading (…)l-00026-of-00033.bin: 62%|█▊ | 252M/405M [00:04<00:02, 58.6MB/s]
Downloading (…)l-00026-of-00033.bin: 65%|█▉ | 262M/405M [00:04<00:02, 61.8MB/s]
Downloading (…)l-00026-of-00033.bin: 67%|██ | 273M/405M [00:04<00:02, 56.4MB/s]
Downloading (…)l-00026-of-00033.bin: 70%|██ | 283M/405M [00:05<00:02, 54.0MB/s]
Downloading (…)l-00026-of-00033.bin: 73%|██▏| 294M/405M [00:05<00:02, 54.8MB/s]
Downloading (…)l-00026-of-00033.bin: 75%|██▎| 304M/405M [00:05<00:01, 57.0MB/s]
Downloading (…)l-00026-of-00033.bin: 78%|██▎| 315M/405M [00:05<00:01, 58.6MB/s]
Downloading (…)l-00026-of-00033.bin: 80%|██▍| 325M/405M [00:05<00:01, 56.7MB/s]
Downloading (…)l-00026-of-00033.bin: 83%|██▍| 336M/405M [00:05<00:01, 59.1MB/s]
Downloading (…)l-00026-of-00033.bin: 85%|██▌| 346M/405M [00:06<00:00, 63.4MB/s]
Downloading (…)l-00026-of-00033.bin: 88%|██▋| 357M/405M [00:06<00:00, 60.6MB/s]
Downloading (…)l-00026-of-00033.bin: 91%|██▋| 367M/405M [00:06<00:00, 49.5MB/s]
Downloading (…)l-00026-of-00033.bin: 93%|██▊| 377M/405M [00:06<00:00, 51.6MB/s]
Downloading (…)l-00026-of-00033.bin: 96%|██▉| 388M/405M [00:06<00:00, 55.9MB/s]
Downloading (…)l-00026-of-00033.bin: 100%|███| 405M/405M [00:07<00:00, 55.9MB/s]
Downloading shards: 79%|██████████████████ | 26/33 [04:56<01:26, 12.37s/it]
Downloading (…)l-00027-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00027-of-00033.bin: 3%| | 10.5M/405M [00:00<00:07, 49.9MB/s]
Downloading (…)l-00027-of-00033.bin: 5%| | 21.0M/405M [00:00<00:09, 38.7MB/s]
Downloading (…)l-00027-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:09, 38.7MB/s]
Downloading (…)l-00027-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:08, 41.5MB/s]
Downloading (…)l-00027-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:09, 39.1MB/s]
Downloading (…)l-00027-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:07, 42.9MB/s]
Downloading (…)l-00027-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:06, 48.8MB/s]
Downloading (…)l-00027-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:06, 46.4MB/s]
Downloading (…)l-00027-of-00033.bin: 23%|▍ | 94.4M/405M [00:02<00:06, 46.7MB/s]
Downloading (…)l-00027-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:05, 50.6MB/s]
Downloading (…)l-00027-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:05, 52.5MB/s]
Downloading (…)l-00027-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:05, 52.5MB/s]
Downloading (…)l-00027-of-00033.bin: 34%|█ | 136M/405M [00:02<00:05, 50.6MB/s]
Downloading (…)l-00027-of-00033.bin: 36%|█ | 147M/405M [00:03<00:05, 49.7MB/s]
Downloading (…)l-00027-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:04, 53.3MB/s]
Downloading (…)l-00027-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:04, 51.9MB/s]
Downloading (…)l-00027-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:04, 53.8MB/s]
Downloading (…)l-00027-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:04, 52.8MB/s]
Downloading (…)l-00027-of-00033.bin: 49%|█▍ | 199M/405M [00:04<00:03, 54.8MB/s]
Downloading (…)l-00027-of-00033.bin: 52%|█▌ | 210M/405M [00:04<00:03, 53.8MB/s]
Downloading (…)l-00027-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:03, 51.8MB/s]
Downloading (…)l-00027-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:03, 51.1MB/s]
Downloading (…)l-00027-of-00033.bin: 60%|█▊ | 241M/405M [00:04<00:03, 53.9MB/s]
Downloading (…)l-00027-of-00033.bin: 62%|█▊ | 252M/405M [00:05<00:02, 57.9MB/s]
Downloading (…)l-00027-of-00033.bin: 65%|█▉ | 262M/405M [00:05<00:02, 52.1MB/s]
Downloading (…)l-00027-of-00033.bin: 67%|██ | 273M/405M [00:05<00:02, 53.2MB/s]
Downloading (…)l-00027-of-00033.bin: 70%|██ | 283M/405M [00:05<00:02, 50.9MB/s]
Downloading (…)l-00027-of-00033.bin: 73%|██▏| 294M/405M [00:05<00:02, 49.0MB/s]
Downloading (…)l-00027-of-00033.bin: 75%|██▎| 304M/405M [00:06<00:01, 51.0MB/s]
Downloading (…)l-00027-of-00033.bin: 78%|██▎| 315M/405M [00:06<00:01, 50.0MB/s]
Downloading (…)l-00027-of-00033.bin: 80%|██▍| 325M/405M [00:06<00:01, 48.6MB/s]
Downloading (…)l-00027-of-00033.bin: 83%|██▍| 336M/405M [00:06<00:01, 47.2MB/s]
Downloading (…)l-00027-of-00033.bin: 85%|██▌| 346M/405M [00:06<00:01, 48.6MB/s]
Downloading (…)l-00027-of-00033.bin: 88%|██▋| 357M/405M [00:07<00:00, 50.8MB/s]
Downloading (…)l-00027-of-00033.bin: 91%|██▋| 367M/405M [00:07<00:00, 47.8MB/s]
Downloading (…)l-00027-of-00033.bin: 93%|██▊| 377M/405M [00:07<00:00, 48.4MB/s]
Downloading (…)l-00027-of-00033.bin: 96%|██▉| 388M/405M [00:07<00:00, 51.5MB/s]
Downloading (…)l-00027-of-00033.bin: 98%|██▉| 398M/405M [00:08<00:00, 50.5MB/s]
Downloading (…)l-00027-of-00033.bin: 100%|███| 405M/405M [00:08<00:00, 49.5MB/s]
Downloading shards: 82%|██████████████████▊ | 27/33 [05:04<01:07, 11.21s/it]
Downloading (…)l-00028-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00028-of-00033.bin: 3%| | 10.5M/405M [00:00<00:10, 36.9MB/s]
Downloading (…)l-00028-of-00033.bin: 5%| | 21.0M/405M [00:00<00:09, 40.3MB/s]
Downloading (…)l-00028-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:08, 42.1MB/s]
Downloading (…)l-00028-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:10, 34.8MB/s]
Downloading (…)l-00028-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:09, 35.4MB/s]
Downloading (…)l-00028-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:09, 36.5MB/s]
Downloading (…)l-00028-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:08, 39.5MB/s]
Downloading (…)l-00028-of-00033.bin: 21%|▍ | 83.9M/405M [00:02<00:10, 31.3MB/s]
Downloading (…)l-00028-of-00033.bin: 23%|▍ | 94.4M/405M [00:02<00:08, 36.1MB/s]
Downloading (…)l-00028-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:07, 40.4MB/s]
Downloading (…)l-00028-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:06, 44.1MB/s]
Downloading (…)l-00028-of-00033.bin: 31%|▉ | 126M/405M [00:03<00:07, 37.6MB/s]
Downloading (…)l-00028-of-00033.bin: 34%|█ | 136M/405M [00:03<00:06, 40.6MB/s]
Downloading (…)l-00028-of-00033.bin: 36%|█ | 147M/405M [00:03<00:06, 41.0MB/s]
Downloading (…)l-00028-of-00033.bin: 39%|█▏ | 157M/405M [00:04<00:06, 41.2MB/s]
Downloading (…)l-00028-of-00033.bin: 41%|█▏ | 168M/405M [00:04<00:06, 34.0MB/s]
Downloading (…)l-00028-of-00033.bin: 44%|█▎ | 178M/405M [00:04<00:06, 37.4MB/s]
Downloading (…)l-00028-of-00033.bin: 47%|█▍ | 189M/405M [00:04<00:05, 39.2MB/s]
Downloading (…)l-00028-of-00033.bin: 49%|█▍ | 199M/405M [00:05<00:04, 41.5MB/s]
Downloading (…)l-00028-of-00033.bin: 52%|█▌ | 210M/405M [00:05<00:06, 31.8MB/s]
Downloading (…)l-00028-of-00033.bin: 54%|█▋ | 220M/405M [00:05<00:05, 36.5MB/s]
Downloading (…)l-00028-of-00033.bin: 57%|█▋ | 231M/405M [00:06<00:04, 36.5MB/s]
Downloading (…)l-00028-of-00033.bin: 60%|█▊ | 241M/405M [00:06<00:03, 41.0MB/s]
Downloading (…)l-00028-of-00033.bin: 62%|█▊ | 252M/405M [00:06<00:04, 36.9MB/s]
Downloading (…)l-00028-of-00033.bin: 65%|█▉ | 262M/405M [00:06<00:03, 41.2MB/s]
Downloading (…)l-00028-of-00033.bin: 67%|██ | 273M/405M [00:07<00:02, 45.4MB/s]
Downloading (…)l-00028-of-00033.bin: 70%|██ | 283M/405M [00:07<00:02, 44.1MB/s]
Downloading (…)l-00028-of-00033.bin: 73%|██▏| 294M/405M [00:07<00:03, 32.1MB/s]
Downloading (…)l-00028-of-00033.bin: 75%|██▎| 304M/405M [00:08<00:02, 35.6MB/s]
Downloading (…)l-00028-of-00033.bin: 78%|██▎| 315M/405M [00:08<00:02, 38.3MB/s]
Downloading (…)l-00028-of-00033.bin: 80%|██▍| 325M/405M [00:08<00:01, 41.1MB/s]
Downloading (…)l-00028-of-00033.bin: 83%|██▍| 336M/405M [00:08<00:01, 35.1MB/s]
Downloading (…)l-00028-of-00033.bin: 85%|██▌| 346M/405M [00:09<00:01, 37.5MB/s]
Downloading (…)l-00028-of-00033.bin: 88%|██▋| 357M/405M [00:09<00:01, 38.5MB/s]
Downloading (…)l-00028-of-00033.bin: 91%|██▋| 367M/405M [00:09<00:00, 43.0MB/s]
Downloading (…)l-00028-of-00033.bin: 93%|██▊| 377M/405M [00:10<00:00, 31.7MB/s]
Downloading (…)l-00028-of-00033.bin: 96%|██▉| 388M/405M [00:10<00:00, 34.9MB/s]
Downloading (…)l-00028-of-00033.bin: 98%|██▉| 398M/405M [00:10<00:00, 40.3MB/s]
Downloading (…)l-00028-of-00033.bin: 100%|███| 405M/405M [00:10<00:00, 38.1MB/s]
Downloading shards: 85%|███████████████████▌ | 28/33 [05:15<00:55, 11.11s/it]
Downloading (…)l-00029-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00029-of-00033.bin: 3%| | 10.5M/405M [00:00<00:09, 42.4MB/s]
Downloading (…)l-00029-of-00033.bin: 5%| | 21.0M/405M [00:00<00:07, 49.4MB/s]
Downloading (…)l-00029-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:06, 55.7MB/s]
Downloading (…)l-00029-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:06, 55.7MB/s]
Downloading (…)l-00029-of-00033.bin: 13%|▎ | 52.4M/405M [00:00<00:06, 54.4MB/s]
Downloading (…)l-00029-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:06, 56.6MB/s]
Downloading (…)l-00029-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:05, 56.1MB/s]
Downloading (…)l-00029-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:05, 57.7MB/s]
Downloading (…)l-00029-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:05, 57.0MB/s]
Downloading (…)l-00029-of-00033.bin: 26%|▊ | 105M/405M [00:01<00:05, 58.6MB/s]
Downloading (…)l-00029-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:04, 61.5MB/s]
Downloading (…)l-00029-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:05, 55.7MB/s]
Downloading (…)l-00029-of-00033.bin: 34%|█ | 136M/405M [00:02<00:05, 51.1MB/s]
Downloading (…)l-00029-of-00033.bin: 36%|█ | 147M/405M [00:02<00:04, 52.6MB/s]
Downloading (…)l-00029-of-00033.bin: 39%|█▏ | 157M/405M [00:02<00:04, 53.8MB/s]
Downloading (…)l-00029-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:04, 55.1MB/s]
Downloading (…)l-00029-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:04, 53.7MB/s]
Downloading (…)l-00029-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:04, 51.7MB/s]
Downloading (…)l-00029-of-00033.bin: 49%|█▍ | 199M/405M [00:03<00:03, 53.5MB/s]
Downloading (…)l-00029-of-00033.bin: 52%|█▌ | 210M/405M [00:03<00:04, 48.1MB/s]
Downloading (…)l-00029-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:03, 51.2MB/s]
Downloading (…)l-00029-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:03, 44.8MB/s]
Downloading (…)l-00029-of-00033.bin: 60%|█▊ | 241M/405M [00:04<00:03, 46.4MB/s]
Downloading (…)l-00029-of-00033.bin: 62%|█▊ | 252M/405M [00:04<00:03, 47.7MB/s]
Downloading (…)l-00029-of-00033.bin: 65%|█▉ | 262M/405M [00:04<00:02, 51.6MB/s]
Downloading (…)l-00029-of-00033.bin: 67%|██ | 273M/405M [00:05<00:02, 48.1MB/s]
Downloading (…)l-00029-of-00033.bin: 70%|██ | 283M/405M [00:05<00:02, 43.7MB/s]
Downloading (…)l-00029-of-00033.bin: 73%|██▏| 294M/405M [00:05<00:02, 43.3MB/s]
Downloading (…)l-00029-of-00033.bin: 75%|██▎| 304M/405M [00:05<00:02, 44.2MB/s]
Downloading (…)l-00029-of-00033.bin: 78%|██▎| 315M/405M [00:06<00:01, 47.2MB/s]
Downloading (…)l-00029-of-00033.bin: 80%|██▍| 325M/405M [00:06<00:01, 42.4MB/s]
Downloading (…)l-00029-of-00033.bin: 83%|██▍| 336M/405M [00:06<00:01, 45.6MB/s]
Downloading (…)l-00029-of-00033.bin: 85%|██▌| 346M/405M [00:06<00:01, 44.2MB/s]
Downloading (…)l-00029-of-00033.bin: 88%|██▋| 357M/405M [00:07<00:00, 48.6MB/s]
Downloading (…)l-00029-of-00033.bin: 91%|██▋| 367M/405M [00:07<00:00, 47.0MB/s]
Downloading (…)l-00029-of-00033.bin: 93%|██▊| 377M/405M [00:07<00:00, 50.1MB/s]
Downloading (…)l-00029-of-00033.bin: 96%|██▉| 388M/405M [00:07<00:00, 50.9MB/s]
Downloading (…)l-00029-of-00033.bin: 98%|██▉| 398M/405M [00:07<00:00, 52.7MB/s]
Downloading (…)l-00029-of-00033.bin: 100%|███| 405M/405M [00:08<00:00, 50.1MB/s]
Downloading shards: 88%|████████████████████▏ | 29/33 [05:23<00:41, 10.28s/it]
Downloading (…)l-00030-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00030-of-00033.bin: 3%| | 10.5M/405M [00:00<00:10, 39.3MB/s]
Downloading (…)l-00030-of-00033.bin: 5%| | 21.0M/405M [00:00<00:07, 51.5MB/s]
Downloading (…)l-00030-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:06, 55.6MB/s]
Downloading (…)l-00030-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:07, 49.6MB/s]
Downloading (…)l-00030-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:06, 52.1MB/s]
Downloading (…)l-00030-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:06, 52.0MB/s]
Downloading (…)l-00030-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:06, 53.6MB/s]
Downloading (…)l-00030-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:06, 48.4MB/s]
Downloading (…)l-00030-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:07, 42.0MB/s]
Downloading (…)l-00030-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:06, 44.4MB/s]
Downloading (…)l-00030-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:06, 46.3MB/s]
Downloading (…)l-00030-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:05, 50.6MB/s]
Downloading (…)l-00030-of-00033.bin: 34%|█ | 136M/405M [00:02<00:05, 53.0MB/s]
Downloading (…)l-00030-of-00033.bin: 36%|█ | 147M/405M [00:02<00:04, 54.3MB/s]
Downloading (…)l-00030-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:05, 46.5MB/s]
Downloading (…)l-00030-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:05, 43.1MB/s]
Downloading (…)l-00030-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:05, 39.6MB/s]
Downloading (…)l-00030-of-00033.bin: 47%|█▍ | 189M/405M [00:04<00:05, 39.5MB/s]
Downloading (…)l-00030-of-00033.bin: 49%|█▍ | 199M/405M [00:04<00:05, 39.5MB/s]
Downloading (…)l-00030-of-00033.bin: 52%|█▌ | 210M/405M [00:04<00:05, 37.3MB/s]
Downloading (…)l-00030-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:04, 41.4MB/s]
Downloading (…)l-00030-of-00033.bin: 57%|█▋ | 231M/405M [00:05<00:03, 45.2MB/s]
Downloading (…)l-00030-of-00033.bin: 60%|█▊ | 241M/405M [00:05<00:03, 48.0MB/s]
Downloading (…)l-00030-of-00033.bin: 62%|█▊ | 252M/405M [00:05<00:03, 45.7MB/s]
Downloading (…)l-00030-of-00033.bin: 65%|█▉ | 262M/405M [00:05<00:03, 47.5MB/s]
Downloading (…)l-00030-of-00033.bin: 67%|██ | 273M/405M [00:05<00:02, 49.2MB/s]
Downloading (…)l-00030-of-00033.bin: 70%|██ | 283M/405M [00:06<00:02, 48.3MB/s]
Downloading (…)l-00030-of-00033.bin: 73%|██▏| 294M/405M [00:06<00:02, 47.7MB/s]
Downloading (…)l-00030-of-00033.bin: 75%|██▎| 304M/405M [00:06<00:02, 45.7MB/s]
Downloading (…)l-00030-of-00033.bin: 78%|██▎| 315M/405M [00:06<00:02, 45.0MB/s]
Downloading (…)l-00030-of-00033.bin: 80%|██▍| 325M/405M [00:07<00:01, 47.5MB/s]
Downloading (…)l-00030-of-00033.bin: 83%|██▍| 336M/405M [00:07<00:01, 47.4MB/s]
Downloading (…)l-00030-of-00033.bin: 85%|██▌| 346M/405M [00:07<00:01, 50.2MB/s]
Downloading (…)l-00030-of-00033.bin: 88%|██▋| 357M/405M [00:07<00:01, 47.8MB/s]
Downloading (…)l-00030-of-00033.bin: 91%|██▋| 367M/405M [00:07<00:00, 46.7MB/s]
Downloading (…)l-00030-of-00033.bin: 93%|██▊| 377M/405M [00:08<00:00, 49.1MB/s]
Downloading (…)l-00030-of-00033.bin: 96%|██▉| 388M/405M [00:08<00:00, 49.4MB/s]
Downloading (…)l-00030-of-00033.bin: 98%|██▉| 398M/405M [00:08<00:00, 50.4MB/s]
Downloading (…)l-00030-of-00033.bin: 100%|███| 405M/405M [00:08<00:00, 46.9MB/s]
Downloading shards: 91%|████████████████████▉ | 30/33 [05:32<00:29, 9.87s/it]
Downloading (…)l-00031-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00031-of-00033.bin: 3%| | 10.5M/405M [00:00<00:18, 21.5MB/s]
Downloading (…)l-00031-of-00033.bin: 5%| | 21.0M/405M [00:00<00:16, 23.2MB/s]
Downloading (…)l-00031-of-00033.bin: 8%|▏ | 31.5M/405M [00:01<00:15, 24.7MB/s]
Downloading (…)l-00031-of-00033.bin: 10%|▏ | 41.9M/405M [00:01<00:15, 23.2MB/s]
Downloading (…)l-00031-of-00033.bin: 13%|▎ | 52.4M/405M [00:02<00:15, 23.3MB/s]
Downloading (…)l-00031-of-00033.bin: 16%|▎ | 62.9M/405M [00:02<00:14, 23.6MB/s]
Downloading (…)l-00031-of-00033.bin: 18%|▎ | 73.4M/405M [00:03<00:13, 23.7MB/s]
Downloading (…)l-00031-of-00033.bin: 21%|▍ | 83.9M/405M [00:03<00:14, 22.1MB/s]
Downloading (…)l-00031-of-00033.bin: 23%|▍ | 94.4M/405M [00:04<00:13, 22.9MB/s]
Downloading (…)l-00031-of-00033.bin: 26%|▊ | 105M/405M [00:04<00:12, 23.6MB/s]
Downloading (…)l-00031-of-00033.bin: 28%|▊ | 115M/405M [00:04<00:12, 23.4MB/s]
Downloading (…)l-00031-of-00033.bin: 31%|▉ | 126M/405M [00:05<00:12, 21.9MB/s]
Downloading (…)l-00031-of-00033.bin: 34%|█ | 136M/405M [00:05<00:11, 23.6MB/s]
Downloading (…)l-00031-of-00033.bin: 36%|█ | 147M/405M [00:06<00:10, 24.8MB/s]
Downloading (…)l-00031-of-00033.bin: 39%|█▏ | 157M/405M [00:06<00:09, 26.4MB/s]
Downloading (…)l-00031-of-00033.bin: 41%|█▏ | 168M/405M [00:07<00:09, 25.6MB/s]
Downloading (…)l-00031-of-00033.bin: 44%|█▎ | 178M/405M [00:07<00:08, 27.6MB/s]
Downloading (…)l-00031-of-00033.bin: 47%|█▍ | 189M/405M [00:07<00:08, 25.8MB/s]
Downloading (…)l-00031-of-00033.bin: 49%|█▍ | 199M/405M [00:08<00:08, 23.9MB/s]
Downloading (…)l-00031-of-00033.bin: 52%|█▌ | 210M/405M [00:08<00:08, 23.8MB/s]
Downloading (…)l-00031-of-00033.bin: 54%|█▋ | 220M/405M [00:09<00:08, 22.4MB/s]
Downloading (…)l-00031-of-00033.bin: 57%|█▋ | 231M/405M [00:09<00:07, 24.3MB/s]
Downloading (…)l-00031-of-00033.bin: 60%|█▊ | 241M/405M [00:09<00:06, 27.0MB/s]
Downloading (…)l-00031-of-00033.bin: 62%|█▊ | 252M/405M [00:10<00:06, 25.4MB/s]
Downloading (…)l-00031-of-00033.bin: 65%|█▉ | 262M/405M [00:10<00:05, 28.3MB/s]
Downloading (…)l-00031-of-00033.bin: 67%|██ | 273M/405M [00:11<00:04, 28.2MB/s]
Downloading (…)l-00031-of-00033.bin: 70%|██ | 283M/405M [00:11<00:04, 27.2MB/s]
Downloading (…)l-00031-of-00033.bin: 73%|██▏| 294M/405M [00:11<00:04, 25.0MB/s]
Downloading (…)l-00031-of-00033.bin: 75%|██▎| 304M/405M [00:12<00:04, 23.6MB/s]
Downloading (…)l-00031-of-00033.bin: 78%|██▎| 315M/405M [00:13<00:04, 21.3MB/s]
Downloading (…)l-00031-of-00033.bin: 80%|██▍| 325M/405M [00:13<00:03, 21.3MB/s]
Downloading (…)l-00031-of-00033.bin: 83%|██▍| 336M/405M [00:14<00:03, 20.9MB/s]
Downloading (…)l-00031-of-00033.bin: 85%|██▌| 346M/405M [00:14<00:02, 21.6MB/s]
Downloading (…)l-00031-of-00033.bin: 88%|██▋| 357M/405M [00:14<00:02, 22.6MB/s]
Downloading (…)l-00031-of-00033.bin: 91%|██▋| 367M/405M [00:15<00:01, 21.5MB/s]
Downloading (…)l-00031-of-00033.bin: 93%|██▊| 377M/405M [00:16<00:01, 20.6MB/s]
Downloading (…)l-00031-of-00033.bin: 96%|██▉| 388M/405M [00:16<00:00, 21.2MB/s]
Downloading (…)l-00031-of-00033.bin: 98%|██▉| 398M/405M [00:16<00:00, 22.2MB/s]
Downloading (…)l-00031-of-00033.bin: 100%|███| 405M/405M [00:17<00:00, 23.6MB/s]
Downloading shards: 94%|█████████████████████▌ | 31/33 [05:50<00:24, 12.13s/it]
Downloading (…)l-00032-of-00033.bin: 0%| | 0.00/405M [00:00<?, ?B/s]
Downloading (…)l-00032-of-00033.bin: 3%| | 10.5M/405M [00:00<00:09, 43.4MB/s]
Downloading (…)l-00032-of-00033.bin: 5%| | 21.0M/405M [00:00<00:08, 43.2MB/s]
Downloading (…)l-00032-of-00033.bin: 8%|▏ | 31.5M/405M [00:00<00:08, 44.7MB/s]
Downloading (…)l-00032-of-00033.bin: 10%|▏ | 41.9M/405M [00:00<00:07, 47.6MB/s]
Downloading (…)l-00032-of-00033.bin: 13%|▎ | 52.4M/405M [00:01<00:07, 45.3MB/s]
Downloading (…)l-00032-of-00033.bin: 16%|▎ | 62.9M/405M [00:01<00:07, 47.3MB/s]
Downloading (…)l-00032-of-00033.bin: 18%|▎ | 73.4M/405M [00:01<00:06, 47.4MB/s]
Downloading (…)l-00032-of-00033.bin: 21%|▍ | 83.9M/405M [00:01<00:06, 49.3MB/s]
Downloading (…)l-00032-of-00033.bin: 23%|▍ | 94.4M/405M [00:01<00:06, 49.9MB/s]
Downloading (…)l-00032-of-00033.bin: 26%|▊ | 105M/405M [00:02<00:05, 53.2MB/s]
Downloading (…)l-00032-of-00033.bin: 28%|▊ | 115M/405M [00:02<00:05, 54.6MB/s]
Downloading (…)l-00032-of-00033.bin: 31%|▉ | 126M/405M [00:02<00:05, 55.8MB/s]
Downloading (…)l-00032-of-00033.bin: 34%|█ | 136M/405M [00:02<00:05, 49.3MB/s]
Downloading (…)l-00032-of-00033.bin: 36%|█ | 147M/405M [00:03<00:05, 48.5MB/s]
Downloading (…)l-00032-of-00033.bin: 39%|█▏ | 157M/405M [00:03<00:05, 47.9MB/s]
Downloading (…)l-00032-of-00033.bin: 41%|█▏ | 168M/405M [00:03<00:04, 50.6MB/s]
Downloading (…)l-00032-of-00033.bin: 44%|█▎ | 178M/405M [00:03<00:04, 50.4MB/s]
Downloading (…)l-00032-of-00033.bin: 47%|█▍ | 189M/405M [00:03<00:04, 47.9MB/s]
Downloading (…)l-00032-of-00033.bin: 49%|█▍ | 199M/405M [00:04<00:04, 46.5MB/s]
Downloading (…)l-00032-of-00033.bin: 52%|█▌ | 210M/405M [00:04<00:03, 49.2MB/s]
Downloading (…)l-00032-of-00033.bin: 54%|█▋ | 220M/405M [00:04<00:03, 50.5MB/s]
Downloading (…)l-00032-of-00033.bin: 57%|█▋ | 231M/405M [00:04<00:03, 52.2MB/s]
Downloading (…)l-00032-of-00033.bin: 60%|█▊ | 241M/405M [00:04<00:03, 51.1MB/s]
Downloading (…)l-00032-of-00033.bin: 62%|█▊ | 252M/405M [00:05<00:02, 51.6MB/s]
Downloading (…)l-00032-of-00033.bin: 65%|█▉ | 262M/405M [00:05<00:03, 46.9MB/s]
Downloading (…)l-00032-of-00033.bin: 67%|██ | 273M/405M [00:05<00:02, 50.3MB/s]
Downloading (…)l-00032-of-00033.bin: 70%|██ | 283M/405M [00:05<00:02, 49.5MB/s]
Downloading (…)l-00032-of-00033.bin: 73%|██▏| 294M/405M [00:05<00:02, 49.5MB/s]
Downloading (…)l-00032-of-00033.bin: 75%|██▎| 304M/405M [00:06<00:02, 49.1MB/s]
Downloading (…)l-00032-of-00033.bin: 78%|██▎| 315M/405M [00:06<00:01, 47.5MB/s]
Downloading (…)l-00032-of-00033.bin: 80%|██▍| 325M/405M [00:06<00:01, 51.8MB/s]
Downloading (…)l-00032-of-00033.bin: 83%|██▍| 336M/405M [00:06<00:01, 53.8MB/s]
Downloading (…)l-00032-of-00033.bin: 85%|██▌| 346M/405M [00:07<00:01, 49.4MB/s]
Downloading (…)l-00032-of-00033.bin: 88%|██▋| 357M/405M [00:07<00:01, 45.9MB/s]
Downloading (…)l-00032-of-00033.bin: 91%|██▋| 367M/405M [00:07<00:00, 46.6MB/s]
Downloading (…)l-00032-of-00033.bin: 93%|██▊| 377M/405M [00:07<00:00, 48.8MB/s]
Downloading (…)l-00032-of-00033.bin: 96%|██▉| 388M/405M [00:07<00:00, 44.4MB/s]
Downloading (…)l-00032-of-00033.bin: 98%|██▉| 398M/405M [00:08<00:00, 45.8MB/s]
Downloading (…)l-00032-of-00033.bin: 100%|███| 405M/405M [00:08<00:00, 48.6MB/s]
Downloading shards: 97%|██████████████████████▎| 32/33 [05:58<00:11, 11.11s/it]
Downloading (…)l-00033-of-00033.bin: 0%| | 0.00/524M [00:00<?, ?B/s]
Downloading (…)l-00033-of-00033.bin: 2%| | 10.5M/524M [00:00<00:08, 57.4MB/s]
Downloading (…)l-00033-of-00033.bin: 4%| | 21.0M/524M [00:00<00:07, 63.8MB/s]
Downloading (…)l-00033-of-00033.bin: 6%| | 31.5M/524M [00:00<00:08, 60.9MB/s]
Downloading (…)l-00033-of-00033.bin: 8%|▏ | 41.9M/524M [00:00<00:08, 56.1MB/s]
Downloading (…)l-00033-of-00033.bin: 10%|▏ | 52.4M/524M [00:00<00:08, 58.8MB/s]
Downloading (…)l-00033-of-00033.bin: 12%|▏ | 62.9M/524M [00:01<00:07, 59.9MB/s]
Downloading (…)l-00033-of-00033.bin: 14%|▎ | 73.4M/524M [00:01<00:07, 60.3MB/s]
Downloading (…)l-00033-of-00033.bin: 16%|▎ | 83.9M/524M [00:01<00:06, 63.4MB/s]
Downloading (…)l-00033-of-00033.bin: 18%|▎ | 94.4M/524M [00:01<00:06, 65.5MB/s]
Downloading (…)l-00033-of-00033.bin: 20%|▌ | 105M/524M [00:01<00:06, 66.6MB/s]
Downloading (…)l-00033-of-00033.bin: 22%|▋ | 115M/524M [00:01<00:06, 66.7MB/s]
Downloading (…)l-00033-of-00033.bin: 24%|▋ | 126M/524M [00:01<00:06, 66.2MB/s]
Downloading (…)l-00033-of-00033.bin: 26%|▊ | 136M/524M [00:02<00:05, 67.6MB/s]
Downloading (…)l-00033-of-00033.bin: 28%|▊ | 147M/524M [00:02<00:05, 63.7MB/s]
Downloading (…)l-00033-of-00033.bin: 30%|▉ | 157M/524M [00:02<00:05, 65.4MB/s]
Downloading (…)l-00033-of-00033.bin: 32%|▉ | 168M/524M [00:02<00:06, 58.5MB/s]
Downloading (…)l-00033-of-00033.bin: 34%|█ | 178M/524M [00:02<00:05, 58.5MB/s]
Downloading (…)l-00033-of-00033.bin: 36%|█ | 189M/524M [00:03<00:05, 57.6MB/s]
Downloading (…)l-00033-of-00033.bin: 38%|█▏ | 199M/524M [00:03<00:05, 55.8MB/s]
Downloading (…)l-00033-of-00033.bin: 40%|█▏ | 210M/524M [00:03<00:05, 59.7MB/s]
Downloading (…)l-00033-of-00033.bin: 42%|█▎ | 220M/524M [00:03<00:05, 59.1MB/s]
Downloading (…)l-00033-of-00033.bin: 44%|█▎ | 231M/524M [00:03<00:04, 61.8MB/s]
Downloading (…)l-00033-of-00033.bin: 46%|█▍ | 241M/524M [00:03<00:04, 59.7MB/s]
Downloading (…)l-00033-of-00033.bin: 48%|█▍ | 252M/524M [00:04<00:05, 52.4MB/s]
Downloading (…)l-00033-of-00033.bin: 50%|█▍ | 262M/524M [00:04<00:04, 55.8MB/s]
Downloading (…)l-00033-of-00033.bin: 52%|█▌ | 273M/524M [00:04<00:04, 59.6MB/s]
Downloading (…)l-00033-of-00033.bin: 54%|█▌ | 283M/524M [00:04<00:04, 55.6MB/s]
Downloading (…)l-00033-of-00033.bin: 56%|█▋ | 294M/524M [00:04<00:04, 54.8MB/s]
Downloading (…)l-00033-of-00033.bin: 58%|█▋ | 304M/524M [00:05<00:03, 58.3MB/s]
Downloading (…)l-00033-of-00033.bin: 60%|█▊ | 315M/524M [00:05<00:03, 59.9MB/s]
Downloading (…)l-00033-of-00033.bin: 62%|█▊ | 325M/524M [00:05<00:03, 61.3MB/s]
Downloading (…)l-00033-of-00033.bin: 64%|█▉ | 336M/524M [00:05<00:02, 64.2MB/s]
Downloading (…)l-00033-of-00033.bin: 66%|█▉ | 346M/524M [00:05<00:03, 59.4MB/s]
Downloading (…)l-00033-of-00033.bin: 68%|██ | 357M/524M [00:05<00:03, 54.9MB/s]
Downloading (…)l-00033-of-00033.bin: 70%|██ | 367M/524M [00:06<00:02, 56.4MB/s]
Downloading (…)l-00033-of-00033.bin: 72%|██▏| 377M/524M [00:06<00:02, 57.5MB/s]
Downloading (…)l-00033-of-00033.bin: 74%|██▏| 388M/524M [00:06<00:02, 58.6MB/s]
Downloading (…)l-00033-of-00033.bin: 76%|██▎| 398M/524M [00:06<00:02, 60.7MB/s]
Downloading (…)l-00033-of-00033.bin: 78%|██▎| 409M/524M [00:06<00:02, 54.0MB/s]
Downloading (…)l-00033-of-00033.bin: 80%|██▍| 419M/524M [00:07<00:01, 57.4MB/s]
Downloading (…)l-00033-of-00033.bin: 82%|██▍| 430M/524M [00:07<00:01, 58.4MB/s]
Downloading (…)l-00033-of-00033.bin: 84%|██▌| 440M/524M [00:07<00:01, 60.0MB/s]
Downloading (…)l-00033-of-00033.bin: 86%|██▌| 451M/524M [00:07<00:01, 63.8MB/s]
Downloading (…)l-00033-of-00033.bin: 88%|██▋| 461M/524M [00:07<00:00, 66.6MB/s]
Downloading (…)l-00033-of-00033.bin: 90%|██▋| 472M/524M [00:07<00:00, 63.7MB/s]
Downloading (…)l-00033-of-00033.bin: 92%|██▊| 482M/524M [00:08<00:00, 60.2MB/s]
Downloading (…)l-00033-of-00033.bin: 94%|██▊| 493M/524M [00:08<00:00, 61.3MB/s]
Downloading (…)l-00033-of-00033.bin: 96%|██▉| 503M/524M [00:08<00:00, 58.0MB/s]
Downloading (…)l-00033-of-00033.bin: 98%|██▉| 514M/524M [00:08<00:00, 53.8MB/s]
Downloading (…)l-00033-of-00033.bin: 100%|███| 524M/524M [00:08<00:00, 59.4MB/s]
Downloading shards: 100%|███████████████████████| 33/33 [06:07<00:00, 11.15s/it]
Loading checkpoint shards: 100%|████████████████| 33/33 [00:10<00:00, 3.19it/s]
Downloading (…)neration_config.json: 100%|█████| 124/124 [00:00<00:00, 55.4kB/s]
Downloading tokenizer.model: 100%|███████████| 500k/500k [00:00<00:00, 9.27MB/s]
Downloading (…)cial_tokens_map.json: 100%|█████| 2.00/2.00 [00:00<00:00, 886B/s]
Downloading (…)okenizer_config.json: 100%|█████| 141/141 [00:00<00:00, 62.4kB/s]
The tokenizer class you load from this checkpoint is not the same type as the class this function is called from. It may result in unexpected tokenization.
The tokenizer class you load from this checkpoint is 'LLaMATokenizer'.
The class this function is called from is 'LlamaTokenizer'.
trainable params: 4194304 || all params: 6742609920 || trainable%: 0.06220594176090199
***** Running training *****
Num Epochs = 1
Instantaneous batch size per GPU = 4
Gradient Accumulation steps = 32
Total train batch size (w. parallel, distributed & accumulation) = 128
Total optimization steps = 390
Saving steps = 39
/usr/local/lib/python3.10/dist-packages/transformers/optimization.py:391: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning
warnings.warn(
{'loss': 1.4186, 'learning_rate': 0.00015384615384615382, 'epoch': 0.05}
10%|████ | 39/390 [19:02<2:53:28, 29.65s/it]
0%| | 0/250 [00:00<?, ?it/s]
1%|▎ | 2/250 [00:00<00:44, 5.59it/s]
1%|▌ | 3/250 [00:01<01:32, 2.67it/s]
2%|▋ | 4/250 [00:01<01:35, 2.57it/s]
2%|▊ | 5/250 [00:01<01:48, 2.27it/s]
2%|█ | 6/250 [00:02<01:43, 2.35it/s]
3%|█▏ | 7/250 [00:02<01:41, 2.40it/s]
3%|█▍ | 8/250 [00:03<01:35, 2.53it/s]
4%|█▌ | 9/250 [00:03<01:45, 2.29it/s]
4%|█▋ | 10/250 [00:04<01:55, 2.08it/s]
4%|█▊ | 11/250 [00:04<02:05, 1.91it/s]
5%|██ | 12/250 [00:05<02:08, 1.86it/s]
5%|██▏ | 13/250 [00:05<02:07, 1.86it/s]
6%|██▎ | 14/250 [00:06<02:03, 1.91it/s]
6%|██▌ | 15/250 [00:07<02:28, 1.58it/s]
6%|██▋ | 16/250 [00:07<02:12, 1.77it/s]
7%|██▊ | 17/250 [00:08<01:58, 1.96it/s]
7%|███ | 18/250 [00:08<01:47, 2.16it/s]
8%|███▏ | 19/250 [00:08<01:41, 2.27it/s]
8%|███▎ | 20/250 [00:09<02:03, 1.87it/s]
8%|███▌ | 21/250 [00:10<01:58, 1.94it/s]
9%|███▋ | 22/250 [00:10<01:50, 2.06it/s]
9%|███▊ | 23/250 [00:10<01:40, 2.26it/s]
10%|████ | 24/250 [00:11<01:37, 2.31it/s]
10%|████▏ | 25/250 [00:11<01:31, 2.45it/s]
10%|████▎ | 26/250 [00:12<01:41, 2.21it/s]
11%|████▌ | 27/250 [00:12<01:33, 2.38it/s]
11%|████▋ | 28/250 [00:12<01:37, 2.28it/s]
12%|████▊ | 29/250 [00:13<02:00, 1.84it/s]
12%|█████ | 30/250 [00:14<01:47, 2.04it/s]
12%|█████▏ | 31/250 [00:14<01:39, 2.20it/s]
13%|█████▍ | 32/250 [00:14<01:28, 2.46it/s]
13%|█████▌ | 33/250 [00:15<01:28, 2.45it/s]
14%|█████▋ | 34/250 [00:15<01:28, 2.45it/s]
14%|█████▉ | 35/250 [00:15<01:22, 2.62it/s]
14%|██████ | 36/250 [00:16<01:26, 2.46it/s]
15%|██████▏ | 37/250 [00:16<01:33, 2.27it/s]
15%|██████▍ | 38/250 [00:17<01:27, 2.43it/s]
16%|██████▌ | 39/250 [00:17<01:22, 2.54it/s]
16%|██████▋ | 40/250 [00:18<01:33, 2.25it/s]
16%|██████▉ | 41/250 [00:18<01:29, 2.33it/s]
17%|███████ | 42/250 [00:19<01:57, 1.77it/s]
17%|███████▏ | 43/250 [00:19<01:51, 1.85it/s]
18%|███████▍ | 44/250 [00:20<01:41, 2.04it/s]
18%|███████▌ | 45/250 [00:20<01:35, 2.14it/s]
18%|███████▋ | 46/250 [00:21<01:33, 2.18it/s]
19%|███████▉ | 47/250 [00:21<01:30, 2.24it/s]
19%|████████ | 48/250 [00:21<01:27, 2.31it/s]
20%|████████▏ | 49/250 [00:22<01:23, 2.41it/s]
20%|████████▍ | 50/250 [00:22<01:23, 2.38it/s]
20%|████████▌ | 51/250 [00:23<01:19, 2.52it/s]
21%|████████▋ | 52/250 [00:23<01:15, 2.61it/s]
21%|████████▉ | 53/250 [00:23<01:16, 2.58it/s]
22%|█████████ | 54/250 [00:24<01:19, 2.47it/s]
22%|█████████▏ | 55/250 [00:24<01:17, 2.52it/s]
22%|█████████▍ | 56/250 [00:25<01:13, 2.63it/s]
23%|█████████▌ | 57/250 [00:25<01:17, 2.49it/s]
23%|█████████▋ | 58/250 [00:25<01:14, 2.57it/s]
24%|█████████▉ | 59/250 [00:26<01:15, 2.51it/s]
24%|██████████ | 60/250 [00:26<01:16, 2.49it/s]
24%|██████████▏ | 61/250 [00:27<01:13, 2.59it/s]
25%|██████████▍ | 62/250 [00:27<01:22, 2.28it/s]
25%|██████████▌ | 63/250 [00:27<01:17, 2.42it/s]
26%|██████████▊ | 64/250 [00:28<01:22, 2.25it/s]
26%|██████████▉ | 65/250 [00:28<01:16, 2.41it/s]
26%|███████████ | 66/250 [00:29<01:11, 2.58it/s]
27%|███████████▎ | 67/250 [00:29<01:09, 2.63it/s]
27%|███████████▍ | 68/250 [00:29<01:12, 2.51it/s]
28%|███████████▌ | 69/250 [00:30<01:08, 2.64it/s]
28%|███████████▊ | 70/250 [00:30<01:03, 2.82it/s]
28%|███████████▉ | 71/250 [00:31<01:14, 2.40it/s]
29%|████████████ | 72/250 [00:31<01:11, 2.48it/s]
29%|████████████▎ | 73/250 [00:31<01:10, 2.52it/s]
30%|████████████▍ | 74/250 [00:32<01:08, 2.56it/s]
30%|████████████▌ | 75/250 [00:32<01:17, 2.27it/s]
30%|████████████▊ | 76/250 [00:33<01:18, 2.23it/s]
31%|████████████▉ | 77/250 [00:33<01:19, 2.17it/s]
31%|█████████████ | 78/250 [00:34<01:16, 2.25it/s]
32%|█████████████▎ | 79/250 [00:34<01:21, 2.09it/s]
32%|█████████████▍ | 80/250 [00:35<01:14, 2.28it/s]
32%|█████████████▌ | 81/250 [00:35<01:20, 2.11it/s]
33%|█████████████▊ | 82/250 [00:36<01:15, 2.22it/s]
33%|█████████████▉ | 83/250 [00:36<01:10, 2.37it/s]
34%|██████████████ | 84/250 [00:37<01:19, 2.09it/s]
34%|██████████████▎ | 85/250 [00:37<01:14, 2.22it/s]
34%|██████████████▍ | 86/250 [00:37<01:19, 2.07it/s]
35%|██████████████▌ | 87/250 [00:38<01:12, 2.24it/s]
35%|██████████████▊ | 88/250 [00:38<01:15, 2.14it/s]
36%|██████████████▉ | 89/250 [00:39<01:22, 1.96it/s]
36%|███████████████ | 90/250 [00:40<01:24, 1.89it/s]
36%|███████████████▎ | 91/250 [00:40<01:21, 1.94it/s]
37%|███████████████▍ | 92/250 [00:40<01:19, 1.99it/s]
37%|███████████████▌ | 93/250 [00:41<01:14, 2.11it/s]
38%|███████████████▊ | 94/250 [00:41<01:11, 2.18it/s]
38%|███████████████▉ | 95/250 [00:42<01:11, 2.18it/s]
38%|████████████████▏ | 96/250 [00:42<01:07, 2.28it/s]
39%|████████████████▎ | 97/250 [00:42<01:02, 2.45it/s]
39%|████████████████▍ | 98/250 [00:43<01:07, 2.25it/s]
40%|████████████████▋ | 99/250 [00:44<01:11, 2.11it/s]
40%|████████████████▍ | 100/250 [00:44<01:29, 1.67it/s]
40%|████████████████▌ | 101/250 [00:45<01:26, 1.72it/s]
41%|████████████████▋ | 102/250 [00:45<01:15, 1.95it/s]
41%|████████████████▉ | 103/250 [00:46<01:11, 2.07it/s]
42%|█████████████████ | 104/250 [00:46<01:07, 2.17it/s]
42%|█████████████████▏ | 105/250 [00:47<01:02, 2.33it/s]
42%|█████████████████▍ | 106/250 [00:47<00:59, 2.43it/s]
43%|█████████████████▌ | 107/250 [00:47<00:58, 2.46it/s]
43%|█████████████████▋ | 108/250 [00:48<01:06, 2.13it/s]
44%|█████████████████▉ | 109/250 [00:48<00:59, 2.35it/s]
44%|██████████████████ | 110/250 [00:49<01:06, 2.11it/s]
44%|██████████████████▏ | 111/250 [00:49<01:01, 2.25it/s]
45%|██████████████████▎ | 112/250 [00:50<01:13, 1.87it/s]
45%|██████████████████▌ | 113/250 [00:50<01:06, 2.07it/s]
46%|██████████████████▋ | 114/250 [00:51<00:57, 2.35it/s]
46%|██████████████████▊ | 115/250 [00:51<01:07, 1.99it/s]
46%|███████████████████ | 116/250 [00:52<00:59, 2.25it/s]
47%|███████████████████▏ | 117/250 [00:52<00:53, 2.47it/s]
47%|███████████████████▎ | 118/250 [00:52<00:54, 2.41it/s]
48%|███████████████████▌ | 119/250 [00:53<00:54, 2.41it/s]
48%|███████████████████▋ | 120/250 [00:53<00:58, 2.21it/s]
48%|███████████████████▊ | 121/250 [00:54<00:57, 2.26it/s]
49%|████████████████████ | 122/250 [00:54<00:54, 2.34it/s]
49%|████████████████████▏ | 123/250 [00:54<00:53, 2.37it/s]
50%|████████████████████▎ | 124/250 [00:55<00:51, 2.46it/s]
50%|████████████████████▌ | 125/250 [00:55<00:48, 2.60it/s]
50%|████████████████████▋ | 126/250 [00:56<00:48, 2.55it/s]
51%|████████████████████▊ | 127/250 [00:56<00:46, 2.66it/s]
51%|████████████████████▉ | 128/250 [00:56<00:43, 2.80it/s]
52%|█████████████████████▏ | 129/250 [00:57<00:41, 2.89it/s]
52%|█████████████████████▎ | 130/250 [00:57<00:41, 2.86it/s]
52%|█████████████████████▍ | 131/250 [00:57<00:43, 2.76it/s]
53%|█████████████████████▋ | 132/250 [00:58<00:44, 2.65it/s]
53%|█████████████████████▊ | 133/250 [00:58<00:45, 2.58it/s]
54%|█████████████████████▉ | 134/250 [00:59<00:43, 2.66it/s]
54%|██████████████████████▏ | 135/250 [00:59<00:41, 2.80it/s]
54%|██████████████████████▎ | 136/250 [00:59<00:44, 2.56it/s]
55%|██████████████████████▍ | 137/250 [01:00<00:42, 2.64it/s]
55%|██████████████████████▋ | 138/250 [01:00<00:42, 2.65it/s]
56%|██████████████████████▊ | 139/250 [01:01<00:58, 1.89it/s]
56%|██████████████████████▉ | 140/250 [01:02<01:10, 1.57it/s]
56%|███████████████████████ | 141/250 [01:02<01:07, 1.62it/s]
57%|███████████████████████▎ | 142/250 [01:03<01:09, 1.56it/s]
57%|███████████████████████▍ | 143/250 [01:04<01:02, 1.71it/s]
58%|███████████████████████▌ | 144/250 [01:04<01:06, 1.60it/s]
58%|███████████████████████▊ | 145/250 [01:05<01:09, 1.50it/s]
58%|███████████████████████▉ | 146/250 [01:05<01:03, 1.64it/s]
59%|████████████████████████ | 147/250 [01:06<00:57, 1.79it/s]
59%|████████████████████████▎ | 148/250 [01:06<00:53, 1.89it/s]
60%|████████████████████████▍ | 149/250 [01:07<00:47, 2.12it/s]
60%|████████████████████████▌ | 150/250 [01:07<00:43, 2.32it/s]
60%|████████████████████████▊ | 151/250 [01:07<00:40, 2.42it/s]
61%|████████████████████████▉ | 152/250 [01:08<00:38, 2.57it/s]
61%|█████████████████████████ | 153/250 [01:08<00:36, 2.65it/s]
62%|█████████████████████████▎ | 154/250 [01:09<00:47, 2.04it/s]
62%|█████████████████████████▍ | 155/250 [01:09<00:43, 2.18it/s]
62%|█████████████████████████▌ | 156/250 [01:10<00:46, 2.01it/s]
63%|█████████████████████████▋ | 157/250 [01:10<00:42, 2.19it/s]
63%|█████████████████████████▉ | 158/250 [01:11<00:39, 2.34it/s]
64%|██████████████████████████ | 159/250 [01:11<00:36, 2.46it/s]
64%|██████████████████████████▏ | 160/250 [01:11<00:35, 2.55it/s]
64%|██████████████████████████▍ | 161/250 [01:12<00:32, 2.71it/s]
65%|██████████████████████████▌ | 162/250 [01:12<00:33, 2.66it/s]
65%|██████████████████████████▋ | 163/250 [01:12<00:32, 2.72it/s]
66%|██████████████████████████▉ | 164/250 [01:13<00:29, 2.90it/s]
66%|███████████████████████████ | 165/250 [01:13<00:35, 2.38it/s]
66%|███████████████████████████▏ | 166/250 [01:14<00:34, 2.47it/s]
67%|███████████████████████████▍ | 167/250 [01:14<00:32, 2.52it/s]
67%|███████████████████████████▌ | 168/250 [01:14<00:33, 2.48it/s]
68%|███████████████████████████▋ | 169/250 [01:15<00:30, 2.68it/s]
68%|███████████████████████████▉ | 170/250 [01:15<00:30, 2.59it/s]
68%|████████████████████████████ | 171/250 [01:15<00:29, 2.70it/s]
69%|████████████████████████████▏ | 172/250 [01:16<00:29, 2.63it/s]
69%|████████████████████████████▎ | 173/250 [01:16<00:27, 2.76it/s]
70%|████████████████████████████▌ | 174/250 [01:16<00:26, 2.83it/s]
70%|████████████████████████████▋ | 175/250 [01:17<00:27, 2.75it/s]
70%|████████████████████████████▊ | 176/250 [01:17<00:26, 2.75it/s]
71%|█████████████████████████████ | 177/250 [01:18<00:31, 2.30it/s]
71%|█████████████████████████████▏ | 178/250 [01:18<00:30, 2.40it/s]
72%|█████████████████████████████▎ | 179/250 [01:19<00:27, 2.61it/s]
72%|█████████████████████████████▌ | 180/250 [01:19<00:27, 2.58it/s]
72%|█████████████████████████████▋ | 181/250 [01:19<00:26, 2.56it/s]
73%|█████████████████████████████▊ | 182/250 [01:20<00:25, 2.66it/s]
73%|██████████████████████████████ | 183/250 [01:20<00:26, 2.49it/s]
74%|██████████████████████████████▏ | 184/250 [01:21<00:27, 2.40it/s]
74%|██████████████████████████████▎ | 185/250 [01:21<00:25, 2.52it/s]
74%|██████████████████████████████▌ | 186/250 [01:21<00:24, 2.65it/s]
75%|██████████████████████████████▋ | 187/250 [01:22<00:23, 2.74it/s]
75%|██████████████████████████████▊ | 188/250 [01:22<00:27, 2.26it/s]
76%|██████████████████████████████▉ | 189/250 [01:23<00:25, 2.40it/s]
76%|███████████████████████████████▏ | 190/250 [01:23<00:23, 2.52it/s]
76%|███████████████████████████████▎ | 191/250 [01:23<00:23, 2.50it/s]
77%|███████████████████████████████▍ | 192/250 [01:24<00:23, 2.43it/s]
77%|███████████████████████████████▋ | 193/250 [01:24<00:22, 2.49it/s]
78%|███████████████████████████████▊ | 194/250 [01:25<00:22, 2.54it/s]
78%|███████████████████████████████▉ | 195/250 [01:25<00:21, 2.55it/s]
78%|████████████████████████████████▏ | 196/250 [01:25<00:20, 2.58it/s]
79%|████████████████████████████████▎ | 197/250 [01:26<00:19, 2.75it/s]
79%|████████████████████████████████▍ | 198/250 [01:26<00:19, 2.68it/s]
80%|████████████████████████████████▋ | 199/250 [01:26<00:18, 2.73it/s]
80%|████████████████████████████████▊ | 200/250 [01:27<00:21, 2.29it/s]
80%|████████████████████████████████▉ | 201/250 [01:27<00:20, 2.38it/s]
81%|█████████████████████████████████▏ | 202/250 [01:28<00:22, 2.15it/s]
81%|█████████████████████████████████▎ | 203/250 [01:28<00:19, 2.40it/s]
82%|█████████████████████████████████▍ | 204/250 [01:29<00:18, 2.53it/s]
82%|█████████████████████████████████▌ | 205/250 [01:29<00:16, 2.71it/s]
82%|█████████████████████████████████▊ | 206/250 [01:29<00:16, 2.61it/s]
83%|█████████████████████████████████▉ | 207/250 [01:30<00:17, 2.42it/s]
83%|██████████████████████████████████ | 208/250 [01:30<00:17, 2.42it/s]
84%|██████████████████████████████████▎ | 209/250 [01:31<00:16, 2.53it/s]
84%|██████████████████████████████████▍ | 210/250 [01:31<00:14, 2.73it/s]
84%|██████████████████████████████████▌ | 211/250 [01:31<00:14, 2.67it/s]
85%|██████████████████████████████████▊ | 212/250 [01:32<00:14, 2.58it/s]
85%|██████████████████████████████████▉ | 213/250 [01:32<00:14, 2.57it/s]
86%|███████████████████████████████████ | 214/250 [01:33<00:16, 2.19it/s]
86%|███████████████████████████████████▎ | 215/250 [01:33<00:16, 2.11it/s]
86%|███████████████████████████████████▍ | 216/250 [01:34<00:16, 2.06it/s]
87%|███████████████████████████████████▌ | 217/250 [01:34<00:14, 2.22it/s]
87%|███████████████████████████████████▊ | 218/250 [01:34<00:13, 2.37it/s]
88%|███████████████████████████████████▉ | 219/250 [01:35<00:15, 2.04it/s]
88%|████████████████████████████████████ | 220/250 [01:35<00:13, 2.27it/s]
88%|████████████████████████████████████▏ | 221/250 [01:36<00:11, 2.45it/s]
89%|████████████████████████████████████▍ | 222/250 [01:36<00:10, 2.59it/s]
89%|████████████████████████████████████▌ | 223/250 [01:36<00:09, 2.74it/s]
90%|████████████████████████████████████▋ | 224/250 [01:37<00:09, 2.64it/s]
90%|████████████████████████████████████▉ | 225/250 [01:37<00:09, 2.69it/s]
90%|█████████████████████████████████████ | 226/250 [01:37<00:08, 2.82it/s]
91%|█████████████████████████████████████▏ | 227/250 [01:38<00:07, 2.90it/s]
91%|█████████████████████████████████████▍ | 228/250 [01:38<00:07, 2.93it/s]
92%|█████████████████████████████████████▌ | 229/250 [01:38<00:07, 2.84it/s]
92%|█████████████████████████████████████▋ | 230/250 [01:39<00:07, 2.83it/s]
92%|█████████████████████████████████████▉ | 231/250 [01:39<00:06, 2.73it/s]
93%|██████████████████████████████████████ | 232/250 [01:40<00:06, 2.73it/s]
93%|██████████████████████████████████████▏ | 233/250 [01:40<00:06, 2.71it/s]
94%|██████████████████████████████████████▍ | 234/250 [01:40<00:05, 2.73it/s]
94%|██████████████████████████████████████▌ | 235/250 [01:41<00:05, 2.72it/s]
94%|██████████████████████████████████████▋ | 236/250 [01:41<00:06, 2.28it/s]
95%|██████████████████████████████████████▊ | 237/250 [01:42<00:05, 2.44it/s]
95%|███████████████████████████████████████ | 238/250 [01:42<00:04, 2.43it/s]
96%|███████████████████████████████████████▏ | 239/250 [01:43<00:06, 1.81it/s]
96%|███████████████████████████████████████▎ | 240/250 [01:43<00:05, 1.96it/s]
96%|███████████████████████████████████████▌ | 241/250 [01:44<00:04, 2.16it/s]
97%|███████████████████████████████████████▋ | 242/250 [01:44<00:03, 2.33it/s]
97%|███████████████████████████████████████▊ | 243/250 [01:44<00:02, 2.49it/s]
98%|████████████████████████████████████████ | 244/250 [01:45<00:02, 2.49it/s]
98%|████████████████████████████████████████▏| 245/250 [01:45<00:02, 2.33it/s]
98%|████████████████████████████████████████▎| 246/250 [01:46<00:01, 2.37it/s]
99%|████████████████████████████████████████▌| 247/250 [01:46<00:01, 2.17it/s]
99%|████████████████████████████████████████▋| 248/250 [01:47<00:00, 2.32it/s]
100%|████████████████████████████████████████▊| 249/250 [01:47<00:00, 2.56it/s]
{'eval_loss': 1.1525402069091797, 'eval_runtime': 108.4713, 'eval_samples_per_second': 18.438, 'eval_steps_per_second': 2.305, 'epoch': 0.1}
10%|████ | 39/390 [20:50<2:53:28, 29.65s/it]
100%|█████████████████████████████████████████| 250/250 [01:47<00:00, 2.38it/s]
{'loss': 1.1665, 'learning_rate': 0.00029914529914529915, 'epoch': 0.1}
{'loss': 1.1148, 'learning_rate': 0.00028205128205128203, 'epoch': 0.15}
20%|████████ | 78/390 [39:56<2:31:36, 29.16s/it]
0%| | 0/250 [00:00<?, ?it/s]
1%|▎ | 2/250 [00:00<00:44, 5.60it/s]
1%|▌ | 3/250 [00:01<01:32, 2.67it/s]
2%|▋ | 4/250 [00:01<01:35, 2.57it/s]
2%|▊ | 5/250 [00:01<01:48, 2.26it/s]
2%|█ | 6/250 [00:02<01:44, 2.34it/s]
3%|█▏ | 7/250 [00:02<01:41, 2.39it/s]
3%|█▍ | 8/250 [00:03<01:36, 2.52it/s]
4%|█▌ | 9/250 [00:03<01:45, 2.28it/s]
4%|█▋ | 10/250 [00:04<01:55, 2.07it/s]
4%|█▊ | 11/250 [00:04<02:05, 1.90it/s]
5%|██ | 12/250 [00:05<02:08, 1.85it/s]
5%|██▏ | 13/250 [00:05<02:07, 1.85it/s]
6%|██▎ | 14/250 [00:06<02:03, 1.91it/s]
6%|██▌ | 15/250 [00:07<02:28, 1.58it/s]
6%|██▋ | 16/250 [00:07<02:12, 1.77it/s]
7%|██▊ | 17/250 [00:08<01:58, 1.96it/s]
7%|███ | 18/250 [00:08<01:47, 2.16it/s]
8%|███▏ | 19/250 [00:08<01:41, 2.27it/s]
8%|███▎ | 20/250 [00:09<02:03, 1.87it/s]
8%|███▌ | 21/250 [00:10<01:58, 1.94it/s]
9%|███▋ | 22/250 [00:10<01:50, 2.06it/s]
9%|███▊ | 23/250 [00:10<01:40, 2.26it/s]
10%|████ | 24/250 [00:11<01:37, 2.31it/s]
10%|████▏ | 25/250 [00:11<01:31, 2.45it/s]
10%|████▎ | 26/250 [00:12<01:41, 2.21it/s]
11%|████▌ | 27/250 [00:12<01:33, 2.38it/s]
11%|████▋ | 28/250 [00:12<01:37, 2.28it/s]
12%|████▊ | 29/250 [00:13<02:00, 1.83it/s]
12%|█████ | 30/250 [00:14<01:48, 2.03it/s]
12%|█████▏ | 31/250 [00:14<01:40, 2.19it/s]
13%|█████▍ | 32/250 [00:14<01:28, 2.45it/s]
13%|█████▌ | 33/250 [00:15<01:29, 2.43it/s]
14%|█████▋ | 34/250 [00:15<01:28, 2.44it/s]
14%|█████▉ | 35/250 [00:15<01:22, 2.60it/s]
14%|██████ | 36/250 [00:16<01:27, 2.45it/s]
15%|██████▏ | 37/250 [00:16<01:34, 2.26it/s]
15%|██████▍ | 38/250 [00:17<01:27, 2.41it/s]
16%|██████▌ | 39/250 [00:17<01:23, 2.53it/s]
16%|██████▋ | 40/250 [00:18<01:33, 2.24it/s]
16%|██████▉ | 41/250 [00:18<01:30, 2.31it/s]
17%|███████ | 42/250 [00:19<01:58, 1.76it/s]
17%|███████▏ | 43/250 [00:19<01:52, 1.85it/s]
18%|███████▍ | 44/250 [00:20<01:41, 2.03it/s]
18%|███████▌ | 45/250 [00:20<01:36, 2.13it/s]
18%|███████▋ | 46/250 [00:21<01:33, 2.18it/s]
19%|███████▉ | 47/250 [00:21<01:31, 2.23it/s]
19%|████████ | 48/250 [00:22<01:27, 2.30it/s]
20%|████████▏ | 49/250 [00:22<01:23, 2.40it/s]
20%|████████▍ | 50/250 [00:22<01:24, 2.37it/s]
20%|████████▌ | 51/250 [00:23<01:19, 2.51it/s]
21%|████████▋ | 52/250 [00:23<01:16, 2.59it/s]
21%|████████▉ | 53/250 [00:23<01:16, 2.57it/s]
22%|█████████ | 54/250 [00:24<01:20, 2.45it/s]
22%|█████████▏ | 55/250 [00:24<01:18, 2.50it/s]
22%|█████████▍ | 56/250 [00:25<01:14, 2.61it/s]
23%|█████████▌ | 57/250 [00:25<01:17, 2.48it/s]
23%|█████████▋ | 58/250 [00:25<01:15, 2.56it/s]
24%|█████████▉ | 59/250 [00:26<01:16, 2.50it/s]
24%|██████████ | 60/250 [00:26<01:16, 2.48it/s]
24%|██████████▏ | 61/250 [00:27<01:13, 2.58it/s]
25%|██████████▍ | 62/250 [00:27<01:22, 2.27it/s]
25%|██████████▌ | 63/250 [00:28<01:16, 2.44it/s]
26%|██████████▊ | 64/250 [00:28<01:22, 2.26it/s]
26%|██████████▉ | 65/250 [00:28<01:16, 2.42it/s]
26%|███████████ | 66/250 [00:29<01:10, 2.59it/s]
27%|███████████▎ | 67/250 [00:29<01:09, 2.64it/s]
27%|███████████▍ | 68/250 [00:30<01:12, 2.51it/s]
28%|███████████▌ | 69/250 [00:30<01:08, 2.63it/s]
28%|███████████▊ | 70/250 [00:30<01:04, 2.81it/s]
28%|███████████▉ | 71/250 [00:31<01:14, 2.39it/s]
29%|████████████ | 72/250 [00:31<01:12, 2.47it/s]
29%|████████████▎ | 73/250 [00:31<01:10, 2.52it/s]
30%|████████████▍ | 74/250 [00:32<01:09, 2.55it/s]
30%|████████████▌ | 75/250 [00:32<01:17, 2.26it/s]
30%|████████████▊ | 76/250 [00:33<01:18, 2.22it/s]
31%|████████████▉ | 77/250 [00:33<01:20, 2.16it/s]
31%|█████████████ | 78/250 [00:34<01:17, 2.22it/s]
32%|█████████████▎ | 79/250 [00:34<01:22, 2.07it/s]
32%|█████████████▍ | 80/250 [00:35<01:15, 2.26it/s]
32%|█████████████▌ | 81/250 [00:35<01:20, 2.09it/s]
33%|█████████████▊ | 82/250 [00:36<01:16, 2.21it/s]
33%|█████████████▉ | 83/250 [00:36<01:10, 2.36it/s]
34%|██████████████ | 84/250 [00:37<01:19, 2.08it/s]
34%|██████████████▎ | 85/250 [00:37<01:14, 2.21it/s]
34%|██████████████▍ | 86/250 [00:38<01:19, 2.06it/s]
35%|██████████████▌ | 87/250 [00:38<01:13, 2.23it/s]
35%|██████████████▊ | 88/250 [00:38<01:15, 2.14it/s]
36%|██████████████▉ | 89/250 [00:39<01:22, 1.95it/s]
36%|███████████████ | 90/250 [00:40<01:24, 1.89it/s]
36%|███████████████▎ | 91/250 [00:40<01:22, 1.94it/s]
37%|███████████████▍ | 92/250 [00:41<01:19, 1.99it/s]
37%|███████████████▌ | 93/250 [00:41<01:14, 2.10it/s]
38%|███████████████▊ | 94/250 [00:41<01:11, 2.18it/s]
38%|███████████████▉ | 95/250 [00:42<01:11, 2.18it/s]
38%|████████████████▏ | 96/250 [00:42<01:07, 2.27it/s]
39%|████████████████▎ | 97/250 [00:43<01:02, 2.44it/s]
39%|████████████████▍ | 98/250 [00:43<01:07, 2.24it/s]
40%|████████████████▋ | 99/250 [00:44<01:11, 2.10it/s]
40%|████████████████▍ | 100/250 [00:45<01:30, 1.67it/s]
40%|████████████████▌ | 101/250 [00:45<01:26, 1.71it/s]
41%|████████████████▋ | 102/250 [00:45<01:16, 1.94it/s]
41%|████████████████▉ | 103/250 [00:46<01:11, 2.06it/s]
42%|█████████████████ | 104/250 [00:46<01:07, 2.16it/s]
42%|█████████████████▏ | 105/250 [00:47<01:02, 2.32it/s]
42%|█████████████████▍ | 106/250 [00:47<00:59, 2.42it/s]
43%|█████████████████▌ | 107/250 [00:47<00:58, 2.45it/s]
43%|█████████████████▋ | 108/250 [00:48<01:06, 2.12it/s]
44%|█████████████████▉ | 109/250 [00:48<01:00, 2.35it/s]
44%|██████████████████ | 110/250 [00:49<01:06, 2.10it/s]
44%|██████████████████▏ | 111/250 [00:49<01:01, 2.25it/s]
45%|██████████████████▎ | 112/250 [00:50<01:14, 1.86it/s]
45%|██████████████████▌ | 113/250 [00:50<01:06, 2.07it/s]
46%|██████████████████▋ | 114/250 [00:51<00:57, 2.34it/s]
46%|██████████████████▊ | 115/250 [00:51<01:07, 1.99it/s]
46%|███████████████████ | 116/250 [00:52<00:59, 2.24it/s]
47%|███████████████████▏ | 117/250 [00:52<00:54, 2.46it/s]
47%|███████████████████▎ | 118/250 [00:53<00:54, 2.41it/s]
48%|███████████████████▌ | 119/250 [00:53<00:54, 2.40it/s]
48%|███████████████████▋ | 120/250 [00:53<00:59, 2.20it/s]
48%|███████████████████▊ | 121/250 [00:54<00:57, 2.24it/s]
49%|████████████████████ | 122/250 [00:54<00:54, 2.33it/s]
49%|████████████████████▏ | 123/250 [00:55<00:53, 2.36it/s]
50%|████████████████████▎ | 124/250 [00:55<00:51, 2.45it/s]
50%|████████████████████▌ | 125/250 [00:55<00:48, 2.59it/s]
50%|████████████████████▋ | 126/250 [00:56<00:48, 2.55it/s]
51%|████████████████████▊ | 127/250 [00:56<00:46, 2.65it/s]
51%|████████████████████▉ | 128/250 [00:56<00:43, 2.79it/s]
52%|█████████████████████▏ | 129/250 [00:57<00:42, 2.88it/s]
52%|█████████████████████▎ | 130/250 [00:57<00:42, 2.85it/s]
52%|█████████████████████▍ | 131/250 [00:58<00:43, 2.75it/s]
53%|█████████████████████▋ | 132/250 [00:58<00:44, 2.64it/s]
53%|█████████████████████▊ | 133/250 [00:58<00:45, 2.58it/s]
54%|█████████████████████▉ | 134/250 [00:59<00:43, 2.67it/s]
54%|██████████████████████▏ | 135/250 [00:59<00:40, 2.80it/s]
54%|██████████████████████▎ | 136/250 [00:59<00:44, 2.56it/s]
55%|██████████████████████▍ | 137/250 [01:00<00:42, 2.63it/s]
55%|██████████████████████▋ | 138/250 [01:00<00:42, 2.65it/s]
56%|██████████████████████▊ | 139/250 [01:01<00:58, 1.89it/s]
56%|██████████████████████▉ | 140/250 [01:02<01:10, 1.57it/s]
56%|███████████████████████ | 141/250 [01:03<01:07, 1.62it/s]
57%|███████████████████████▎ | 142/250 [01:03<01:09, 1.56it/s]
57%|███████████████████████▍ | 143/250 [01:04<01:02, 1.71it/s]
58%|███████████████████████▌ | 144/250 [01:04<01:06, 1.59it/s]
58%|███████████████████████▊ | 145/250 [01:05<01:09, 1.50it/s]
58%|███████████████████████▉ | 146/250 [01:06<01:03, 1.64it/s]
59%|████████████████████████ | 147/250 [01:06<00:57, 1.79it/s]
59%|████████████████████████▎ | 148/250 [01:07<00:54, 1.89it/s]
60%|████████████████████████▍ | 149/250 [01:07<00:47, 2.11it/s]
60%|████████████████████████▌ | 150/250 [01:07<00:43, 2.31it/s]
60%|████████████████████████▊ | 151/250 [01:08<00:41, 2.41it/s]
61%|████████████████████████▉ | 152/250 [01:08<00:38, 2.56it/s]
61%|█████████████████████████ | 153/250 [01:08<00:36, 2.64it/s]
62%|█████████████████████████▎ | 154/250 [01:09<00:47, 2.04it/s]
62%|█████████████████████████▍ | 155/250 [01:09<00:43, 2.18it/s]
62%|█████████████████████████▌ | 156/250 [01:10<00:46, 2.01it/s]
63%|█████████████████████████▋ | 157/250 [01:10<00:42, 2.19it/s]
63%|█████████████████████████▉ | 158/250 [01:11<00:39, 2.34it/s]
64%|██████████████████████████ | 159/250 [01:11<00:36, 2.46it/s]
64%|██████████████████████████▏ | 160/250 [01:11<00:35, 2.55it/s]
64%|██████████████████████████▍ | 161/250 [01:12<00:32, 2.71it/s]
65%|██████████████████████████▌ | 162/250 [01:12<00:33, 2.66it/s]
65%|██████████████████████████▋ | 163/250 [01:13<00:32, 2.71it/s]
66%|██████████████████████████▉ | 164/250 [01:13<00:29, 2.89it/s]
66%|███████████████████████████ | 165/250 [01:13<00:35, 2.37it/s]
66%|███████████████████████████▏ | 166/250 [01:14<00:34, 2.45it/s]
67%|███████████████████████████▍ | 167/250 [01:14<00:33, 2.51it/s]
67%|███████████████████████████▌ | 168/250 [01:15<00:33, 2.46it/s]
68%|███████████████████████████▋ | 169/250 [01:15<00:30, 2.66it/s]
68%|███████████████████████████▉ | 170/250 [01:15<00:31, 2.57it/s]
68%|████████████████████████████ | 171/250 [01:16<00:29, 2.69it/s]
69%|████████████████████████████▏ | 172/250 [01:16<00:29, 2.62it/s]
69%|████████████████████████████▎ | 173/250 [01:16<00:28, 2.75it/s]
70%|████████████████████████████▌ | 174/250 [01:17<00:26, 2.82it/s]
70%|████████████████████████████▋ | 175/250 [01:17<00:27, 2.74it/s]
70%|████████████████████████████▊ | 176/250 [01:17<00:27, 2.74it/s]
71%|█████████████████████████████ | 177/250 [01:18<00:31, 2.29it/s]
71%|█████████████████████████████▏ | 178/250 [01:18<00:30, 2.39it/s]
72%|█████████████████████████████▎ | 179/250 [01:19<00:27, 2.61it/s]
72%|█████████████████████████████▌ | 180/250 [01:19<00:27, 2.58it/s]
72%|█████████████████████████████▋ | 181/250 [01:20<00:26, 2.56it/s]
73%|█████████████████████████████▊ | 182/250 [01:20<00:25, 2.65it/s]
73%|██████████████████████████████ | 183/250 [01:20<00:26, 2.48it/s]
74%|██████████████████████████████▏ | 184/250 [01:21<00:27, 2.40it/s]
74%|██████████████████████████████▎ | 185/250 [01:21<00:25, 2.52it/s]
74%|██████████████████████████████▌ | 186/250 [01:21<00:24, 2.64it/s]
75%|██████████████████████████████▋ | 187/250 [01:22<00:23, 2.73it/s]
75%|██████████████████████████████▊ | 188/250 [01:22<00:27, 2.25it/s]
76%|██████████████████████████████▉ | 189/250 [01:23<00:25, 2.39it/s]
76%|███████████████████████████████▏ | 190/250 [01:23<00:23, 2.52it/s]
76%|███████████████████████████████▎ | 191/250 [01:24<00:23, 2.50it/s]
77%|███████████████████████████████▍ | 192/250 [01:24<00:23, 2.42it/s]
77%|███████████████████████████████▋ | 193/250 [01:24<00:22, 2.48it/s]
78%|███████████████████████████████▊ | 194/250 [01:25<00:22, 2.54it/s]
78%|███████████████████████████████▉ | 195/250 [01:25<00:21, 2.54it/s]
78%|████████████████████████████████▏ | 196/250 [01:26<00:20, 2.58it/s]
79%|████████████████████████████████▎ | 197/250 [01:26<00:19, 2.74it/s]
79%|████████████████████████████████▍ | 198/250 [01:26<00:19, 2.68it/s]
80%|████████████████████████████████▋ | 199/250 [01:27<00:18, 2.73it/s]
80%|████████████████████████████████▊ | 200/250 [01:27<00:21, 2.30it/s]
80%|████████████████████████████████▉ | 201/250 [01:28<00:20, 2.38it/s]
81%|█████████████████████████████████▏ | 202/250 [01:28<00:22, 2.16it/s]
81%|█████████████████████████████████▎ | 203/250 [01:28<00:19, 2.40it/s]
82%|█████████████████████████████████▍ | 204/250 [01:29<00:17, 2.56it/s]
82%|█████████████████████████████████▌ | 205/250 [01:29<00:16, 2.73it/s]
82%|█████████████████████████████████▊ | 206/250 [01:29<00:16, 2.63it/s]
83%|█████████████████████████████████▉ | 207/250 [01:30<00:17, 2.43it/s]
83%|██████████████████████████████████ | 208/250 [01:30<00:17, 2.43it/s]
84%|██████████████████████████████████▎ | 209/250 [01:31<00:16, 2.54it/s]
84%|██████████████████████████████████▍ | 210/250 [01:31<00:14, 2.73it/s]
84%|██████████████████████████████████▌ | 211/250 [01:31<00:14, 2.67it/s]
85%|██████████████████████████████████▊ | 212/250 [01:32<00:14, 2.57it/s]
85%|██████████████████████████████████▉ | 213/250 [01:32<00:14, 2.57it/s]
86%|███████████████████████████████████ | 214/250 [01:33<00:16, 2.19it/s]
86%|███████████████████████████████████▎ | 215/250 [01:33<00:16, 2.11it/s]
86%|███████████████████████████████████▍ | 216/250 [01:34<00:16, 2.05it/s]
87%|███████████████████████████████████▌ | 217/250 [01:34<00:14, 2.22it/s]
87%|███████████████████████████████████▊ | 218/250 [01:35<00:13, 2.37it/s]
88%|███████████████████████████████████▉ | 219/250 [01:35<00:15, 2.04it/s]
88%|████████████████████████████████████ | 220/250 [01:36<00:13, 2.27it/s]
88%|████████████████████████████████████▏ | 221/250 [01:36<00:11, 2.44it/s]
89%|████████████████████████████████████▍ | 222/250 [01:36<00:10, 2.58it/s]
89%|████████████████████████████████████▌ | 223/250 [01:37<00:09, 2.73it/s]
90%|████████████████████████████████████▋ | 224/250 [01:37<00:09, 2.63it/s]
90%|████████████████████████████████████▉ | 225/250 [01:37<00:09, 2.68it/s]
90%|█████████████████████████████████████ | 226/250 [01:38<00:08, 2.81it/s]
91%|█████████████████████████████████████▏ | 227/250 [01:38<00:07, 2.90it/s]
91%|█████████████████████████████████████▍ | 228/250 [01:38<00:07, 2.93it/s]
92%|█████████████████████████████████████▌ | 229/250 [01:39<00:07, 2.85it/s]
92%|█████████████████████████████████████▋ | 230/250 [01:39<00:07, 2.84it/s]
92%|█████████████████████████████████████▉ | 231/250 [01:39<00:06, 2.73it/s]
93%|██████████████████████████████████████ | 232/250 [01:40<00:06, 2.73it/s]
93%|██████████████████████████████████████▏ | 233/250 [01:40<00:06, 2.71it/s]
94%|██████████████████████████████████████▍ | 234/250 [01:41<00:05, 2.73it/s]
94%|██████████████████████████████████████▌ | 235/250 [01:41<00:05, 2.72it/s]
94%|██████████████████████████████████████▋ | 236/250 [01:42<00:06, 2.28it/s]
95%|██████████████████████████████████████▊ | 237/250 [01:42<00:05, 2.44it/s]
95%|███████████████████████████████████████ | 238/250 [01:42<00:04, 2.43it/s]
96%|███████████████████████████████████████▏ | 239/250 [01:43<00:06, 1.81it/s]
96%|███████████████████████████████████████▎ | 240/250 [01:44<00:05, 1.95it/s]
96%|███████████████████████████████████████▌ | 241/250 [01:44<00:04, 2.15it/s]
97%|███████████████████████████████████████▋ | 242/250 [01:44<00:03, 2.32it/s]
97%|███████████████████████████████████████▊ | 243/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████ | 244/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████▏| 245/250 [01:46<00:02, 2.32it/s]
98%|████████████████████████████████████████▎| 246/250 [01:46<00:01, 2.37it/s]
99%|████████████████████████████████████████▌| 247/250 [01:46<00:01, 2.17it/s]
99%|████████████████████████████████████████▋| 248/250 [01:47<00:00, 2.32it/s]
100%|████████████████████████████████████████▊| 249/250 [01:47<00:00, 2.55it/s]
100%|█████████████████████████████████████████| 250/250 [01:48<00:00, 2.38it/s]
{'eval_loss': 1.1168040037155151, 'eval_runtime': 108.7236, 'eval_samples_per_second': 18.395, 'eval_steps_per_second': 2.299, 'epoch': 0.2}
20%|████████ | 78/390 [41:45<2:31:36, 29.16s/it]
{'loss': 1.1018, 'learning_rate': 0.00026495726495726497, 'epoch': 0.21}
{'loss': 1.0935, 'learning_rate': 0.00024786324786324785, 'epoch': 0.26}
30%|███████████ | 117/390 [1:00:56<2:14:05, 29.47s/it]
0%| | 0/250 [00:00<?, ?it/s]
1%|▎ | 2/250 [00:00<00:44, 5.56it/s]
1%|▌ | 3/250 [00:01<01:32, 2.67it/s]
2%|▋ | 4/250 [00:01<01:36, 2.56it/s]
2%|▊ | 5/250 [00:01<01:48, 2.26it/s]
2%|█ | 6/250 [00:02<01:44, 2.34it/s]
3%|█▏ | 7/250 [00:02<01:41, 2.39it/s]
3%|█▍ | 8/250 [00:03<01:36, 2.52it/s]
4%|█▌ | 9/250 [00:03<01:45, 2.28it/s]
4%|█▋ | 10/250 [00:04<01:55, 2.08it/s]
4%|█▊ | 11/250 [00:04<02:05, 1.90it/s]
5%|██ | 12/250 [00:05<02:08, 1.85it/s]
5%|██▏ | 13/250 [00:05<02:07, 1.85it/s]
6%|██▎ | 14/250 [00:06<02:04, 1.90it/s]
6%|██▌ | 15/250 [00:07<02:28, 1.58it/s]
6%|██▋ | 16/250 [00:07<02:12, 1.76it/s]
7%|██▊ | 17/250 [00:08<01:58, 1.96it/s]
7%|███ | 18/250 [00:08<01:47, 2.16it/s]
8%|███▏ | 19/250 [00:08<01:41, 2.27it/s]
8%|███▎ | 20/250 [00:09<02:03, 1.87it/s]
8%|███▌ | 21/250 [00:10<01:58, 1.94it/s]
9%|███▋ | 22/250 [00:10<01:50, 2.06it/s]
9%|███▊ | 23/250 [00:10<01:40, 2.26it/s]
10%|████ | 24/250 [00:11<01:38, 2.31it/s]
10%|████▏ | 25/250 [00:11<01:31, 2.45it/s]
10%|████▎ | 26/250 [00:12<01:41, 2.21it/s]
11%|████▌ | 27/250 [00:12<01:33, 2.37it/s]
11%|████▋ | 28/250 [00:13<01:37, 2.27it/s]
12%|████▊ | 29/250 [00:13<02:00, 1.83it/s]
12%|█████ | 30/250 [00:14<01:48, 2.03it/s]
12%|█████▏ | 31/250 [00:14<01:39, 2.19it/s]
13%|█████▍ | 32/250 [00:14<01:29, 2.44it/s]
13%|█████▌ | 33/250 [00:15<01:29, 2.43it/s]
14%|█████▋ | 34/250 [00:15<01:28, 2.43it/s]
14%|█████▉ | 35/250 [00:15<01:22, 2.60it/s]
14%|██████ | 36/250 [00:16<01:27, 2.44it/s]
15%|██████▏ | 37/250 [00:16<01:34, 2.26it/s]
15%|██████▍ | 38/250 [00:17<01:27, 2.42it/s]
16%|██████▌ | 39/250 [00:17<01:23, 2.53it/s]
16%|██████▋ | 40/250 [00:18<01:33, 2.24it/s]
16%|██████▉ | 41/250 [00:18<01:30, 2.31it/s]
17%|███████ | 42/250 [00:19<01:57, 1.76it/s]
17%|███████▏ | 43/250 [00:20<01:52, 1.85it/s]
18%|███████▍ | 44/250 [00:20<01:41, 2.03it/s]
18%|███████▌ | 45/250 [00:20<01:36, 2.13it/s]
18%|███████▋ | 46/250 [00:21<01:33, 2.17it/s]
19%|███████▉ | 47/250 [00:21<01:31, 2.23it/s]
19%|████████ | 48/250 [00:22<01:27, 2.30it/s]
20%|████████▏ | 49/250 [00:22<01:23, 2.40it/s]
20%|████████▍ | 50/250 [00:22<01:24, 2.37it/s]
20%|████████▌ | 51/250 [00:23<01:19, 2.50it/s]
21%|████████▋ | 52/250 [00:23<01:16, 2.59it/s]
21%|████████▉ | 53/250 [00:23<01:16, 2.57it/s]
22%|█████████ | 54/250 [00:24<01:19, 2.45it/s]
22%|█████████▏ | 55/250 [00:24<01:18, 2.49it/s]
22%|█████████▍ | 56/250 [00:25<01:14, 2.60it/s]
23%|█████████▌ | 57/250 [00:25<01:18, 2.47it/s]
23%|█████████▋ | 58/250 [00:25<01:15, 2.55it/s]
24%|█████████▉ | 59/250 [00:26<01:16, 2.50it/s]
24%|██████████ | 60/250 [00:26<01:16, 2.48it/s]
24%|██████████▏ | 61/250 [00:27<01:13, 2.58it/s]
25%|██████████▍ | 62/250 [00:27<01:22, 2.27it/s]
25%|██████████▌ | 63/250 [00:28<01:16, 2.44it/s]
26%|██████████▊ | 64/250 [00:28<01:22, 2.26it/s]
26%|██████████▉ | 65/250 [00:28<01:16, 2.42it/s]
26%|███████████ | 66/250 [00:29<01:10, 2.59it/s]
27%|███████████▎ | 67/250 [00:29<01:09, 2.64it/s]
27%|███████████▍ | 68/250 [00:30<01:12, 2.51it/s]
28%|███████████▌ | 69/250 [00:30<01:08, 2.63it/s]
28%|███████████▊ | 70/250 [00:30<01:04, 2.81it/s]
28%|███████████▉ | 71/250 [00:31<01:14, 2.39it/s]
29%|████████████ | 72/250 [00:31<01:12, 2.47it/s]
29%|████████████▎ | 73/250 [00:31<01:10, 2.51it/s]
30%|████████████▍ | 74/250 [00:32<01:08, 2.55it/s]
30%|████████████▌ | 75/250 [00:32<01:17, 2.26it/s]
30%|████████████▊ | 76/250 [00:33<01:18, 2.22it/s]
31%|████████████▉ | 77/250 [00:33<01:20, 2.16it/s]
31%|█████████████ | 78/250 [00:34<01:16, 2.24it/s]
32%|█████████████▎ | 79/250 [00:34<01:22, 2.08it/s]
32%|█████████████▍ | 80/250 [00:35<01:15, 2.27it/s]
32%|█████████████▌ | 81/250 [00:35<01:20, 2.09it/s]
33%|█████████████▊ | 82/250 [00:36<01:16, 2.21it/s]
33%|█████████████▉ | 83/250 [00:36<01:10, 2.36it/s]
34%|██████████████ | 84/250 [00:37<01:19, 2.08it/s]
34%|██████████████▎ | 85/250 [00:37<01:14, 2.21it/s]
34%|██████████████▍ | 86/250 [00:38<01:19, 2.06it/s]
35%|██████████████▌ | 87/250 [00:38<01:13, 2.23it/s]
35%|██████████████▊ | 88/250 [00:38<01:15, 2.13it/s]
36%|██████████████▉ | 89/250 [00:39<01:22, 1.95it/s]
36%|███████████████ | 90/250 [00:40<01:24, 1.89it/s]
36%|███████████████▎ | 91/250 [00:40<01:22, 1.94it/s]
37%|███████████████▍ | 92/250 [00:41<01:19, 1.99it/s]
37%|███████████████▌ | 93/250 [00:41<01:14, 2.10it/s]
38%|███████████████▊ | 94/250 [00:41<01:11, 2.18it/s]
38%|███████████████▉ | 95/250 [00:42<01:11, 2.18it/s]
38%|████████████████▏ | 96/250 [00:42<01:07, 2.27it/s]
39%|████████████████▎ | 97/250 [00:43<01:02, 2.44it/s]
39%|████████████████▍ | 98/250 [00:43<01:07, 2.24it/s]
40%|████████████████▋ | 99/250 [00:44<01:11, 2.10it/s]
40%|████████████████▍ | 100/250 [00:45<01:29, 1.67it/s]
40%|████████████████▌ | 101/250 [00:45<01:26, 1.71it/s]
41%|████████████████▋ | 102/250 [00:46<01:16, 1.94it/s]
41%|████████████████▉ | 103/250 [00:46<01:11, 2.06it/s]
42%|█████████████████ | 104/250 [00:46<01:07, 2.16it/s]
42%|█████████████████▏ | 105/250 [00:47<01:02, 2.32it/s]
42%|█████████████████▍ | 106/250 [00:47<00:59, 2.42it/s]
43%|█████████████████▌ | 107/250 [00:47<00:58, 2.45it/s]
43%|█████████████████▋ | 108/250 [00:48<01:06, 2.12it/s]
44%|█████████████████▉ | 109/250 [00:48<01:00, 2.34it/s]
44%|██████████████████ | 110/250 [00:49<01:06, 2.10it/s]
44%|██████████████████▏ | 111/250 [00:49<01:01, 2.25it/s]
45%|██████████████████▎ | 112/250 [00:50<01:13, 1.87it/s]
45%|██████████████████▌ | 113/250 [00:50<01:06, 2.07it/s]
46%|██████████████████▋ | 114/250 [00:51<00:57, 2.34it/s]
46%|██████████████████▊ | 115/250 [00:51<01:07, 1.99it/s]
46%|███████████████████ | 116/250 [00:52<00:59, 2.24it/s]
47%|███████████████████▏ | 117/250 [00:52<00:54, 2.46it/s]
47%|███████████████████▎ | 118/250 [00:53<00:54, 2.41it/s]
48%|███████████████████▌ | 119/250 [00:53<00:54, 2.40it/s]
48%|███████████████████▋ | 120/250 [00:53<00:59, 2.20it/s]
48%|███████████████████▊ | 121/250 [00:54<00:57, 2.25it/s]
49%|████████████████████ | 122/250 [00:54<00:55, 2.32it/s]
49%|████████████████████▏ | 123/250 [00:55<00:53, 2.35it/s]
50%|████████████████████▎ | 124/250 [00:55<00:51, 2.45it/s]
50%|████████████████████▌ | 125/250 [00:55<00:48, 2.59it/s]
50%|████████████████████▋ | 126/250 [00:56<00:48, 2.54it/s]
51%|████████████████████▊ | 127/250 [00:56<00:46, 2.65it/s]
51%|████████████████████▉ | 128/250 [00:56<00:43, 2.79it/s]
52%|█████████████████████▏ | 129/250 [00:57<00:42, 2.88it/s]
52%|█████████████████████▎ | 130/250 [00:57<00:42, 2.86it/s]
52%|█████████████████████▍ | 131/250 [00:58<00:43, 2.75it/s]
53%|█████████████████████▋ | 132/250 [00:58<00:44, 2.65it/s]
53%|█████████████████████▊ | 133/250 [00:58<00:45, 2.58it/s]
54%|█████████████████████▉ | 134/250 [00:59<00:43, 2.67it/s]
54%|██████████████████████▏ | 135/250 [00:59<00:41, 2.80it/s]
54%|██████████████████████▎ | 136/250 [00:59<00:44, 2.56it/s]
55%|██████████████████████▍ | 137/250 [01:00<00:42, 2.64it/s]
55%|██████████████████████▋ | 138/250 [01:00<00:42, 2.65it/s]
56%|██████████████████████▊ | 139/250 [01:01<00:58, 1.89it/s]
56%|██████████████████████▉ | 140/250 [01:02<01:10, 1.57it/s]
56%|███████████████████████ | 141/250 [01:03<01:07, 1.62it/s]
57%|███████████████████████▎ | 142/250 [01:03<01:09, 1.56it/s]
57%|███████████████████████▍ | 143/250 [01:04<01:02, 1.71it/s]
58%|███████████████████████▌ | 144/250 [01:04<01:06, 1.59it/s]
58%|███████████████████████▊ | 145/250 [01:05<01:09, 1.50it/s]
58%|███████████████████████▉ | 146/250 [01:06<01:03, 1.64it/s]
59%|████████████████████████ | 147/250 [01:06<00:57, 1.79it/s]
59%|████████████████████████▎ | 148/250 [01:07<00:54, 1.89it/s]
60%|████████████████████████▍ | 149/250 [01:07<00:47, 2.11it/s]
60%|████████████████████████▌ | 150/250 [01:07<00:43, 2.31it/s]
60%|████████████████████████▊ | 151/250 [01:08<00:41, 2.41it/s]
61%|████████████████████████▉ | 152/250 [01:08<00:38, 2.57it/s]
61%|█████████████████████████ | 153/250 [01:08<00:36, 2.64it/s]
62%|█████████████████████████▎ | 154/250 [01:09<00:47, 2.04it/s]
62%|█████████████████████████▍ | 155/250 [01:09<00:43, 2.18it/s]
62%|█████████████████████████▌ | 156/250 [01:10<00:46, 2.01it/s]
63%|█████████████████████████▋ | 157/250 [01:10<00:42, 2.19it/s]
63%|█████████████████████████▉ | 158/250 [01:11<00:39, 2.34it/s]
64%|██████████████████████████ | 159/250 [01:11<00:36, 2.46it/s]
64%|██████████████████████████▏ | 160/250 [01:11<00:35, 2.55it/s]
64%|██████████████████████████▍ | 161/250 [01:12<00:32, 2.71it/s]
65%|██████████████████████████▌ | 162/250 [01:12<00:33, 2.66it/s]
65%|██████████████████████████▋ | 163/250 [01:13<00:32, 2.71it/s]
66%|██████████████████████████▉ | 164/250 [01:13<00:29, 2.89it/s]
66%|███████████████████████████ | 165/250 [01:13<00:35, 2.37it/s]
66%|███████████████████████████▏ | 166/250 [01:14<00:34, 2.46it/s]
67%|███████████████████████████▍ | 167/250 [01:14<00:33, 2.51it/s]
67%|███████████████████████████▌ | 168/250 [01:15<00:33, 2.46it/s]
68%|███████████████████████████▋ | 169/250 [01:15<00:30, 2.67it/s]
68%|███████████████████████████▉ | 170/250 [01:15<00:31, 2.58it/s]
68%|████████████████████████████ | 171/250 [01:16<00:29, 2.69it/s]
69%|████████████████████████████▏ | 172/250 [01:16<00:29, 2.63it/s]
69%|████████████████████████████▎ | 173/250 [01:16<00:27, 2.75it/s]
70%|████████████████████████████▌ | 174/250 [01:17<00:26, 2.82it/s]
70%|████████████████████████████▋ | 175/250 [01:17<00:27, 2.74it/s]
70%|████████████████████████████▊ | 176/250 [01:17<00:27, 2.74it/s]
71%|█████████████████████████████ | 177/250 [01:18<00:31, 2.29it/s]
71%|█████████████████████████████▏ | 178/250 [01:18<00:30, 2.40it/s]
72%|█████████████████████████████▎ | 179/250 [01:19<00:27, 2.62it/s]
72%|█████████████████████████████▌ | 180/250 [01:19<00:27, 2.58it/s]
72%|█████████████████████████████▋ | 181/250 [01:20<00:26, 2.56it/s]
73%|█████████████████████████████▊ | 182/250 [01:20<00:25, 2.66it/s]
73%|██████████████████████████████ | 183/250 [01:20<00:26, 2.48it/s]
74%|██████████████████████████████▏ | 184/250 [01:21<00:27, 2.40it/s]
74%|██████████████████████████████▎ | 185/250 [01:21<00:25, 2.52it/s]
74%|██████████████████████████████▌ | 186/250 [01:21<00:24, 2.65it/s]
75%|██████████████████████████████▋ | 187/250 [01:22<00:23, 2.73it/s]
75%|██████████████████████████████▊ | 188/250 [01:22<00:27, 2.25it/s]
76%|██████████████████████████████▉ | 189/250 [01:23<00:25, 2.39it/s]
76%|███████████████████████████████▏ | 190/250 [01:23<00:23, 2.51it/s]
76%|███████████████████████████████▎ | 191/250 [01:24<00:23, 2.50it/s]
77%|███████████████████████████████▍ | 192/250 [01:24<00:23, 2.43it/s]
77%|███████████████████████████████▋ | 193/250 [01:24<00:23, 2.47it/s]
78%|███████████████████████████████▊ | 194/250 [01:25<00:22, 2.53it/s]
78%|███████████████████████████████▉ | 195/250 [01:25<00:21, 2.54it/s]
78%|████████████████████████████████▏ | 196/250 [01:26<00:20, 2.58it/s]
79%|████████████████████████████████▎ | 197/250 [01:26<00:19, 2.73it/s]
79%|████████████████████████████████▍ | 198/250 [01:26<00:19, 2.67it/s]
80%|████████████████████████████████▋ | 199/250 [01:27<00:18, 2.73it/s]
80%|████████████████████████████████▊ | 200/250 [01:27<00:21, 2.30it/s]
80%|████████████████████████████████▉ | 201/250 [01:28<00:20, 2.38it/s]
81%|█████████████████████████████████▏ | 202/250 [01:28<00:22, 2.15it/s]
81%|█████████████████████████████████▎ | 203/250 [01:28<00:19, 2.40it/s]
82%|█████████████████████████████████▍ | 204/250 [01:29<00:18, 2.55it/s]
82%|█████████████████████████████████▌ | 205/250 [01:29<00:16, 2.73it/s]
82%|█████████████████████████████████▊ | 206/250 [01:29<00:16, 2.63it/s]
83%|█████████████████████████████████▉ | 207/250 [01:30<00:17, 2.43it/s]
83%|██████████████████████████████████ | 208/250 [01:30<00:17, 2.42it/s]
84%|██████████████████████████████████▎ | 209/250 [01:31<00:16, 2.53it/s]
84%|██████████████████████████████████▍ | 210/250 [01:31<00:14, 2.73it/s]
84%|██████████████████████████████████▌ | 211/250 [01:31<00:14, 2.68it/s]
85%|██████████████████████████████████▊ | 212/250 [01:32<00:14, 2.58it/s]
85%|██████████████████████████████████▉ | 213/250 [01:32<00:14, 2.56it/s]
86%|███████████████████████████████████ | 214/250 [01:33<00:16, 2.19it/s]
86%|███████████████████████████████████▎ | 215/250 [01:33<00:16, 2.11it/s]
86%|███████████████████████████████████▍ | 216/250 [01:34<00:16, 2.05it/s]
87%|███████████████████████████████████▌ | 217/250 [01:34<00:14, 2.21it/s]
87%|███████████████████████████████████▊ | 218/250 [01:35<00:13, 2.36it/s]
88%|███████████████████████████████████▉ | 219/250 [01:35<00:15, 2.04it/s]
88%|████████████████████████████████████ | 220/250 [01:36<00:13, 2.26it/s]
88%|████████████████████████████████████▏ | 221/250 [01:36<00:11, 2.44it/s]
89%|████████████████████████████████████▍ | 222/250 [01:36<00:10, 2.58it/s]
89%|████████████████████████████████████▌ | 223/250 [01:37<00:09, 2.73it/s]
90%|████████████████████████████████████▋ | 224/250 [01:37<00:09, 2.63it/s]
90%|████████████████████████████████████▉ | 225/250 [01:37<00:09, 2.68it/s]
90%|█████████████████████████████████████ | 226/250 [01:38<00:08, 2.81it/s]
91%|█████████████████████████████████████▏ | 227/250 [01:38<00:07, 2.89it/s]
91%|█████████████████████████████████████▍ | 228/250 [01:38<00:07, 2.92it/s]
92%|█████████████████████████████████████▌ | 229/250 [01:39<00:07, 2.86it/s]
92%|█████████████████████████████████████▋ | 230/250 [01:39<00:07, 2.84it/s]
92%|█████████████████████████████████████▉ | 231/250 [01:39<00:06, 2.74it/s]
93%|██████████████████████████████████████ | 232/250 [01:40<00:06, 2.73it/s]
93%|██████████████████████████████████████▏ | 233/250 [01:40<00:06, 2.71it/s]
94%|██████████████████████████████████████▍ | 234/250 [01:41<00:05, 2.73it/s]
94%|██████████████████████████████████████▌ | 235/250 [01:41<00:05, 2.72it/s]
94%|██████████████████████████████████████▋ | 236/250 [01:42<00:06, 2.29it/s]
95%|██████████████████████████████████████▊ | 237/250 [01:42<00:05, 2.44it/s]
95%|███████████████████████████████████████ | 238/250 [01:42<00:04, 2.43it/s]
96%|███████████████████████████████████████▏ | 239/250 [01:43<00:06, 1.81it/s]
96%|███████████████████████████████████████▎ | 240/250 [01:44<00:05, 1.95it/s]
96%|███████████████████████████████████████▌ | 241/250 [01:44<00:04, 2.15it/s]
97%|███████████████████████████████████████▋ | 242/250 [01:44<00:03, 2.32it/s]
97%|███████████████████████████████████████▊ | 243/250 [01:45<00:02, 2.47it/s]
98%|████████████████████████████████████████ | 244/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████▏| 245/250 [01:46<00:02, 2.32it/s]
98%|████████████████████████████████████████▎| 246/250 [01:46<00:01, 2.37it/s]
99%|████████████████████████████████████████▌| 247/250 [01:46<00:01, 2.16it/s]
99%|████████████████████████████████████████▋| 248/250 [01:47<00:00, 2.32it/s]
100%|████████████████████████████████████████▊| 249/250 [01:47<00:00, 2.55it/s]
100%|█████████████████████████████████████████| 250/250 [01:48<00:00, 2.38it/s]
{'eval_loss': 1.1057891845703125, 'eval_runtime': 108.7439, 'eval_samples_per_second': 18.392, 'eval_steps_per_second': 2.299, 'epoch': 0.3}
30%|███████████ | 117/390 [1:02:44<2:14:05, 29.47s/it]
{'loss': 1.0929, 'learning_rate': 0.00023076923076923076, 'epoch': 0.31}
{'loss': 1.0894, 'learning_rate': 0.00021367521367521365, 'epoch': 0.36}
40%|██████████████▊ | 156/390 [1:21:50<1:59:03, 30.53s/it]
0%| | 0/250 [00:00<?, ?it/s]
1%|▎ | 2/250 [00:00<00:44, 5.58it/s]
1%|▌ | 3/250 [00:01<01:32, 2.67it/s]
2%|▋ | 4/250 [00:01<01:36, 2.56it/s]
2%|▊ | 5/250 [00:01<01:48, 2.25it/s]
2%|█ | 6/250 [00:02<01:44, 2.34it/s]
3%|█▏ | 7/250 [00:02<01:41, 2.38it/s]
3%|█▍ | 8/250 [00:03<01:36, 2.52it/s]
4%|█▌ | 9/250 [00:03<01:45, 2.28it/s]
4%|█▋ | 10/250 [00:04<01:55, 2.08it/s]
4%|█▊ | 11/250 [00:04<02:05, 1.90it/s]
5%|██ | 12/250 [00:05<02:07, 1.86it/s]
5%|██▏ | 13/250 [00:05<02:07, 1.86it/s]
6%|██▎ | 14/250 [00:06<02:03, 1.91it/s]
6%|██▌ | 15/250 [00:07<02:28, 1.58it/s]
6%|██▋ | 16/250 [00:07<02:12, 1.77it/s]
7%|██▊ | 17/250 [00:08<01:58, 1.96it/s]
7%|███ | 18/250 [00:08<01:47, 2.16it/s]
8%|███▏ | 19/250 [00:08<01:41, 2.27it/s]
8%|███▎ | 20/250 [00:09<02:03, 1.87it/s]
8%|███▌ | 21/250 [00:10<01:58, 1.94it/s]
9%|███▋ | 22/250 [00:10<01:50, 2.06it/s]
9%|███▊ | 23/250 [00:10<01:40, 2.25it/s]
10%|████ | 24/250 [00:11<01:38, 2.30it/s]
10%|████▏ | 25/250 [00:11<01:32, 2.44it/s]
10%|████▎ | 26/250 [00:12<01:41, 2.21it/s]
11%|████▌ | 27/250 [00:12<01:33, 2.37it/s]
11%|████▋ | 28/250 [00:12<01:37, 2.28it/s]
12%|████▊ | 29/250 [00:13<02:00, 1.83it/s]
12%|█████ | 30/250 [00:14<01:48, 2.03it/s]
12%|█████▏ | 31/250 [00:14<01:39, 2.19it/s]
13%|█████▍ | 32/250 [00:14<01:28, 2.46it/s]
13%|█████▌ | 33/250 [00:15<01:29, 2.44it/s]
14%|█████▋ | 34/250 [00:15<01:28, 2.44it/s]
14%|█████▉ | 35/250 [00:15<01:22, 2.60it/s]
14%|██████ | 36/250 [00:16<01:27, 2.45it/s]
15%|██████▏ | 37/250 [00:16<01:34, 2.26it/s]
15%|██████▍ | 38/250 [00:17<01:27, 2.42it/s]
16%|██████▌ | 39/250 [00:17<01:23, 2.53it/s]
16%|██████▋ | 40/250 [00:18<01:33, 2.24it/s]
16%|██████▉ | 41/250 [00:18<01:30, 2.32it/s]
17%|███████ | 42/250 [00:19<01:57, 1.76it/s]
17%|███████▏ | 43/250 [00:19<01:51, 1.85it/s]
18%|███████▍ | 44/250 [00:20<01:41, 2.04it/s]
18%|███████▌ | 45/250 [00:20<01:36, 2.13it/s]
18%|███████▋ | 46/250 [00:21<01:33, 2.17it/s]
19%|███████▉ | 47/250 [00:21<01:31, 2.23it/s]
19%|████████ | 48/250 [00:22<01:27, 2.30it/s]
20%|████████▏ | 49/250 [00:22<01:23, 2.40it/s]
20%|████████▍ | 50/250 [00:22<01:24, 2.37it/s]
20%|████████▌ | 51/250 [00:23<01:19, 2.51it/s]
21%|████████▋ | 52/250 [00:23<01:16, 2.60it/s]
21%|████████▉ | 53/250 [00:23<01:16, 2.57it/s]
22%|█████████ | 54/250 [00:24<01:19, 2.46it/s]
22%|█████████▏ | 55/250 [00:24<01:17, 2.51it/s]
22%|█████████▍ | 56/250 [00:25<01:14, 2.61it/s]
23%|█████████▌ | 57/250 [00:25<01:17, 2.49it/s]
23%|█████████▋ | 58/250 [00:25<01:14, 2.57it/s]
24%|█████████▉ | 59/250 [00:26<01:16, 2.51it/s]
24%|██████████ | 60/250 [00:26<01:16, 2.48it/s]
24%|██████████▏ | 61/250 [00:27<01:13, 2.58it/s]
25%|██████████▍ | 62/250 [00:27<01:22, 2.28it/s]
25%|██████████▌ | 63/250 [00:28<01:16, 2.44it/s]
26%|██████████▊ | 64/250 [00:28<01:22, 2.26it/s]
26%|██████████▉ | 65/250 [00:28<01:16, 2.43it/s]
26%|███████████ | 66/250 [00:29<01:10, 2.60it/s]
27%|███████████▎ | 67/250 [00:29<01:09, 2.64it/s]
27%|███████████▍ | 68/250 [00:29<01:12, 2.51it/s]
28%|███████████▌ | 69/250 [00:30<01:08, 2.63it/s]
28%|███████████▊ | 70/250 [00:30<01:04, 2.79it/s]
28%|███████████▉ | 71/250 [00:31<01:15, 2.38it/s]
29%|████████████ | 72/250 [00:31<01:12, 2.46it/s]
29%|████████████▎ | 73/250 [00:31<01:10, 2.51it/s]
30%|████████████▍ | 74/250 [00:32<01:09, 2.55it/s]
30%|████████████▌ | 75/250 [00:32<01:17, 2.26it/s]
30%|████████████▊ | 76/250 [00:33<01:18, 2.22it/s]
31%|████████████▉ | 77/250 [00:33<01:20, 2.16it/s]
31%|█████████████ | 78/250 [00:34<01:16, 2.24it/s]
32%|█████████████▎ | 79/250 [00:34<01:22, 2.08it/s]
32%|█████████████▍ | 80/250 [00:35<01:14, 2.27it/s]
32%|█████████████▌ | 81/250 [00:35<01:20, 2.10it/s]
33%|█████████████▊ | 82/250 [00:36<01:15, 2.22it/s]
33%|█████████████▉ | 83/250 [00:36<01:10, 2.36it/s]
34%|██████████████ | 84/250 [00:37<01:19, 2.08it/s]
34%|██████████████▎ | 85/250 [00:37<01:14, 2.21it/s]
34%|██████████████▍ | 86/250 [00:38<01:19, 2.07it/s]
35%|██████████████▌ | 87/250 [00:38<01:12, 2.23it/s]
35%|██████████████▊ | 88/250 [00:38<01:15, 2.14it/s]
36%|██████████████▉ | 89/250 [00:39<01:22, 1.95it/s]
36%|███████████████ | 90/250 [00:40<01:24, 1.89it/s]
36%|███████████████▎ | 91/250 [00:40<01:22, 1.94it/s]
37%|███████████████▍ | 92/250 [00:41<01:19, 1.99it/s]
37%|███████████████▌ | 93/250 [00:41<01:14, 2.10it/s]
38%|███████████████▊ | 94/250 [00:41<01:11, 2.17it/s]
38%|███████████████▉ | 95/250 [00:42<01:11, 2.17it/s]
38%|████████████████▏ | 96/250 [00:42<01:07, 2.27it/s]
39%|████████████████▎ | 97/250 [00:43<01:02, 2.44it/s]
39%|████████████████▍ | 98/250 [00:43<01:07, 2.24it/s]
40%|████████████████▋ | 99/250 [00:44<01:11, 2.10it/s]
40%|████████████████▍ | 100/250 [00:45<01:29, 1.67it/s]
40%|████████████████▌ | 101/250 [00:45<01:26, 1.72it/s]
41%|████████████████▋ | 102/250 [00:45<01:16, 1.94it/s]
41%|████████████████▉ | 103/250 [00:46<01:11, 2.06it/s]
42%|█████████████████ | 104/250 [00:46<01:07, 2.16it/s]
42%|█████████████████▏ | 105/250 [00:47<01:02, 2.32it/s]
42%|█████████████████▍ | 106/250 [00:47<00:59, 2.43it/s]
43%|█████████████████▌ | 107/250 [00:47<00:58, 2.45it/s]
43%|█████████████████▋ | 108/250 [00:48<01:06, 2.12it/s]
44%|█████████████████▉ | 109/250 [00:48<01:00, 2.35it/s]
44%|██████████████████ | 110/250 [00:49<01:06, 2.10it/s]
44%|██████████████████▏ | 111/250 [00:49<01:01, 2.25it/s]
45%|██████████████████▎ | 112/250 [00:50<01:14, 1.86it/s]
45%|██████████████████▌ | 113/250 [00:50<01:06, 2.07it/s]
46%|██████████████████▋ | 114/250 [00:51<00:58, 2.34it/s]
46%|██████████████████▊ | 115/250 [00:51<01:07, 1.99it/s]
46%|███████████████████ | 116/250 [00:52<00:59, 2.24it/s]
47%|███████████████████▏ | 117/250 [00:52<00:54, 2.45it/s]
47%|███████████████████▎ | 118/250 [00:52<00:54, 2.40it/s]
48%|███████████████████▌ | 119/250 [00:53<00:54, 2.40it/s]
48%|███████████████████▋ | 120/250 [00:53<00:59, 2.20it/s]
48%|███████████████████▊ | 121/250 [00:54<00:57, 2.25it/s]
49%|████████████████████ | 122/250 [00:54<00:54, 2.33it/s]
49%|████████████████████▏ | 123/250 [00:55<00:53, 2.36it/s]
50%|████████████████████▎ | 124/250 [00:55<00:51, 2.46it/s]
50%|████████████████████▌ | 125/250 [00:55<00:48, 2.60it/s]
50%|████████████████████▋ | 126/250 [00:56<00:48, 2.55it/s]
51%|████████████████████▊ | 127/250 [00:56<00:46, 2.66it/s]
51%|████████████████████▉ | 128/250 [00:56<00:43, 2.79it/s]
52%|█████████████████████▏ | 129/250 [00:57<00:41, 2.88it/s]
52%|█████████████████████▎ | 130/250 [00:57<00:42, 2.85it/s]
52%|█████████████████████▍ | 131/250 [00:57<00:43, 2.75it/s]
53%|█████████████████████▋ | 132/250 [00:58<00:44, 2.64it/s]
53%|█████████████████████▊ | 133/250 [00:58<00:45, 2.57it/s]
54%|█████████████████████▉ | 134/250 [00:59<00:43, 2.66it/s]
54%|██████████████████████▏ | 135/250 [00:59<00:41, 2.80it/s]
54%|██████████████████████▎ | 136/250 [00:59<00:44, 2.56it/s]
55%|██████████████████████▍ | 137/250 [01:00<00:42, 2.63it/s]
55%|██████████████████████▋ | 138/250 [01:00<00:42, 2.64it/s]
56%|██████████████████████▊ | 139/250 [01:01<00:58, 1.89it/s]
56%|██████████████████████▉ | 140/250 [01:02<01:10, 1.57it/s]
56%|███████████████████████ | 141/250 [01:03<01:07, 1.62it/s]
57%|███████████████████████▎ | 142/250 [01:03<01:09, 1.56it/s]
57%|███████████████████████▍ | 143/250 [01:04<01:02, 1.71it/s]
58%|███████████████████████▌ | 144/250 [01:04<01:06, 1.59it/s]
58%|███████████████████████▊ | 145/250 [01:05<01:09, 1.50it/s]
58%|███████████████████████▉ | 146/250 [01:06<01:03, 1.64it/s]
59%|████████████████████████ | 147/250 [01:06<00:57, 1.79it/s]
59%|████████████████████████▎ | 148/250 [01:07<00:54, 1.88it/s]
60%|████████████████████████▍ | 149/250 [01:07<00:47, 2.11it/s]
60%|████████████████████████▌ | 150/250 [01:07<00:43, 2.31it/s]
60%|████████████████████████▊ | 151/250 [01:08<00:41, 2.41it/s]
61%|████████████████████████▉ | 152/250 [01:08<00:38, 2.56it/s]
61%|█████████████████████████ | 153/250 [01:08<00:36, 2.63it/s]
62%|█████████████████████████▎ | 154/250 [01:09<00:47, 2.03it/s]
62%|█████████████████████████▍ | 155/250 [01:09<00:43, 2.17it/s]
62%|█████████████████████████▌ | 156/250 [01:10<00:46, 2.01it/s]
63%|█████████████████████████▋ | 157/250 [01:10<00:42, 2.18it/s]
63%|█████████████████████████▉ | 158/250 [01:11<00:39, 2.33it/s]
64%|██████████████████████████ | 159/250 [01:11<00:37, 2.45it/s]
64%|██████████████████████████▏ | 160/250 [01:11<00:35, 2.54it/s]
64%|██████████████████████████▍ | 161/250 [01:12<00:33, 2.69it/s]
65%|██████████████████████████▌ | 162/250 [01:12<00:33, 2.65it/s]
65%|██████████████████████████▋ | 163/250 [01:13<00:32, 2.70it/s]
66%|██████████████████████████▉ | 164/250 [01:13<00:29, 2.88it/s]
66%|███████████████████████████ | 165/250 [01:13<00:35, 2.37it/s]
66%|███████████████████████████▏ | 166/250 [01:14<00:34, 2.45it/s]
67%|███████████████████████████▍ | 167/250 [01:14<00:33, 2.51it/s]
67%|███████████████████████████▌ | 168/250 [01:15<00:33, 2.47it/s]
68%|███████████████████████████▋ | 169/250 [01:15<00:30, 2.67it/s]
68%|███████████████████████████▉ | 170/250 [01:15<00:31, 2.58it/s]
68%|████████████████████████████ | 171/250 [01:16<00:29, 2.69it/s]
69%|████████████████████████████▏ | 172/250 [01:16<00:29, 2.62it/s]
69%|████████████████████████████▎ | 173/250 [01:16<00:27, 2.75it/s]
70%|████████████████████████████▌ | 174/250 [01:17<00:26, 2.82it/s]
70%|████████████████████████████▋ | 175/250 [01:17<00:27, 2.74it/s]
70%|████████████████████████████▊ | 176/250 [01:17<00:27, 2.73it/s]
71%|█████████████████████████████ | 177/250 [01:18<00:31, 2.29it/s]
71%|█████████████████████████████▏ | 178/250 [01:18<00:30, 2.39it/s]
72%|█████████████████████████████▎ | 179/250 [01:19<00:27, 2.61it/s]
72%|█████████████████████████████▌ | 180/250 [01:19<00:27, 2.58it/s]
72%|█████████████████████████████▋ | 181/250 [01:20<00:26, 2.56it/s]
73%|█████████████████████████████▊ | 182/250 [01:20<00:25, 2.65it/s]
73%|██████████████████████████████ | 183/250 [01:20<00:27, 2.47it/s]
74%|██████████████████████████████▏ | 184/250 [01:21<00:27, 2.39it/s]
74%|██████████████████████████████▎ | 185/250 [01:21<00:25, 2.51it/s]
74%|██████████████████████████████▌ | 186/250 [01:21<00:24, 2.64it/s]
75%|██████████████████████████████▋ | 187/250 [01:22<00:23, 2.71it/s]
75%|██████████████████████████████▊ | 188/250 [01:22<00:27, 2.25it/s]
76%|██████████████████████████████▉ | 189/250 [01:23<00:25, 2.39it/s]
76%|███████████████████████████████▏ | 190/250 [01:23<00:23, 2.51it/s]
76%|███████████████████████████████▎ | 191/250 [01:24<00:23, 2.49it/s]
77%|███████████████████████████████▍ | 192/250 [01:24<00:23, 2.42it/s]
77%|███████████████████████████████▋ | 193/250 [01:24<00:22, 2.48it/s]
78%|███████████████████████████████▊ | 194/250 [01:25<00:22, 2.53it/s]
78%|███████████████████████████████▉ | 195/250 [01:25<00:21, 2.54it/s]
78%|████████████████████████████████▏ | 196/250 [01:26<00:20, 2.58it/s]
79%|████████████████████████████████▎ | 197/250 [01:26<00:19, 2.73it/s]
79%|████████████████████████████████▍ | 198/250 [01:26<00:19, 2.67it/s]
80%|████████████████████████████████▋ | 199/250 [01:27<00:18, 2.73it/s]
80%|████████████████████████████████▊ | 200/250 [01:27<00:21, 2.29it/s]
80%|████████████████████████████████▉ | 201/250 [01:28<00:20, 2.38it/s]
81%|█████████████████████████████████▏ | 202/250 [01:28<00:22, 2.15it/s]
81%|█████████████████████████████████▎ | 203/250 [01:28<00:19, 2.39it/s]
82%|█████████████████████████████████▍ | 204/250 [01:29<00:18, 2.55it/s]
82%|█████████████████████████████████▌ | 205/250 [01:29<00:16, 2.72it/s]
82%|█████████████████████████████████▊ | 206/250 [01:29<00:16, 2.62it/s]
83%|█████████████████████████████████▉ | 207/250 [01:30<00:17, 2.42it/s]
83%|██████████████████████████████████ | 208/250 [01:30<00:17, 2.41it/s]
84%|██████████████████████████████████▎ | 209/250 [01:31<00:16, 2.52it/s]
84%|██████████████████████████████████▍ | 210/250 [01:31<00:14, 2.72it/s]
84%|██████████████████████████████████▌ | 211/250 [01:31<00:14, 2.66it/s]
85%|██████████████████████████████████▊ | 212/250 [01:32<00:14, 2.57it/s]
85%|██████████████████████████████████▉ | 213/250 [01:32<00:14, 2.56it/s]
86%|███████████████████████████████████ | 214/250 [01:33<00:16, 2.19it/s]
86%|███████████████████████████████████▎ | 215/250 [01:33<00:16, 2.10it/s]
86%|███████████████████████████████████▍ | 216/250 [01:34<00:16, 2.05it/s]
87%|███████████████████████████████████▌ | 217/250 [01:34<00:14, 2.22it/s]
87%|███████████████████████████████████▊ | 218/250 [01:35<00:13, 2.37it/s]
88%|███████████████████████████████████▉ | 219/250 [01:35<00:15, 2.04it/s]
88%|████████████████████████████████████ | 220/250 [01:36<00:13, 2.27it/s]
88%|████████████████████████████████████▏ | 221/250 [01:36<00:11, 2.44it/s]
89%|████████████████████████████████████▍ | 222/250 [01:36<00:10, 2.58it/s]
89%|████████████████████████████████████▌ | 223/250 [01:37<00:09, 2.73it/s]
90%|████████████████████████████████████▋ | 224/250 [01:37<00:09, 2.63it/s]
90%|████████████████████████████████████▉ | 225/250 [01:37<00:09, 2.68it/s]
90%|█████████████████████████████████████ | 226/250 [01:38<00:08, 2.81it/s]
91%|█████████████████████████████████████▏ | 227/250 [01:38<00:07, 2.89it/s]
91%|█████████████████████████████████████▍ | 228/250 [01:38<00:07, 2.91it/s]
92%|█████████████████████████████████████▌ | 229/250 [01:39<00:07, 2.84it/s]
92%|█████████████████████████████████████▋ | 230/250 [01:39<00:07, 2.83it/s]
92%|█████████████████████████████████████▉ | 231/250 [01:39<00:06, 2.73it/s]
93%|██████████████████████████████████████ | 232/250 [01:40<00:06, 2.72it/s]
93%|██████████████████████████████████████▏ | 233/250 [01:40<00:06, 2.68it/s]
94%|██████████████████████████████████████▍ | 234/250 [01:41<00:05, 2.71it/s]
94%|██████████████████████████████████████▌ | 235/250 [01:41<00:05, 2.70it/s]
94%|██████████████████████████████████████▋ | 236/250 [01:42<00:06, 2.28it/s]
95%|██████████████████████████████████████▊ | 237/250 [01:42<00:05, 2.43it/s]
95%|███████████████████████████████████████ | 238/250 [01:42<00:04, 2.42it/s]
96%|███████████████████████████████████████▏ | 239/250 [01:43<00:06, 1.80it/s]
96%|███████████████████████████████████████▎ | 240/250 [01:44<00:05, 1.95it/s]
96%|███████████████████████████████████████▌ | 241/250 [01:44<00:04, 2.15it/s]
97%|███████████████████████████████████████▋ | 242/250 [01:44<00:03, 2.32it/s]
97%|███████████████████████████████████████▊ | 243/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████ | 244/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████▏| 245/250 [01:46<00:02, 2.32it/s]
98%|████████████████████████████████████████▎| 246/250 [01:46<00:01, 2.36it/s]
99%|████████████████████████████████████████▌| 247/250 [01:47<00:01, 2.16it/s]
99%|████████████████████████████████████████▋| 248/250 [01:47<00:00, 2.31it/s]
100%|████████████████████████████████████████▊| 249/250 [01:47<00:00, 2.55it/s]
100%|█████████████████████████████████████████| 250/250 [01:48<00:00, 2.38it/s]
{'eval_loss': 1.1005803346633911, 'eval_runtime': 108.781, 'eval_samples_per_second': 18.386, 'eval_steps_per_second': 2.298, 'epoch': 0.4}
40%|██████████████▊ | 156/390 [1:23:39<1:59:03, 30.53s/it]
{'loss': 1.0781, 'learning_rate': 0.00019658119658119659, 'epoch': 0.41}
{'loss': 1.1028, 'learning_rate': 0.00017948717948717947, 'epoch': 0.46}
50%|██████████████████▌ | 195/390 [1:42:37<1:36:02, 29.55s/it]
0%| | 0/250 [00:00<?, ?it/s]
1%|▎ | 2/250 [00:00<00:44, 5.57it/s]
1%|▌ | 3/250 [00:01<01:32, 2.67it/s]
2%|▋ | 4/250 [00:01<01:36, 2.56it/s]
2%|▊ | 5/250 [00:01<01:48, 2.26it/s]
2%|█ | 6/250 [00:02<01:44, 2.34it/s]
3%|█▏ | 7/250 [00:02<01:41, 2.39it/s]
3%|█▍ | 8/250 [00:03<01:36, 2.52it/s]
4%|█▌ | 9/250 [00:03<01:45, 2.28it/s]
4%|█▋ | 10/250 [00:04<01:55, 2.08it/s]
4%|█▊ | 11/250 [00:04<02:05, 1.90it/s]
5%|██ | 12/250 [00:05<02:08, 1.86it/s]
5%|██▏ | 13/250 [00:05<02:07, 1.86it/s]
6%|██▎ | 14/250 [00:06<02:03, 1.91it/s]
6%|██▌ | 15/250 [00:07<02:28, 1.58it/s]
6%|██▋ | 16/250 [00:07<02:12, 1.77it/s]
7%|██▊ | 17/250 [00:08<01:58, 1.96it/s]
7%|███ | 18/250 [00:08<01:47, 2.16it/s]
8%|███▏ | 19/250 [00:08<01:41, 2.27it/s]
8%|███▎ | 20/250 [00:09<02:03, 1.87it/s]
8%|███▌ | 21/250 [00:10<01:58, 1.94it/s]
9%|███▋ | 22/250 [00:10<01:50, 2.06it/s]
9%|███▊ | 23/250 [00:10<01:40, 2.26it/s]
10%|████ | 24/250 [00:11<01:37, 2.31it/s]
10%|████▏ | 25/250 [00:11<01:31, 2.45it/s]
10%|████▎ | 26/250 [00:12<01:41, 2.21it/s]
11%|████▌ | 27/250 [00:12<01:33, 2.38it/s]
11%|████▋ | 28/250 [00:12<01:37, 2.28it/s]
12%|████▊ | 29/250 [00:13<02:00, 1.83it/s]
12%|█████ | 30/250 [00:14<01:48, 2.04it/s]
12%|█████▏ | 31/250 [00:14<01:39, 2.19it/s]
13%|█████▍ | 32/250 [00:14<01:28, 2.45it/s]
13%|█████▌ | 33/250 [00:15<01:29, 2.44it/s]
14%|█████▋ | 34/250 [00:15<01:28, 2.44it/s]
14%|█████▉ | 35/250 [00:15<01:22, 2.60it/s]
14%|██████ | 36/250 [00:16<01:27, 2.45it/s]
15%|██████▏ | 37/250 [00:16<01:34, 2.26it/s]
15%|██████▍ | 38/250 [00:17<01:27, 2.42it/s]
16%|██████▌ | 39/250 [00:17<01:23, 2.53it/s]
16%|██████▋ | 40/250 [00:18<01:33, 2.24it/s]
16%|██████▉ | 41/250 [00:18<01:30, 2.32it/s]
17%|███████ | 42/250 [00:19<01:57, 1.76it/s]
17%|███████▏ | 43/250 [00:19<01:51, 1.85it/s]
18%|███████▍ | 44/250 [00:20<01:41, 2.04it/s]
18%|███████▌ | 45/250 [00:20<01:35, 2.14it/s]
18%|███████▋ | 46/250 [00:21<01:33, 2.18it/s]
19%|███████▉ | 47/250 [00:21<01:31, 2.23it/s]
19%|████████ | 48/250 [00:22<01:27, 2.31it/s]
20%|████████▏ | 49/250 [00:22<01:23, 2.40it/s]
20%|████████▍ | 50/250 [00:22<01:24, 2.37it/s]
20%|████████▌ | 51/250 [00:23<01:19, 2.51it/s]
21%|████████▋ | 52/250 [00:23<01:16, 2.59it/s]
21%|████████▉ | 53/250 [00:23<01:16, 2.56it/s]
22%|█████████ | 54/250 [00:24<01:19, 2.45it/s]
22%|█████████▏ | 55/250 [00:24<01:18, 2.50it/s]
22%|█████████▍ | 56/250 [00:25<01:14, 2.61it/s]
23%|█████████▌ | 57/250 [00:25<01:17, 2.48it/s]
23%|█████████▋ | 58/250 [00:25<01:14, 2.56it/s]
24%|█████████▉ | 59/250 [00:26<01:16, 2.50it/s]
24%|██████████ | 60/250 [00:26<01:16, 2.48it/s]
24%|██████████▏ | 61/250 [00:27<01:13, 2.58it/s]
25%|██████████▍ | 62/250 [00:27<01:22, 2.28it/s]
25%|██████████▌ | 63/250 [00:28<01:16, 2.44it/s]
26%|██████████▊ | 64/250 [00:28<01:22, 2.26it/s]
26%|██████████▉ | 65/250 [00:28<01:16, 2.43it/s]
26%|███████████ | 66/250 [00:29<01:10, 2.60it/s]
27%|███████████▎ | 67/250 [00:29<01:09, 2.64it/s]
27%|███████████▍ | 68/250 [00:29<01:12, 2.51it/s]
28%|███████████▌ | 69/250 [00:30<01:08, 2.63it/s]
28%|███████████▊ | 70/250 [00:30<01:03, 2.82it/s]
28%|███████████▉ | 71/250 [00:31<01:14, 2.40it/s]
29%|████████████ | 72/250 [00:31<01:12, 2.47it/s]
29%|████████████▎ | 73/250 [00:31<01:10, 2.52it/s]
30%|████████████▍ | 74/250 [00:32<01:08, 2.56it/s]
30%|████████████▌ | 75/250 [00:32<01:17, 2.27it/s]
30%|████████████▊ | 76/250 [00:33<01:18, 2.22it/s]
31%|████████████▉ | 77/250 [00:33<01:20, 2.16it/s]
31%|█████████████ | 78/250 [00:34<01:16, 2.24it/s]
32%|█████████████▎ | 79/250 [00:34<01:22, 2.08it/s]
32%|█████████████▍ | 80/250 [00:35<01:14, 2.27it/s]
32%|█████████████▌ | 81/250 [00:35<01:20, 2.10it/s]
33%|█████████████▊ | 82/250 [00:36<01:15, 2.21it/s]
33%|█████████████▉ | 83/250 [00:36<01:10, 2.36it/s]
34%|██████████████ | 84/250 [00:37<01:19, 2.08it/s]
34%|██████████████▎ | 85/250 [00:37<01:14, 2.21it/s]
34%|██████████████▍ | 86/250 [00:38<01:19, 2.06it/s]
35%|██████████████▌ | 87/250 [00:38<01:13, 2.23it/s]
35%|██████████████▊ | 88/250 [00:38<01:15, 2.14it/s]
36%|██████████████▉ | 89/250 [00:39<01:22, 1.95it/s]
36%|███████████████ | 90/250 [00:40<01:24, 1.89it/s]
36%|███████████████▎ | 91/250 [00:40<01:22, 1.94it/s]
37%|███████████████▍ | 92/250 [00:41<01:19, 1.99it/s]
37%|███████████████▌ | 93/250 [00:41<01:14, 2.10it/s]
38%|███████████████▊ | 94/250 [00:41<01:11, 2.18it/s]
38%|███████████████▉ | 95/250 [00:42<01:11, 2.18it/s]
38%|████████████████▏ | 96/250 [00:42<01:07, 2.27it/s]
39%|████████████████▎ | 97/250 [00:43<01:02, 2.43it/s]
39%|████████████████▍ | 98/250 [00:43<01:08, 2.23it/s]
40%|████████████████▋ | 99/250 [00:44<01:11, 2.10it/s]
40%|████████████████▍ | 100/250 [00:45<01:30, 1.67it/s]
40%|████████████████▌ | 101/250 [00:45<01:26, 1.71it/s]
41%|████████████████▋ | 102/250 [00:45<01:16, 1.94it/s]
41%|████████████████▉ | 103/250 [00:46<01:11, 2.06it/s]
42%|█████████████████ | 104/250 [00:46<01:07, 2.16it/s]
42%|█████████████████▏ | 105/250 [00:47<01:02, 2.32it/s]
42%|█████████████████▍ | 106/250 [00:47<00:59, 2.42it/s]
43%|█████████████████▌ | 107/250 [00:47<00:58, 2.45it/s]
43%|█████████████████▋ | 108/250 [00:48<01:07, 2.12it/s]
44%|█████████████████▉ | 109/250 [00:48<01:00, 2.34it/s]
44%|██████████████████ | 110/250 [00:49<01:06, 2.10it/s]
44%|██████████████████▏ | 111/250 [00:49<01:01, 2.25it/s]
45%|██████████████████▎ | 112/250 [00:50<01:14, 1.86it/s]
45%|██████████████████▌ | 113/250 [00:50<01:06, 2.07it/s]
46%|██████████████████▋ | 114/250 [00:51<00:58, 2.34it/s]
46%|██████████████████▊ | 115/250 [00:51<01:07, 1.99it/s]
46%|███████████████████ | 116/250 [00:52<00:59, 2.24it/s]
47%|███████████████████▏ | 117/250 [00:52<00:54, 2.45it/s]
47%|███████████████████▎ | 118/250 [00:52<00:54, 2.40it/s]
48%|███████████████████▌ | 119/250 [00:53<00:54, 2.40it/s]
48%|███████████████████▋ | 120/250 [00:53<00:59, 2.19it/s]
48%|███████████████████▊ | 121/250 [00:54<00:57, 2.24it/s]
49%|████████████████████ | 122/250 [00:54<00:55, 2.33it/s]
49%|████████████████████▏ | 123/250 [00:55<00:53, 2.36it/s]
50%|████████████████████▎ | 124/250 [00:55<00:51, 2.45it/s]
50%|████████████████████▌ | 125/250 [00:55<00:48, 2.59it/s]
50%|████████████████████▋ | 126/250 [00:56<00:48, 2.54it/s]
51%|████████████████████▊ | 127/250 [00:56<00:46, 2.65it/s]
51%|████████████████████▉ | 128/250 [00:56<00:43, 2.79it/s]
52%|█████████████████████▏ | 129/250 [00:57<00:42, 2.88it/s]
52%|█████████████████████▎ | 130/250 [00:57<00:42, 2.85it/s]
52%|█████████████████████▍ | 131/250 [00:57<00:43, 2.75it/s]
53%|█████████████████████▋ | 132/250 [00:58<00:44, 2.64it/s]
53%|█████████████████████▊ | 133/250 [00:58<00:45, 2.57it/s]
54%|█████████████████████▉ | 134/250 [00:59<00:43, 2.66it/s]
54%|██████████████████████▏ | 135/250 [00:59<00:41, 2.80it/s]
54%|██████████████████████▎ | 136/250 [00:59<00:44, 2.56it/s]
55%|██████████████████████▍ | 137/250 [01:00<00:42, 2.63it/s]
55%|██████████████████████▋ | 138/250 [01:00<00:42, 2.65it/s]
56%|██████████████████████▊ | 139/250 [01:01<00:58, 1.89it/s]
56%|██████████████████████▉ | 140/250 [01:02<01:10, 1.57it/s]
56%|███████████████████████ | 141/250 [01:03<01:07, 1.62it/s]
57%|███████████████████████▎ | 142/250 [01:03<01:09, 1.55it/s]
57%|███████████████████████▍ | 143/250 [01:04<01:02, 1.71it/s]
58%|███████████████████████▌ | 144/250 [01:04<01:06, 1.59it/s]
58%|███████████████████████▊ | 145/250 [01:05<01:09, 1.50it/s]
58%|███████████████████████▉ | 146/250 [01:06<01:03, 1.64it/s]
59%|████████████████████████ | 147/250 [01:06<00:57, 1.79it/s]
59%|████████████████████████▎ | 148/250 [01:07<00:54, 1.89it/s]
60%|████████████████████████▍ | 149/250 [01:07<00:47, 2.11it/s]
60%|████████████████████████▌ | 150/250 [01:07<00:43, 2.31it/s]
60%|████████████████████████▊ | 151/250 [01:08<00:41, 2.41it/s]
61%|████████████████████████▉ | 152/250 [01:08<00:38, 2.56it/s]
61%|█████████████████████████ | 153/250 [01:08<00:36, 2.64it/s]
62%|█████████████████████████▎ | 154/250 [01:09<00:47, 2.03it/s]
62%|█████████████████████████▍ | 155/250 [01:09<00:43, 2.18it/s]
62%|█████████████████████████▌ | 156/250 [01:10<00:46, 2.01it/s]
63%|█████████████████████████▋ | 157/250 [01:10<00:42, 2.19it/s]
63%|█████████████████████████▉ | 158/250 [01:11<00:39, 2.34it/s]
64%|██████████████████████████ | 159/250 [01:11<00:36, 2.46it/s]
64%|██████████████████████████▏ | 160/250 [01:11<00:35, 2.55it/s]
64%|██████████████████████████▍ | 161/250 [01:12<00:32, 2.70it/s]
65%|██████████████████████████▌ | 162/250 [01:12<00:33, 2.66it/s]
65%|██████████████████████████▋ | 163/250 [01:13<00:32, 2.71it/s]
66%|██████████████████████████▉ | 164/250 [01:13<00:29, 2.89it/s]
66%|███████████████████████████ | 165/250 [01:13<00:35, 2.37it/s]
66%|███████████████████████████▏ | 166/250 [01:14<00:34, 2.46it/s]
67%|███████████████████████████▍ | 167/250 [01:14<00:33, 2.51it/s]
67%|███████████████████████████▌ | 168/250 [01:15<00:33, 2.47it/s]
68%|███████████████████████████▋ | 169/250 [01:15<00:30, 2.66it/s]
68%|███████████████████████████▉ | 170/250 [01:15<00:31, 2.58it/s]
68%|████████████████████████████ | 171/250 [01:16<00:29, 2.69it/s]
69%|████████████████████████████▏ | 172/250 [01:16<00:29, 2.62it/s]
69%|████████████████████████████▎ | 173/250 [01:16<00:27, 2.75it/s]
70%|████████████████████████████▌ | 174/250 [01:17<00:26, 2.82it/s]
70%|████████████████████████████▋ | 175/250 [01:17<00:27, 2.74it/s]
70%|████████████████████████████▊ | 176/250 [01:17<00:27, 2.74it/s]
71%|█████████████████████████████ | 177/250 [01:18<00:31, 2.29it/s]
71%|█████████████████████████████▏ | 178/250 [01:18<00:30, 2.39it/s]
72%|█████████████████████████████▎ | 179/250 [01:19<00:27, 2.61it/s]
72%|█████████████████████████████▌ | 180/250 [01:19<00:27, 2.58it/s]
72%|█████████████████████████████▋ | 181/250 [01:20<00:26, 2.56it/s]
73%|█████████████████████████████▊ | 182/250 [01:20<00:25, 2.65it/s]
73%|██████████████████████████████ | 183/250 [01:20<00:26, 2.48it/s]
74%|██████████████████████████████▏ | 184/250 [01:21<00:27, 2.40it/s]
74%|██████████████████████████████▎ | 185/250 [01:21<00:25, 2.51it/s]
74%|██████████████████████████████▌ | 186/250 [01:21<00:24, 2.64it/s]
75%|██████████████████████████████▋ | 187/250 [01:22<00:23, 2.72it/s]
75%|██████████████████████████████▊ | 188/250 [01:22<00:27, 2.25it/s]
76%|██████████████████████████████▉ | 189/250 [01:23<00:25, 2.39it/s]
76%|███████████████████████████████▏ | 190/250 [01:23<00:23, 2.50it/s]
76%|███████████████████████████████▎ | 191/250 [01:24<00:23, 2.49it/s]
77%|███████████████████████████████▍ | 192/250 [01:24<00:23, 2.42it/s]
77%|███████████████████████████████▋ | 193/250 [01:24<00:23, 2.48it/s]
78%|███████████████████████████████▊ | 194/250 [01:25<00:22, 2.53it/s]
78%|███████████████████████████████▉ | 195/250 [01:25<00:21, 2.54it/s]
78%|████████████████████████████████▏ | 196/250 [01:26<00:20, 2.57it/s]
79%|████████████████████████████████▎ | 197/250 [01:26<00:19, 2.73it/s]
79%|████████████████████████████████▍ | 198/250 [01:26<00:19, 2.67it/s]
80%|████████████████████████████████▋ | 199/250 [01:27<00:18, 2.73it/s]
80%|████████████████████████████████▊ | 200/250 [01:27<00:21, 2.29it/s]
80%|████████████████████████████████▉ | 201/250 [01:28<00:20, 2.38it/s]
81%|█████████████████████████████████▏ | 202/250 [01:28<00:22, 2.15it/s]
81%|█████████████████████████████████▎ | 203/250 [01:28<00:19, 2.40it/s]
82%|█████████████████████████████████▍ | 204/250 [01:29<00:18, 2.55it/s]
82%|█████████████████████████████████▌ | 205/250 [01:29<00:16, 2.73it/s]
82%|█████████████████████████████████▊ | 206/250 [01:29<00:16, 2.62it/s]
83%|█████████████████████████████████▉ | 207/250 [01:30<00:17, 2.43it/s]
83%|██████████████████████████████████ | 208/250 [01:30<00:17, 2.42it/s]
84%|██████████████████████████████████▎ | 209/250 [01:31<00:16, 2.53it/s]
84%|██████████████████████████████████▍ | 210/250 [01:31<00:14, 2.72it/s]
84%|██████████████████████████████████▌ | 211/250 [01:31<00:14, 2.67it/s]
85%|██████████████████████████████████▊ | 212/250 [01:32<00:14, 2.58it/s]
85%|██████████████████████████████████▉ | 213/250 [01:32<00:14, 2.57it/s]
86%|███████████████████████████████████ | 214/250 [01:33<00:16, 2.19it/s]
86%|███████████████████████████████████▎ | 215/250 [01:33<00:16, 2.10it/s]
86%|███████████████████████████████████▍ | 216/250 [01:34<00:16, 2.05it/s]
87%|███████████████████████████████████▌ | 217/250 [01:34<00:14, 2.22it/s]
87%|███████████████████████████████████▊ | 218/250 [01:35<00:13, 2.37it/s]
88%|███████████████████████████████████▉ | 219/250 [01:35<00:15, 2.04it/s]
88%|████████████████████████████████████ | 220/250 [01:36<00:13, 2.26it/s]
88%|████████████████████████████████████▏ | 221/250 [01:36<00:11, 2.44it/s]
89%|████████████████████████████████████▍ | 222/250 [01:36<00:10, 2.58it/s]
89%|████████████████████████████████████▌ | 223/250 [01:37<00:09, 2.73it/s]
90%|████████████████████████████████████▋ | 224/250 [01:37<00:09, 2.63it/s]
90%|████████████████████████████████████▉ | 225/250 [01:37<00:09, 2.68it/s]
90%|█████████████████████████████████████ | 226/250 [01:38<00:08, 2.81it/s]
91%|█████████████████████████████████████▏ | 227/250 [01:38<00:07, 2.89it/s]
91%|█████████████████████████████████████▍ | 228/250 [01:38<00:07, 2.92it/s]
92%|█████████████████████████████████████▌ | 229/250 [01:39<00:07, 2.85it/s]
92%|█████████████████████████████████████▋ | 230/250 [01:39<00:07, 2.84it/s]
92%|█████████████████████████████████████▉ | 231/250 [01:39<00:06, 2.73it/s]
93%|██████████████████████████████████████ | 232/250 [01:40<00:06, 2.73it/s]
93%|██████████████████████████████████████▏ | 233/250 [01:40<00:06, 2.71it/s]
94%|██████████████████████████████████████▍ | 234/250 [01:41<00:05, 2.73it/s]
94%|██████████████████████████████████████▌ | 235/250 [01:41<00:05, 2.72it/s]
94%|██████████████████████████████████████▋ | 236/250 [01:42<00:06, 2.28it/s]
95%|██████████████████████████████████████▊ | 237/250 [01:42<00:05, 2.44it/s]
95%|███████████████████████████████████████ | 238/250 [01:42<00:04, 2.42it/s]
96%|███████████████████████████████████████▏ | 239/250 [01:43<00:06, 1.80it/s]
96%|███████████████████████████████████████▎ | 240/250 [01:44<00:05, 1.95it/s]
96%|███████████████████████████████████████▌ | 241/250 [01:44<00:04, 2.15it/s]
97%|███████████████████████████████████████▋ | 242/250 [01:44<00:03, 2.32it/s]
97%|███████████████████████████████████████▊ | 243/250 [01:45<00:02, 2.47it/s]
98%|████████████████████████████████████████ | 244/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████▏| 245/250 [01:46<00:02, 2.32it/s]
98%|████████████████████████████████████████▎| 246/250 [01:46<00:01, 2.36it/s]
99%|████████████████████████████████████████▌| 247/250 [01:46<00:01, 2.16it/s]
99%|████████████████████████████████████████▋| 248/250 [01:47<00:00, 2.32it/s]
100%|████████████████████████████████████████▊| 249/250 [01:47<00:00, 2.55it/s]
100%|█████████████████████████████████████████| 250/250 [01:48<00:00, 2.38it/s]
{'eval_loss': 1.0975703001022339, 'eval_runtime': 108.7398, 'eval_samples_per_second': 18.393, 'eval_steps_per_second': 2.299, 'epoch': 0.5}
50%|██████████████████▌ | 195/390 [1:44:26<1:36:02, 29.55s/it]
{'loss': 1.0724, 'learning_rate': 0.00016239316239316238, 'epoch': 0.51}
{'loss': 1.0923, 'learning_rate': 0.0001452991452991453, 'epoch': 0.56}
60%|██████████████████████▏ | 234/390 [2:03:26<1:17:01, 29.63s/it]
0%| | 0/250 [00:00<?, ?it/s]
1%|▎ | 2/250 [00:00<00:44, 5.56it/s]
1%|▌ | 3/250 [00:01<01:32, 2.67it/s]
2%|▋ | 4/250 [00:01<01:36, 2.56it/s]
2%|▊ | 5/250 [00:01<01:48, 2.26it/s]
2%|█ | 6/250 [00:02<01:44, 2.34it/s]
3%|█▏ | 7/250 [00:02<01:41, 2.38it/s]
3%|█▍ | 8/250 [00:03<01:36, 2.51it/s]
4%|█▌ | 9/250 [00:03<01:45, 2.28it/s]
4%|█▋ | 10/250 [00:04<01:55, 2.08it/s]
4%|█▊ | 11/250 [00:04<02:05, 1.90it/s]
5%|██ | 12/250 [00:05<02:08, 1.85it/s]
5%|██▏ | 13/250 [00:05<02:07, 1.86it/s]
6%|██▎ | 14/250 [00:06<02:03, 1.90it/s]
6%|██▌ | 15/250 [00:07<02:28, 1.58it/s]
6%|██▋ | 16/250 [00:07<02:12, 1.77it/s]
7%|██▊ | 17/250 [00:08<01:58, 1.96it/s]
7%|███ | 18/250 [00:08<01:47, 2.16it/s]
8%|███▏ | 19/250 [00:08<01:41, 2.27it/s]
8%|███▎ | 20/250 [00:09<02:03, 1.87it/s]
8%|███▌ | 21/250 [00:10<01:58, 1.94it/s]
9%|███▋ | 22/250 [00:10<01:50, 2.06it/s]
9%|███▊ | 23/250 [00:10<01:40, 2.26it/s]
10%|████ | 24/250 [00:11<01:37, 2.31it/s]
10%|████▏ | 25/250 [00:11<01:31, 2.45it/s]
10%|████▎ | 26/250 [00:12<01:41, 2.21it/s]
11%|████▌ | 27/250 [00:12<01:33, 2.38it/s]
11%|████▋ | 28/250 [00:12<01:37, 2.28it/s]
12%|████▊ | 29/250 [00:13<02:00, 1.83it/s]
12%|█████ | 30/250 [00:14<01:47, 2.04it/s]
12%|█████▏ | 31/250 [00:14<01:39, 2.20it/s]
13%|█████▍ | 32/250 [00:14<01:29, 2.44it/s]
13%|█████▌ | 33/250 [00:15<01:29, 2.43it/s]
14%|█████▋ | 34/250 [00:15<01:28, 2.43it/s]
14%|█████▉ | 35/250 [00:15<01:22, 2.60it/s]
14%|██████ | 36/250 [00:16<01:27, 2.44it/s]
15%|██████▏ | 37/250 [00:16<01:34, 2.26it/s]
15%|██████▍ | 38/250 [00:17<01:27, 2.41it/s]
16%|██████▌ | 39/250 [00:17<01:23, 2.53it/s]
16%|██████▋ | 40/250 [00:18<01:33, 2.24it/s]
16%|██████▉ | 41/250 [00:18<01:30, 2.31it/s]
17%|███████ | 42/250 [00:19<01:57, 1.76it/s]
17%|███████▏ | 43/250 [00:19<01:52, 1.85it/s]
18%|███████▍ | 44/250 [00:20<01:41, 2.03it/s]
18%|███████▌ | 45/250 [00:20<01:36, 2.13it/s]
18%|███████▋ | 46/250 [00:21<01:33, 2.17it/s]
19%|███████▉ | 47/250 [00:21<01:31, 2.23it/s]
19%|████████ | 48/250 [00:22<01:27, 2.30it/s]
20%|████████▏ | 49/250 [00:22<01:23, 2.40it/s]
20%|████████▍ | 50/250 [00:22<01:24, 2.37it/s]
20%|████████▌ | 51/250 [00:23<01:19, 2.50it/s]
21%|████████▋ | 52/250 [00:23<01:16, 2.59it/s]
21%|████████▉ | 53/250 [00:23<01:16, 2.57it/s]
22%|█████████ | 54/250 [00:24<01:19, 2.45it/s]
22%|█████████▏ | 55/250 [00:24<01:18, 2.49it/s]
22%|█████████▍ | 56/250 [00:25<01:14, 2.60it/s]
23%|█████████▌ | 57/250 [00:25<01:17, 2.48it/s]
23%|█████████▋ | 58/250 [00:25<01:15, 2.56it/s]
24%|█████████▉ | 59/250 [00:26<01:16, 2.50it/s]
24%|██████████ | 60/250 [00:26<01:16, 2.48it/s]
24%|██████████▏ | 61/250 [00:27<01:13, 2.59it/s]
25%|██████████▍ | 62/250 [00:27<01:22, 2.28it/s]
25%|██████████▌ | 63/250 [00:28<01:16, 2.45it/s]
26%|██████████▊ | 64/250 [00:28<01:22, 2.26it/s]
26%|██████████▉ | 65/250 [00:28<01:16, 2.43it/s]
26%|███████████ | 66/250 [00:29<01:10, 2.60it/s]
27%|███████████▎ | 67/250 [00:29<01:09, 2.64it/s]
27%|███████████▍ | 68/250 [00:30<01:12, 2.51it/s]
28%|███████████▌ | 69/250 [00:30<01:08, 2.63it/s]
28%|███████████▊ | 70/250 [00:30<01:03, 2.82it/s]
28%|███████████▉ | 71/250 [00:31<01:14, 2.40it/s]
29%|████████████ | 72/250 [00:31<01:11, 2.47it/s]
29%|████████████▎ | 73/250 [00:31<01:10, 2.52it/s]
30%|████████████▍ | 74/250 [00:32<01:08, 2.56it/s]
30%|████████████▌ | 75/250 [00:32<01:17, 2.27it/s]
30%|████████████▊ | 76/250 [00:33<01:18, 2.23it/s]
31%|████████████▉ | 77/250 [00:33<01:19, 2.16it/s]
31%|█████████████ | 78/250 [00:34<01:16, 2.24it/s]
32%|█████████████▎ | 79/250 [00:34<01:22, 2.08it/s]
32%|█████████████▍ | 80/250 [00:35<01:14, 2.27it/s]
32%|█████████████▌ | 81/250 [00:35<01:20, 2.10it/s]
33%|█████████████▊ | 82/250 [00:36<01:15, 2.21it/s]
33%|█████████████▉ | 83/250 [00:36<01:10, 2.36it/s]
34%|██████████████ | 84/250 [00:37<01:19, 2.08it/s]
34%|██████████████▎ | 85/250 [00:37<01:14, 2.21it/s]
34%|██████████████▍ | 86/250 [00:38<01:19, 2.06it/s]
35%|██████████████▌ | 87/250 [00:38<01:13, 2.23it/s]
35%|██████████████▊ | 88/250 [00:38<01:15, 2.14it/s]
36%|██████████████▉ | 89/250 [00:39<01:22, 1.95it/s]
36%|███████████████ | 90/250 [00:40<01:24, 1.89it/s]
36%|███████████████▎ | 91/250 [00:40<01:21, 1.94it/s]
37%|███████████████▍ | 92/250 [00:41<01:19, 1.99it/s]
37%|███████████████▌ | 93/250 [00:41<01:14, 2.10it/s]
38%|███████████████▊ | 94/250 [00:41<01:11, 2.18it/s]
38%|███████████████▉ | 95/250 [00:42<01:11, 2.17it/s]
38%|████████████████▏ | 96/250 [00:42<01:07, 2.27it/s]
39%|████████████████▎ | 97/250 [00:43<01:02, 2.44it/s]
39%|████████████████▍ | 98/250 [00:43<01:07, 2.24it/s]
40%|████████████████▋ | 99/250 [00:44<01:11, 2.10it/s]
40%|████████████████▍ | 100/250 [00:45<01:29, 1.67it/s]
40%|████████████████▌ | 101/250 [00:45<01:26, 1.71it/s]
41%|████████████████▋ | 102/250 [00:45<01:16, 1.94it/s]
41%|████████████████▉ | 103/250 [00:46<01:11, 2.06it/s]
42%|█████████████████ | 104/250 [00:46<01:07, 2.16it/s]
42%|█████████████████▏ | 105/250 [00:47<01:02, 2.32it/s]
42%|█████████████████▍ | 106/250 [00:47<00:59, 2.42it/s]
43%|█████████████████▌ | 107/250 [00:47<00:58, 2.45it/s]
43%|█████████████████▋ | 108/250 [00:48<01:07, 2.12it/s]
44%|█████████████████▉ | 109/250 [00:48<01:00, 2.34it/s]
44%|██████████████████ | 110/250 [00:49<01:06, 2.10it/s]
44%|██████████████████▏ | 111/250 [00:49<01:01, 2.25it/s]
45%|██████████████████▎ | 112/250 [00:50<01:14, 1.86it/s]
45%|██████████████████▌ | 113/250 [00:50<01:06, 2.07it/s]
46%|██████████████████▋ | 114/250 [00:51<00:58, 2.34it/s]
46%|██████████████████▊ | 115/250 [00:51<01:07, 1.99it/s]
46%|███████████████████ | 116/250 [00:52<00:59, 2.24it/s]
47%|███████████████████▏ | 117/250 [00:52<00:54, 2.46it/s]
47%|███████████████████▎ | 118/250 [00:52<00:54, 2.41it/s]
48%|███████████████████▌ | 119/250 [00:53<00:54, 2.40it/s]
48%|███████████████████▋ | 120/250 [00:53<00:59, 2.20it/s]
48%|███████████████████▊ | 121/250 [00:54<00:57, 2.25it/s]
49%|████████████████████ | 122/250 [00:54<00:54, 2.33it/s]
49%|████████████████████▏ | 123/250 [00:55<00:53, 2.36it/s]
50%|████████████████████▎ | 124/250 [00:55<00:51, 2.45it/s]
50%|████████████████████▌ | 125/250 [00:55<00:48, 2.59it/s]
50%|████████████████████▋ | 126/250 [00:56<00:48, 2.54it/s]
51%|████████████████████▊ | 127/250 [00:56<00:46, 2.65it/s]
51%|████████████████████▉ | 128/250 [00:56<00:43, 2.79it/s]
52%|█████████████████████▏ | 129/250 [00:57<00:42, 2.88it/s]
52%|█████████████████████▎ | 130/250 [00:57<00:41, 2.86it/s]
52%|█████████████████████▍ | 131/250 [00:58<00:43, 2.75it/s]
53%|█████████████████████▋ | 132/250 [00:58<00:44, 2.65it/s]
53%|█████████████████████▊ | 133/250 [00:58<00:45, 2.58it/s]
54%|█████████████████████▉ | 134/250 [00:59<00:43, 2.67it/s]
54%|██████████████████████▏ | 135/250 [00:59<00:40, 2.81it/s]
54%|██████████████████████▎ | 136/250 [00:59<00:44, 2.56it/s]
55%|██████████████████████▍ | 137/250 [01:00<00:42, 2.64it/s]
55%|██████████████████████▋ | 138/250 [01:00<00:42, 2.65it/s]
56%|██████████████████████▊ | 139/250 [01:01<00:58, 1.89it/s]
56%|██████████████████████▉ | 140/250 [01:02<01:10, 1.57it/s]
56%|███████████████████████ | 141/250 [01:03<01:07, 1.62it/s]
57%|███████████████████████▎ | 142/250 [01:03<01:09, 1.56it/s]
57%|███████████████████████▍ | 143/250 [01:04<01:02, 1.71it/s]
58%|███████████████████████▌ | 144/250 [01:04<01:06, 1.59it/s]
58%|███████████████████████▊ | 145/250 [01:05<01:09, 1.50it/s]
58%|███████████████████████▉ | 146/250 [01:06<01:03, 1.64it/s]
59%|████████████████████████ | 147/250 [01:06<00:57, 1.79it/s]
59%|████████████████████████▎ | 148/250 [01:07<00:54, 1.88it/s]
60%|████████████████████████▍ | 149/250 [01:07<00:47, 2.11it/s]
60%|████████████████████████▌ | 150/250 [01:07<00:43, 2.31it/s]
60%|████████████████████████▊ | 151/250 [01:08<00:41, 2.41it/s]
61%|████████████████████████▉ | 152/250 [01:08<00:38, 2.56it/s]
61%|█████████████████████████ | 153/250 [01:08<00:36, 2.64it/s]
62%|█████████████████████████▎ | 154/250 [01:09<00:47, 2.04it/s]
62%|█████████████████████████▍ | 155/250 [01:09<00:43, 2.18it/s]
62%|█████████████████████████▌ | 156/250 [01:10<00:46, 2.01it/s]
63%|█████████████████████████▋ | 157/250 [01:10<00:42, 2.19it/s]
63%|█████████████████████████▉ | 158/250 [01:11<00:39, 2.34it/s]
64%|██████████████████████████ | 159/250 [01:11<00:37, 2.46it/s]
64%|██████████████████████████▏ | 160/250 [01:11<00:35, 2.55it/s]
64%|██████████████████████████▍ | 161/250 [01:12<00:32, 2.71it/s]
65%|██████████████████████████▌ | 162/250 [01:12<00:33, 2.66it/s]
65%|██████████████████████████▋ | 163/250 [01:12<00:32, 2.71it/s]
66%|██████████████████████████▉ | 164/250 [01:13<00:29, 2.89it/s]
66%|███████████████████████████ | 165/250 [01:13<00:35, 2.37it/s]
66%|███████████████████████████▏ | 166/250 [01:14<00:34, 2.46it/s]
67%|███████████████████████████▍ | 167/250 [01:14<00:33, 2.51it/s]
67%|███████████████████████████▌ | 168/250 [01:15<00:33, 2.46it/s]
68%|███████████████████████████▋ | 169/250 [01:15<00:30, 2.66it/s]
68%|███████████████████████████▉ | 170/250 [01:15<00:31, 2.58it/s]
68%|████████████████████████████ | 171/250 [01:16<00:29, 2.69it/s]
69%|████████████████████████████▏ | 172/250 [01:16<00:29, 2.62it/s]
69%|████████████████████████████▎ | 173/250 [01:16<00:28, 2.75it/s]
70%|████████████████████████████▌ | 174/250 [01:17<00:26, 2.82it/s]
70%|████████████████████████████▋ | 175/250 [01:17<00:27, 2.74it/s]
70%|████████████████████████████▊ | 176/250 [01:17<00:27, 2.74it/s]
71%|█████████████████████████████ | 177/250 [01:18<00:31, 2.29it/s]
71%|█████████████████████████████▏ | 178/250 [01:18<00:30, 2.40it/s]
72%|█████████████████████████████▎ | 179/250 [01:19<00:27, 2.62it/s]
72%|█████████████████████████████▌ | 180/250 [01:19<00:27, 2.58it/s]
72%|█████████████████████████████▋ | 181/250 [01:20<00:26, 2.56it/s]
73%|█████████████████████████████▊ | 182/250 [01:20<00:25, 2.66it/s]
73%|██████████████████████████████ | 183/250 [01:20<00:26, 2.49it/s]
74%|██████████████████████████████▏ | 184/250 [01:21<00:27, 2.40it/s]
74%|██████████████████████████████▎ | 185/250 [01:21<00:25, 2.52it/s]
74%|██████████████████████████████▌ | 186/250 [01:21<00:24, 2.64it/s]
75%|██████████████████████████████▋ | 187/250 [01:22<00:23, 2.72it/s]
75%|██████████████████████████████▊ | 188/250 [01:22<00:27, 2.25it/s]
76%|██████████████████████████████▉ | 189/250 [01:23<00:25, 2.39it/s]
76%|███████████████████████████████▏ | 190/250 [01:23<00:23, 2.51it/s]
76%|███████████████████████████████▎ | 191/250 [01:24<00:23, 2.50it/s]
77%|███████████████████████████████▍ | 192/250 [01:24<00:23, 2.43it/s]
77%|███████████████████████████████▋ | 193/250 [01:24<00:23, 2.47it/s]
78%|███████████████████████████████▊ | 194/250 [01:25<00:22, 2.53it/s]
78%|███████████████████████████████▉ | 195/250 [01:25<00:21, 2.53it/s]
78%|████████████████████████████████▏ | 196/250 [01:25<00:20, 2.57it/s]
79%|████████████████████████████████▎ | 197/250 [01:26<00:19, 2.73it/s]
79%|████████████████████████████████▍ | 198/250 [01:26<00:19, 2.67it/s]
80%|████████████████████████████████▋ | 199/250 [01:27<00:18, 2.73it/s]
80%|████████████████████████████████▊ | 200/250 [01:27<00:21, 2.29it/s]
80%|████████████████████████████████▉ | 201/250 [01:28<00:20, 2.38it/s]
81%|█████████████████████████████████▏ | 202/250 [01:28<00:22, 2.15it/s]
81%|█████████████████████████████████▎ | 203/250 [01:28<00:19, 2.40it/s]
82%|█████████████████████████████████▍ | 204/250 [01:29<00:18, 2.55it/s]
82%|█████████████████████████████████▌ | 205/250 [01:29<00:16, 2.73it/s]
82%|█████████████████████████████████▊ | 206/250 [01:29<00:16, 2.63it/s]
83%|█████████████████████████████████▉ | 207/250 [01:30<00:17, 2.43it/s]
83%|██████████████████████████████████ | 208/250 [01:30<00:17, 2.42it/s]
84%|██████████████████████████████████▎ | 209/250 [01:31<00:16, 2.53it/s]
84%|██████████████████████████████████▍ | 210/250 [01:31<00:14, 2.73it/s]
84%|██████████████████████████████████▌ | 211/250 [01:31<00:14, 2.67it/s]
85%|██████████████████████████████████▊ | 212/250 [01:32<00:14, 2.58it/s]
85%|██████████████████████████████████▉ | 213/250 [01:32<00:14, 2.57it/s]
86%|███████████████████████████████████ | 214/250 [01:33<00:16, 2.19it/s]
86%|███████████████████████████████████▎ | 215/250 [01:33<00:16, 2.11it/s]
86%|███████████████████████████████████▍ | 216/250 [01:34<00:16, 2.06it/s]
87%|███████████████████████████████████▌ | 217/250 [01:34<00:14, 2.22it/s]
87%|███████████████████████████████████▊ | 218/250 [01:35<00:13, 2.36it/s]
88%|███████████████████████████████████▉ | 219/250 [01:35<00:15, 2.03it/s]
88%|████████████████████████████████████ | 220/250 [01:36<00:13, 2.26it/s]
88%|████████████████████████████████████▏ | 221/250 [01:36<00:11, 2.43it/s]
89%|████████████████████████████████████▍ | 222/250 [01:36<00:10, 2.57it/s]
89%|████████████████████████████████████▌ | 223/250 [01:37<00:09, 2.72it/s]
90%|████████████████████████████████████▋ | 224/250 [01:37<00:09, 2.62it/s]
90%|████████████████████████████████████▉ | 225/250 [01:37<00:09, 2.68it/s]
90%|█████████████████████████████████████ | 226/250 [01:38<00:08, 2.81it/s]
91%|█████████████████████████████████████▏ | 227/250 [01:38<00:07, 2.89it/s]
91%|█████████████████████████████████████▍ | 228/250 [01:38<00:07, 2.92it/s]
92%|█████████████████████████████████████▌ | 229/250 [01:39<00:07, 2.85it/s]
92%|█████████████████████████████████████▋ | 230/250 [01:39<00:07, 2.84it/s]
92%|█████████████████████████████████████▉ | 231/250 [01:39<00:06, 2.73it/s]
93%|██████████████████████████████████████ | 232/250 [01:40<00:06, 2.73it/s]
93%|██████████████████████████████████████▏ | 233/250 [01:40<00:06, 2.70it/s]
94%|██████████████████████████████████████▍ | 234/250 [01:41<00:05, 2.72it/s]
94%|██████████████████████████████████████▌ | 235/250 [01:41<00:05, 2.72it/s]
94%|██████████████████████████████████████▋ | 236/250 [01:42<00:06, 2.28it/s]
95%|██████████████████████████████████████▊ | 237/250 [01:42<00:05, 2.44it/s]
95%|███████████████████████████████████████ | 238/250 [01:42<00:04, 2.42it/s]
96%|███████████████████████████████████████▏ | 239/250 [01:43<00:06, 1.80it/s]
96%|███████████████████████████████████████▎ | 240/250 [01:44<00:05, 1.95it/s]
96%|███████████████████████████████████████▌ | 241/250 [01:44<00:04, 2.15it/s]
97%|███████████████████████████████████████▋ | 242/250 [01:44<00:03, 2.32it/s]
97%|███████████████████████████████████████▊ | 243/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████ | 244/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████▏| 245/250 [01:46<00:02, 2.32it/s]
98%|████████████████████████████████████████▎| 246/250 [01:46<00:01, 2.36it/s]
99%|████████████████████████████████████████▌| 247/250 [01:46<00:01, 2.16it/s]
99%|████████████████████████████████████████▋| 248/250 [01:47<00:00, 2.32it/s]
100%|████████████████████████████████████████▊| 249/250 [01:47<00:00, 2.55it/s]
{'eval_loss': 1.093505859375, 'eval_runtime': 108.7239, 'eval_samples_per_second': 18.395, 'eval_steps_per_second': 2.299, 'epoch': 0.6}
60%|██████████████████████▏ | 234/390 [2:05:14<1:17:01, 29.63s/it]
100%|█████████████████████████████████████████| 250/250 [01:48<00:00, 2.38it/s]
{'loss': 1.0856, 'learning_rate': 0.00012820512820512818, 'epoch': 0.62}
{'loss': 1.0944, 'learning_rate': 0.00011111111111111109, 'epoch': 0.67}
70%|███████████████████████████▎ | 273/390 [2:24:06<56:29, 28.97s/it]
0%| | 0/250 [00:00<?, ?it/s]
1%|▎ | 2/250 [00:00<00:44, 5.56it/s]
1%|▌ | 3/250 [00:01<01:32, 2.67it/s]
2%|▋ | 4/250 [00:01<01:36, 2.56it/s]
2%|▊ | 5/250 [00:01<01:48, 2.26it/s]
2%|█ | 6/250 [00:02<01:44, 2.34it/s]
3%|█▏ | 7/250 [00:02<01:41, 2.39it/s]
3%|█▍ | 8/250 [00:03<01:36, 2.52it/s]
4%|█▌ | 9/250 [00:03<01:45, 2.28it/s]
4%|█▋ | 10/250 [00:04<01:55, 2.08it/s]
4%|█▊ | 11/250 [00:04<02:05, 1.90it/s]
5%|██ | 12/250 [00:05<02:08, 1.86it/s]
5%|██▏ | 13/250 [00:05<02:07, 1.86it/s]
6%|██▎ | 14/250 [00:06<02:03, 1.91it/s]
6%|██▌ | 15/250 [00:07<02:28, 1.58it/s]
6%|██▋ | 16/250 [00:07<02:12, 1.76it/s]
7%|██▊ | 17/250 [00:08<01:58, 1.96it/s]
7%|███ | 18/250 [00:08<01:47, 2.16it/s]
8%|███▏ | 19/250 [00:08<01:41, 2.27it/s]
8%|███▎ | 20/250 [00:09<02:03, 1.87it/s]
8%|███▌ | 21/250 [00:10<01:58, 1.94it/s]
9%|███▋ | 22/250 [00:10<01:50, 2.06it/s]
9%|███▊ | 23/250 [00:10<01:40, 2.26it/s]
10%|████ | 24/250 [00:11<01:37, 2.31it/s]
10%|████▏ | 25/250 [00:11<01:31, 2.45it/s]
10%|████▎ | 26/250 [00:12<01:41, 2.22it/s]
11%|████▌ | 27/250 [00:12<01:33, 2.38it/s]
11%|████▋ | 28/250 [00:12<01:37, 2.28it/s]
12%|████▊ | 29/250 [00:13<02:00, 1.83it/s]
12%|█████ | 30/250 [00:14<01:48, 2.04it/s]
12%|█████▏ | 31/250 [00:14<01:39, 2.19it/s]
13%|█████▍ | 32/250 [00:14<01:28, 2.46it/s]
13%|█████▌ | 33/250 [00:15<01:29, 2.43it/s]
14%|█████▋ | 34/250 [00:15<01:28, 2.44it/s]
14%|█████▉ | 35/250 [00:15<01:22, 2.60it/s]
14%|██████ | 36/250 [00:16<01:27, 2.44it/s]
15%|██████▏ | 37/250 [00:16<01:34, 2.26it/s]
15%|██████▍ | 38/250 [00:17<01:27, 2.41it/s]
16%|██████▌ | 39/250 [00:17<01:23, 2.53it/s]
16%|██████▋ | 40/250 [00:18<01:33, 2.24it/s]
16%|██████▉ | 41/250 [00:18<01:30, 2.31it/s]
17%|███████ | 42/250 [00:19<01:57, 1.76it/s]
17%|███████▏ | 43/250 [00:19<01:52, 1.85it/s]
18%|███████▍ | 44/250 [00:20<01:41, 2.03it/s]
18%|███████▌ | 45/250 [00:20<01:36, 2.13it/s]
18%|███████▋ | 46/250 [00:21<01:33, 2.18it/s]
19%|███████▉ | 47/250 [00:21<01:31, 2.23it/s]
19%|████████ | 48/250 [00:22<01:27, 2.30it/s]
20%|████████▏ | 49/250 [00:22<01:23, 2.40it/s]
20%|████████▍ | 50/250 [00:22<01:24, 2.37it/s]
20%|████████▌ | 51/250 [00:23<01:19, 2.50it/s]
21%|████████▋ | 52/250 [00:23<01:16, 2.59it/s]
21%|████████▉ | 53/250 [00:23<01:16, 2.56it/s]
22%|█████████ | 54/250 [00:24<01:19, 2.45it/s]
22%|█████████▏ | 55/250 [00:24<01:18, 2.50it/s]
22%|█████████▍ | 56/250 [00:25<01:14, 2.60it/s]
23%|█████████▌ | 57/250 [00:25<01:18, 2.47it/s]
23%|█████████▋ | 58/250 [00:25<01:15, 2.55it/s]
24%|█████████▉ | 59/250 [00:26<01:16, 2.50it/s]
24%|██████████ | 60/250 [00:26<01:16, 2.47it/s]
24%|██████████▏ | 61/250 [00:27<01:13, 2.58it/s]
25%|██████████▍ | 62/250 [00:27<01:22, 2.27it/s]
25%|██████████▌ | 63/250 [00:28<01:16, 2.44it/s]
26%|██████████▊ | 64/250 [00:28<01:22, 2.26it/s]
26%|██████████▉ | 65/250 [00:28<01:16, 2.42it/s]
26%|███████████ | 66/250 [00:29<01:10, 2.59it/s]
27%|███████████▎ | 67/250 [00:29<01:09, 2.64it/s]
27%|███████████▍ | 68/250 [00:30<01:12, 2.51it/s]
28%|███████████▌ | 69/250 [00:30<01:08, 2.63it/s]
28%|███████████▊ | 70/250 [00:30<01:03, 2.81it/s]
28%|███████████▉ | 71/250 [00:31<01:14, 2.39it/s]
29%|████████████ | 72/250 [00:31<01:12, 2.47it/s]
29%|████████████▎ | 73/250 [00:31<01:10, 2.52it/s]
30%|████████████▍ | 74/250 [00:32<01:08, 2.56it/s]
30%|████████████▌ | 75/250 [00:32<01:17, 2.26it/s]
30%|████████████▊ | 76/250 [00:33<01:18, 2.22it/s]
31%|████████████▉ | 77/250 [00:33<01:20, 2.16it/s]
31%|█████████████ | 78/250 [00:34<01:16, 2.24it/s]
32%|█████████████▎ | 79/250 [00:34<01:22, 2.08it/s]
32%|█████████████▍ | 80/250 [00:35<01:15, 2.27it/s]
32%|█████████████▌ | 81/250 [00:35<01:20, 2.09it/s]
33%|█████████████▊ | 82/250 [00:36<01:16, 2.21it/s]
33%|█████████████▉ | 83/250 [00:36<01:10, 2.36it/s]
34%|██████████████ | 84/250 [00:37<01:19, 2.08it/s]
34%|██████████████▎ | 85/250 [00:37<01:14, 2.21it/s]
34%|██████████████▍ | 86/250 [00:38<01:19, 2.06it/s]
35%|██████████████▌ | 87/250 [00:38<01:13, 2.23it/s]
35%|██████████████▊ | 88/250 [00:38<01:15, 2.14it/s]
36%|██████████████▉ | 89/250 [00:39<01:22, 1.95it/s]
36%|███████████████ | 90/250 [00:40<01:24, 1.89it/s]
36%|███████████████▎ | 91/250 [00:40<01:22, 1.94it/s]
37%|███████████████▍ | 92/250 [00:41<01:19, 1.99it/s]
37%|███████████████▌ | 93/250 [00:41<01:14, 2.10it/s]
38%|███████████████▊ | 94/250 [00:41<01:11, 2.18it/s]
38%|███████████████▉ | 95/250 [00:42<01:11, 2.17it/s]
38%|████████████████▏ | 96/250 [00:42<01:07, 2.27it/s]
39%|████████████████▎ | 97/250 [00:43<01:02, 2.43it/s]
39%|████████████████▍ | 98/250 [00:43<01:07, 2.24it/s]
40%|████████████████▋ | 99/250 [00:44<01:11, 2.10it/s]
40%|████████████████▍ | 100/250 [00:45<01:29, 1.67it/s]
40%|████████████████▌ | 101/250 [00:45<01:27, 1.71it/s]
41%|████████████████▋ | 102/250 [00:45<01:16, 1.94it/s]
41%|████████████████▉ | 103/250 [00:46<01:11, 2.06it/s]
42%|█████████████████ | 104/250 [00:46<01:07, 2.16it/s]
42%|█████████████████▏ | 105/250 [00:47<01:02, 2.31it/s]
42%|█████████████████▍ | 106/250 [00:47<00:59, 2.42it/s]
43%|█████████████████▌ | 107/250 [00:47<00:58, 2.44it/s]
43%|█████████████████▋ | 108/250 [00:48<01:07, 2.12it/s]
44%|█████████████████▉ | 109/250 [00:48<01:00, 2.34it/s]
44%|██████████████████ | 110/250 [00:49<01:06, 2.10it/s]
44%|██████████████████▏ | 111/250 [00:49<01:01, 2.24it/s]
45%|██████████████████▎ | 112/250 [00:50<01:14, 1.86it/s]
45%|██████████████████▌ | 113/250 [00:50<01:06, 2.07it/s]
46%|██████████████████▋ | 114/250 [00:51<00:58, 2.34it/s]
46%|██████████████████▊ | 115/250 [00:51<01:07, 1.99it/s]
46%|███████████████████ | 116/250 [00:52<00:59, 2.24it/s]
47%|███████████████████▏ | 117/250 [00:52<00:54, 2.46it/s]
47%|███████████████████▎ | 118/250 [00:52<00:54, 2.40it/s]
48%|███████████████████▌ | 119/250 [00:53<00:54, 2.40it/s]
48%|███████████████████▋ | 120/250 [00:53<00:59, 2.20it/s]
48%|███████████████████▊ | 121/250 [00:54<00:57, 2.25it/s]
49%|████████████████████ | 122/250 [00:54<00:54, 2.33it/s]
49%|████████████████████▏ | 123/250 [00:55<00:53, 2.35it/s]
50%|████████████████████▎ | 124/250 [00:55<00:51, 2.45it/s]
50%|████████████████████▌ | 125/250 [00:55<00:48, 2.59it/s]
50%|████████████████████▋ | 126/250 [00:56<00:48, 2.54it/s]
51%|████████████████████▊ | 127/250 [00:56<00:46, 2.65it/s]
51%|████████████████████▉ | 128/250 [00:56<00:43, 2.79it/s]
52%|█████████████████████▏ | 129/250 [00:57<00:42, 2.87it/s]
52%|█████████████████████▎ | 130/250 [00:57<00:42, 2.85it/s]
52%|█████████████████████▍ | 131/250 [00:58<00:43, 2.75it/s]
53%|█████████████████████▋ | 132/250 [00:58<00:44, 2.64it/s]
53%|█████████████████████▊ | 133/250 [00:58<00:45, 2.57it/s]
54%|█████████████████████▉ | 134/250 [00:59<00:43, 2.67it/s]
54%|██████████████████████▏ | 135/250 [00:59<00:41, 2.80it/s]
54%|██████████████████████▎ | 136/250 [00:59<00:44, 2.56it/s]
55%|██████████████████████▍ | 137/250 [01:00<00:42, 2.63it/s]
55%|██████████████████████▋ | 138/250 [01:00<00:42, 2.65it/s]
56%|██████████████████████▊ | 139/250 [01:01<00:58, 1.89it/s]
56%|██████████████████████▉ | 140/250 [01:02<01:10, 1.57it/s]
56%|███████████████████████ | 141/250 [01:03<01:07, 1.62it/s]
57%|███████████████████████▎ | 142/250 [01:03<01:09, 1.56it/s]
57%|███████████████████████▍ | 143/250 [01:04<01:02, 1.71it/s]
58%|███████████████████████▌ | 144/250 [01:04<01:06, 1.59it/s]
58%|███████████████████████▊ | 145/250 [01:05<01:09, 1.50it/s]
58%|███████████████████████▉ | 146/250 [01:06<01:03, 1.64it/s]
59%|████████████████████████ | 147/250 [01:06<00:57, 1.79it/s]
59%|████████████████████████▎ | 148/250 [01:07<00:54, 1.88it/s]
60%|████████████████████████▍ | 149/250 [01:07<00:47, 2.11it/s]
60%|████████████████████████▌ | 150/250 [01:07<00:43, 2.31it/s]
60%|████████████████████████▊ | 151/250 [01:08<00:41, 2.41it/s]
61%|████████████████████████▉ | 152/250 [01:08<00:38, 2.56it/s]
61%|█████████████████████████ | 153/250 [01:08<00:36, 2.63it/s]
62%|█████████████████████████▎ | 154/250 [01:09<00:47, 2.03it/s]
62%|█████████████████████████▍ | 155/250 [01:09<00:43, 2.17it/s]
62%|█████████████████████████▌ | 156/250 [01:10<00:46, 2.01it/s]
63%|█████████████████████████▋ | 157/250 [01:10<00:42, 2.19it/s]
63%|█████████████████████████▉ | 158/250 [01:11<00:39, 2.33it/s]
64%|██████████████████████████ | 159/250 [01:11<00:37, 2.46it/s]
64%|██████████████████████████▏ | 160/250 [01:11<00:35, 2.54it/s]
64%|██████████████████████████▍ | 161/250 [01:12<00:32, 2.70it/s]
65%|██████████████████████████▌ | 162/250 [01:12<00:33, 2.65it/s]
65%|██████████████████████████▋ | 163/250 [01:13<00:32, 2.70it/s]
66%|██████████████████████████▉ | 164/250 [01:13<00:29, 2.88it/s]
66%|███████████████████████████ | 165/250 [01:13<00:35, 2.37it/s]
66%|███████████████████████████▏ | 166/250 [01:14<00:34, 2.46it/s]
67%|███████████████████████████▍ | 167/250 [01:14<00:33, 2.51it/s]
67%|███████████████████████████▌ | 168/250 [01:15<00:33, 2.46it/s]
68%|███████████████████████████▋ | 169/250 [01:15<00:30, 2.66it/s]
68%|███████████████████████████▉ | 170/250 [01:15<00:31, 2.57it/s]
68%|████████████████████████████ | 171/250 [01:16<00:29, 2.69it/s]
69%|████████████████████████████▏ | 172/250 [01:16<00:29, 2.62it/s]
69%|████████████████████████████▎ | 173/250 [01:16<00:28, 2.75it/s]
70%|████████████████████████████▌ | 174/250 [01:17<00:26, 2.82it/s]
70%|████████████████████████████▋ | 175/250 [01:17<00:27, 2.74it/s]
70%|████████████████████████████▊ | 176/250 [01:17<00:27, 2.73it/s]
71%|█████████████████████████████ | 177/250 [01:18<00:31, 2.29it/s]
71%|█████████████████████████████▏ | 178/250 [01:18<00:30, 2.40it/s]
72%|█████████████████████████████▎ | 179/250 [01:19<00:27, 2.62it/s]
72%|█████████████████████████████▌ | 180/250 [01:19<00:27, 2.58it/s]
72%|█████████████████████████████▋ | 181/250 [01:20<00:26, 2.56it/s]
73%|█████████████████████████████▊ | 182/250 [01:20<00:25, 2.66it/s]
73%|██████████████████████████████ | 183/250 [01:20<00:26, 2.48it/s]
74%|██████████████████████████████▏ | 184/250 [01:21<00:27, 2.40it/s]
74%|██████████████████████████████▎ | 185/250 [01:21<00:25, 2.52it/s]
74%|██████████████████████████████▌ | 186/250 [01:21<00:24, 2.65it/s]
75%|██████████████████████████████▋ | 187/250 [01:22<00:23, 2.73it/s]
75%|██████████████████████████████▊ | 188/250 [01:22<00:27, 2.25it/s]
76%|██████████████████████████████▉ | 189/250 [01:23<00:25, 2.39it/s]
76%|███████████████████████████████▏ | 190/250 [01:23<00:23, 2.51it/s]
76%|███████████████████████████████▎ | 191/250 [01:24<00:23, 2.49it/s]
77%|███████████████████████████████▍ | 192/250 [01:24<00:23, 2.42it/s]
77%|███████████████████████████████▋ | 193/250 [01:24<00:23, 2.47it/s]
78%|███████████████████████████████▊ | 194/250 [01:25<00:22, 2.51it/s]
78%|███████████████████████████████▉ | 195/250 [01:25<00:21, 2.52it/s]
78%|████████████████████████████████▏ | 196/250 [01:26<00:21, 2.56it/s]
79%|████████████████████████████████▎ | 197/250 [01:26<00:19, 2.72it/s]
79%|████████████████████████████████▍ | 198/250 [01:26<00:19, 2.66it/s]
80%|████████████████████████████████▋ | 199/250 [01:27<00:18, 2.72it/s]
80%|████████████████████████████████▊ | 200/250 [01:27<00:21, 2.29it/s]
80%|████████████████████████████████▉ | 201/250 [01:28<00:20, 2.38it/s]
81%|█████████████████████████████████▏ | 202/250 [01:28<00:22, 2.15it/s]
81%|█████████████████████████████████▎ | 203/250 [01:28<00:19, 2.39it/s]
82%|█████████████████████████████████▍ | 204/250 [01:29<00:18, 2.55it/s]
82%|█████████████████████████████████▌ | 205/250 [01:29<00:16, 2.73it/s]
82%|█████████████████████████████████▊ | 206/250 [01:30<00:16, 2.62it/s]
83%|█████████████████████████████████▉ | 207/250 [01:30<00:17, 2.43it/s]
83%|██████████████████████████████████ | 208/250 [01:30<00:17, 2.42it/s]
84%|██████████████████████████████████▎ | 209/250 [01:31<00:16, 2.53it/s]
84%|██████████████████████████████████▍ | 210/250 [01:31<00:14, 2.73it/s]
84%|██████████████████████████████████▌ | 211/250 [01:31<00:14, 2.67it/s]
85%|██████████████████████████████████▊ | 212/250 [01:32<00:14, 2.58it/s]
85%|██████████████████████████████████▉ | 213/250 [01:32<00:14, 2.57it/s]
86%|███████████████████████████████████ | 214/250 [01:33<00:16, 2.19it/s]
86%|███████████████████████████████████▎ | 215/250 [01:33<00:16, 2.11it/s]
86%|███████████████████████████████████▍ | 216/250 [01:34<00:16, 2.06it/s]
87%|███████████████████████████████████▌ | 217/250 [01:34<00:14, 2.22it/s]
87%|███████████████████████████████████▊ | 218/250 [01:35<00:13, 2.36it/s]
88%|███████████████████████████████████▉ | 219/250 [01:35<00:15, 2.03it/s]
88%|████████████████████████████████████ | 220/250 [01:36<00:13, 2.26it/s]
88%|████████████████████████████████████▏ | 221/250 [01:36<00:11, 2.44it/s]
89%|████████████████████████████████████▍ | 222/250 [01:36<00:10, 2.58it/s]
89%|████████████████████████████████████▌ | 223/250 [01:37<00:09, 2.73it/s]
90%|████████████████████████████████████▋ | 224/250 [01:37<00:09, 2.63it/s]
90%|████████████████████████████████████▉ | 225/250 [01:37<00:09, 2.68it/s]
90%|█████████████████████████████████████ | 226/250 [01:38<00:08, 2.81it/s]
91%|█████████████████████████████████████▏ | 227/250 [01:38<00:07, 2.90it/s]
91%|█████████████████████████████████████▍ | 228/250 [01:38<00:07, 2.93it/s]
92%|█████████████████████████████████████▌ | 229/250 [01:39<00:07, 2.85it/s]
92%|█████████████████████████████████████▋ | 230/250 [01:39<00:07, 2.84it/s]
92%|█████████████████████████████████████▉ | 231/250 [01:39<00:06, 2.73it/s]
93%|██████████████████████████████████████ | 232/250 [01:40<00:06, 2.73it/s]
93%|██████████████████████████████████████▏ | 233/250 [01:40<00:06, 2.71it/s]
94%|██████████████████████████████████████▍ | 234/250 [01:41<00:05, 2.73it/s]
94%|██████████████████████████████████████▌ | 235/250 [01:41<00:05, 2.72it/s]
94%|██████████████████████████████████████▋ | 236/250 [01:42<00:06, 2.29it/s]
95%|██████████████████████████████████████▊ | 237/250 [01:42<00:05, 2.44it/s]
95%|███████████████████████████████████████ | 238/250 [01:42<00:04, 2.43it/s]
96%|███████████████████████████████████████▏ | 239/250 [01:43<00:06, 1.81it/s]
96%|███████████████████████████████████████▎ | 240/250 [01:44<00:05, 1.95it/s]
96%|███████████████████████████████████████▌ | 241/250 [01:44<00:04, 2.15it/s]
97%|███████████████████████████████████████▋ | 242/250 [01:44<00:03, 2.33it/s]
97%|███████████████████████████████████████▊ | 243/250 [01:45<00:02, 2.47it/s]
98%|████████████████████████████████████████ | 244/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████▏| 245/250 [01:46<00:02, 2.32it/s]
98%|████████████████████████████████████████▎| 246/250 [01:46<00:01, 2.36it/s]
99%|████████████████████████████████████████▌| 247/250 [01:47<00:01, 2.16it/s]
99%|████████████████████████████████████████▋| 248/250 [01:47<00:00, 2.31it/s]
100%|████████████████████████████████████████▊| 249/250 [01:47<00:00, 2.55it/s]
100%|█████████████████████████████████████████| 250/250 [01:48<00:00, 2.38it/s]
{'eval_loss': 1.091776967048645, 'eval_runtime': 108.7779, 'eval_samples_per_second': 18.386, 'eval_steps_per_second': 2.298, 'epoch': 0.7}
70%|███████████████████████████▎ | 273/390 [2:25:54<56:29, 28.97s/it]
{'loss': 1.0697, 'learning_rate': 9.4017094017094e-05, 'epoch': 0.72}
{'loss': 1.0753, 'learning_rate': 7.692307692307691e-05, 'epoch': 0.77}
80%|███████████████████████████████▏ | 312/390 [2:44:55<37:37, 28.95s/it]
0%| | 0/250 [00:00<?, ?it/s]
1%|▎ | 2/250 [00:00<00:44, 5.55it/s]
1%|▌ | 3/250 [00:01<01:32, 2.67it/s]
2%|▋ | 4/250 [00:01<01:36, 2.56it/s]
2%|▊ | 5/250 [00:01<01:48, 2.26it/s]
2%|█ | 6/250 [00:02<01:44, 2.34it/s]
3%|█▏ | 7/250 [00:02<01:41, 2.39it/s]
3%|█▍ | 8/250 [00:03<01:36, 2.52it/s]
4%|█▌ | 9/250 [00:03<01:45, 2.28it/s]
4%|█▋ | 10/250 [00:04<01:55, 2.08it/s]
4%|█▊ | 11/250 [00:04<02:05, 1.90it/s]
5%|██ | 12/250 [00:05<02:08, 1.86it/s]
5%|██▏ | 13/250 [00:05<02:07, 1.85it/s]
6%|██▎ | 14/250 [00:06<02:04, 1.90it/s]
6%|██▌ | 15/250 [00:07<02:29, 1.58it/s]
6%|██▋ | 16/250 [00:07<02:12, 1.76it/s]
7%|██▊ | 17/250 [00:08<01:58, 1.96it/s]
7%|███ | 18/250 [00:08<01:47, 2.16it/s]
8%|███▏ | 19/250 [00:08<01:41, 2.27it/s]
8%|███▎ | 20/250 [00:09<02:03, 1.87it/s]
8%|███▌ | 21/250 [00:10<01:58, 1.94it/s]
9%|███▋ | 22/250 [00:10<01:50, 2.06it/s]
9%|███▊ | 23/250 [00:10<01:40, 2.26it/s]
10%|████ | 24/250 [00:11<01:37, 2.31it/s]
10%|████▏ | 25/250 [00:11<01:31, 2.45it/s]
10%|████▎ | 26/250 [00:12<01:41, 2.21it/s]
11%|████▌ | 27/250 [00:12<01:33, 2.37it/s]
11%|████▋ | 28/250 [00:13<01:37, 2.28it/s]
12%|████▊ | 29/250 [00:13<02:00, 1.83it/s]
12%|█████ | 30/250 [00:14<01:48, 2.03it/s]
12%|█████▏ | 31/250 [00:14<01:39, 2.19it/s]
13%|█████▍ | 32/250 [00:14<01:28, 2.45it/s]
13%|█████▌ | 33/250 [00:15<01:28, 2.44it/s]
14%|█████▋ | 34/250 [00:15<01:28, 2.43it/s]
14%|█████▉ | 35/250 [00:15<01:22, 2.60it/s]
14%|██████ | 36/250 [00:16<01:27, 2.45it/s]
15%|██████▏ | 37/250 [00:16<01:34, 2.26it/s]
15%|██████▍ | 38/250 [00:17<01:27, 2.41it/s]
16%|██████▌ | 39/250 [00:17<01:23, 2.53it/s]
16%|██████▋ | 40/250 [00:18<01:33, 2.24it/s]
16%|██████▉ | 41/250 [00:18<01:30, 2.31it/s]
17%|███████ | 42/250 [00:19<01:58, 1.76it/s]
17%|███████▏ | 43/250 [00:19<01:52, 1.85it/s]
18%|███████▍ | 44/250 [00:20<01:41, 2.03it/s]
18%|███████▌ | 45/250 [00:20<01:36, 2.13it/s]
18%|███████▋ | 46/250 [00:21<01:33, 2.17it/s]
19%|███████▉ | 47/250 [00:21<01:31, 2.23it/s]
19%|████████ | 48/250 [00:22<01:27, 2.30it/s]
20%|████████▏ | 49/250 [00:22<01:23, 2.40it/s]
20%|████████▍ | 50/250 [00:22<01:24, 2.37it/s]
20%|████████▌ | 51/250 [00:23<01:19, 2.51it/s]
21%|████████▋ | 52/250 [00:23<01:16, 2.59it/s]
21%|████████▉ | 53/250 [00:23<01:16, 2.57it/s]
22%|█████████ | 54/250 [00:24<01:19, 2.46it/s]
22%|█████████▏ | 55/250 [00:24<01:17, 2.50it/s]
22%|█████████▍ | 56/250 [00:25<01:14, 2.61it/s]
23%|█████████▌ | 57/250 [00:25<01:17, 2.48it/s]
23%|█████████▋ | 58/250 [00:25<01:15, 2.56it/s]
24%|█████████▉ | 59/250 [00:26<01:16, 2.50it/s]
24%|██████████ | 60/250 [00:26<01:16, 2.48it/s]
24%|██████████▏ | 61/250 [00:27<01:13, 2.58it/s]
25%|██████████▍ | 62/250 [00:27<01:22, 2.27it/s]
25%|██████████▌ | 63/250 [00:28<01:16, 2.44it/s]
26%|██████████▊ | 64/250 [00:28<01:22, 2.26it/s]
26%|██████████▉ | 65/250 [00:28<01:16, 2.43it/s]
26%|███████████ | 66/250 [00:29<01:10, 2.60it/s]
27%|███████████▎ | 67/250 [00:29<01:09, 2.64it/s]
27%|███████████▍ | 68/250 [00:30<01:12, 2.51it/s]
28%|███████████▌ | 69/250 [00:30<01:08, 2.63it/s]
28%|███████████▊ | 70/250 [00:30<01:03, 2.81it/s]
28%|███████████▉ | 71/250 [00:31<01:14, 2.39it/s]
29%|████████████ | 72/250 [00:31<01:12, 2.47it/s]
29%|████████████▎ | 73/250 [00:31<01:10, 2.52it/s]
30%|████████████▍ | 74/250 [00:32<01:08, 2.56it/s]
30%|████████████▌ | 75/250 [00:32<01:17, 2.26it/s]
30%|████████████▊ | 76/250 [00:33<01:18, 2.22it/s]
31%|████████████▉ | 77/250 [00:33<01:20, 2.16it/s]
31%|█████████████ | 78/250 [00:34<01:16, 2.24it/s]
32%|█████████████▎ | 79/250 [00:34<01:22, 2.08it/s]
32%|█████████████▍ | 80/250 [00:35<01:14, 2.27it/s]
32%|█████████████▌ | 81/250 [00:35<01:20, 2.09it/s]
33%|█████████████▊ | 82/250 [00:36<01:16, 2.20it/s]
33%|█████████████▉ | 83/250 [00:36<01:10, 2.35it/s]
34%|██████████████ | 84/250 [00:37<01:19, 2.08it/s]
34%|██████████████▎ | 85/250 [00:37<01:14, 2.21it/s]
34%|██████████████▍ | 86/250 [00:38<01:19, 2.06it/s]
35%|██████████████▌ | 87/250 [00:38<01:13, 2.23it/s]
35%|██████████████▊ | 88/250 [00:38<01:15, 2.14it/s]
36%|██████████████▉ | 89/250 [00:39<01:22, 1.95it/s]
36%|███████████████ | 90/250 [00:40<01:24, 1.89it/s]
36%|███████████████▎ | 91/250 [00:40<01:21, 1.94it/s]
37%|███████████████▍ | 92/250 [00:41<01:19, 1.99it/s]
37%|███████████████▌ | 93/250 [00:41<01:14, 2.10it/s]
38%|███████████████▊ | 94/250 [00:41<01:11, 2.18it/s]
38%|███████████████▉ | 95/250 [00:42<01:11, 2.18it/s]
38%|████████████████▏ | 96/250 [00:42<01:07, 2.28it/s]
39%|████████████████▎ | 97/250 [00:43<01:02, 2.44it/s]
39%|████████████████▍ | 98/250 [00:43<01:07, 2.24it/s]
40%|████████████████▋ | 99/250 [00:44<01:11, 2.11it/s]
40%|████████████████▍ | 100/250 [00:45<01:29, 1.67it/s]
40%|████████████████▌ | 101/250 [00:45<01:26, 1.71it/s]
41%|████████████████▋ | 102/250 [00:45<01:16, 1.94it/s]
41%|████████████████▉ | 103/250 [00:46<01:11, 2.06it/s]
42%|█████████████████ | 104/250 [00:46<01:07, 2.16it/s]
42%|█████████████████▏ | 105/250 [00:47<01:02, 2.32it/s]
42%|█████████████████▍ | 106/250 [00:47<00:59, 2.42it/s]
43%|█████████████████▌ | 107/250 [00:47<00:58, 2.45it/s]
43%|█████████████████▋ | 108/250 [00:48<01:06, 2.12it/s]
44%|█████████████████▉ | 109/250 [00:48<01:00, 2.35it/s]
44%|██████████████████ | 110/250 [00:49<01:06, 2.10it/s]
44%|██████████████████▏ | 111/250 [00:49<01:01, 2.25it/s]
45%|██████████████████▎ | 112/250 [00:50<01:14, 1.86it/s]
45%|██████████████████▌ | 113/250 [00:50<01:06, 2.07it/s]
46%|██████████████████▋ | 114/250 [00:51<00:58, 2.34it/s]
46%|██████████████████▊ | 115/250 [00:51<01:07, 1.99it/s]
46%|███████████████████ | 116/250 [00:52<00:59, 2.25it/s]
47%|███████████████████▏ | 117/250 [00:52<00:54, 2.46it/s]
47%|███████████████████▎ | 118/250 [00:52<00:54, 2.41it/s]
48%|███████████████████▌ | 119/250 [00:53<00:54, 2.40it/s]
48%|███████████████████▋ | 120/250 [00:53<00:59, 2.20it/s]
48%|███████████████████▊ | 121/250 [00:54<00:57, 2.25it/s]
49%|████████████████████ | 122/250 [00:54<00:54, 2.34it/s]
49%|████████████████████▏ | 123/250 [00:55<00:53, 2.36it/s]
50%|████████████████████▎ | 124/250 [00:55<00:51, 2.45it/s]
50%|████████████████████▌ | 125/250 [00:55<00:48, 2.59it/s]
50%|████████████████████▋ | 126/250 [00:56<00:48, 2.54it/s]
51%|████████████████████▊ | 127/250 [00:56<00:46, 2.65it/s]
51%|████████████████████▉ | 128/250 [00:56<00:43, 2.79it/s]
52%|█████████████████████▏ | 129/250 [00:57<00:42, 2.88it/s]
52%|█████████████████████▎ | 130/250 [00:57<00:42, 2.85it/s]
52%|█████████████████████▍ | 131/250 [00:58<00:43, 2.75it/s]
53%|█████████████████████▋ | 132/250 [00:58<00:44, 2.65it/s]
53%|█████████████████████▊ | 133/250 [00:58<00:45, 2.58it/s]
54%|█████████████████████▉ | 134/250 [00:59<00:43, 2.67it/s]
54%|██████████████████████▏ | 135/250 [00:59<00:40, 2.81it/s]
54%|██████████████████████▎ | 136/250 [00:59<00:44, 2.56it/s]
55%|██████████████████████▍ | 137/250 [01:00<00:42, 2.64it/s]
55%|██████████████████████▋ | 138/250 [01:00<00:42, 2.65it/s]
56%|██████████████████████▊ | 139/250 [01:01<00:58, 1.89it/s]
56%|██████████████████████▉ | 140/250 [01:02<01:10, 1.57it/s]
56%|███████████████████████ | 141/250 [01:03<01:07, 1.62it/s]
57%|███████████████████████▎ | 142/250 [01:03<01:09, 1.56it/s]
57%|███████████████████████▍ | 143/250 [01:04<01:02, 1.71it/s]
58%|███████████████████████▌ | 144/250 [01:04<01:06, 1.59it/s]
58%|███████████████████████▊ | 145/250 [01:05<01:10, 1.50it/s]
58%|███████████████████████▉ | 146/250 [01:06<01:03, 1.64it/s]
59%|████████████████████████ | 147/250 [01:06<00:57, 1.79it/s]
59%|████████████████████████▎ | 148/250 [01:07<00:54, 1.88it/s]
60%|████████████████████████▍ | 149/250 [01:07<00:47, 2.11it/s]
60%|████████████████████████▌ | 150/250 [01:07<00:43, 2.30it/s]
60%|████████████████████████▊ | 151/250 [01:08<00:41, 2.41it/s]
61%|████████████████████████▉ | 152/250 [01:08<00:38, 2.56it/s]
61%|█████████████████████████ | 153/250 [01:08<00:36, 2.63it/s]
62%|█████████████████████████▎ | 154/250 [01:09<00:47, 2.03it/s]
62%|█████████████████████████▍ | 155/250 [01:09<00:43, 2.18it/s]
62%|█████████████████████████▌ | 156/250 [01:10<00:46, 2.01it/s]
63%|█████████████████████████▋ | 157/250 [01:10<00:42, 2.19it/s]
63%|█████████████████████████▉ | 158/250 [01:11<00:39, 2.34it/s]
64%|██████████████████████████ | 159/250 [01:11<00:37, 2.46it/s]
64%|██████████████████████████▏ | 160/250 [01:11<00:35, 2.55it/s]
64%|██████████████████████████▍ | 161/250 [01:12<00:32, 2.70it/s]
65%|██████████████████████████▌ | 162/250 [01:12<00:33, 2.66it/s]
65%|██████████████████████████▋ | 163/250 [01:13<00:32, 2.71it/s]
66%|██████████████████████████▉ | 164/250 [01:13<00:29, 2.89it/s]
66%|███████████████████████████ | 165/250 [01:13<00:35, 2.37it/s]
66%|███████████████████████████▏ | 166/250 [01:14<00:34, 2.46it/s]
67%|███████████████████████████▍ | 167/250 [01:14<00:33, 2.51it/s]
67%|███████████████████████████▌ | 168/250 [01:15<00:33, 2.47it/s]
68%|███████████████████████████▋ | 169/250 [01:15<00:30, 2.67it/s]
68%|███████████████████████████▉ | 170/250 [01:15<00:31, 2.57it/s]
68%|████████████████████████████ | 171/250 [01:16<00:29, 2.68it/s]
69%|████████████████████████████▏ | 172/250 [01:16<00:29, 2.62it/s]
69%|████████████████████████████▎ | 173/250 [01:16<00:28, 2.75it/s]
70%|████████████████████████████▌ | 174/250 [01:17<00:27, 2.81it/s]
70%|████████████████████████████▋ | 175/250 [01:17<00:27, 2.74it/s]
70%|████████████████████████████▊ | 176/250 [01:17<00:27, 2.73it/s]
71%|█████████████████████████████ | 177/250 [01:18<00:31, 2.29it/s]
71%|█████████████████████████████▏ | 178/250 [01:18<00:30, 2.39it/s]
72%|█████████████████████████████▎ | 179/250 [01:19<00:27, 2.61it/s]
72%|█████████████████████████████▌ | 180/250 [01:19<00:27, 2.58it/s]
72%|█████████████████████████████▋ | 181/250 [01:20<00:26, 2.56it/s]
73%|█████████████████████████████▊ | 182/250 [01:20<00:25, 2.65it/s]
73%|██████████████████████████████ | 183/250 [01:20<00:27, 2.48it/s]
74%|██████████████████████████████▏ | 184/250 [01:21<00:27, 2.39it/s]
74%|██████████████████████████████▎ | 185/250 [01:21<00:25, 2.51it/s]
74%|██████████████████████████████▌ | 186/250 [01:21<00:24, 2.64it/s]
75%|██████████████████████████████▋ | 187/250 [01:22<00:23, 2.72it/s]
75%|██████████████████████████████▊ | 188/250 [01:22<00:27, 2.25it/s]
76%|██████████████████████████████▉ | 189/250 [01:23<00:25, 2.39it/s]
76%|███████████████████████████████▏ | 190/250 [01:23<00:23, 2.51it/s]
76%|███████████████████████████████▎ | 191/250 [01:24<00:23, 2.49it/s]
77%|███████████████████████████████▍ | 192/250 [01:24<00:23, 2.42it/s]
77%|███████████████████████████████▋ | 193/250 [01:24<00:22, 2.48it/s]
78%|███████████████████████████████▊ | 194/250 [01:25<00:22, 2.54it/s]
78%|███████████████████████████████▉ | 195/250 [01:25<00:21, 2.53it/s]
78%|████████████████████████████████▏ | 196/250 [01:26<00:21, 2.57it/s]
79%|████████████████████████████████▎ | 197/250 [01:26<00:19, 2.73it/s]
79%|████████████████████████████████▍ | 198/250 [01:26<00:19, 2.67it/s]
80%|████████████████████████████████▋ | 199/250 [01:27<00:18, 2.73it/s]
80%|████████████████████████████████▊ | 200/250 [01:27<00:21, 2.29it/s]
80%|████████████████████████████████▉ | 201/250 [01:28<00:20, 2.38it/s]
81%|█████████████████████████████████▏ | 202/250 [01:28<00:22, 2.15it/s]
81%|█████████████████████████████████▎ | 203/250 [01:28<00:19, 2.39it/s]
82%|█████████████████████████████████▍ | 204/250 [01:29<00:18, 2.55it/s]
82%|█████████████████████████████████▌ | 205/250 [01:29<00:16, 2.73it/s]
82%|█████████████████████████████████▊ | 206/250 [01:29<00:16, 2.62it/s]
83%|█████████████████████████████████▉ | 207/250 [01:30<00:17, 2.43it/s]
83%|██████████████████████████████████ | 208/250 [01:30<00:17, 2.42it/s]
84%|██████████████████████████████████▎ | 209/250 [01:31<00:16, 2.53it/s]
84%|██████████████████████████████████▍ | 210/250 [01:31<00:14, 2.72it/s]
84%|██████████████████████████████████▌ | 211/250 [01:31<00:14, 2.67it/s]
85%|██████████████████████████████████▊ | 212/250 [01:32<00:14, 2.58it/s]
85%|██████████████████████████████████▉ | 213/250 [01:32<00:14, 2.57it/s]
86%|███████████████████████████████████ | 214/250 [01:33<00:16, 2.19it/s]
86%|███████████████████████████████████▎ | 215/250 [01:33<00:16, 2.10it/s]
86%|███████████████████████████████████▍ | 216/250 [01:34<00:16, 2.05it/s]
87%|███████████████████████████████████▌ | 217/250 [01:34<00:14, 2.22it/s]
87%|███████████████████████████████████▊ | 218/250 [01:35<00:13, 2.37it/s]
88%|███████████████████████████████████▉ | 219/250 [01:35<00:15, 2.04it/s]
88%|████████████████████████████████████ | 220/250 [01:36<00:13, 2.26it/s]
88%|████████████████████████████████████▏ | 221/250 [01:36<00:11, 2.44it/s]
89%|████████████████████████████████████▍ | 222/250 [01:36<00:10, 2.58it/s]
89%|████████████████████████████████████▌ | 223/250 [01:37<00:09, 2.72it/s]
90%|████████████████████████████████████▋ | 224/250 [01:37<00:09, 2.62it/s]
90%|████████████████████████████████████▉ | 225/250 [01:37<00:09, 2.68it/s]
90%|█████████████████████████████████████ | 226/250 [01:38<00:08, 2.81it/s]
91%|█████████████████████████████████████▏ | 227/250 [01:38<00:07, 2.89it/s]
91%|█████████████████████████████████████▍ | 228/250 [01:38<00:07, 2.92it/s]
92%|█████████████████████████████████████▌ | 229/250 [01:39<00:07, 2.85it/s]
92%|█████████████████████████████████████▋ | 230/250 [01:39<00:07, 2.84it/s]
92%|█████████████████████████████████████▉ | 231/250 [01:39<00:06, 2.73it/s]
93%|██████████████████████████████████████ | 232/250 [01:40<00:06, 2.73it/s]
93%|██████████████████████████████████████▏ | 233/250 [01:40<00:06, 2.71it/s]
94%|██████████████████████████████████████▍ | 234/250 [01:41<00:05, 2.73it/s]
94%|██████████████████████████████████████▌ | 235/250 [01:41<00:05, 2.72it/s]
94%|██████████████████████████████████████▋ | 236/250 [01:42<00:06, 2.28it/s]
95%|██████████████████████████████████████▊ | 237/250 [01:42<00:05, 2.44it/s]
95%|███████████████████████████████████████ | 238/250 [01:42<00:04, 2.42it/s]
96%|███████████████████████████████████████▏ | 239/250 [01:43<00:06, 1.80it/s]
96%|███████████████████████████████████████▎ | 240/250 [01:44<00:05, 1.95it/s]
96%|███████████████████████████████████████▌ | 241/250 [01:44<00:04, 2.15it/s]
97%|███████████████████████████████████████▋ | 242/250 [01:44<00:03, 2.32it/s]
97%|███████████████████████████████████████▊ | 243/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████ | 244/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████▏| 245/250 [01:46<00:02, 2.32it/s]
98%|████████████████████████████████████████▎| 246/250 [01:46<00:01, 2.37it/s]
99%|████████████████████████████████████████▌| 247/250 [01:46<00:01, 2.16it/s]
99%|████████████████████████████████████████▋| 248/250 [01:47<00:00, 2.32it/s]
100%|████████████████████████████████████████▊| 249/250 [01:47<00:00, 2.55it/s]
100%|█████████████████████████████████████████| 250/250 [01:48<00:00, 2.38it/s]
{'eval_loss': 1.0898607969284058, 'eval_runtime': 108.7363, 'eval_samples_per_second': 18.393, 'eval_steps_per_second': 2.299, 'epoch': 0.8}
80%|███████████████████████████████▏ | 312/390 [2:46:44<37:37, 28.95s/it]
{'loss': 1.0732, 'learning_rate': 5.9829059829059824e-05, 'epoch': 0.82}
{'loss': 1.0808, 'learning_rate': 4.2735042735042735e-05, 'epoch': 0.87}
90%|███████████████████████████████████ | 351/390 [3:05:35<18:47, 28.90s/it]
0%| | 0/250 [00:00<?, ?it/s]
1%|▎ | 2/250 [00:00<00:44, 5.56it/s]
1%|▌ | 3/250 [00:01<01:32, 2.67it/s]
2%|▋ | 4/250 [00:01<01:36, 2.56it/s]
2%|▊ | 5/250 [00:01<01:48, 2.26it/s]
2%|█ | 6/250 [00:02<01:44, 2.34it/s]
3%|█▏ | 7/250 [00:02<01:41, 2.39it/s]
3%|█▍ | 8/250 [00:03<01:36, 2.52it/s]
4%|█▌ | 9/250 [00:03<01:45, 2.28it/s]
4%|█▋ | 10/250 [00:04<01:55, 2.08it/s]
4%|█▊ | 11/250 [00:04<02:05, 1.90it/s]
5%|██ | 12/250 [00:05<02:08, 1.86it/s]
5%|██▏ | 13/250 [00:05<02:07, 1.85it/s]
6%|██▎ | 14/250 [00:06<02:04, 1.90it/s]
6%|██▌ | 15/250 [00:07<02:28, 1.58it/s]
6%|██▋ | 16/250 [00:07<02:12, 1.77it/s]
7%|██▊ | 17/250 [00:08<01:58, 1.96it/s]
7%|███ | 18/250 [00:08<01:47, 2.16it/s]
8%|███▏ | 19/250 [00:08<01:41, 2.27it/s]
8%|███▎ | 20/250 [00:09<02:03, 1.87it/s]
8%|███▌ | 21/250 [00:10<01:58, 1.94it/s]
9%|███▋ | 22/250 [00:10<01:50, 2.06it/s]
9%|███▊ | 23/250 [00:10<01:40, 2.26it/s]
10%|████ | 24/250 [00:11<01:37, 2.31it/s]
10%|████▏ | 25/250 [00:11<01:31, 2.45it/s]
10%|████▎ | 26/250 [00:12<01:41, 2.21it/s]
11%|████▌ | 27/250 [00:12<01:33, 2.38it/s]
11%|████▋ | 28/250 [00:12<01:37, 2.28it/s]
12%|████▊ | 29/250 [00:13<02:00, 1.83it/s]
12%|█████ | 30/250 [00:14<01:48, 2.03it/s]
12%|█████▏ | 31/250 [00:14<01:39, 2.19it/s]
13%|█████▍ | 32/250 [00:14<01:28, 2.45it/s]
13%|█████▌ | 33/250 [00:15<01:28, 2.44it/s]
14%|█████▋ | 34/250 [00:15<01:28, 2.44it/s]
14%|█████▉ | 35/250 [00:15<01:23, 2.59it/s]
14%|██████ | 36/250 [00:16<01:27, 2.44it/s]
15%|██████▏ | 37/250 [00:16<01:34, 2.25it/s]
15%|██████▍ | 38/250 [00:17<01:27, 2.41it/s]
16%|██████▌ | 39/250 [00:17<01:23, 2.53it/s]
16%|██████▋ | 40/250 [00:18<01:34, 2.23it/s]
16%|██████▉ | 41/250 [00:18<01:30, 2.31it/s]
17%|███████ | 42/250 [00:19<01:58, 1.76it/s]
17%|███████▏ | 43/250 [00:19<01:52, 1.85it/s]
18%|███████▍ | 44/250 [00:20<01:41, 2.03it/s]
18%|███████▌ | 45/250 [00:20<01:35, 2.14it/s]
18%|███████▋ | 46/250 [00:21<01:33, 2.18it/s]
19%|███████▉ | 47/250 [00:21<01:30, 2.23it/s]
19%|████████ | 48/250 [00:22<01:27, 2.31it/s]
20%|████████▏ | 49/250 [00:22<01:23, 2.40it/s]
20%|████████▍ | 50/250 [00:22<01:24, 2.37it/s]
20%|████████▌ | 51/250 [00:23<01:19, 2.51it/s]
21%|████████▋ | 52/250 [00:23<01:16, 2.60it/s]
21%|████████▉ | 53/250 [00:23<01:16, 2.57it/s]
22%|█████████ | 54/250 [00:24<01:19, 2.46it/s]
22%|█████████▏ | 55/250 [00:24<01:17, 2.50it/s]
22%|█████████▍ | 56/250 [00:25<01:14, 2.61it/s]
23%|█████████▌ | 57/250 [00:25<01:17, 2.49it/s]
23%|█████████▋ | 58/250 [00:25<01:15, 2.55it/s]
24%|█████████▉ | 59/250 [00:26<01:16, 2.50it/s]
24%|██████████ | 60/250 [00:26<01:16, 2.47it/s]
24%|██████████▏ | 61/250 [00:27<01:13, 2.58it/s]
25%|██████████▍ | 62/250 [00:27<01:22, 2.27it/s]
25%|██████████▌ | 63/250 [00:28<01:16, 2.44it/s]
26%|██████████▊ | 64/250 [00:28<01:22, 2.26it/s]
26%|██████████▉ | 65/250 [00:28<01:16, 2.43it/s]
26%|███████████ | 66/250 [00:29<01:10, 2.60it/s]
27%|███████████▎ | 67/250 [00:29<01:09, 2.64it/s]
27%|███████████▍ | 68/250 [00:30<01:12, 2.51it/s]
28%|███████████▌ | 69/250 [00:30<01:08, 2.63it/s]
28%|███████████▊ | 70/250 [00:30<01:03, 2.82it/s]
28%|███████████▉ | 71/250 [00:31<01:14, 2.40it/s]
29%|████████████ | 72/250 [00:31<01:11, 2.47it/s]
29%|████████████▎ | 73/250 [00:31<01:10, 2.52it/s]
30%|████████████▍ | 74/250 [00:32<01:08, 2.56it/s]
30%|████████████▌ | 75/250 [00:32<01:17, 2.26it/s]
30%|████████████▊ | 76/250 [00:33<01:18, 2.22it/s]
31%|████████████▉ | 77/250 [00:33<01:20, 2.16it/s]
31%|█████████████ | 78/250 [00:34<01:16, 2.24it/s]
32%|█████████████▎ | 79/250 [00:34<01:22, 2.08it/s]
32%|█████████████▍ | 80/250 [00:35<01:14, 2.27it/s]
32%|█████████████▌ | 81/250 [00:35<01:20, 2.10it/s]
33%|█████████████▊ | 82/250 [00:36<01:16, 2.21it/s]
33%|█████████████▉ | 83/250 [00:36<01:10, 2.36it/s]
34%|██████████████ | 84/250 [00:37<01:19, 2.08it/s]
34%|██████████████▎ | 85/250 [00:37<01:14, 2.21it/s]
34%|██████████████▍ | 86/250 [00:38<01:19, 2.06it/s]
35%|██████████████▌ | 87/250 [00:38<01:13, 2.23it/s]
35%|██████████████▊ | 88/250 [00:38<01:15, 2.14it/s]
36%|██████████████▉ | 89/250 [00:39<01:22, 1.95it/s]
36%|███████████████ | 90/250 [00:40<01:24, 1.89it/s]
36%|███████████████▎ | 91/250 [00:40<01:22, 1.94it/s]
37%|███████████████▍ | 92/250 [00:41<01:19, 1.99it/s]
37%|███████████████▌ | 93/250 [00:41<01:14, 2.10it/s]
38%|███████████████▊ | 94/250 [00:41<01:11, 2.18it/s]
38%|███████████████▉ | 95/250 [00:42<01:11, 2.18it/s]
38%|████████████████▏ | 96/250 [00:42<01:07, 2.28it/s]
39%|████████████████▎ | 97/250 [00:43<01:02, 2.44it/s]
39%|████████████████▍ | 98/250 [00:43<01:07, 2.24it/s]
40%|████████████████▋ | 99/250 [00:44<01:11, 2.10it/s]
40%|████████████████▍ | 100/250 [00:45<01:29, 1.67it/s]
40%|████████████████▌ | 101/250 [00:45<01:26, 1.72it/s]
41%|████████████████▋ | 102/250 [00:45<01:16, 1.94it/s]
41%|████████████████▉ | 103/250 [00:46<01:11, 2.06it/s]
42%|█████████████████ | 104/250 [00:46<01:07, 2.16it/s]
42%|█████████████████▏ | 105/250 [00:47<01:02, 2.31it/s]
42%|█████████████████▍ | 106/250 [00:47<00:59, 2.42it/s]
43%|█████████████████▌ | 107/250 [00:47<00:58, 2.44it/s]
43%|█████████████████▋ | 108/250 [00:48<01:07, 2.12it/s]
44%|█████████████████▉ | 109/250 [00:48<01:00, 2.34it/s]
44%|██████████████████ | 110/250 [00:49<01:06, 2.10it/s]
44%|██████████████████▏ | 111/250 [00:49<01:01, 2.24it/s]
45%|██████████████████▎ | 112/250 [00:50<01:14, 1.86it/s]
45%|██████████████████▌ | 113/250 [00:50<01:06, 2.07it/s]
46%|██████████████████▋ | 114/250 [00:51<00:58, 2.34it/s]
46%|██████████████████▊ | 115/250 [00:51<01:07, 1.99it/s]
46%|███████████████████ | 116/250 [00:52<00:59, 2.24it/s]
47%|███████████████████▏ | 117/250 [00:52<00:54, 2.45it/s]
47%|███████████████████▎ | 118/250 [00:52<00:54, 2.40it/s]
48%|███████████████████▌ | 119/250 [00:53<00:54, 2.40it/s]
48%|███████████████████▋ | 120/250 [00:53<00:59, 2.19it/s]
48%|███████████████████▊ | 121/250 [00:54<00:57, 2.24it/s]
49%|████████████████████ | 122/250 [00:54<00:54, 2.33it/s]
49%|████████████████████▏ | 123/250 [00:55<00:53, 2.36it/s]
50%|████████████████████▎ | 124/250 [00:55<00:51, 2.45it/s]
50%|████████████████████▌ | 125/250 [00:55<00:48, 2.58it/s]
50%|████████████████████▋ | 126/250 [00:56<00:48, 2.53it/s]
51%|████████████████████▊ | 127/250 [00:56<00:46, 2.64it/s]
51%|████████████████████▉ | 128/250 [00:56<00:43, 2.78it/s]
52%|█████████████████████▏ | 129/250 [00:57<00:42, 2.87it/s]
52%|█████████████████████▎ | 130/250 [00:57<00:42, 2.85it/s]
52%|█████████████████████▍ | 131/250 [00:58<00:43, 2.74it/s]
53%|█████████████████████▋ | 132/250 [00:58<00:44, 2.64it/s]
53%|█████████████████████▊ | 133/250 [00:58<00:45, 2.57it/s]
54%|█████████████████████▉ | 134/250 [00:59<00:43, 2.66it/s]
54%|██████████████████████▏ | 135/250 [00:59<00:41, 2.80it/s]
54%|██████████████████████▎ | 136/250 [00:59<00:44, 2.56it/s]
55%|██████████████████████▍ | 137/250 [01:00<00:42, 2.64it/s]
55%|██████████████████████▋ | 138/250 [01:00<00:42, 2.65it/s]
56%|██████████████████████▊ | 139/250 [01:01<00:58, 1.89it/s]
56%|██████████████████████▉ | 140/250 [01:02<01:10, 1.57it/s]
56%|███████████████████████ | 141/250 [01:03<01:07, 1.62it/s]
57%|███████████████████████▎ | 142/250 [01:03<01:09, 1.56it/s]
57%|███████████████████████▍ | 143/250 [01:04<01:02, 1.71it/s]
58%|███████████████████████▌ | 144/250 [01:04<01:06, 1.60it/s]
58%|███████████████████████▊ | 145/250 [01:05<01:09, 1.50it/s]
58%|███████████████████████▉ | 146/250 [01:06<01:03, 1.64it/s]
59%|████████████████████████ | 147/250 [01:06<00:57, 1.79it/s]
59%|████████████████████████▎ | 148/250 [01:07<00:54, 1.89it/s]
60%|████████████████████████▍ | 149/250 [01:07<00:47, 2.11it/s]
60%|████████████████████████▌ | 150/250 [01:07<00:43, 2.31it/s]
60%|████████████████████████▊ | 151/250 [01:08<00:41, 2.41it/s]
61%|████████████████████████▉ | 152/250 [01:08<00:38, 2.56it/s]
61%|█████████████████████████ | 153/250 [01:08<00:36, 2.64it/s]
62%|█████████████████████████▎ | 154/250 [01:09<00:47, 2.03it/s]
62%|█████████████████████████▍ | 155/250 [01:09<00:43, 2.18it/s]
62%|█████████████████████████▌ | 156/250 [01:10<00:46, 2.01it/s]
63%|█████████████████████████▋ | 157/250 [01:10<00:42, 2.19it/s]
63%|█████████████████████████▉ | 158/250 [01:11<00:39, 2.34it/s]
64%|██████████████████████████ | 159/250 [01:11<00:37, 2.46it/s]
64%|██████████████████████████▏ | 160/250 [01:11<00:35, 2.55it/s]
64%|██████████████████████████▍ | 161/250 [01:12<00:32, 2.70it/s]
65%|██████████████████████████▌ | 162/250 [01:12<00:33, 2.66it/s]
65%|██████████████████████████▋ | 163/250 [01:13<00:32, 2.71it/s]
66%|██████████████████████████▉ | 164/250 [01:13<00:29, 2.89it/s]
66%|███████████████████████████ | 165/250 [01:13<00:35, 2.37it/s]
66%|███████████████████████████▏ | 166/250 [01:14<00:34, 2.46it/s]
67%|███████████████████████████▍ | 167/250 [01:14<00:33, 2.51it/s]
67%|███████████████████████████▌ | 168/250 [01:15<00:33, 2.46it/s]
68%|███████████████████████████▋ | 169/250 [01:15<00:30, 2.66it/s]
68%|███████████████████████████▉ | 170/250 [01:15<00:31, 2.57it/s]
68%|████████████████████████████ | 171/250 [01:16<00:29, 2.67it/s]
69%|████████████████████████████▏ | 172/250 [01:16<00:29, 2.61it/s]
69%|████████████████████████████▎ | 173/250 [01:16<00:28, 2.74it/s]
70%|████████████████████████████▌ | 174/250 [01:17<00:27, 2.81it/s]
70%|████████████████████████████▋ | 175/250 [01:17<00:27, 2.74it/s]
70%|████████████████████████████▊ | 176/250 [01:17<00:27, 2.73it/s]
71%|█████████████████████████████ | 177/250 [01:18<00:31, 2.29it/s]
71%|█████████████████████████████▏ | 178/250 [01:18<00:30, 2.40it/s]
72%|█████████████████████████████▎ | 179/250 [01:19<00:27, 2.62it/s]
72%|█████████████████████████████▌ | 180/250 [01:19<00:27, 2.58it/s]
72%|█████████████████████████████▋ | 181/250 [01:20<00:26, 2.56it/s]
73%|█████████████████████████████▊ | 182/250 [01:20<00:25, 2.66it/s]
73%|██████████████████████████████ | 183/250 [01:20<00:26, 2.49it/s]
74%|██████████████████████████████▏ | 184/250 [01:21<00:27, 2.40it/s]
74%|██████████████████████████████▎ | 185/250 [01:21<00:25, 2.52it/s]
74%|██████████████████████████████▌ | 186/250 [01:21<00:24, 2.65it/s]
75%|██████████████████████████████▋ | 187/250 [01:22<00:23, 2.73it/s]
75%|██████████████████████████████▊ | 188/250 [01:22<00:27, 2.26it/s]
76%|██████████████████████████████▉ | 189/250 [01:23<00:25, 2.39it/s]
76%|███████████████████████████████▏ | 190/250 [01:23<00:23, 2.52it/s]
76%|███████████████████████████████▎ | 191/250 [01:24<00:23, 2.50it/s]
77%|███████████████████████████████▍ | 192/250 [01:24<00:23, 2.43it/s]
77%|███████████████████████████████▋ | 193/250 [01:24<00:22, 2.49it/s]
78%|███████████████████████████████▊ | 194/250 [01:25<00:22, 2.54it/s]
78%|███████████████████████████████▉ | 195/250 [01:25<00:21, 2.54it/s]
78%|████████████████████████████████▏ | 196/250 [01:26<00:21, 2.57it/s]
79%|████████████████████████████████▎ | 197/250 [01:26<00:19, 2.73it/s]
79%|████████████████████████████████▍ | 198/250 [01:26<00:19, 2.67it/s]
80%|████████████████████████████████▋ | 199/250 [01:27<00:18, 2.72it/s]
80%|████████████████████████████████▊ | 200/250 [01:27<00:21, 2.29it/s]
80%|████████████████████████████████▉ | 201/250 [01:28<00:20, 2.37it/s]
81%|█████████████████████████████████▏ | 202/250 [01:28<00:22, 2.15it/s]
81%|█████████████████████████████████▎ | 203/250 [01:28<00:19, 2.39it/s]
82%|█████████████████████████████████▍ | 204/250 [01:29<00:18, 2.55it/s]
82%|█████████████████████████████████▌ | 205/250 [01:29<00:16, 2.73it/s]
82%|█████████████████████████████████▊ | 206/250 [01:29<00:16, 2.62it/s]
83%|█████████████████████████████████▉ | 207/250 [01:30<00:17, 2.43it/s]
83%|██████████████████████████████████ | 208/250 [01:30<00:17, 2.42it/s]
84%|██████████████████████████████████▎ | 209/250 [01:31<00:16, 2.53it/s]
84%|██████████████████████████████████▍ | 210/250 [01:31<00:14, 2.72it/s]
84%|██████████████████████████████████▌ | 211/250 [01:31<00:14, 2.67it/s]
85%|██████████████████████████████████▊ | 212/250 [01:32<00:14, 2.58it/s]
85%|██████████████████████████████████▉ | 213/250 [01:32<00:14, 2.57it/s]
86%|███████████████████████████████████ | 214/250 [01:33<00:16, 2.19it/s]
86%|███████████████████████████████████▎ | 215/250 [01:33<00:16, 2.11it/s]
86%|███████████████████████████████████▍ | 216/250 [01:34<00:16, 2.06it/s]
87%|███████████████████████████████████▌ | 217/250 [01:34<00:14, 2.22it/s]
87%|███████████████████████████████████▊ | 218/250 [01:35<00:13, 2.37it/s]
88%|███████████████████████████████████▉ | 219/250 [01:35<00:15, 2.04it/s]
88%|████████████████████████████████████ | 220/250 [01:36<00:13, 2.26it/s]
88%|████████████████████████████████████▏ | 221/250 [01:36<00:11, 2.44it/s]
89%|████████████████████████████████████▍ | 222/250 [01:36<00:10, 2.58it/s]
89%|████████████████████████████████████▌ | 223/250 [01:37<00:09, 2.73it/s]
90%|████████████████████████████████████▋ | 224/250 [01:37<00:09, 2.63it/s]
90%|████████████████████████████████████▉ | 225/250 [01:37<00:09, 2.68it/s]
90%|█████████████████████████████████████ | 226/250 [01:38<00:08, 2.81it/s]
91%|█████████████████████████████████████▏ | 227/250 [01:38<00:07, 2.89it/s]
91%|█████████████████████████████████████▍ | 228/250 [01:38<00:07, 2.92it/s]
92%|█████████████████████████████████████▌ | 229/250 [01:39<00:07, 2.85it/s]
92%|█████████████████████████████████████▋ | 230/250 [01:39<00:07, 2.83it/s]
92%|█████████████████████████████████████▉ | 231/250 [01:39<00:06, 2.72it/s]
93%|██████████████████████████████████████ | 232/250 [01:40<00:06, 2.72it/s]
93%|██████████████████████████████████████▏ | 233/250 [01:40<00:06, 2.70it/s]
94%|██████████████████████████████████████▍ | 234/250 [01:41<00:05, 2.73it/s]
94%|██████████████████████████████████████▌ | 235/250 [01:41<00:05, 2.72it/s]
94%|██████████████████████████████████████▋ | 236/250 [01:42<00:06, 2.29it/s]
95%|██████████████████████████████████████▊ | 237/250 [01:42<00:05, 2.44it/s]
95%|███████████████████████████████████████ | 238/250 [01:42<00:04, 2.43it/s]
96%|███████████████████████████████████████▏ | 239/250 [01:43<00:06, 1.81it/s]
96%|███████████████████████████████████████▎ | 240/250 [01:44<00:05, 1.95it/s]
96%|███████████████████████████████████████▌ | 241/250 [01:44<00:04, 2.15it/s]
97%|███████████████████████████████████████▋ | 242/250 [01:44<00:03, 2.33it/s]
97%|███████████████████████████████████████▊ | 243/250 [01:45<00:02, 2.49it/s]
98%|████████████████████████████████████████ | 244/250 [01:45<00:02, 2.49it/s]
98%|████████████████████████████████████████▏| 245/250 [01:46<00:02, 2.32it/s]
98%|████████████████████████████████████████▎| 246/250 [01:46<00:01, 2.37it/s]
99%|████████████████████████████████████████▌| 247/250 [01:46<00:01, 2.16it/s]
99%|████████████████████████████████████████▋| 248/250 [01:47<00:00, 2.32it/s]
100%|████████████████████████████████████████▊| 249/250 [01:47<00:00, 2.55it/s]
100%|█████████████████████████████████████████| 250/250 [01:48<00:00, 2.38it/s]
{'eval_loss': 1.0888385772705078, 'eval_runtime': 108.7345, 'eval_samples_per_second': 18.393, 'eval_steps_per_second': 2.299, 'epoch': 0.9}
90%|███████████████████████████████████ | 351/390 [3:07:23<18:47, 28.90s/it]
{'loss': 1.0532, 'learning_rate': 2.564102564102564e-05, 'epoch': 0.92}
{'loss': 1.0649, 'learning_rate': 8.547008547008546e-06, 'epoch': 0.97}
100%|███████████████████████████████████████| 390/390 [3:26:27<00:00, 29.51s/it]
0%| | 0/250 [00:00<?, ?it/s]
1%|▎ | 2/250 [00:00<00:44, 5.56it/s]
1%|▌ | 3/250 [00:01<01:32, 2.67it/s]
2%|▋ | 4/250 [00:01<01:36, 2.56it/s]
2%|▊ | 5/250 [00:01<01:48, 2.25it/s]
2%|█ | 6/250 [00:02<01:44, 2.34it/s]
3%|█▏ | 7/250 [00:02<01:41, 2.38it/s]
3%|█▍ | 8/250 [00:03<01:36, 2.51it/s]
4%|█▌ | 9/250 [00:03<01:46, 2.27it/s]
4%|█▋ | 10/250 [00:04<01:55, 2.08it/s]
4%|█▊ | 11/250 [00:04<02:05, 1.90it/s]
5%|██ | 12/250 [00:05<02:08, 1.85it/s]
5%|██▏ | 13/250 [00:05<02:07, 1.86it/s]
6%|██▎ | 14/250 [00:06<02:03, 1.91it/s]
6%|██▌ | 15/250 [00:07<02:28, 1.58it/s]
6%|██▋ | 16/250 [00:07<02:12, 1.77it/s]
7%|██▊ | 17/250 [00:08<01:58, 1.96it/s]
7%|███ | 18/250 [00:08<01:47, 2.16it/s]
8%|███▏ | 19/250 [00:08<01:41, 2.27it/s]
8%|███▎ | 20/250 [00:09<02:03, 1.87it/s]
8%|███▌ | 21/250 [00:10<01:58, 1.94it/s]
9%|███▋ | 22/250 [00:10<01:50, 2.06it/s]
9%|███▊ | 23/250 [00:10<01:40, 2.26it/s]
10%|████ | 24/250 [00:11<01:37, 2.31it/s]
10%|████▏ | 25/250 [00:11<01:31, 2.45it/s]
10%|████▎ | 26/250 [00:12<01:41, 2.22it/s]
11%|████▌ | 27/250 [00:12<01:33, 2.38it/s]
11%|████▋ | 28/250 [00:12<01:37, 2.28it/s]
12%|████▊ | 29/250 [00:13<02:00, 1.83it/s]
12%|█████ | 30/250 [00:14<01:48, 2.03it/s]
12%|█████▏ | 31/250 [00:14<01:40, 2.19it/s]
13%|█████▍ | 32/250 [00:14<01:28, 2.45it/s]
13%|█████▌ | 33/250 [00:15<01:29, 2.44it/s]
14%|█████▋ | 34/250 [00:15<01:28, 2.44it/s]
14%|█████▉ | 35/250 [00:15<01:22, 2.60it/s]
14%|██████ | 36/250 [00:16<01:27, 2.45it/s]
15%|██████▏ | 37/250 [00:16<01:34, 2.26it/s]
15%|██████▍ | 38/250 [00:17<01:27, 2.41it/s]
16%|██████▌ | 39/250 [00:17<01:23, 2.53it/s]
16%|██████▋ | 40/250 [00:18<01:33, 2.24it/s]
16%|██████▉ | 41/250 [00:18<01:30, 2.31it/s]
17%|███████ | 42/250 [00:19<01:57, 1.76it/s]
17%|███████▏ | 43/250 [00:19<01:52, 1.85it/s]
18%|███████▍ | 44/250 [00:20<01:41, 2.03it/s]
18%|███████▌ | 45/250 [00:20<01:36, 2.13it/s]
18%|███████▋ | 46/250 [00:21<01:33, 2.18it/s]
19%|███████▉ | 47/250 [00:21<01:31, 2.23it/s]
19%|████████ | 48/250 [00:22<01:27, 2.30it/s]
20%|████████▏ | 49/250 [00:22<01:23, 2.40it/s]
20%|████████▍ | 50/250 [00:22<01:24, 2.37it/s]
20%|████████▌ | 51/250 [00:23<01:19, 2.50it/s]
21%|████████▋ | 52/250 [00:23<01:16, 2.58it/s]
21%|████████▉ | 53/250 [00:23<01:17, 2.56it/s]
22%|█████████ | 54/250 [00:24<01:20, 2.45it/s]
22%|█████████▏ | 55/250 [00:24<01:18, 2.49it/s]
22%|█████████▍ | 56/250 [00:25<01:14, 2.60it/s]
23%|█████████▌ | 57/250 [00:25<01:17, 2.48it/s]
23%|█████████▋ | 58/250 [00:25<01:15, 2.56it/s]
24%|█████████▉ | 59/250 [00:26<01:16, 2.50it/s]
24%|██████████ | 60/250 [00:26<01:16, 2.48it/s]
24%|██████████▏ | 61/250 [00:27<01:13, 2.58it/s]
25%|██████████▍ | 62/250 [00:27<01:22, 2.27it/s]
25%|██████████▌ | 63/250 [00:28<01:16, 2.44it/s]
26%|██████████▊ | 64/250 [00:28<01:22, 2.26it/s]
26%|██████████▉ | 65/250 [00:28<01:16, 2.42it/s]
26%|███████████ | 66/250 [00:29<01:10, 2.59it/s]
27%|███████████▎ | 67/250 [00:29<01:09, 2.64it/s]
27%|███████████▍ | 68/250 [00:30<01:12, 2.51it/s]
28%|███████████▌ | 69/250 [00:30<01:08, 2.63it/s]
28%|███████████▊ | 70/250 [00:30<01:04, 2.81it/s]
28%|███████████▉ | 71/250 [00:31<01:14, 2.39it/s]
29%|████████████ | 72/250 [00:31<01:12, 2.47it/s]
29%|████████████▎ | 73/250 [00:31<01:10, 2.52it/s]
30%|████████████▍ | 74/250 [00:32<01:08, 2.56it/s]
30%|████████████▌ | 75/250 [00:32<01:17, 2.27it/s]
30%|████████████▊ | 76/250 [00:33<01:18, 2.22it/s]
31%|████████████▉ | 77/250 [00:33<01:20, 2.16it/s]
31%|█████████████ | 78/250 [00:34<01:16, 2.24it/s]
32%|█████████████▎ | 79/250 [00:34<01:22, 2.08it/s]
32%|█████████████▍ | 80/250 [00:35<01:14, 2.27it/s]
32%|█████████████▌ | 81/250 [00:35<01:20, 2.09it/s]
33%|█████████████▊ | 82/250 [00:36<01:15, 2.21it/s]
33%|█████████████▉ | 83/250 [00:36<01:10, 2.36it/s]
34%|██████████████ | 84/250 [00:37<01:19, 2.08it/s]
34%|██████████████▎ | 85/250 [00:37<01:14, 2.21it/s]
34%|██████████████▍ | 86/250 [00:38<01:19, 2.06it/s]
35%|██████████████▌ | 87/250 [00:38<01:13, 2.23it/s]
35%|██████████████▊ | 88/250 [00:38<01:15, 2.14it/s]
36%|██████████████▉ | 89/250 [00:39<01:22, 1.95it/s]
36%|███████████████ | 90/250 [00:40<01:24, 1.89it/s]
36%|███████████████▎ | 91/250 [00:40<01:22, 1.94it/s]
37%|███████████████▍ | 92/250 [00:41<01:19, 1.99it/s]
37%|███████████████▌ | 93/250 [00:41<01:14, 2.10it/s]
38%|███████████████▊ | 94/250 [00:41<01:11, 2.18it/s]
38%|███████████████▉ | 95/250 [00:42<01:11, 2.17it/s]
38%|████████████████▏ | 96/250 [00:42<01:07, 2.27it/s]
39%|████████████████▎ | 97/250 [00:43<01:02, 2.44it/s]
39%|████████████████▍ | 98/250 [00:43<01:08, 2.23it/s]
40%|████████████████▋ | 99/250 [00:44<01:11, 2.10it/s]
40%|████████████████▍ | 100/250 [00:45<01:29, 1.67it/s]
40%|████████████████▌ | 101/250 [00:45<01:26, 1.71it/s]
41%|████████████████▋ | 102/250 [00:45<01:16, 1.94it/s]
41%|████████████████▉ | 103/250 [00:46<01:11, 2.06it/s]
42%|█████████████████ | 104/250 [00:46<01:07, 2.16it/s]
42%|█████████████████▏ | 105/250 [00:47<01:02, 2.32it/s]
42%|█████████████████▍ | 106/250 [00:47<00:59, 2.43it/s]
43%|█████████████████▌ | 107/250 [00:47<00:58, 2.45it/s]
43%|█████████████████▋ | 108/250 [00:48<01:06, 2.12it/s]
44%|█████████████████▉ | 109/250 [00:48<01:00, 2.35it/s]
44%|██████████████████ | 110/250 [00:49<01:06, 2.10it/s]
44%|██████████████████▏ | 111/250 [00:49<01:01, 2.25it/s]
45%|██████████████████▎ | 112/250 [00:50<01:13, 1.87it/s]
45%|██████████████████▌ | 113/250 [00:50<01:06, 2.07it/s]
46%|██████████████████▋ | 114/250 [00:51<00:57, 2.35it/s]
46%|██████████████████▊ | 115/250 [00:51<01:07, 1.99it/s]
46%|███████████████████ | 116/250 [00:52<00:59, 2.25it/s]
47%|███████████████████▏ | 117/250 [00:52<00:54, 2.46it/s]
47%|███████████████████▎ | 118/250 [00:52<00:54, 2.41it/s]
48%|███████████████████▌ | 119/250 [00:53<00:54, 2.40it/s]
48%|███████████████████▋ | 120/250 [00:53<00:59, 2.20it/s]
48%|███████████████████▊ | 121/250 [00:54<00:57, 2.24it/s]
49%|████████████████████ | 122/250 [00:54<00:54, 2.33it/s]
49%|████████████████████▏ | 123/250 [00:55<00:53, 2.36it/s]
50%|████████████████████▎ | 124/250 [00:55<00:51, 2.44it/s]
50%|████████████████████▌ | 125/250 [00:55<00:48, 2.57it/s]
50%|████████████████████▋ | 126/250 [00:56<00:49, 2.53it/s]
51%|████████████████████▊ | 127/250 [00:56<00:46, 2.64it/s]
51%|████████████████████▉ | 128/250 [00:56<00:43, 2.78it/s]
52%|█████████████████████▏ | 129/250 [00:57<00:42, 2.85it/s]
52%|█████████████████████▎ | 130/250 [00:57<00:42, 2.83it/s]
52%|█████████████████████▍ | 131/250 [00:58<00:43, 2.73it/s]
53%|█████████████████████▋ | 132/250 [00:58<00:44, 2.63it/s]
53%|█████████████████████▊ | 133/250 [00:58<00:45, 2.56it/s]
54%|█████████████████████▉ | 134/250 [00:59<00:43, 2.66it/s]
54%|██████████████████████▏ | 135/250 [00:59<00:41, 2.80it/s]
54%|██████████████████████▎ | 136/250 [00:59<00:44, 2.56it/s]
55%|██████████████████████▍ | 137/250 [01:00<00:42, 2.63it/s]
55%|██████████████████████▋ | 138/250 [01:00<00:42, 2.65it/s]
56%|██████████████████████▊ | 139/250 [01:01<00:58, 1.89it/s]
56%|██████████████████████▉ | 140/250 [01:02<01:10, 1.57it/s]
56%|███████████████████████ | 141/250 [01:03<01:07, 1.62it/s]
57%|███████████████████████▎ | 142/250 [01:03<01:09, 1.55it/s]
57%|███████████████████████▍ | 143/250 [01:04<01:02, 1.71it/s]
58%|███████████████████████▌ | 144/250 [01:04<01:06, 1.59it/s]
58%|███████████████████████▊ | 145/250 [01:05<01:09, 1.50it/s]
58%|███████████████████████▉ | 146/250 [01:06<01:03, 1.64it/s]
59%|████████████████████████ | 147/250 [01:06<00:57, 1.79it/s]
59%|████████████████████████▎ | 148/250 [01:07<00:54, 1.89it/s]
60%|████████████████████████▍ | 149/250 [01:07<00:47, 2.11it/s]
60%|████████████████████████▌ | 150/250 [01:07<00:43, 2.31it/s]
60%|████████████████████████▊ | 151/250 [01:08<00:41, 2.41it/s]
61%|████████████████████████▉ | 152/250 [01:08<00:38, 2.56it/s]
61%|█████████████████████████ | 153/250 [01:08<00:36, 2.64it/s]
62%|█████████████████████████▎ | 154/250 [01:09<00:47, 2.04it/s]
62%|█████████████████████████▍ | 155/250 [01:09<00:43, 2.18it/s]
62%|█████████████████████████▌ | 156/250 [01:10<00:46, 2.01it/s]
63%|█████████████████████████▋ | 157/250 [01:10<00:42, 2.19it/s]
63%|█████████████████████████▉ | 158/250 [01:11<00:39, 2.34it/s]
64%|██████████████████████████ | 159/250 [01:11<00:37, 2.46it/s]
64%|██████████████████████████▏ | 160/250 [01:11<00:35, 2.55it/s]
64%|██████████████████████████▍ | 161/250 [01:12<00:32, 2.70it/s]
65%|██████████████████████████▌ | 162/250 [01:12<00:33, 2.66it/s]
65%|██████████████████████████▋ | 163/250 [01:13<00:32, 2.71it/s]
66%|██████████████████████████▉ | 164/250 [01:13<00:29, 2.89it/s]
66%|███████████████████████████ | 165/250 [01:13<00:35, 2.37it/s]
66%|███████████████████████████▏ | 166/250 [01:14<00:34, 2.46it/s]
67%|███████████████████████████▍ | 167/250 [01:14<00:33, 2.51it/s]
67%|███████████████████████████▌ | 168/250 [01:15<00:33, 2.47it/s]
68%|███████████████████████████▋ | 169/250 [01:15<00:30, 2.67it/s]
68%|███████████████████████████▉ | 170/250 [01:15<00:31, 2.58it/s]
68%|████████████████████████████ | 171/250 [01:16<00:29, 2.69it/s]
69%|████████████████████████████▏ | 172/250 [01:16<00:29, 2.63it/s]
69%|████████████████████████████▎ | 173/250 [01:16<00:27, 2.75it/s]
70%|████████████████████████████▌ | 174/250 [01:17<00:26, 2.82it/s]
70%|████████████████████████████▋ | 175/250 [01:17<00:27, 2.74it/s]
70%|████████████████████████████▊ | 176/250 [01:17<00:27, 2.74it/s]
71%|█████████████████████████████ | 177/250 [01:18<00:31, 2.29it/s]
71%|█████████████████████████████▏ | 178/250 [01:18<00:30, 2.40it/s]
72%|█████████████████████████████▎ | 179/250 [01:19<00:27, 2.62it/s]
72%|█████████████████████████████▌ | 180/250 [01:19<00:27, 2.59it/s]
72%|█████████████████████████████▋ | 181/250 [01:20<00:26, 2.57it/s]
73%|█████████████████████████████▊ | 182/250 [01:20<00:25, 2.66it/s]
73%|██████████████████████████████ | 183/250 [01:20<00:26, 2.49it/s]
74%|██████████████████████████████▏ | 184/250 [01:21<00:27, 2.40it/s]
74%|██████████████████████████████▎ | 185/250 [01:21<00:25, 2.52it/s]
74%|██████████████████████████████▌ | 186/250 [01:21<00:24, 2.65it/s]
75%|██████████████████████████████▋ | 187/250 [01:22<00:23, 2.73it/s]
75%|██████████████████████████████▊ | 188/250 [01:22<00:27, 2.26it/s]
76%|██████████████████████████████▉ | 189/250 [01:23<00:25, 2.39it/s]
76%|███████████████████████████████▏ | 190/250 [01:23<00:23, 2.51it/s]
76%|███████████████████████████████▎ | 191/250 [01:24<00:23, 2.49it/s]
77%|███████████████████████████████▍ | 192/250 [01:24<00:23, 2.42it/s]
77%|███████████████████████████████▋ | 193/250 [01:24<00:22, 2.48it/s]
78%|███████████████████████████████▊ | 194/250 [01:25<00:22, 2.54it/s]
78%|███████████████████████████████▉ | 195/250 [01:25<00:21, 2.54it/s]
78%|████████████████████████████████▏ | 196/250 [01:26<00:20, 2.58it/s]
79%|████████████████████████████████▎ | 197/250 [01:26<00:19, 2.74it/s]
79%|████████████████████████████████▍ | 198/250 [01:26<00:19, 2.68it/s]
80%|████████████████████████████████▋ | 199/250 [01:27<00:18, 2.73it/s]
80%|████████████████████████████████▊ | 200/250 [01:27<00:21, 2.30it/s]
80%|████████████████████████████████▉ | 201/250 [01:28<00:20, 2.38it/s]
81%|█████████████████████████████████▏ | 202/250 [01:28<00:22, 2.15it/s]
81%|█████████████████████████████████▎ | 203/250 [01:28<00:19, 2.40it/s]
82%|█████████████████████████████████▍ | 204/250 [01:29<00:18, 2.55it/s]
82%|█████████████████████████████████▌ | 205/250 [01:29<00:16, 2.73it/s]
82%|█████████████████████████████████▊ | 206/250 [01:29<00:16, 2.63it/s]
83%|█████████████████████████████████▉ | 207/250 [01:30<00:17, 2.43it/s]
83%|██████████████████████████████████ | 208/250 [01:30<00:17, 2.42it/s]
84%|██████████████████████████████████▎ | 209/250 [01:31<00:16, 2.53it/s]
84%|██████████████████████████████████▍ | 210/250 [01:31<00:14, 2.73it/s]
84%|██████████████████████████████████▌ | 211/250 [01:31<00:14, 2.67it/s]
85%|██████████████████████████████████▊ | 212/250 [01:32<00:14, 2.58it/s]
85%|██████████████████████████████████▉ | 213/250 [01:32<00:14, 2.57it/s]
86%|███████████████████████████████████ | 214/250 [01:33<00:16, 2.19it/s]
86%|███████████████████████████████████▎ | 215/250 [01:33<00:16, 2.11it/s]
86%|███████████████████████████████████▍ | 216/250 [01:34<00:16, 2.05it/s]
87%|███████████████████████████████████▌ | 217/250 [01:34<00:14, 2.22it/s]
87%|███████████████████████████████████▊ | 218/250 [01:35<00:13, 2.37it/s]
88%|███████████████████████████████████▉ | 219/250 [01:35<00:15, 2.04it/s]
88%|████████████████████████████████████ | 220/250 [01:36<00:13, 2.27it/s]
88%|████████████████████████████████████▏ | 221/250 [01:36<00:11, 2.44it/s]
89%|████████████████████████████████████▍ | 222/250 [01:36<00:10, 2.58it/s]
89%|████████████████████████████████████▌ | 223/250 [01:37<00:09, 2.73it/s]
90%|████████████████████████████████████▋ | 224/250 [01:37<00:09, 2.63it/s]
90%|████████████████████████████████████▉ | 225/250 [01:37<00:09, 2.68it/s]
90%|█████████████████████████████████████ | 226/250 [01:38<00:08, 2.81it/s]
91%|█████████████████████████████████████▏ | 227/250 [01:38<00:07, 2.90it/s]
91%|█████████████████████████████████████▍ | 228/250 [01:38<00:07, 2.92it/s]
92%|█████████████████████████████████████▌ | 229/250 [01:39<00:07, 2.85it/s]
92%|█████████████████████████████████████▋ | 230/250 [01:39<00:07, 2.84it/s]
92%|█████████████████████████████████████▉ | 231/250 [01:39<00:06, 2.73it/s]
93%|██████████████████████████████████████ | 232/250 [01:40<00:06, 2.73it/s]
93%|██████████████████████████████████████▏ | 233/250 [01:40<00:06, 2.71it/s]
94%|██████████████████████████████████████▍ | 234/250 [01:41<00:05, 2.73it/s]
94%|██████████████████████████████████████▌ | 235/250 [01:41<00:05, 2.73it/s]
94%|██████████████████████████████████████▋ | 236/250 [01:42<00:06, 2.29it/s]
95%|██████████████████████████████████████▊ | 237/250 [01:42<00:05, 2.44it/s]
95%|███████████████████████████████████████ | 238/250 [01:42<00:04, 2.43it/s]
96%|███████████████████████████████████████▏ | 239/250 [01:43<00:06, 1.80it/s]
96%|███████████████████████████████████████▎ | 240/250 [01:44<00:05, 1.95it/s]
96%|███████████████████████████████████████▌ | 241/250 [01:44<00:04, 2.15it/s]
97%|███████████████████████████████████████▋ | 242/250 [01:44<00:03, 2.33it/s]
97%|███████████████████████████████████████▊ | 243/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████ | 244/250 [01:45<00:02, 2.48it/s]
98%|████████████████████████████████████████▏| 245/250 [01:46<00:02, 2.32it/s]
98%|████████████████████████████████████████▎| 246/250 [01:46<00:01, 2.37it/s]
99%|████████████████████████████████████████▌| 247/250 [01:46<00:01, 2.17it/s]
99%|████████████████████████████████████████▋| 248/250 [01:47<00:00, 2.32it/s]
100%|████████████████████████████████████████▊| 249/250 [01:47<00:00, 2.55it/s]
100%|█████████████████████████████████████████| 250/250 [01:48<00:00, 2.38it/s]
{'eval_loss': 1.0883216857910156, 'eval_runtime': 108.7281, 'eval_samples_per_second': 18.395, 'eval_steps_per_second': 2.299, 'epoch': 1.0}
100%|███████████████████████████████████████| 390/390 [3:28:16<00:00, 29.51s/it]
There were missing keys in the checkpoint model loaded: ['base_model.model.model.embed_tokens.weight', 'base_model.model.model.layers.0.self_attn.q_proj.weight', 'base_model.model.model.layers.0.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.0.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.0.self_attn.k_proj.weight', 'base_model.model.model.layers.0.self_attn.v_proj.weight', 'base_model.model.model.layers.0.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.0.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.0.self_attn.o_proj.weight', 'base_model.model.model.layers.0.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.0.mlp.gate_proj.weight', 'base_model.model.model.layers.0.mlp.down_proj.weight', 'base_model.model.model.layers.0.mlp.up_proj.weight', 'base_model.model.model.layers.0.input_layernorm.weight', 'base_model.model.model.layers.0.post_attention_layernorm.weight', 'base_model.model.model.layers.1.self_attn.q_proj.weight', 'base_model.model.model.layers.1.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.1.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.1.self_attn.k_proj.weight', 'base_model.model.model.layers.1.self_attn.v_proj.weight', 'base_model.model.model.layers.1.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.1.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.1.self_attn.o_proj.weight', 'base_model.model.model.layers.1.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.1.mlp.gate_proj.weight', 'base_model.model.model.layers.1.mlp.down_proj.weight', 'base_model.model.model.layers.1.mlp.up_proj.weight', 'base_model.model.model.layers.1.input_layernorm.weight', 'base_model.model.model.layers.1.post_attention_layernorm.weight', 'base_model.model.model.layers.2.self_attn.q_proj.weight', 'base_model.model.model.layers.2.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.2.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.2.self_attn.k_proj.weight', 'base_model.model.model.layers.2.self_attn.v_proj.weight', 'base_model.model.model.layers.2.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.2.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.2.self_attn.o_proj.weight', 'base_model.model.model.layers.2.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.2.mlp.gate_proj.weight', 'base_model.model.model.layers.2.mlp.down_proj.weight', 'base_model.model.model.layers.2.mlp.up_proj.weight', 'base_model.model.model.layers.2.input_layernorm.weight', 'base_model.model.model.layers.2.post_attention_layernorm.weight', 'base_model.model.model.layers.3.self_attn.q_proj.weight', 'base_model.model.model.layers.3.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.3.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.3.self_attn.k_proj.weight', 'base_model.model.model.layers.3.self_attn.v_proj.weight', 'base_model.model.model.layers.3.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.3.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.3.self_attn.o_proj.weight', 'base_model.model.model.layers.3.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.3.mlp.gate_proj.weight', 'base_model.model.model.layers.3.mlp.down_proj.weight', 'base_model.model.model.layers.3.mlp.up_proj.weight', 'base_model.model.model.layers.3.input_layernorm.weight', 'base_model.model.model.layers.3.post_attention_layernorm.weight', 'base_model.model.model.layers.4.self_attn.q_proj.weight', 'base_model.model.model.layers.4.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.4.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.4.self_attn.k_proj.weight', 'base_model.model.model.layers.4.self_attn.v_proj.weight', 'base_model.model.model.layers.4.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.4.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.4.self_attn.o_proj.weight', 'base_model.model.model.layers.4.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.4.mlp.gate_proj.weight', 'base_model.model.model.layers.4.mlp.down_proj.weight', 'base_model.model.model.layers.4.mlp.up_proj.weight', 'base_model.model.model.layers.4.input_layernorm.weight', 'base_model.model.model.layers.4.post_attention_layernorm.weight', 'base_model.model.model.layers.5.self_attn.q_proj.weight', 'base_model.model.model.layers.5.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.5.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.5.self_attn.k_proj.weight', 'base_model.model.model.layers.5.self_attn.v_proj.weight', 'base_model.model.model.layers.5.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.5.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.5.self_attn.o_proj.weight', 'base_model.model.model.layers.5.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.5.mlp.gate_proj.weight', 'base_model.model.model.layers.5.mlp.down_proj.weight', 'base_model.model.model.layers.5.mlp.up_proj.weight', 'base_model.model.model.layers.5.input_layernorm.weight', 'base_model.model.model.layers.5.post_attention_layernorm.weight', 'base_model.model.model.layers.6.self_attn.q_proj.weight', 'base_model.model.model.layers.6.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.6.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.6.self_attn.k_proj.weight', 'base_model.model.model.layers.6.self_attn.v_proj.weight', 'base_model.model.model.layers.6.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.6.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.6.self_attn.o_proj.weight', 'base_model.model.model.layers.6.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.6.mlp.gate_proj.weight', 'base_model.model.model.layers.6.mlp.down_proj.weight', 'base_model.model.model.layers.6.mlp.up_proj.weight', 'base_model.model.model.layers.6.input_layernorm.weight', 'base_model.model.model.layers.6.post_attention_layernorm.weight', 'base_model.model.model.layers.7.self_attn.q_proj.weight', 'base_model.model.model.layers.7.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.7.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.7.self_attn.k_proj.weight', 'base_model.model.model.layers.7.self_attn.v_proj.weight', 'base_model.model.model.layers.7.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.7.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.7.self_attn.o_proj.weight', 'base_model.model.model.layers.7.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.7.mlp.gate_proj.weight', 'base_model.model.model.layers.7.mlp.down_proj.weight', 'base_model.model.model.layers.7.mlp.up_proj.weight', 'base_model.model.model.layers.7.input_layernorm.weight', 'base_model.model.model.layers.7.post_attention_layernorm.weight', 'base_model.model.model.layers.8.self_attn.q_proj.weight', 'base_model.model.model.layers.8.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.8.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.8.self_attn.k_proj.weight', 'base_model.model.model.layers.8.self_attn.v_proj.weight', 'base_model.model.model.layers.8.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.8.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.8.self_attn.o_proj.weight', 'base_model.model.model.layers.8.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.8.mlp.gate_proj.weight', 'base_model.model.model.layers.8.mlp.down_proj.weight', 'base_model.model.model.layers.8.mlp.up_proj.weight', 'base_model.model.model.layers.8.input_layernorm.weight', 'base_model.model.model.layers.8.post_attention_layernorm.weight', 'base_model.model.model.layers.9.self_attn.q_proj.weight', 'base_model.model.model.layers.9.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.9.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.9.self_attn.k_proj.weight', 'base_model.model.model.layers.9.self_attn.v_proj.weight', 'base_model.model.model.layers.9.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.9.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.9.self_attn.o_proj.weight', 'base_model.model.model.layers.9.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.9.mlp.gate_proj.weight', 'base_model.model.model.layers.9.mlp.down_proj.weight', 'base_model.model.model.layers.9.mlp.up_proj.weight', 'base_model.model.model.layers.9.input_layernorm.weight', 'base_model.model.model.layers.9.post_attention_layernorm.weight', 'base_model.model.model.layers.10.self_attn.q_proj.weight', 'base_model.model.model.layers.10.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.10.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.10.self_attn.k_proj.weight', 'base_model.model.model.layers.10.self_attn.v_proj.weight', 'base_model.model.model.layers.10.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.10.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.10.self_attn.o_proj.weight', 'base_model.model.model.layers.10.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.10.mlp.gate_proj.weight', 'base_model.model.model.layers.10.mlp.down_proj.weight', 'base_model.model.model.layers.10.mlp.up_proj.weight', 'base_model.model.model.layers.10.input_layernorm.weight', 'base_model.model.model.layers.10.post_attention_layernorm.weight', 'base_model.model.model.layers.11.self_attn.q_proj.weight', 'base_model.model.model.layers.11.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.11.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.11.self_attn.k_proj.weight', 'base_model.model.model.layers.11.self_attn.v_proj.weight', 'base_model.model.model.layers.11.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.11.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.11.self_attn.o_proj.weight', 'base_model.model.model.layers.11.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.11.mlp.gate_proj.weight', 'base_model.model.model.layers.11.mlp.down_proj.weight', 'base_model.model.model.layers.11.mlp.up_proj.weight', 'base_model.model.model.layers.11.input_layernorm.weight', 'base_model.model.model.layers.11.post_attention_layernorm.weight', 'base_model.model.model.layers.12.self_attn.q_proj.weight', 'base_model.model.model.layers.12.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.12.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.12.self_attn.k_proj.weight', 'base_model.model.model.layers.12.self_attn.v_proj.weight', 'base_model.model.model.layers.12.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.12.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.12.self_attn.o_proj.weight', 'base_model.model.model.layers.12.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.12.mlp.gate_proj.weight', 'base_model.model.model.layers.12.mlp.down_proj.weight', 'base_model.model.model.layers.12.mlp.up_proj.weight', 'base_model.model.model.layers.12.input_layernorm.weight', 'base_model.model.model.layers.12.post_attention_layernorm.weight', 'base_model.model.model.layers.13.self_attn.q_proj.weight', 'base_model.model.model.layers.13.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.13.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.13.self_attn.k_proj.weight', 'base_model.model.model.layers.13.self_attn.v_proj.weight', 'base_model.model.model.layers.13.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.13.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.13.self_attn.o_proj.weight', 'base_model.model.model.layers.13.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.13.mlp.gate_proj.weight', 'base_model.model.model.layers.13.mlp.down_proj.weight', 'base_model.model.model.layers.13.mlp.up_proj.weight', 'base_model.model.model.layers.13.input_layernorm.weight', 'base_model.model.model.layers.13.post_attention_layernorm.weight', 'base_model.model.model.layers.14.self_attn.q_proj.weight', 'base_model.model.model.layers.14.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.14.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.14.self_attn.k_proj.weight', 'base_model.model.model.layers.14.self_attn.v_proj.weight', 'base_model.model.model.layers.14.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.14.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.14.self_attn.o_proj.weight', 'base_model.model.model.layers.14.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.14.mlp.gate_proj.weight', 'base_model.model.model.layers.14.mlp.down_proj.weight', 'base_model.model.model.layers.14.mlp.up_proj.weight', 'base_model.model.model.layers.14.input_layernorm.weight', 'base_model.model.model.layers.14.post_attention_layernorm.weight', 'base_model.model.model.layers.15.self_attn.q_proj.weight', 'base_model.model.model.layers.15.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.15.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.15.self_attn.k_proj.weight', 'base_model.model.model.layers.15.self_attn.v_proj.weight', 'base_model.model.model.layers.15.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.15.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.15.self_attn.o_proj.weight', 'base_model.model.model.layers.15.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.15.mlp.gate_proj.weight', 'base_model.model.model.layers.15.mlp.down_proj.weight', 'base_model.model.model.layers.15.mlp.up_proj.weight', 'base_model.model.model.layers.15.input_layernorm.weight', 'base_model.model.model.layers.15.post_attention_layernorm.weight', 'base_model.model.model.layers.16.self_attn.q_proj.weight', 'base_model.model.model.layers.16.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.16.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.16.self_attn.k_proj.weight', 'base_model.model.model.layers.16.self_attn.v_proj.weight', 'base_model.model.model.layers.16.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.16.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.16.self_attn.o_proj.weight', 'base_model.model.model.layers.16.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.16.mlp.gate_proj.weight', 'base_model.model.model.layers.16.mlp.down_proj.weight', 'base_model.model.model.layers.16.mlp.up_proj.weight', 'base_model.model.model.layers.16.input_layernorm.weight', 'base_model.model.model.layers.16.post_attention_layernorm.weight', 'base_model.model.model.layers.17.self_attn.q_proj.weight', 'base_model.model.model.layers.17.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.17.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.17.self_attn.k_proj.weight', 'base_model.model.model.layers.17.self_attn.v_proj.weight', 'base_model.model.model.layers.17.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.17.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.17.self_attn.o_proj.weight', 'base_model.model.model.layers.17.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.17.mlp.gate_proj.weight', 'base_model.model.model.layers.17.mlp.down_proj.weight', 'base_model.model.model.layers.17.mlp.up_proj.weight', 'base_model.model.model.layers.17.input_layernorm.weight', 'base_model.model.model.layers.17.post_attention_layernorm.weight', 'base_model.model.model.layers.18.self_attn.q_proj.weight', 'base_model.model.model.layers.18.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.18.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.18.self_attn.k_proj.weight', 'base_model.model.model.layers.18.self_attn.v_proj.weight', 'base_model.model.model.layers.18.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.18.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.18.self_attn.o_proj.weight', 'base_model.model.model.layers.18.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.18.mlp.gate_proj.weight', 'base_model.model.model.layers.18.mlp.down_proj.weight', 'base_model.model.model.layers.18.mlp.up_proj.weight', 'base_model.model.model.layers.18.input_layernorm.weight', 'base_model.model.model.layers.18.post_attention_layernorm.weight', 'base_model.model.model.layers.19.self_attn.q_proj.weight', 'base_model.model.model.layers.19.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.19.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.19.self_attn.k_proj.weight', 'base_model.model.model.layers.19.self_attn.v_proj.weight', 'base_model.model.model.layers.19.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.19.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.19.self_attn.o_proj.weight', 'base_model.model.model.layers.19.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.19.mlp.gate_proj.weight', 'base_model.model.model.layers.19.mlp.down_proj.weight', 'base_model.model.model.layers.19.mlp.up_proj.weight', 'base_model.model.model.layers.19.input_layernorm.weight', 'base_model.model.model.layers.19.post_attention_layernorm.weight', 'base_model.model.model.layers.20.self_attn.q_proj.weight', 'base_model.model.model.layers.20.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.20.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.20.self_attn.k_proj.weight', 'base_model.model.model.layers.20.self_attn.v_proj.weight', 'base_model.model.model.layers.20.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.20.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.20.self_attn.o_proj.weight', 'base_model.model.model.layers.20.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.20.mlp.gate_proj.weight', 'base_model.model.model.layers.20.mlp.down_proj.weight', 'base_model.model.model.layers.20.mlp.up_proj.weight', 'base_model.model.model.layers.20.input_layernorm.weight', 'base_model.model.model.layers.20.post_attention_layernorm.weight', 'base_model.model.model.layers.21.self_attn.q_proj.weight', 'base_model.model.model.layers.21.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.21.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.21.self_attn.k_proj.weight', 'base_model.model.model.layers.21.self_attn.v_proj.weight', 'base_model.model.model.layers.21.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.21.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.21.self_attn.o_proj.weight', 'base_model.model.model.layers.21.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.21.mlp.gate_proj.weight', 'base_model.model.model.layers.21.mlp.down_proj.weight', 'base_model.model.model.layers.21.mlp.up_proj.weight', 'base_model.model.model.layers.21.input_layernorm.weight', 'base_model.model.model.layers.21.post_attention_layernorm.weight', 'base_model.model.model.layers.22.self_attn.q_proj.weight', 'base_model.model.model.layers.22.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.22.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.22.self_attn.k_proj.weight', 'base_model.model.model.layers.22.self_attn.v_proj.weight', 'base_model.model.model.layers.22.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.22.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.22.self_attn.o_proj.weight', 'base_model.model.model.layers.22.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.22.mlp.gate_proj.weight', 'base_model.model.model.layers.22.mlp.down_proj.weight', 'base_model.model.model.layers.22.mlp.up_proj.weight', 'base_model.model.model.layers.22.input_layernorm.weight', 'base_model.model.model.layers.22.post_attention_layernorm.weight', 'base_model.model.model.layers.23.self_attn.q_proj.weight', 'base_model.model.model.layers.23.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.23.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.23.self_attn.k_proj.weight', 'base_model.model.model.layers.23.self_attn.v_proj.weight', 'base_model.model.model.layers.23.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.23.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.23.self_attn.o_proj.weight', 'base_model.model.model.layers.23.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.23.mlp.gate_proj.weight', 'base_model.model.model.layers.23.mlp.down_proj.weight', 'base_model.model.model.layers.23.mlp.up_proj.weight', 'base_model.model.model.layers.23.input_layernorm.weight', 'base_model.model.model.layers.23.post_attention_layernorm.weight', 'base_model.model.model.layers.24.self_attn.q_proj.weight', 'base_model.model.model.layers.24.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.24.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.24.self_attn.k_proj.weight', 'base_model.model.model.layers.24.self_attn.v_proj.weight', 'base_model.model.model.layers.24.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.24.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.24.self_attn.o_proj.weight', 'base_model.model.model.layers.24.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.24.mlp.gate_proj.weight', 'base_model.model.model.layers.24.mlp.down_proj.weight', 'base_model.model.model.layers.24.mlp.up_proj.weight', 'base_model.model.model.layers.24.input_layernorm.weight', 'base_model.model.model.layers.24.post_attention_layernorm.weight', 'base_model.model.model.layers.25.self_attn.q_proj.weight', 'base_model.model.model.layers.25.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.25.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.25.self_attn.k_proj.weight', 'base_model.model.model.layers.25.self_attn.v_proj.weight', 'base_model.model.model.layers.25.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.25.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.25.self_attn.o_proj.weight', 'base_model.model.model.layers.25.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.25.mlp.gate_proj.weight', 'base_model.model.model.layers.25.mlp.down_proj.weight', 'base_model.model.model.layers.25.mlp.up_proj.weight', 'base_model.model.model.layers.25.input_layernorm.weight', 'base_model.model.model.layers.25.post_attention_layernorm.weight', 'base_model.model.model.layers.26.self_attn.q_proj.weight', 'base_model.model.model.layers.26.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.26.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.26.self_attn.k_proj.weight', 'base_model.model.model.layers.26.self_attn.v_proj.weight', 'base_model.model.model.layers.26.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.26.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.26.self_attn.o_proj.weight', 'base_model.model.model.layers.26.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.26.mlp.gate_proj.weight', 'base_model.model.model.layers.26.mlp.down_proj.weight', 'base_model.model.model.layers.26.mlp.up_proj.weight', 'base_model.model.model.layers.26.input_layernorm.weight', 'base_model.model.model.layers.26.post_attention_layernorm.weight', 'base_model.model.model.layers.27.self_attn.q_proj.weight', 'base_model.model.model.layers.27.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.27.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.27.self_attn.k_proj.weight', 'base_model.model.model.layers.27.self_attn.v_proj.weight', 'base_model.model.model.layers.27.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.27.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.27.self_attn.o_proj.weight', 'base_model.model.model.layers.27.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.27.mlp.gate_proj.weight', 'base_model.model.model.layers.27.mlp.down_proj.weight', 'base_model.model.model.layers.27.mlp.up_proj.weight', 'base_model.model.model.layers.27.input_layernorm.weight', 'base_model.model.model.layers.27.post_attention_layernorm.weight', 'base_model.model.model.layers.28.self_attn.q_proj.weight', 'base_model.model.model.layers.28.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.28.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.28.self_attn.k_proj.weight', 'base_model.model.model.layers.28.self_attn.v_proj.weight', 'base_model.model.model.layers.28.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.28.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.28.self_attn.o_proj.weight', 'base_model.model.model.layers.28.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.28.mlp.gate_proj.weight', 'base_model.model.model.layers.28.mlp.down_proj.weight', 'base_model.model.model.layers.28.mlp.up_proj.weight', 'base_model.model.model.layers.28.input_layernorm.weight', 'base_model.model.model.layers.28.post_attention_layernorm.weight', 'base_model.model.model.layers.29.self_attn.q_proj.weight', 'base_model.model.model.layers.29.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.29.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.29.self_attn.k_proj.weight', 'base_model.model.model.layers.29.self_attn.v_proj.weight', 'base_model.model.model.layers.29.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.29.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.29.self_attn.o_proj.weight', 'base_model.model.model.layers.29.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.29.mlp.gate_proj.weight', 'base_model.model.model.layers.29.mlp.down_proj.weight', 'base_model.model.model.layers.29.mlp.up_proj.weight', 'base_model.model.model.layers.29.input_layernorm.weight', 'base_model.model.model.layers.29.post_attention_layernorm.weight', 'base_model.model.model.layers.30.self_attn.q_proj.weight', 'base_model.model.model.layers.30.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.30.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.30.self_attn.k_proj.weight', 'base_model.model.model.layers.30.self_attn.v_proj.weight', 'base_model.model.model.layers.30.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.30.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.30.self_attn.o_proj.weight', 'base_model.model.model.layers.30.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.30.mlp.gate_proj.weight', 'base_model.model.model.layers.30.mlp.down_proj.weight', 'base_model.model.model.layers.30.mlp.up_proj.weight', 'base_model.model.model.layers.30.input_layernorm.weight', 'base_model.model.model.layers.30.post_attention_layernorm.weight', 'base_model.model.model.layers.31.self_attn.q_proj.weight', 'base_model.model.model.layers.31.self_attn.q_proj.lora_A.default.weight', 'base_model.model.model.layers.31.self_attn.q_proj.lora_B.default.weight', 'base_model.model.model.layers.31.self_attn.k_proj.weight', 'base_model.model.model.layers.31.self_attn.v_proj.weight', 'base_model.model.model.layers.31.self_attn.v_proj.lora_A.default.weight', 'base_model.model.model.layers.31.self_attn.v_proj.lora_B.default.weight', 'base_model.model.model.layers.31.self_attn.o_proj.weight', 'base_model.model.model.layers.31.self_attn.rotary_emb.inv_freq', 'base_model.model.model.layers.31.mlp.gate_proj.weight', 'base_model.model.model.layers.31.mlp.down_proj.weight', 'base_model.model.model.layers.31.mlp.up_proj.weight', 'base_model.model.model.layers.31.input_layernorm.weight', 'base_model.model.model.layers.31.post_attention_layernorm.weight', 'base_model.model.model.norm.weight', 'base_model.model.lm_head.0.weight'].
There were unexpected keys in the checkpoint model loaded: ['base_model.model.model.layers.0.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.0.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.0.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.0.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.1.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.1.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.1.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.1.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.2.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.2.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.2.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.2.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.3.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.3.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.3.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.3.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.4.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.4.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.4.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.4.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.5.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.5.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.5.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.5.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.6.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.6.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.6.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.6.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.7.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.7.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.7.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.7.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.8.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.8.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.8.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.8.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.9.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.9.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.9.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.9.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.10.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.10.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.10.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.10.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.11.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.11.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.11.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.11.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.12.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.12.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.12.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.12.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.13.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.13.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.13.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.13.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.14.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.14.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.14.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.14.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.15.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.15.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.15.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.15.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.16.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.16.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.16.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.16.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.17.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.17.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.17.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.17.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.18.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.18.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.18.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.18.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.19.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.19.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.19.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.19.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.20.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.20.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.20.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.20.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.21.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.21.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.21.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.21.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.22.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.22.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.22.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.22.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.23.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.23.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.23.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.23.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.24.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.24.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.24.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.24.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.25.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.25.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.25.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.25.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.26.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.26.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.26.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.26.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.27.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.27.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.27.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.27.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.28.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.28.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.28.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.28.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.29.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.29.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.29.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.29.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.30.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.30.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.30.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.30.self_attn.v_proj.lora_B.weight', 'base_model.model.model.layers.31.self_attn.q_proj.lora_A.weight', 'base_model.model.model.layers.31.self_attn.q_proj.lora_B.weight', 'base_model.model.model.layers.31.self_attn.v_proj.lora_A.weight', 'base_model.model.model.layers.31.self_attn.v_proj.lora_B.weight'].
{'train_runtime': 12496.3489, 'train_samples_per_second': 3.997, 'train_steps_per_second': 0.031, 'train_loss': 1.1050885347219614, 'epoch': 1.0}
100%|███████████████████████████████████████| 390/390 [3:28:16<00:00, 32.04s/it]
If there's a warning about missing keys above, please disregard :)
In [ ]: