Slow downloads

[hivenet-fabioferreira]

I can't download at download speed above 50mbps even in same host of olah-server.

# echo $HF_ENDPOINT
http://localhost:8090
# huggingface-cli download tiiuae/Falcon3-10B-Instruct
⚠️  Warning: 'huggingface-cli download' is deprecated. Use 'hf download' instead.
Fetching 13 files:   0%|                                                                                              | 0/13 [00:00<?, ?it/s]Downloading 'model-00005-of-00005.safetensors' to '/root/.cache/huggingface/hub/models--tiiuae--Falcon3-10B-Instruct/blobs/1c9f763fa820f09556566aa92d4aa77f-10.incomplete' (resume from 262144000/946883120)
Downloading 'model-00001-of-00005.safetensors' to '/root/.cache/huggingface/hub/models--tiiuae--Falcon3-10B-Instruct/blobs/74e89d03c3a9de7b27cbeb9e4002f23c-10.incomplete' (resume from 367001600/4938900432)
Downloading 'model-00003-of-00005.safetensors' to '/root/.cache/huggingface/hub/models--tiiuae--Falcon3-10B-Instruct/blobs/89b23dade93f7d20ff10ed02c50fbc34-10.incomplete' (resume from 314572800/4891740544)
Downloading 'model-00002-of-00005.safetensors' to '/root/.cache/huggingface/hub/models--tiiuae--Falcon3-10B-Instruct/blobs/589551959e9ba3d53609aa7051bbf704-10.incomplete' (resume from 314572800/4942085160)
Downloading 'model-00004-of-00005.safetensors' to '/root/.cache/huggingface/hub/models--tiiuae--Falcon3-10B-Instruct/blobs/40af8aa97d63f2cb6281912b7c25bdb8-10.incomplete' (resume from 314572800/4891740536)
(…)2db6202/model-00005-of-00005.safetensors: 100%|████████████████████████████████████████████████████████| 947M/947M [00:47<00:00, 14.4MB/s]
Download complete. Moving file to /root/.cache/huggingface/hub/models--tiiuae--Falcon3-10B-Instruct/blobs/1c9f763fa820f09556566aa92d4aa77f-10
(…)2db6202/model-00004-of-00005.safetensors: 100%|██████████████████████████████████████████████████████| 4.89G/4.89G [06:59<00:00, 10.9MB/s]
Download complete. Moving file to /root/.cache/huggingface/hub/models--tiiuae--Falcon3-10B-Instruct/blobs/40af8aa97d63f2cb6281912b7c25bdb8-10
(…)2db6202/model-00002-of-00005.safetensors: 100%|██████████████████████████████████████████████████████| 4.94G/4.94G [07:14<00:00, 10.6MB/s]
Download complete. Moving file to /root/.cache/huggingface/hub/models--tiiuae--Falcon3-10B-Instruct/blobs/589551959e9ba3d53609aa7051bbf704-10
(…)2db6202/model-00003-of-00005.safetensors: 100%|██████████████████████████████████████████████████████| 4.89G/4.89G [07:22<00:00, 10.4MB/s]
Download complete. Moving file to /root/.cache/huggingface/hub/models--tiiuae--Falcon3-10B-Instruct/blobs/89b23dade93f7d20ff10ed02c50fbc34-10
(…)2db6202/model-00001-of-00005.safetensors:  98%|█████████████████████████████████████████████████████ | 4.85G/4.94G [07:22<00:07, 11.7MB/s^Fetching 13 files:  31%|██████████████████████████▏                                                          | 4/13 [07:29<16:50, 112.26s/it]

My docker image:

FROM ubuntu:24.04

# Install packages
RUN apt-get update && apt-get install -y --no-install-recommends \
  build-essential \
  wget \
  git \
  && apt-get clean autoclean && rm -rf /var/lib/apt/lists/{apt,dpkg,cache,log} /tmp/* /var/tmp/*

RUN wget --no-check-certificate https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh -O /tmp/miniconda.sh && \
  bash /tmp/miniconda.sh -b -p /opt/conda && \
  rm /tmp/miniconda.sh && \
  ln -s /opt/conda/etc/profile.d/conda.sh /etc/profile.d/conda.sh && \
  echo ". /opt/conda/etc/profile.d/conda.sh" >> ~/.bashrc && \
  echo "conda activate base" >> ~/.bashrc

ENV PATH="/opt/conda/bin:${PATH}"

# Accept Anaconda TOS before installing anything
RUN conda tos accept --override-channels --channel https://repo.anaconda.com/pkgs/main \
    && conda tos accept --override-channels --channel https://repo.anaconda.com/pkgs/r

RUN conda install python~=3.10.12 pip
RUN pip install brotli==1.1.0 requests==2.31.0 olah==0.4.1

VOLUME /root/.cache

# Default command to run olah server
ENTRYPOINT ["olah-cli"]
CMD ["--host", "0.0.0.0", "--port", "8090", "--mirror-netloc", "0.0.0.0:8090", "--repos-path", "/root/.cache"]

Extra env variables

export WEB_CONCURRENCY=4
export HF_TOKEN=hc_xxxxxx

I appreciate some help on this issue.