fbd0c9b7f4
- Introduced Convex, an open-source reactive database, with README and environment variable configurations. - Added Chinese translation for Convex documentation. - Created docker-compose configuration for Convex services. - Introduced llama-swap, a model swapping proxy for OpenAI/Anthropic compatible servers, with comprehensive README and example configuration. - Added Chinese translation for llama-swap documentation. - Included example environment file and docker-compose setup for llama-swap. - Configured health checks and resource limits for both Convex and llama-swap services.
29 lines
1.1 KiB
Docker
29 lines
1.1 KiB
Docker
# Use the official vllm image for gpu with Ampere、Ada Lovelace、Hopper architecture (8.0 <= Compute Capability <= 9.0)
|
|
# Compute Capability version query (https://developer.nvidia.com/cuda-gpus)
|
|
FROM vllm/vllm-openai:v0.10.2
|
|
|
|
# Use the official vllm image for gpu with Volta、Turing、Blackwell architecture (7.0 < Compute Capability < 8.0 or Compute Capability >= 10.0)
|
|
# support x86_64 architecture and ARM(AArch64) architecture
|
|
# FROM vllm/vllm-openai:v0.11.0
|
|
|
|
# Install libgl for opencv support & Noto fonts for Chinese characters
|
|
RUN apt-get update && \
|
|
apt-get install -y \
|
|
fonts-noto-core \
|
|
fonts-noto-cjk \
|
|
fontconfig \
|
|
libgl1 && \
|
|
fc-cache -fv && \
|
|
apt-get clean && \
|
|
rm -rf /var/lib/apt/lists/*
|
|
|
|
# Install mineru latest
|
|
RUN python3 -m pip install -U 'mineru[core]>=2.7.6' --break-system-packages && \
|
|
python3 -m pip cache purge
|
|
|
|
# Download models and update the configuration file
|
|
RUN /bin/bash -c "mineru-models-download -s huggingface -m all"
|
|
|
|
# Set the entry point to activate the virtual environment and run the command line tool
|
|
ENTRYPOINT ["/bin/bash", "-c", "export MINERU_MODEL_SOURCE=local && exec \"$@\"", "--"]
|