操作流程

• 1、下载安装
• 2、配置
• 3、测试

下载安装

• 准备期

susetenforce0mkdir-p/usr/local/software/ollama&mkdir-p/usr/local/software/ollama/modelschmod0777-R/usr/local/software/ollama /usr/local/software/ollama/modelschown$USER:$USER-R/usr/local/software/ollama /usr/local/software/ollama/models

• Ollama

cd/usr/local/software# 官网：https://ollama.com/download/linux# ollama在线安装: curl -fsSL https://ollama.com/install.sh | sh# ollama离线安装mkdir-pollama&&chmod0777-Rollama&&chown$USER:$USER-Rollamawgethttps://github.com/ollama/ollama/releases/download/v0.6.5/ollama-linux-amd64.tgztar-xzvfollama-linux-amd64.tgz-C/usr/local/software/ollamarm-rfollama-linux-amd64.tgz

配置

# 创建ollama开机自启cat>/etc/systemd/system/ollama.service<<'EOF' [Unit] Description=Ollama Service After=network-online.target [Service] Type=ollama User=root Group=root Restart=always RestartSec=3 ExecStart=/usr/local/software/ollama/bin/ollama serve Environment="OLLAMA_HOST=0.0.0.0" Environment="OLLAMA_PORT=11434" Environment="OLLAMA_GPU_LAYER=cuda" Environment="OLLAMA_ORIGINS=*" Environment="OLLAMA_DEBUG=1" Environment="OLLAMA_MODELS=/usr/local/software/ollama/models" Environment="CUDA_VISIBLE_DEVICES=GPU-e1d26ec1-7ba8-8d54-49a8-d1f0b9d865c2" [Install] WantedBy=multi-user.target EOFgroupaddollamauseradd-gollama-s/usr/sbin/nologin ollamachmod0777-R/usr/local/software/ollama /etc/systemd/system/ollama.servicechown$USER:$USER-R/usr/local/software/ollama /etc/systemd/system/ollama.servicechownollama:ollama-R/usr/local/software/ollama /etc/systemd/system/ollama.service#查看GPU的UUID#命令：nvidia-smi -Lcat>>/etc/profile<<"EOF" #set ollama environment OLLAMA_HOME=/usr/local/software/ollama OLLAMA_HOST=0.0.0.0 OLLAMA_PORT=11434 OLLAMA_GPU_LAYER=cuda OLLAMA_MODELS=/usr/local/software/ollama/models OLLAMA_ORIGINS=* OLLAMA_DEBUG=1 PATH=$OLLAMA_HOME:$OLLAMA_HOME/bin:$OLLAMA_GPU_LAYER:$OLLAMA_MODELS:$PATH:$OLLAMA_HOST:$OLLAMA_PORT:$OLLAMA_ORIGINS:$OLLAMA_DEBUG export OLLAMA_HOME OLLAMA_GPU_LAYER OLLAMA_MODELS PATH OLLAMA_HOST OLLAMA_PORT OLLAMA_ORIGINS OLLAMA_DEBUG EOFsource/etc/profile# 启动另外一个终端systemctl daemon-reload systemctlenableollama systemctl stop ollama systemctl start ollama systemctl status ollamareboot

测试

ollama-v# 提问 查看PROCESSOR列比例值是否有使用GPUollamaps

• api：https://docs.ollama.com/api