ollama on Termux support

[Kallinteris-Andreas]

I am running ollama locally on my phone via Termux

root@localhost:~# ollama serve
2024/12/02 11:02:42 routes.go:1197: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://*] OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
time=2024-12-02T11:02:42.655Z level=INFO source=images.go:753 msg="total blobs: 8"
time=2024-12-02T11:02:42.657Z level=INFO source=images.go:760 msg="total unused blobs removed: 0"
time=2024-12-02T11:02:42.660Z level=INFO source=routes.go:1248 msg="Listening on 127.0.0.1:11434 (version 0.4.6)"
time=2024-12-02T11:02:42.701Z level=INFO source=common.go:135 msg="extracting embedded files" dir=/tmp/ollama2376261441/runners
time=2024-12-02T11:02:42.930Z level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners="[cuda_v12 cpu cuda_jetpack5 cuda_jetpack6 cuda_v11]"
time=2024-12-02T11:02:42.931Z level=INFO source=gpu.go:221 msg="looking for compatible GPUs"
time=2024-12-02T11:02:43.000Z level=INFO source=gpu.go:386 msg="no compatible GPUs were discovered"
time=2024-12-02T11:02:43.001Z level=INFO source=types.go:123 msg="inference compute" id=0 library=cpu variant="no vector extensions" compute="" driver=0.0 name="" total="7.5 GiB" available="5.0 GiB"

and on the app the next button is not "clickable"

[Taewan-P]

Use http://127.0.0.1:11434/. 127.0.0.1 is basically same as localhost. Also since it is a local server, make sure it is http, not https.

[Kallinteris-Andreas]

Now I get this error message when I'm trying to use the chat

I have tried both HTTP and HTTPS

[Taewan-P]

Have you tried accessing the api address endpoint with your browser in your phone?

[Taewan-P]

@Kallinteris-Andreas Did you solve this issue? If so, I would like to close the discussion.

[Kallinteris-Andreas]

Yes it works

[Taewan-P]

Do you mean it is fixed or ollama is accessible via browser but still doesn't work?

[Kallinteris-Andreas]

Sorry, yes i meant the browser connects to the server but gptmobile still has the same error