Perplexica and Ollama Setup
Are you in the self-hosted camp, enjoying Ollama, and wondering when we'd have something like Perplexity AI but local, and maybe a bit more secure? I had been keeping an eye out when I came across an article on MARKTECHPOST about Perplexica. So I decided to take a crack at it. There were a few issues I encountered which we'll work around in the Perplexica setup, aside from config there was a call property that we need to address. Let's dive in.
Ollama Install and Setup
To begin with Ollama, follow these steps:
-
Run the installation script using
curl -fsSL https://ollama.com/install.sh | sh
-
Pull the latest version of Llama3 using
ollama pull llama3:latest
-
Pull the latest version of Nomic-Embed-Text using
ollama pull nomic-embed-text:latest
-
Edit the Ollama service file by running sudo systemctl edit ollama.service and adding the following lines
Copy Code [Service] Environment="OLLAMA_HOST=0.0.0.0"
-
Reload the systemd daemon using
sudo systemctl daemon-reload
-
Restart the Ollama service using
sudo systemctl restart ollama
Perplexica Setup
To set up Perplexica, follow these steps:
-
Clone the Perplexica repository using
git clone https://github.com/ItzCrazyKns/Perplexica.git
-
Copy the sample configuration file to a new file named config.toml
using cp sample.config.toml config.toml
-
Open config.toml in a text editor (such as nano) and make the following changes:
Change OLLAMA = http://server-ip:11434
Comment out the server for SEARXNG and press CTRL+X to exit and Y to save
-
Open
ui/components/theme/Switcher.tsx
in a text editor (such as nano) and make the following changes to line 10
const ThemeSwitcher = ({ className, size }: { className?: string; size?: number }) => {
Then press ctrl+x, then y to save the file
Open
docker-compose.yml
in a text editor (such as nano) and make the following changes
SEARXNG_API_URL=http://server-ip:4000
NEXT_PUBLIC_API_URL=http://server-ip:3001/api
NEXT_PUBLIC_WS_URL=ws://server-ip:3001
-
Build and start the Perplexica container using
docker compose up -d --build
Access Perplexica by visiting
http://server-ip:3000
in your web browser
That's it! With these steps, you should be able to set up both Perplexica and Ollama on your system. If you found this helpful please share this post, donate to my Buymeacoffee, or clap if you're reading this on Medium. Till next time fair winds and following seas!
Top comments (0)