How to Debug the Ollama API: A Step-by-Step Guide

This article explains how to download Ollama and deploy AI large language models (such as DeepSeek-R1, Llama 3.2, etc.) locally. Using Ollama—an open-source large language model service tool—you can run powerful open-source AI models on your own computer. We'll provide comprehensive instructions for installation, setup, and most importantly, debugging the API endpoint to enable seamless interaction with your AI models.

Table of Contents

1. Step 1: Download and Install Ollama
2. Step 2: Install AI Models
3. Step 3: Interact with AI Models
4. Step 4: Optional - Simplify Workflows with GUI/Web Tools
5. Step 5: Debug the Ollama API

Step 1: Download and Install Ollama

1. Visit Ollama's official GitHub repository: https://github.com/ollama/ollama
2. Download the version corresponding to your operating system (this tutorial uses macOS as an example; Windows follows similar steps).

1. Complete the installation.

After installation, open the Terminal (on macOS, press F4 and search for "Terminal"). Enter ollama - if the following prompt appears, installation was successful.

Step 2: Install AI Models

After installing Ollama, download the desired AI model using these commands:

ollama run llama3.2

Available models (replace llama3.2 with your preferred model):

A progress indicator will appear during download (duration depends on internet speed):

When prompted with "Send a message", you're ready to interact with the model:

Step 3: Interact with Llama3.2

Example interaction (asking "Who are you?"):

• Use Control + D to end the current session.
• To restart later, simply rerun ollama run llama3.2.

Step 4: Optional GUI/Web Interface Support

Using a terminal for daily interactions can be inconvenient. For a more user-friendly experience, Ollama's GitHub repository lists multiple community-driven GUI and web-based tools. You can explore these options independently, as each project provides its own setup instructions. Here's a brief overview:

• GUI Tools

  • Ollama Desktop: Native app for macOS/Windows (supports model management and chat).
  • LM Studio: Cross-platform interface with model library integration.

• Web Interfaces

  • Ollama WebUI: Browser-based chat interface (run locally).
  • OpenWebUI: Customizable web dashboard for model interaction.

For details, visit the Ollama GitHub README.

Step 5: Debug the Ollama API

Ollama exposes a local API by default. Refer to the Ollama API Docs for details.

Below, we will use Apidog to debug the local API generated by Ollama. If you haven't installed Apidog yet, you can download and install it—it's an excellent tool for API debugging, API documentation, API mocking, and automated API testing.

Create a New Request

Copy this cURL command:

curl --location --request POST 'http://localhost:11434/api/generate' \
--header 'Content-Type: application/json' \
--data-raw '{
    "model": "llama3.2",
    "prompt": "Why is the sky blue?",
    "stream": false
}'

In Apidog:

1. Create a new HTTP project.
2. Paste the cURL into the request builder.
3. Save the configuration.

Send the Request

Navigate to the "Run" tab and click "Send". The AI response will appear.

For streaming output, set "stream": true.

Advanced API Debugging Tips

Here are some additional tips for debugging the Ollama API effectively:

1. Check API Status: Verify the Ollama service is running with:

   curl http://localhost:11434/api/version

1. Troubleshoot Common Issues:

   • Ensure Ollama is running before making API calls
   • Check that your model is correctly downloaded (ollama list)
   • Verify the port isn't blocked by a firewall

2. Customize API Parameters: Experiment with these parameters in your requests:
   

   {
     "model": "llama3.2",
     "prompt": "Write a short poem about coding",
     "system": "You are a helpful assistant that writes poetry",
     "temperature": 0.7,
     "top_p": 0.9,
     "top_k": 40,
     "max_tokens": 500
   }

1. Implement Error Handling: Always check for error responses from the API and handle them gracefully in your applications.

Conclusion

This guide covered:

1. Ollama installation
2. Model deployment
3. Command-line interaction
4. API testing and debugging with Apidog

You now have a complete workflow for local AI model experimentation, application development, and API debugging. By mastering the Ollama API, you can build sophisticated applications that leverage powerful AI models running entirely on your local machine.

References

1. Ollama GitHub Repository
2. Ollama API Documentation
3. Apidog Documentation

• 10 Markdown Tips for Creating Beautiful Product Documentation in 2025