The thought of querying a distant LLM makes my backbone tingle — and never in a great way. After I have to do a spot of analysis through AI, I go for an area LLM, corresponding to Ollama.
In case you haven't but put in Ollama, you’ll be able to examine it my information on the way to set up an LLM on MacOS (and why it’s best to). You can even set up Ollama on Linux and Home windows, and, provided that the Firefox extension works on all three platforms, you’ll be able to make sure that no matter desktop OS you utilize will work.
Additionally: My 5 favorite web browsers – and what each is ideal for
Utilizing Ollama from inside the terminal window is definitely fairly straightforward, nevertheless it doesn't offer you such apparent entry to different options (corresponding to LLM/Immediate choice, picture add, web search allow/disable, and Settings).
The free extension I’ll level out works on Firefox, Zen Browser (one in every of my favorites), and others.
Let's get to that extension.
Tips on how to set up the Web page Help extension in Firefox
What you'll want: To make this work, you'll want Ollama put in and working, in addition to the Firefox browser. That's it. Let's make some magic.
As with all browser extensions, do a little bit of analysis earlier than putting in.
Tips on how to use Web page Help
Earlier than you really use Web page Help, it’s essential be sure that Ollama is working. In case you've already put in it, you’ll be able to run an area LLM with a command like this:
ollama run llama3.2
In case you see the >>> immediate, the LLM is working and able to settle for queries.
Additionally: This terminal app makes use of AI that will help you perceive the command line
1. Pin the extension
The very first thing I’d do is pin the Web page Help extension to the Firefox toolbar. To try this, click on the puzzle piece icon after which click on the gear icon related to Web page Help. From the drop-down, click on "Pin to toolbar." It’s best to now see the Web page Help icon within the Firefox toolbar (which appears to be like like a tiny thought balloon).
I all the time pin add-ons that I do know I'll use often to the Firefox toolbar.
2. Open the extension
Click on the Web page Help icon, and a brand new tab will open with the Ollama UI.
3. Choose your mannequin
Earlier than you’ll be able to run your first question, it’s essential choose a mannequin. Click on the "Choose a Mannequin" drop-down and select the mannequin you've put in (corresponding to llama3.2:newest).
If in case you have a number of fashions put in, they'll all seem on this drop-down.
4. Kind your question
Now you can kind your question within the backside part labeled "Kind a message." Hit Enter in your keyboard or click on Submit, and Ollama will go to work.
Ollama informing me what Linux is.
5. Including a brand new mannequin
You can even add new fashions with Web page Help. To try this, click on the gear icon within the higher proper of the Web page Help window. Click on Handle Fashions within the left sidebar, after which click on Add New Mannequin. Within the pop-up window, kind the title of the mannequin you need to add and click on Pull Mannequin. For an entire listing of fashions obtainable to Ollama, try this web page.
You may add as many fashions as you want, however do pay attention to the file dimension of every, as some can get very giant.
And that, my buddies, is how one can extra simply work together with Ollama, because of a simple-to-use Firefox extension.