The concept of querying a distant LLM makes my backbone tingle — and never in a great way. After I must do a spot of analysis through AI, I go for an area LLM, resembling Ollama.
Should you haven't but put in Ollama, you’ll be able to examine it my information on tips on how to set up an LLM on MacOS (and why it is best to). It’s also possible to set up Ollama on Linux and Home windows, and, on condition that the Firefox extension works on all three platforms, you’ll be able to make certain that no matter desktop OS you utilize will work.
Additionally: My 5 favorite web browsers – and what each is ideal for
Utilizing Ollama from inside the terminal window is definitely fairly simple, nevertheless it doesn't provide you with such apparent entry to different options (resembling LLM/Immediate choice, picture add, web search allow/disable, and Settings).
The free extension I’ll level out works on Firefox, Zen Browser (one among my favorites), and others.
Let's get to that extension.
Tips on how to set up the Web page Help extension in Firefox
What you'll want: To make this work, you'll want Ollama put in and operating, in addition to the Firefox browser. That's it. Let's make some magic.
As with all browser extensions, do a little bit of analysis earlier than putting in.
Tips on how to use Web page Help
Earlier than you really use Web page Help, you must make sure that Ollama is operating. Should you've already put in it, you’ll be able to run an area LLM with a command like this:
ollama run llama3.2
Should you see the >>> immediate, the LLM is operating and able to settle for queries.
Additionally: This terminal app makes use of AI that will help you perceive the command line
1. Pin the extension
The very first thing I might do is pin the Web page Help extension to the Firefox toolbar. To try this, click on the puzzle piece icon after which click on the gear icon related to Web page Help. From the drop-down, click on "Pin to toolbar." You need to now see the Web page Help icon within the Firefox toolbar (which seems like a tiny thought balloon).
I all the time pin add-ons that I do know I'll use usually to the Firefox toolbar.
2. Open the extension
Click on the Web page Help icon, and a brand new tab will open with the Ollama UI.
3. Choose your mannequin
Earlier than you’ll be able to run your first question, you must choose a mannequin. Click on the "Choose a Mannequin" drop-down and select the mannequin you've put in (resembling llama3.2:newest).
When you’ve got a number of fashions put in, they'll all seem on this drop-down.
4. Kind your question
Now you can kind your question within the backside part labeled "Kind a message." Hit Enter in your keyboard or click on Submit, and Ollama will go to work.
Ollama informing me what Linux is.
5. Including a brand new mannequin
It’s also possible to add new fashions with Web page Help. To try this, click on the gear icon within the higher proper of the Web page Help window. Click on Handle Fashions within the left sidebar, after which click on Add New Mannequin. Within the pop-up window, kind the identify of the mannequin you wish to add and click on Pull Mannequin. For a whole listing of fashions accessible to Ollama, take a look at this web page.
You possibly can add as many fashions as you want, however do be aware of the file measurement of every, as some can get very massive.
And that, my associates, is how one can extra simply work together with Ollama, due to a simple-to-use Firefox extension.