{"id":3810,"date":"2024-12-07T17:39:21","date_gmt":"2024-12-07T14:39:21","guid":{"rendered":"https:\/\/demensdeum.com\/blog\/2024\/12\/07\/local-llms-ollama\/"},"modified":"2024-12-16T22:32:10","modified_gmt":"2024-12-16T19:32:10","slug":"local-llms-ollama","status":"publish","type":"post","link":"https:\/\/demensdeum.com\/blog\/2024\/12\/07\/local-llms-ollama\/","title":{"rendered":"Local neural networks using ollama"},"content":{"rendered":"<p>If you wanted to run something like ChatGPT and you have a powerful enough computer, for example with an Nvidia RTX video card, then you can run the ollama project, which will allow you to use one of the ready-made LLM models on a local machine, absolutely free. ollama provides the ability to communicate with LLM models, like ChatGPT, and the latest version also announced the ability to read images, format output data in json format.<\/p>\n<p>I also launched the project on a MacBook with an Apple M2 processor, and I know that the latest models of AMD video cards are supported.<\/p>\n<p><img decoding=\"async\" src=\"https:\/\/demensdeum.com\/blog\/wp-content\/uploads\/2024\/12\/mediaollama_logo.jpg\"><\/p>\n<p>To install on macOS, visit the ollama website:<br \/>\n<a href=\"https:\/\/ollama.com\/download\/mac\" rel=\"noopener\" target=\"_blank\">https:\/\/ollama.com\/download\/mac<\/a><\/p>\n<p>Click &#8220;Download for macOS&#8221;, you will download an archive of the form ollama-darwin.zip, inside the archive there will be Ollama.app which you need to copy to &#8220;Applications&#8221;. After that, launch Ollama.app, most likely the installation process will occur at the first launch. After that, you saw the ollama icon in the tray, the tray is on the right top next to the clock.<\/p>\n<p>After that, launch a regular macOS terminal and type the command to download, install and launch any ollama model. The list of available models, descriptions, and their characteristics can be found on the ollama website:<br \/>\n<a href=\"https:\/\/ollama.com\/search\" rel=\"noopener\" target=\"_blank\">https:\/\/ollama.com\/search<\/a><\/p>\n<p>Choose the model with the least number of parameters if it does not fit into your video card at startup.<\/p>\n<p>For example, the commands to launch the llama3.1:latest model:<\/p>\n<div class=\"hcb_wrap\">\n<pre class=\"prism line-numbers lang-bash\" data-lang=\"bash\"><code>\nollama run llama3.1:latest\n\n<\/code><\/pre>\n<\/div>\n<p>Installation for Windows and Linux is generally similar, in one case there will be an ollama installer and further work with it through Powershell.<br \/>\nFor Linux, the installation is done by a script, but I recommend using the version of your specific package manager. In Linux, ollama can also be launched through a regular bash terminal.<\/p>\n<p>Sources<br \/>\n<a href=\"https:\/\/www.youtube.com\/watch?v=Wjrdr0NU4Sk\" rel=\"noopener\" target=\"_blank\">https:\/\/www.youtube.com\/watch?v=Wjrdr0NU4Sk<\/a><br \/>\n<a href=\"https:\/\/ollama.com\" rel=\"noopener\" target=\"_blank\">https:\/\/ollama.com<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>If you wanted to run something like ChatGPT and you have a powerful enough computer, for example with an Nvidia RTX video card, then you can run the ollama project, which will allow you to use one of the ready-made LLM models on a local machine, absolutely free. ollama provides the ability to communicate with<a class=\"more-link\" href=\"https:\/\/demensdeum.com\/blog\/2024\/12\/07\/local-llms-ollama\/\">Continue reading <span class=\"screen-reader-text\">&#8220;Local neural networks using ollama&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[49],"tags":[],"class_list":["post-3810","post","type-post","status-publish","format-standard","hentry","category-blog","entry"],"translation":{"provider":"WPGlobus","version":"3.0.2","language":"en","enabled_languages":["en","ru","zh","de","fr","ja","pt","hi"],"languages":{"en":{"title":true,"content":true,"excerpt":false},"ru":{"title":true,"content":true,"excerpt":false},"zh":{"title":true,"content":true,"excerpt":false},"de":{"title":true,"content":true,"excerpt":false},"fr":{"title":true,"content":true,"excerpt":false},"ja":{"title":true,"content":true,"excerpt":false},"pt":{"title":true,"content":true,"excerpt":false},"hi":{"title":false,"content":false,"excerpt":false}}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/demensdeum.com\/blog\/wp-json\/wp\/v2\/posts\/3810","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/demensdeum.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/demensdeum.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/demensdeum.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/demensdeum.com\/blog\/wp-json\/wp\/v2\/comments?post=3810"}],"version-history":[{"count":18,"href":"https:\/\/demensdeum.com\/blog\/wp-json\/wp\/v2\/posts\/3810\/revisions"}],"predecessor-version":[{"id":3828,"href":"https:\/\/demensdeum.com\/blog\/wp-json\/wp\/v2\/posts\/3810\/revisions\/3828"}],"wp:attachment":[{"href":"https:\/\/demensdeum.com\/blog\/wp-json\/wp\/v2\/media?parent=3810"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/demensdeum.com\/blog\/wp-json\/wp\/v2\/categories?post=3810"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/demensdeum.com\/blog\/wp-json\/wp\/v2\/tags?post=3810"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}