Private LLM - Local AI Chat App Reviews

Literally a Open Assistant knockoff. I’m not against a developer using open source work, but this is a very thin wrapper around someone else’s work with credit given. It’s just sad. I found out this was open assistant after letting the app chat with itself till it mentioned its name was open assistant. Ask it that question in the beginning and it will tell you it’s personal GPT.

Too much good stuff to say. PrivateLLM rocks! First off the devs are cool and responsive but the best part is that it has shortcuts support so the sky’s the limit. Feed whatever data you can into it and it’s all offline and private.

Best app for LLM‘s. Awesome app allowing you to choose which LLM’s you use for specific tasks. I think it’s pretty flawless the way it is great job on developing. I think it’s the best thing available today. Ultimate Wish list: functionality to simultaneously query multiple chosen large language models and aggregate their responses into a single answer by master LLM chosen.

Please allow LLM choice. Please allow us to pick our LLM the same way we do in text-generation-ui by providing hugging face name. I realize not all models can run on iOS, but I was hoping to mostly use this for CodeLlama.

App is actually not so bad but could be improved. I’m currently using the 3b model on a iPhone 12 and it’s pretty rough. It’d be great to see it worked on some more even if the 7b model is the priority.

Simply Incredible!. I cannot believe that I can run a model similar to GPT 3.5 on my iPhone 12 mini! It is a bit slow, but really impressive. The purchase allowed me to install on my MacBook Pro M1 Max 32GB and it is faster than GPT 4. Really excited to see how this app continues to develop and the models get better.

Great app! More features pls! :). This app is awesome for offline use! I would like to be able to download other models from hugging face though. Please make this a feature!

Great. Feature suggestion: the ability to edit the REPLIES that the LLM gives. This way you can influence it better.

Beatiful app.. This app is perfect. I have no problem paying 10 dollars for this app. It does exactly what i need it to do.

Helpful but not an end-all problem solver. Gives solid basic advice. Can handle smaller projects and concerns. Not 100% there. Not 100% stable. Can tell some creepy stories that are unsolicited. Definitely needs a safety team.

Could be 5-star. This app is superb, in terms of its immediate usefulness. It would be above and beyond if there were a history or separate chat type feature as all of the other apps have.

Works Great On IPad Pro M4 13 Inch. On least on the high-end iPad, performance is wonderful even on the largest models. Definitely worth $10 USD.

Love Being able to run a powerfull LLM locally. I cannot believe it is as easy as a few clicks to install an LLM like ChatGPT and it is running entirely on my Mac! No internet required, no monthly fee for a plus version. awesome!

Missing features.. We need the ability to set the system message, considering the price we should be able to load our own models. —— Changed to 5 star for now, if the dev delivers on what they said this app should be great!

Good Basic Beta. Needs Document Support. For the basic chat UI many average consumers like it's fine. But the app need to support common advanced use like adding a PDF, .docx, or .txt file and then running queries against it to privately work with the larger context windows newer models support. As of July 2024 trying to do this hard crashes the app.

A good start. This app is fun, but being able to use other models and configure them would make this app 10 times more useful. I’m hoping the dev adds support for model selection (mistral, pls) and setting the role of the AI.

Pretty great, but it has some limitations. The implementation here is great, especially now that the devs have added support for several models! Works best with devices with a lot of RAM - I have an iPhone 15 Pro, which seems to be enough, but my old 12 didn't really handle it well. I just wish you could save threads like in the ChatGPT app (and maybe give specific system instructions depending on the thread?). Otherwise, pretty good and worth the price! Also, if we could save specific temperature and top-P presets with models and maybe be able to directly type values in, that would be nice.

Works well but needs some improvement. The 7B model constantly crashes on 14 Pro even though the prompt says that the phone can handle it. Downgrading to the 3B seems to work much better.

Still the best offline AI.... Still the best offline AI, most stable and has by far the most current datasets available; this is truly a beast of an app for offline use. I strongly recommend! 👍👍👍

Thank you - A Must Buy. In today's world of subscriptions and personal data living on devices that are not ours this is a refreshing app that I am happy to support. App has been updated since I originally took the plunge (week it came out, randomly found on /r/macapps) several times, is super responsive and best of all 1x fee with local privacy.

Gemma 2B just made this a killer app.. With the recent addition of Gemma 2B which is based of Google Gemni this has just become a killer app for me this has been the best LLM model that provides the best answer I hope to see 7B support in the future and I hope this comes Gemma comes to iPhone and iPad soon. Not only is ther the best performing model but it's all done on device which make this even better. Thank you!

EXACTLY what I needed. This LLM app is what i was looking for. It is the reason I purchased an iPad M4. Defff worth the $10. Even the developer is active and available to chat with online, so reach out if you run into any issues, overall super great and cannot wait to see more updates!

A great package. Worth the $10. Obviously not as useful as Bard/GPT but it undeniably meets all expectations, and I have yet to see anything comparable. With outstanding email support, a Discord support server, and devs that continually work to improve the app for all platforms- this is a must buy for anyone interested.

Great app. This app is pretty great for when you don’t have internet, but want access to ChatGPT. It’s not as powerful as the online version, but the fact that this is a one-time price of $10 is awesome! The only issue I’ve encountered with it so far is that it reloads every time you leave the app even for a moment. I’d love to see a History feature to see previous conversations and maybe Shortcut support, but it’s overall a really great app!

Great tool. Looking forward to future features.. What as easy way to work with LLMs. You can download multiple different models and you can share the application with your family. That's a deal that is hard to beat.

So far so good!. Okay… THIS APP IS AMAZING. I am using this on my iPhone 12 Pro Max and wow, pretty fast reply. I am still playing around with this app but I am very impressed with it. I wonder if new models from huggingface could be downloaded, if that’s possible.

Works as intended.. Wish there was an option for adding additional models, but the ones that are available work well. Now if y’all were able to do a text-to-voice implementation with custom voices that’d be amazing. I’m not particular tech savvy, but the fact this app is capable of working offline is amazing.

Great so far. Seems to do most of what I want. I think there just needs to be two main features added, and one of them should be super easy: 1. Allow increasing font size. Right now the font is pretty small on my computer, and the view menu doesn't have an option to increase font size 2. Support LaTeX. I do a lot of math work these days, and I don't want to see math written without LaTeX. ChatGPT has this feature, which has been super helpful for me when studying

Missing some key features.. Would love to have the ability to include default custom instructions like ChatGPT has. Would also like the option to redo the ai’s chat. Otherwise it’s nice to see this working on a phone.

Good app, design needs work. It’s a very good app but the design needs a lot of work. Would also be good if there was a description for each of the models and what each might be best for.

Not worth $10. This app lacks polish and you can get similar functionality for free from other apps. The Shortcuts feature launches the app and does not query in the background. Waste of money, I will be seeking a refund from Apple. Also, the developer seems a little touchy and immature in their replies to these reviews.

Cool app that keeps getting updated!. I've been using the app since it first came out and it keeps getting better and better. The developers just released a new version that allows you to switch between different models, which is really nice feature!

What Took You So Long. This app represents everything I ever wanted with respect to locally operating a LLM on my Ipad and on my Macbook Pro. It is well worth the purchase price. Please add generative AI to your next update.

Good try. Well, according to the list of viable machines, my iPad Air 3rd generation should be able to run this. It won't run. It launches, struggles for a minute, and crashes. So, I can't really review this. All I can say is that it won't run on my iPad. EDIT: I was able to run this on my MacBook M2 just fine. Looking forward to seeing it run on my iPad. (I have poor old-person eyesight, and I hope the type is slightly larger on the iPad. It doesn't seem to be adjustable on the Mac.)

Different ai models?. I seen that there’s different AI models to choose from in the App Store pictures but when I open the app, the ones in the picture aren’t there. Maybe there could/should be an instruction page on where/how-to download other AI models

Has been updated to be better now. Your app is a good option for on device LLM I congratulate you on your successful update please make shortcut not show when run

Phi3-Mini Please! (Nice app even on Intel Mac). I'm reading Phi3-Mini is quite capable for its size. I know it was just released, but if you could get a version up soon that would be great. Maybe your existing Phi2 implementation will facilitate that. Easy to download and run an LLM locally. No muss, no fuss. Would like to echo another reviewer: please add support for increasing font size. I found I can actually access the default Mac font menu and specify something different, but it doesn't seem to have any effect on the actual font used in the application.

A great tool, with huge potential.. Obviously being an offline GPT limits the responses, but the fundamentals for something impressive in future less memory restricted devices eg iPhone 15 and beyond is really exciting. Offline and privacy focused are essential qualities of this app and it works quite well. A good bargain for the price with an active developer. One recommendation/piece of feedback would be to provide information on what the settings TOP-P and temperature do. If we come across an error or weird, reproducible response could you provide an option to email you a log so we can forward you the issue easily? This way you don’t need to embed any privacy violating analytics packages.

Great little local run chat bot. This is a good little chat bot to play around with when you don’t have internet access. I only have an iPhone 12, so it won’t run the bigger model, but it’s still enjoyable. For a feature request, it’d be nice to have the ability to customize the system prompt.

Poor at deducing intent. Here was my prompt: Request a LinkedIn recommendation from a friend who offered to do one for you. No more than 4 sentences. Tone should be very friendly and familiar and ask them to focus on these 2 things (make them placeholders), if possible. It wrote a recommendation that I would be giving for a friend, basically is not able to deduce or understand the meaning of the prompt. This happened repeatedly with prompts input. Put same prompt into ChatGPT - near perfect response. Tried a few different models including dolphin, LLama - same issues. Not sure if it’s in how to app approaches the LLM or some other factor, but it’s not as good as using ChatGPT or even Ollama on Mac.

Good start!. This app is pretty fantastic! It runs almost smoothly on my phone and I can use it anywhere without needing the cloud. Some additional features that would be cool are being able to browse the internet, interact with documents, get connected with a keyboard for rephrasing or correcting grammar on my phone instead of just on a computer. Also, there could be some improvement in user experience - smoother animations would be awesome. Keep up the good work!

App freezes. Updated review, had to re download the app twice, but now it’s working well. I have to say I’m impressed with the app. It is quick on response, and the models I have tried so far are excellent. The only improvement I could wish for would be the ability to save and reload chats.

There should be an option to use 13B model. (feature request). UI is great and all but 7B model is not that powerful for any useful work, adding an option for Mac users to choose a bigger model will be useful.

Dumb as rocks. Cannot simply justify the $9.99 price point when the LLM can’t even answer basic history questions correctly. That being said, for an offline version of what would be your standard Chat GPT, you can’t be that upset. Unless you’re someone who finds themself offline most of the time and MUST have an LLM to play with (which probably isn’t very many people) please stay away.

So much potential. I've been using this app for a couple of months at this point. When it was first released, it was a neat proof of concept, but it only supported 7B models and was overall just too simple to use effectively. With a recent update, a 13B model was released for all macs with 16GB of memory, and it makes such a huge difference! It's not quite at the same level as ChatGPT 3.5T, but it's close enough that I never use 3.5T anymore; this is my go-to. I greatly appreciate the on-device processing (hallelujah privacy!), and it doesn't even use too much power - my battery still lasts for hours and hours. The performance is also great; my base M1 Air powers right through the prompts. I only have two complaints about the app at this point. 1) The 13B model uses about 12GB of memory by itself, which does force the use of swap on a 16GB Air. Not much the dev can do about this, but it is something to keep in mind. You'll want to close out of other programs before launching this. 2) There still is no feature that has separate conversations. If you want to start a new conversation, you need to delete the existing conversation. I'd love it if we could get separate conversations in a future update; it would make this app so much easier to use. Overall, I love it and do not regret buying it at all. I can't wait to see what future updates bring :)

Font Size. The main issue I have is not being able to adjust the Font Size, it's tiny compared to even other apps. Makes it almost unusable IMO. Great app overall besides that, super fast, responsive, etc.

Incredible. Great app! Always interested in trying newer, more powerful models!

Good app with a privacy oriented focus. This is a very important app and concept in this day and age. Although as a suggestion in order to improve the AI users should be allowed to "opt in" to submitting data to better refine the model. Thank you for everything you do!

Great Support So Far. Love the additional models, this is what I was hoping to see when I paid for an app. It's easy enough to find a free client, so this type of support is just what I hope to see continue!

Great approach. Having option to load own models will be wonderful. Eg Llama 2 or others.

Did you know that you can earn 25 USD from our site just by registering? Get $25 for free by joining Payoneer!

Useless. Honestly the worst and deeply useless ai app I’ve ever used. Don’t bother wasting your time even downloading it

Failing… on Mac. Basic model Prompts - fail; Llama 3.2 crash; other models - loading.. loading..

Has potential. The app seems more stable than the others I’ve tried. It would be good to see the ability to browse and add models from huggingface and to have RAG available document querying.

Downloading models. iPhone 15 Pro gets stuck everytime if you navigate from the app while downloading a model. Cannot even use anything. Was eager to replace ChatGPT but it's not consistent.

Greatly appreciated efforts by dev. When I first tried this app, it was a letdown - just one slow option and I wasn't impressed. But man, was I wrong! The developer has put in some serious hard work, pulling off a 'No Man’s Sky' style transformation. Now, it's packed with well performing models for whichever device you have presently, and honestly it’s become my go-to. Also, I will always appreciate and recommend this app based on its privacy oriented USP alone - because finding apps that care about privacy (especially in a field so ripe for exploit) feels like panning for gold in a septic tank. I’ve gone from regretting my purchase to relying on it daily. It’s versatile, reliable, and an absolute game-changer for anyone looking to work with LLMs privately. I've got to give a huge shoutout to the developers for their commitment to turning things around. Your hard work hasn’t gone unnoticed, and I'm sincerely grateful for it. Wishing you all the success in the future - you’ve got a fan in me! Had to update my review to give the devs a huge thumbs up for such an impressive turnaround!

Impressive. The speed is impressive. The ability to connect with Apple shortcuts ment I could drop my OpenAI api calls for tagging and summaries. And being able to choose models really allows you to purpose build automations. It would be great to be able to choose a model when using apple shortcuts. And more model options over time would be great.

Slow. Can only download 1 model at a time. Downloading is very slow. No background downloading, if the download window closes, downloads are cancelled. Cant reference externally saved models in files app

no correct answers on language. asked it english word meanings and it failed

Useless. Didn’t work for me at all. Takes ages to download models, then models either take forever to respond or else produces gobblygook. Disappointing.

Great introduction to the use of open LLMs, but the Shortcuts integration is glitchy. This is a great, easy starting point to explore open LLMs locally on Apple devices. Unfortunately the Shortcuts integration, likely the most helpful and distinguishing feature, suffers from glitches: - The „ ask Private LLM” action errors out complaining of missing „q” and „s” parameters every second time, despite the input is one single text field - the „Start a new chat with Private LLM” action doesn’t pass the values for prompt and query to the app most often than not, I originally thought it was due to some unexpected special characters or the text being too long, but copy/pasting the same prompt and input directly in the app always works without issues Also, one missing feature that would make a world of difference since each model is tailored to specific use cases: allow pre-selecting a model for the Shortcuts actions. If the issues with Shortcuts were to be addressed, this would be easily a 5 stars app that any LLM enthusiast with not much time on their hands should by yesterday!

It’s okay except a crashing issue. App is good but keeps crashing randomly even for simple prompts and then the chat is cleared and I have to type the whole question again. Have had about 6-7 crashes just today, ram is fine as closed other apps. Running 14 pro max.

Crashes too much. The app works well when it works, so too many times it will just crash and the conversation gets lost. It can't handle the load and quits itself. (iPhone 15)

Amazing!. I'm astounded that I can run such capable models on my laptop. The developer is very active and constantly improving the app. It makes running local private models extremely easy and as of the latest update has a great range of different models to chose from. I have replaced a decent portion of my Open AI usage with this App

Excellent. Excellent, fast unlike other ones, no in app payments, works offline, you can override the ai and give it a personality or even completely unrestricted it. Could do with image generation and ai notes sort of thing.

Some of the Models don’t work very well. The App is great but have had issues with many of the models giving strange and unusable responses.

Privacy focused. After I saw the only review here on the App Store that’s nothing but gibberish, I had to write my own. I love that this app works offline and everything you put into it is private and kept on your device. Plus, there’s no money hungry subscription service. From what I’ve seen on reddit, the developer is working hard on improving the app and I’m looking forward to seeing what’s implemented in the coming updates. So far it’s been great for every day questions and information.

A solid effort. I’m not sure if this dev needs more funding, but this is the *very* beginnings of a local LLM app. What I would love to have is a way for conversations to be stored. Right now you can only clear a conversation and have a new one. With the built-in StableLM 2 Zephyr 1.6B Model (others can be downloaded for free) it misunderstands a lot of requests. I really hope the dev adds conversations and projects (with project knowledge, resources and custom instructions) to the features soon, that would allow me to ditch Claude.ai for good. It would also be great if between the myriad of models available for download a small indication shows what each model excels at. Also please add a donate button.

Works well. Works out of the box. I like that it’s getting updated with llms that will work on your phone. I would recommend to follow the developers recommendation for which LLM to use. Ps phone does warm up and use battery, but that’s expected.

Imagine you at your best. All the time. Picture yourself at your sharpest and most productive. Your most alert and focused. Your most lucid, creative and confident. At work. At play. In every area of your life. Add Mind Lab Pro® v4.0 to your daily routine and uncap your true potential. Buy Now!

Plenty of models. Can’t get rid of the built in one though. Wastes a bit of space if you are using a different model.

Great first step. It is amazing that I can run local models on my phone and ipad, but the app lack some features like multiple chats, personas with different instructions and options and RAG so I can teach my models things. Even if that made the models slower to answer it would be super useful, especially if you can point different personas to specific files. I have no doubts that the future of Ai is local and training your own assistants, this is a great first step hope it gets more complete soon.

Best local LLM client on iOS. Provides a ton of models, quantized with OmniQuant, including abliterated options. App is entirely private, there are decent options for configuration, the devs are active on Discord, and new features are continually being evaluated and worked on.

Good. Does what it says lots of LLMs only request is to have it available on my Apple Watch.

USERS BEWARE THIS APP IS NOT PRIVATE OR SECURE!. This APP wrote a response to me explicitly stating that there are no user controls to turn off data usage for training purposes. There is no clear data privacy within Private LLM.

Awesome!. Please take consideration people with 16 go of ram iPad pro! Get us some bigger model!

Reasonable Expectations. The developer has given easy access to a usable information source, disconnected from the tentacles of big tech. This is to be applauded. But expectations are important here. You can't compare a solo effort with that of an organization with billion-dollar funding. Just contextualize this with pre-ChatGPT tech and you may find this a tool to have (in situations where yes.. you are disconnected from the internet or you don't want big tech operators to hoover your brain for free). Docs on if or how to do do supervised instruction of the model would be welcome or how to tweak this. Read the vendor warnings. These are known industry limitations of this type of offering.

Only gives gibberish answers. While the app technically does allow you to run models locally on your device, I can’t find a single model, including the packaged one, that gives even remotely accurate answers to simple questions. The answers are always gibberish. This is on a 16pro, so if it’s a limitation of my device, I’m not sure which one would do any better. Tweaking the model parameters doesn’t help at all.

Don’t waste your money. Although the software calls itself, an LLM, it’s pretty useless since it hallucinates, and provides a ton of inaccurate information. It has no access to real time information, even when connected to the Internet. it pretends to have capabilities (booking calendar entries), but it can’t do any of it. not sure where somebody would find the suffer useful.

No Multiple Chats. Been asking for that feature for two years, dev team response is always “Soon 🙂” It’s practically useless with a single window chat

Neglected app, developers lie. The developers seem to spend more time responding to negative reviews than they do actually working on the app. It’s been more than a year since they promised more than 1 conversation (very difficult!), conversation history (so complicated!), longer conversations (“just start a new conversation”), etc. The development team also seems really bitter, with the app description saying their app is better because, to paraphrase, “the other guys are a bunch of idiots, but not us, we’re super duper smart!”, and even going out of their way to insult negative reviews (“do you even know what a large language model is, you f—ing noob? Read a book”). Grow up.

Why Phi-3 only 4-bit!!!. This app looks ok, but they are ruining the experience by only allowing very low quants of the model. I got this app just to use Llama 3 at 4-bit quant and Phi-3 mini at 8-bit quant (which an iPad Pro M2 can easily handle). Please add these quants or allow a way to add ours. Happy to update the review if this is done. If you’re worried about the app crashing on older hardware you can add a warning to those models.

Garbage app. No updates , free app got better models. And never getting any right answer , model showing 8b but working worst then 3 b models originally. Developer doing nothing after taking money.

Ai Love. Absolutely one of the best apps for runnibg some models on your phone instead of sending everything to the cloud.👨🏼‍💻That makes it useful for learning, private notes, brainstorming, and practicing Al worktlows.💯

IPHONE 16 and iPad Pro gibberish mode as well. I have the same issue someone else had. Eventually then LLMs start delivering gibberish and I have to restart. Too bad. Good idea, but too many issues.

Such a great update!. The growing list of the downloadable models and the new override prompt are great! Could we get more in app information about each model, maybe something that explains what each model is best at? I was also wondering about adding the ability to make override prompts presets linked to specific models. This would allow a user to make various custom assistants designed for specific tasks.

Good start. While I purchased the app out of curiosity, I am reasonably happy with the app so far. The reason I only gave 3 stars for now is due to its occasional inaccuracy and less-than-stellar performance when compared to other online GPTs out there. I hope that the developer improves the app’s UI and provides an option to view and select downloaded models. Right now, downloading and applying the new language model is pretty unstable.

Basically a scam. I don't usually give 1 star reviews. A simple "hi" will give you a response that tells you it doesn't know what it's talking about. Tell it to be more concise it'll tell you it doesn't know what you're talking about. It will get very simple things just blatantly wrong, and overall will sound like a word salad being vomitted all over your screen. I saw the Reddit advertisement and this seemed promising, but honestly this is borderline insulting to install on my computer.

Basic but it works. Pros: -simple interface -If you are looking to run language models on your own device this does the job -lots of models you can choice from -you can run llama-3 8B on an iPhone with 6GB of ram (wow) Cons: -occasional performance problems which are fixed with a restart -as of now the app is very barebones in features especially for those looking to tinker -very aggressive quants mean a drop in output quality but this is due to hardware restrictions from the limited amount of RAM available on mobile devices -some interesting models are unavailable to download Overall I recommend this app, just don’t expect the same quality, speed or features of an online monthly subscription llm app like ChatGPT. Looking forward to future updates from the developers!

Doesn’t write story’s. I asked it to write me a story numerous times and it wouldn’t even having given it all the information it needed and it gave inaccurate information regarding well known things do not waste your money on this

Awesome, BUT... I left the app for not even 2 minutes and when i came back, my long conversation was cleared and i wasn’t done with the conversation yet. Not having a built in chat history that i can return to is actually really frustrating.

No history. This app doesn’t keep chat history. This is a real shortcoming.

Great app.. Would love to be able to download different models. If not from an in app catalogue, perhaps putting in a url from hugging face? Otherwise pretty neat.

Better and Better. The developer is doing a wonderful job at updating the models the app uses, and it’s really noticeable.

ChatGPT Provides much better answers. I have ChatGPT on my phone. The answers from Personal GPT sound like they're written by a teenager, and the ones I recieve from ChatGPT are very professional and much more informative. ChatGPT was free, so you may understand my frustration when having paid for a service that is far underperforming what I can get out of a free applicaiton on my cellphone.

Can we get more R1 models on iPhone?. I would love to have access to the 1.5b Queen Distill, the 7b one doesn’t work on iPhone 14 pro. Other models works great, I’ll give the shortcut features a try!

Adsterra is the most preferred ad network for those looking for an alternative to AdSense. Adsterra is the ideal choice for new sites with low daily traffic. In order to advertise on the site in Adsterra, like other ad networks, a certain traffic limit, domain age, etc. is required. There are no strict rules. Sign up!

Conversational memory persistence. Need to fix memory and saving conversations it sometimes reset and you lose your conversation and you’re large language model forgets the conversation

This feels like the future. I love love love this app it’s like living in the future with AI models on my device. Everyone should have this!

Ok local LLM app. This app works ok for what it’s intended for but they should allow you to download whichever model you want from Huggingface to run, otherwise you have to wait for them to update app to use new models.

Great app. Overall this is great. Only private LLM manager I could find that runs on iOS (as a plus the macOS version is available through the App Store!). The UI isn’t the most polished, but that isn’t the end of the world.

Helpful but not an end-all problem solver. Gives solid basic advice. Can handle smaller projects and concerns. Not 100% there. Not 100% stable. Can tell some creepy stories that are unsolicited. Definitely needs a safety team.

I asked and it directly stated internet is needed for use.. I asked multiple times in different ways and I received the same block of text as an answer every time. I thought I was getting a completely local ai to use, but this appears to be FALSE. Additionally, after some research, it appears that huggingface, which is used for the available “models” to choose from, is not completely sandboxed.

Hopefully a safe(ish) way to poke around some LLMs. I have used the app on both my laptop, phone, and iPad as a means of keeping my data secure while exploring the potential uses, and practical limitations, of using LLM’s locally.

Please allow LLM choice. Please allow us to pick our LLM the same way we do in text-generation-ui by providing hugging face name. I realize not all models can run on iOS, but I was hoping to mostly use this for CodeLlama.

Don’t waste your 5 bucks.. I saw this application in one of my AI newsletters I receive in my email and thought I’d give it a try. Not impressed. Waste of money. If you have used ANY of the mainstream, up to date, Chat AI platforms, you’ll be disappointed in this application. You get constant repetitive responses, very little memory of conversations and data.

Complete garbage…any other AI platform is better.. This is completely worthless. Literally any free AI platform ChatGPT, Grok, Venice are far better. The role play is terrible and most certainly is not ‘uncensored’. No wonder you have to pay before you try it out…because no one would ever buy it after trying it.

The app is cool but would be great with some other features. It would be great if you could upload photos/documents to chats, also downloading other open source model you like by yourself.

Could be 5-star. This app is superb, in terms of its immediate usefulness. It would be above and beyond if there were a history or separate chat type feature as all of the other apps have.

Poor at deducing intent. Here was my prompt: Request a LinkedIn recommendation from a friend who offered to do one for you. No more than 4 sentences. Tone should be very friendly and familiar and ask them to focus on these 2 things (make them placeholders), if possible. It wrote a recommendation that I would be giving for a friend, basically is not able to deduce or understand the meaning of the prompt. This happened repeatedly with prompts input. Put same prompt into ChatGPT - near perfect response. Tried a few different models including dolphin, LLama - same issues. Not sure if it’s in how to app approaches the LLM or some other factor, but it’s not as good as using ChatGPT or even Ollama on Mac.

Web search please. I really hope that this app can support the network search function, so that I can have a real intelligent assistant.

Still the best offline AI.... Still the best offline AI, most stable and has by far the most current datasets available; this is truly a beast of an app for offline use. I strongly recommend! 👍👍👍

Nice idea, needs more work. First, the app should not crash. I’m picking a model recommended on the company website for my Mac RAM specs, yet the app crashes as soon as I switch to the recommended model. Second, it would be helpful to have the recommendations from the company website on the app. I have no interest wading through gazillion models. Give sensible recommendations inside the app and dash the big list of models in some advanced section.

So far so good!. Okay… THIS APP IS AMAZING. I am using this on my iPhone 12 Pro Max and wow, pretty fast reply. I am still playing around with this app but I am very impressed with it. I wonder if new models from huggingface could be downloaded, if that’s possible.

Disappointing. How can you not support multiple conversations? Who works on one project at a time? It’s an absolute necessity. You need to explicitly note this before people spend money on this app. Also, be aware LlM are curated by the company that produces the app. You cannot side load LLM that aren’t listed. Additionally, there are models listed as supported on your website that are not supported in the app.

Great Support So Far. Love the additional models, this is what I was hoping to see when I paid for an app. It's easy enough to find a free client, so this type of support is just what I hope to see continue!

Works well but needs some improvement. The 7B model constantly crashes on 14 Pro even though the prompt says that the phone can handle it. Downgrading to the 3B seems to work much better.

There should be an option to use 13B model. (feature request). UI is great and all but 7B model is not that powerful for any useful work, adding an option for Mac users to choose a bigger model will be useful.

Good Basic Beta. Needs Document Support. For the basic chat UI many average consumers like it's fine. But the app need to support common advanced use like adding a PDF, .docx, or .txt file and then running queries against it to privately work with the larger context windows newer models support. As of July 2024 trying to do this hard crashes the app.

It’s cool and all.. My only issue is how restrictive it is, I was hoping for an app to experiment with many forms of ai but they are basically the same-ish. Unless I am using it wrong but I doubt that so far You don’t have to parent people especially in a private app they paid for lol unless you do. Who knows.

Has been updated to be better now. Your app is a good option for on device LLM I congratulate you on your successful update please make shortcut not show when run

chat models are missing, low performance for heavy models for some reason.. 70b model is not accurate, something wrong with performance after 4b compressions. Chat models are missing. UI is much worse than chatgpt, chat history would be helpful :)

No history?. I think there should be a history for previous chats. Maybe auto delete at one week.

Love Being able to run a powerfull LLM locally. I cannot believe it is as easy as a few clicks to install an LLM like ChatGPT and it is running entirely on my Mac! No internet required, no monthly fee for a plus version. awesome!

Model and behavior bugs. The DeepSeek R1 models have a large number of issues ranging from mixture of output and reasoning, to infinite rambling, to using random special characters to fully corrupted outputs. This happens even when the model is the only one running.

Good to test the open source models. This app is great to test the models locally on your computer. Like to have a Private Ai that doesn’t leak data to the internet out there. However I do wish to tweak the models and modify them somehow.

Beatiful app.. This app is perfect. I have no problem paying 10 dollars for this app. It does exactly what i need it to do.

Too much good stuff to say. PrivateLLM rocks! First off the devs are cool and responsive but the best part is that it has shortcuts support so the sky’s the limit. Feed whatever data you can into it and it’s all offline and private.

What Took You So Long. This app represents everything I ever wanted with respect to locally operating a LLM on my Ipad and on my Macbook Pro. It is well worth the purchase price. Please add generative AI to your next update.

Good app, design needs work. It’s a very good app but the design needs a lot of work. Would also be good if there was a description for each of the models and what each might be best for.

It is a good app, but it feels restricted.. It's functioning well so far, but it's not an unchained LLM, which somewhat undermines the purpose of having a ‘private’ LLM. It also tends to be overly cautious when answering medical questions.

A good start. This app is fun, but being able to use other models and configure them would make this app 10 times more useful. I’m hoping the dev adds support for model selection (mistral, pls) and setting the role of the AI.

Just how I like it. Go look at ChatGPTs page and see all the data they’re harvesting. No thank you

Different ai models?. I seen that there’s different AI models to choose from in the App Store pictures but when I open the app, the ones in the picture aren’t there. Maybe there could/should be an instruction page on where/how-to download other AI models

Needs a few more QoL stuff. Like export, being able to download bigger models to run on MacOS (I’m fine with longer wait/processing times), Being able to run more than one model simultaneously, etc.

Nice app but model files download slow. Could you add more download mirrors for the model files? The current download speeds are slow, sometimes no speed at all. Thanks a lot!

Frustrating, so many caveats, verbose. Terrible frustrating experience. Very limited information, super basic, did not understand my questions, filled responses with cya legal language over and over instead of being efficient. I gave it feedback on how to respond but kept getting the same canned responses. I’m confused how a general AI assistant could work so poorly. Waste of $4.95!!!

Collects data. I asked about the assurances in the privacy policy. The response to whether personal data is collected, “Yes, personal data may be collected in certain circumstances . . . where it is necessary to protect the interests of another individual.” It does collect your data (but may not retain it — but who knows). If it wasn’t collecting your personal identifying data, it couldn’t report you to the “authorities”.

Wonderful app. This is a really great way to run local LLMs. The devs update it often. Just make sure you read the system requirements before you buy.

Diverse options. I dislike the fact we can’t just download whatever model we want and experiment on IOS. You have to download apps like this to get a wide selection of LLMs. I don’t like that this is a paid for app to access what is essentially free AI models; but the selection is diverse and the app works.

Frequently crashes. Since the latest update the app seems to crash during every generation, regardless of the model being used.

Love it. I really liked the app, i just wished there was an option to upload files too :(

Almost 5 Stars. It would be 5 stars but it crashes upon giving every to every other response. Other than that it’s great. Fixing the crashes would be my suggestion.

Not worth $10. This app lacks polish and you can get similar functionality for free from other apps. The Shortcuts feature launches the app and does not query in the background. Waste of money, I will be seeking a refund from Apple. Also, the developer seems a little touchy and immature in their replies to these reviews.

Great app! More features pls! :). This app is awesome for offline use! I would like to be able to download other models from hugging face though. Please make this a feature!

Good app. Very cool app for those with limited internet connectivity. You can download different models for what fits your needs. Be warned: Each one does take up quite a bit of space.

Literally a Open Assistant knockoff. I’m not against a developer using open source work, but this is a very thin wrapper around someone else’s work with credit given. It’s just sad. I found out this was open assistant after letting the app chat with itself till it mentioned its name was open assistant. Ask it that question in the beginning and it will tell you it’s personal GPT.