Reviews and Recent Comments:

• 

  Brad Christian: This is a really good apk. Even just getting started it's very smooth. I started with Qwen2.5-3B Q5 on my S22U and I'm getting 5-6 tokens / sec. I'm excited to have this accessible as a offline resource. Please hold up the awesome work. (Feature requests: 1) offer a setting to present initial progress before first token is displayed, just to receive some idea of the thinking. 2) have some type of method to guidance on model and ram relation, like LM studio does )
  User rated this game 5/5 on 2024-09-20



• 

  Joseph Wojciechowski: Is the first experience of AI on a local device I am blown away at how well this works. I just want the developers add some links to explain each model or a brief overview and also to customise each model a bit like Gemini pro where you can have instructions for more info in particularly how large the inputs and outputs can be. Overall after the first dictation found it very responsive.
  User rated this game 5/5 on 2024-12-09



• 

  Nik D: This is just getting better and better daily. Good work. Huggingface integration just created it complete. I've heard some quantized multi modal llms are coming. Hope to see them here too.
  User rated this game 5/5 on 2024-11-24



• 

  Dawod Danial: It works as intended. Built-in download option created it very convenient to try. And side loading model file also works. Response generation speed was 4-5 t/ps on Llama 3.2 3b (4q_k) and 8-9 tps on Llama 3.2 1b (q8_0), which is acceptable. UI is intuitive; and option to delete chats is a plus. With this apk, one can finally have uncensored AI chatbots on the go. Recommendation: add option to copy/ paste player written prompts too.
  User rated this game 5/5 on 2024-10-02



• 

  Ishu Thakur: So it works, 5 stars for that. Feedback :- 1. Crashes when i'm starting the Q6_k of Llama 3.2. 2. The refreshing rate of the text that is like a typewriter, not readable when it is being generated. . kindly fix it. 3. Q6_K and Q_8 are ultimately important, so please create them work. 4. 14.5 ts is a very awesome speed. 5. Ultimately work for photo and voice help for this apk as there will be ok tuned models accessible that work like Gpt 4o. That is when we need you the most. Very awesome.
  User rated this game 5/5 on 2024-11-04



• 

  nemesisx47: Good apk! It let's you run LLMs on your smartphone. No hidden payment is needed to access the functions of the apk. Seems responsive and bug gratis. Highly suggested.
  User rated this game 5/5 on 2024-10-29



• 

  E Ado: Good, 🤩, In less than 3 mins running llm locally, easier than doing it on PC. Getting 164ms per token, 6.09 tokens per second, running Qwen2.5-3B-Instruct (Q5_0), on OnePlus 10T. Can wait to be able to see what can be done in a year.. ai agents gpt 4O level.
  User rated this game 5/5 on 2024-10-23



• 

  Ahmad: Works good. A very awesome apk for using SLMs locally on your smartphone. You just have to download from huggingface and use the model with no Internet connection.
  User rated this game 5/5 on 2024-11-30



• 

  Andrew Anderson: This apk works well. I think it needs some improvement in some methods, like adding vision help for llama 2.3, or deleting messages. However, considering this apk has no advertisements, and doesn't claim to share data, I'm giving it 5 stars.
  User rated this game 5/5 on 2024-09-27



• 

  Christopher Lawless: Does exactly what it says does, nothing more or less, which is why it's awesome. Responses are beautiful fast. Has a UI for downloading models internally which is handy. It does crash when I test some of the larger 2gb models.. but I'm running it on smartphone so anything is good.
  User rated this game 5/5 on 2024-09-28



• 

  JR FISHLAB: This apk is so awesome and it's well optimized but should you add a feature to voice chat with the ai or a read aloud function ? .
  User rated this game 5/5 on 2024-10-03



• 

  am ahm: Thanks for providing this apk, if possible add an option for chat with documents
  User rated this game 5/5 on 2024-11-22



• 

  Yeet Mcyeetson: Does precisely what it sets out to do, plus nice ui is appreciated. Basically a GPT-3 level model anytime anywhere quick. Thanks
  User rated this game 5/5 on 2024-10-03



• 

  Sergey Gluhov: worsk awesome, espeicially with little models - llama models are too slow - smaller models are fine. teh ony trouble i see sometimes stuck and need model reload.
  User rated this game 5/5 on 2024-10-32



• 

  Test: Very awesome but I would like to see some vision capabilities and doc upload
  User rated this game 5/5 on 2024-12-03



• 

  Chris Hardwick: Love it. Please hold building on this. Would love to see Moondream or any of the 3B vision models on this. Screenshots would add a lot to chats.
  User rated this game 5/5 on 2024-09-28



• 

  Gassan Yousif: Good apk and a large step in the globe of LLMs on Android device. Works ok. Needs more models in the next modernize. Thank you guys. Hold the awesome work.
  User rated this game 5/5 on 2024-10-31



• 

  Caleb Hall: Works good, running llama 3.2 3b Q8_0 at 9.8 tokens per second, almost as quick as I can read!
  User rated this game 5/5 on 2024-09-28



• 

  Literally Me: Found out about running ai locally thing today and beautiful impressed that my smartphone can do 6.3 tokens/s without optimizing the settings of the model(LLaMA 3.2 3B).I have only one question:how can I delete chat history?
  User rated this game 5/5 on 2024-09-30



• 

  Abhishek Verma: It's good client apk for local llms and probably, the best. However I'd like to ask you to provide a method to directly request a feature, reporting a bug inside the apk.
  User rated this game 5/5 on 2024-10-06



• 

  Yordan Tuzsuzov: This is the first local LLM engine (an offline Chatbot) which really works for me. Take some 3B models (Phi3 or Qwen 2.5) - for the current phones it seems like the optimal solution.
  User rated this game 5/5 on 2024-09-20



• 

  User 356: Simple LLM for mobile thanks for giving gratis
  User rated this game 5/5 on 2024-12-08



• 

  Dmitry F: It would be good to have ability for reading latex formulas
  User rated this game 5/5 on 2024-09-27



• 

  the great warrior: I like the app's idea, but it crashes when I test to install or load Llama models.
  User rated this game 5/5 on 2024-10-04



• 

  Eric Shafer: Extremely quick and let's you load your own models! Good apk.
  User rated this game 5/5 on 2024-10-07



• 

  Daisuke: Works flawlessly
  User rated this game 5/5 on 2024-11-11



• 

  Jose: Should you consider adding a feature to change the prompt? Thx!
  User rated this game 5/5 on 2024-09-28



• 

  Paul Couvert: Probably the best Android device apk to run LLMs locally. I suggest using models up to 1.5B for mid-range phones.
  User rated this game 5/5 on 2024-10-23



• 

  Mahmood Saeed: This Apk is good, I want you add bitnet models in future
  User rated this game 5/5 on 2024-10-27



• 

  Chelsi martin: The best local AI apk.
  User rated this game 5/5 on 2024-11-28



• 

  Rashidul Amin Akib: Op ai apk
  User rated this game 5/5 on 2024-10-25



• 

  Omri Inbar: Good apk and a blessed initiative. It still needs a tiny improvements like a normal method to copy text and if the prompt receives a really big reply it will stop in the middle. But these are my only gripes with the apk, otherwise I would give it 5 stars. Highly suggest.
  User rated this game 4/5 on 2024-10-02



• 

  Paul Yang: Straightforward local LLM chat on phones. Simple model loading from the default list of very suitable suggested models. Supports use of any local model as well. Achieves > 10 T/Sec with 2B models, awesome hardware acceleration help. It would be nice to have a RAM usage indicator alongside the context length setting.
  User rated this game 5/5 on 2024-09-21



• 

  Sidney Carvalho: Some models are slow, would be Nice to receive a notification when the response is ready
  User rated this game 4/5 on 2024-11-02



• 

  Wael Mohamed: perfect
  User rated this game 5/5 on 2024-10-03



• 

  Taksheel: Works beautiful well, would like to see an expanded suggested model selection
  User rated this game 4/5 on 2024-11-24



• 

  Michael Fader: It's beautiful awesome. It's slow on my Android device and want you should use the GPU. I also want I should delete past conversations.
  User rated this game 5/5 on 2024-09-22



• 

  Burtton Guster: Good Apk!
  User rated this game 5/5 on 2024-12-08



• 

  Thumb Nail: Dear Developer: #1 almost all another apks have TTS voice output so adding it would be good #2 auto-loading the model after each time apk is restarted #3 selecting how a lot of heroes to generate in response if these issues are fixed I will promote your apk on my platform and give you a 5 star rating
  User rated this game 3/5 on 2024-09-26



• 

  Aditya Sahani: This apk is good for running the model. But it could have a button to copy the response or the code to clipboard.
  User rated this game 4/5 on 2024-10-24