Iphone 12 pro, ipad and iphone 15 or some other device this llama.rn pakage has issue. Even the device has latest os and enough gpu to run the model.

[PratikBhatti83]

When using the llama.rn package, the initLlama function fails to initialize, throwing a "Failed to load model" error.

[PratikBhatti83]

@jhen0409 @a-ghorbani is there any solution for this? could you please help me to solve this problem

[jhen0409]

I can't figure the cause based on the error message. Could you provide more information, like Xcode logs or what models are you using?

[PratikBhatti83]

@jhen0409 i used Llama-3.2-1B-Instruct-Q4_K_M.gguf this model!

Xcode log is like below error only

Context initialization failed: Error: Failed to load model.

Meanwhile on other device like Iphone 13, Iphone 14 Pro I can able to run this model. but some of the device it's failed to load model while intiazation. i think you should update lllama.cpp version or sync the latest code because I checked llama.cpp doesn't have this type of initialization issue.