Notes on how Karui works and what I learned from creating it.
- KN001: Foundation Models in the Background
The rate limiting Karui meets when it runs Apple’s on-device model from a Shortcuts automation in the background, and how it copes, including asking Private Cloud Compute instead.