I made a short demo that explains a bit more about the current status and direction. My next goal is to release a beta version so that others can try it out and provide feedback.
@genekim I made a short demo here. More info to come!
@smith.adriane Probably a topic worth talking / demo-ing at a Clojure conference, if. you ask me...
Perhaps next year at the conj or so
This is so cool! Thank you for making it ā Is there an easy way to figure out what the externally exposed commands are for iOS apps? Iām now curious what the YouTube app would allow ā Iād love to get my own viewing history, access my watch lists, etc. Keep up the amazing work! This is so cool to see!
The demo is about building an app rather than controlling an app. As far as I can tell, the ability to control or communicate with other apps on the phone is mostly useless outside of a few specific uses cases. There is a youtube API, but it seems like they removed this info years ago, https://stackoverflow.com/questions/63213016/how-can-i-get-my-watch-history-with-youtube-data-api-v3. One alternative that might be interesting would be to use a tool like https://github.com/yt-dlp/yt-dlp and then you can customize your experience and use your own data however you want.
Another approach is if you're saving screenshots to your phone, you could write a script that runs on your phone and: ⢠looks through your photos ⢠identifies which are youtube screenshots ⢠automatically extracts the timestamp (somehow?) ⢠store, export, display, and/or send the data somewhere useful Obviously, there's a few missing details, but it at least seems plausible. The script would also have access to any APIs you would typically be able to access like openai.