Coding with LLMs (Claude Code, OpenAI Codex) is often presented as the ‘killer app’ for Generative AI. But looking at data, it seems the one piece of the puzzle missing is actual cost. …
I don’t think anyone is assuming it will stay at its current efficiency and there will be zero improvements. A lot of the everyday AI use cases will likely be pushed to someone’s personal device aka your phone. In the same way a lot of Uber and Spotify is handled by your personal device today. What we’ve seen for years now is the development of these gargantuan models that are then condensed down into much smaller models with 90%+ of the same effectiveness. Simultaneously we will see and are seeing devices sold with better NPU’s for edge compute for AI the same we’ve seen the push for more edge compute to manage other services such as Uber and Spotify.
Across this thread and others there’s like this implicit assumption AI will never progress beyond where it is right now in spite of the evidence of its almost exponential growth. It’s really interesting.
I don’t think anyone is assuming it will stay at its current efficiency and there will be zero improvements. A lot of the everyday AI use cases will likely be pushed to someone’s personal device aka your phone. In the same way a lot of Uber and Spotify is handled by your personal device today. What we’ve seen for years now is the development of these gargantuan models that are then condensed down into much smaller models with 90%+ of the same effectiveness. Simultaneously we will see and are seeing devices sold with better NPU’s for edge compute for AI the same we’ve seen the push for more edge compute to manage other services such as Uber and Spotify.
Across this thread and others there’s like this implicit assumption AI will never progress beyond where it is right now in spite of the evidence of its almost exponential growth. It’s really interesting.