Nice article! I work in edge AI and I've been writing about this topic for a while. One of the most interesting things to me is how edge compute will break the subscription-based model and result in a rush for cheaper devices:
> The most immediate impact of on-device intelligence is a reduction in recurring costs. Imagine trading cloud infrastructure for a more capable local device. While faster processors are more expensive per unit, they are still far cheaper than the expense of hosting—and staffing—the gigantic infrastructure required to make a cloud application work.
> To sell a system that depends on the cloud, device manufacturers are forced into the subscription business model. All that hosting costs money, which is impossible to recoup from device sales alone. This is why so many modern gadgets come with a significant monthly fee. While subscription revenue can be useful for companies, it reduces the accessibility of products and limits their overall market.
Wow. Incredible work here. This is the exact type of thought that is needed right now.
I think there is a pretty large disconnect between the capabilities, and the cost of those capabilities for the average person. Very curious to see how it plays out.
Love the thinking. Lots of useful stuff in here. Even in a small startup, using the latest models for consumer services, the lag time to process in the cloud and deliver an answer to the user is too slow. Computing on the device, with high quality, localized, personal AI models, can't happen soon enough. Lastly, quantum physics will play a significant role in this evolution. Qubits are a key foundational element that makes it possible.
Nice article! I work in edge AI and I've been writing about this topic for a while. One of the most interesting things to me is how edge compute will break the subscription-based model and result in a rush for cheaper devices:
> The most immediate impact of on-device intelligence is a reduction in recurring costs. Imagine trading cloud infrastructure for a more capable local device. While faster processors are more expensive per unit, they are still far cheaper than the expense of hosting—and staffing—the gigantic infrastructure required to make a cloud application work.
> To sell a system that depends on the cloud, device manufacturers are forced into the subscription business model. All that hosting costs money, which is impossible to recoup from device sales alone. This is why so many modern gadgets come with a significant monthly fee. While subscription revenue can be useful for companies, it reduces the accessibility of products and limits their overall market.
Taken from my article here: https://dansitu.substack.com/p/disconnectivity
Wow. Incredible work here. This is the exact type of thought that is needed right now.
I think there is a pretty large disconnect between the capabilities, and the cost of those capabilities for the average person. Very curious to see how it plays out.
Really great post!
Love the thinking. Lots of useful stuff in here. Even in a small startup, using the latest models for consumer services, the lag time to process in the cloud and deliver an answer to the user is too slow. Computing on the device, with high quality, localized, personal AI models, can't happen soon enough. Lastly, quantum physics will play a significant role in this evolution. Qubits are a key foundational element that makes it possible.
Where do you see the role of confidential compute fitting as we go head deeper into this cycle of bringing more powerful compute closer to the edge?