It’s not the average consumer spending thousands on tokens. Even my work just had a meeting about how “the free lunch is over” now that AI costs are expanding, and they bought their own hardware to investigate hosting local models.
Linux is widely used in the enterprise world. It’s the home consumer world that doesn’t use it as much and even that is rapidly changing as things enshitify.
they bought their own hardware to investigate hosting local models.
That’s going to be incredibly hard to make economical I bet, unless you have the ability to basically max out the utilization of the hardware around the clock.
It’s not the average consumer spending thousands on tokens. Even my work just had a meeting about how “the free lunch is over” now that AI costs are expanding, and they bought their own hardware to investigate hosting local models.
Linux is widely used in the enterprise world. It’s the home consumer world that doesn’t use it as much and even that is rapidly changing as things enshitify.
That’s going to be incredibly hard to make economical I bet, unless you have the ability to basically max out the utilization of the hardware around the clock.