Not every software company is a game developer, and even at home, not every programmer plays games on their PC that require a powerful GPU. If everyone working on, for example, business software all of a sudden needs a gaming PC that will be constantly running an AI model, that will greatly increase costs, both in terms of procurement of equipment and electricity. An increase in demand for powerful GPUs in fields that traditionally had no need for them isn’t exactly going to improve the hardware cost situation either.
Whether you run the model locally or you leave it to a company, someone is going to have to pay the cost.
Not every software company is a game developer, and even at home, not every programmer plays games on their PC that require a powerful GPU. If everyone working on, for example, business software all of a sudden needs a gaming PC that will be constantly running an AI model, that will greatly increase costs, both in terms of procurement of equipment and electricity. An increase in demand for powerful GPUs in fields that traditionally had no need for them isn’t exactly going to improve the hardware cost situation either.
Whether you run the model locally or you leave it to a company, someone is going to have to pay the cost.