What is the Cost of Maintaining the Correctness of a GenAI Service? (268)

This week’s podcast is about estimating the costs of providing GenAI products and services. And this is changing. You can listen to this podcast here, which has the slides and graphics mentioned. Also available at iTunes and Google Podcasts. Here is the link to the TechMoat Consulting. Here is the link to our Tech Tours. My approach to assessing GenAI operating costs is the below checklist. What is the cost of compute, including energy and cooling? Initial cost vs. ongoing?The core compute is...