Mastodon Feed
jsonstein@masto.deoan.org ("Jeff Sonstein") wrote:
from thebatch@deeplearning.ai email newsletter:
“Cathie Wood, author of ARK Invest’s “Big Ideas 2024” report, estimated that training costs are falling at a very rapid 75 percent annually, around half due to algorithmic improvements and half due to compute hardware improvements. Nvidia’s progress paints an optimistic picture of further gains. It also signals the difficulty of trying to use model training to build a moat around a business.”