Discussion about this post

User's avatar
david rasiel's avatar

With respect to consumers, I think that Dan will eventually be proven entirely right. With respect to business usage, though, the game is rather different. It’s a rare earnings call these days that doesn’t feature extensive discussion of all the wonderful productivity improvements that are soon to arrive or, in some cases, already have. Some — most? — of this is just corporate pablum, but not all of it. Moreover, there’s bound to be some cost to switching vendors, so it’s not inconceivable that decent profits will be made. Enough to justify current valuations?? Almost certainly not.

Will O'Neil's avatar

I am a worn-out applied mathematician who has grown ancient and addled following the course of "artificial intelligence" literally since the day the term was coined, seven decades ago. Indeed, I became interested in machine learning even before 1956.

Now I make a certain use of LLMs and have no doubt that they make a small contribution toward improving my productivity in some research tasks. But the unstated and very limiting assumption that almost everyone makes is that the "language" involved in "language model" is the common tongue, or perhaps a somewhat specialized variant such as mathematical language or a programming language. Creatures of language that we no doubt are, I nevertheless see it as evident that our production in the economic sense is mediated by language in such sense only to a limited extent; an extent no doubt greater than anciently it was, but yet limited. It would appear to follow that the scope for improving economic productivity through application of LLMs is indeed circumscribed.

LLMs are surely not the only field of application for the current iteration of machine learning (ML) technology. Autonomous self-driving vehicles and self-guiding UAVs represent another field currently in the public eye, of course. Still another is the enabling or improving of a wide variety of industrial processes, as exemplified by https://pubs.acs.org/doi/10.1021/jacs.6c03234 . (Picked at random from the morning's email.)

Yet from what I can tell, the current hyperscaling investment frenzy is directed almost exclusively toward improvement of LLM capabilities, which, as Prof. DeLong trenchantly argues, offers somewhat dim prospects for return. Why is it, I wonder, that the AI industry chooses to focus its investment in this direction, rather in search for fields of application having greater potential?

All of which brings me back to "O'Neil's law of AI," originally formulated about 60 years ago: Those who are most obsessed with *artificial* intelligence seem often rather deficient in *natural* critical intelligence.

9 more comments...

No posts

Ready for more?