Discussion about this post

User's avatar
Alex Tolley's avatar

For all the breathless hype, I don't see MAMLMs being able to make scientific or technological discoveries with outside-the-box approaches.

Take AlphaFold, a brilliant execution of such an MAMLM to predict the tertiary structure of a protein from its amino acid sequence. But that is all it can do. It is a protein folding tool. It cannot even conceive of how to fold RNA from the 4 bases, UACG. It cannot inform you where the protein domains are and if there is importance in where they are related. Each of these questions requires a human to do, or expensive new models to be trained to answer these questions.

Take mathematics. The big AI companies benchmark their MAMLMs against various math questions. Granted, these are hard, and a MAMLM may correctly solve a problem using existing math techniques. But they cannot invent new mathematical techniques, just apply existing ones. Certainly, MAMLMs may be able to solve (or help to solve) outstanding conjectures using existing techniques, but just as likely, they will not. Human mathematicians will be needed, perhaps to invent new math to solve the problem.

So I can see MAMLMs doing grunt work, much as we use power tools instead of hand tools, for construction.

Given the incentives, if they are that powerful, there should be MAMLMs already making bucketloads of money fairly accurately predicting securities prices. They may be doing so now, but are hidden from view. But if they are, they are going to be obvious when they try to use that money rather than putting it in a warehouse, and exchanges are going to note these fabulous winners. Do any such exist?

Like powertools, these MAMLMs will be very useful, as long as we control them, block their fabrications and BS, and generally make sure they do the task they are asked to do. Of course, there is also the danger that their human masters won't know when they lie or fabricate responses, and we are forced to trust them. But until MAMLMs achieve human-level creativity, I don't see them magically able to solve problems that are conceptually out of our grasp.

As for solving climate change. My guess is that an MAMLM will simply say, "The solutions are well-known, you just have to act on them. There are no new magical technological solutions that are needed. The list of needed actions is..."

David E Lewis's avatar

Might be worth a read.

Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity

https://metr.org/Early_2025_AI_Experienced_OS_Devs_Study.pdf

4 more comments...

No posts

Ready for more?