Great post thanks for sharing! So you believe building applications on Open AI's models would be setting yourself up to be disrupted when they decide to compete or remove you from their API? It seems you are suggesting that startups should only be building on open source models. I also think beyond GTM and network effects that the quality of the application and outputs generated should determine who succeeds in each space. I am interested in learning about your idea for an AI-enhanced social network.
Last night I sat home talking to my virtual dead parents saying thing we didn’t have time for Then my virtual friend and therapist helped me feel so much better
I re watched some old movies and changed the ending to match my mood and made a new pair of Jeans on my 3D printer Fell asleep playing road warrior after adding more horsepower so I can alway win
Wow! I'm stunned and grateful for what you are doing. I'm not very tech advanced so I'm struggling to grasp the acronyms and follow but I'm getting the potential of all this is greater than I can yet envisions. Two questions:
1. Has someone developed a public education AI that will use logic, persuasion, humor and entertainment, etc to educate, convince, inspire and motivate people to work for the common good like solving global warming, environmental and social justice, inventing cures for diseases, developing more improvements to clean energy, and how to talk with people of differing views to work for the common good and reducing fear of immigrants or others who are different?
2. Is anyone working with AI to develop protective tools to reduce risks for children and adults of things like AI being used to foster bigotry or to enhance human trafficking, or many other harmful endeavors?
Dec 4, 2022·edited Dec 4, 2022Liked by Tomas Pueyo
Extensive analysis ! Being fascinated by the topic since GPT2 time (try http://homer.paolim.fr/) there is one parameter which I think might be interesting to consider, e.g computational cost. You can run stable diffusion on pretty standard material. No way you can do the same with GPT3 sized model. So the cost of the API which doesn’t make it so useful to scale an app. And smaller model just don’t deliver the wow experience. Lots of people are working on making the smaller models better but for now the breakthrough didn’t happen and it’s not clear if it will. Without this there will be a clear divide between image generation - which is solved - and text generation which, in practical terms, isn’t. But let’s see ;)
This is on par with when you wrote Flatten the Curve. Catching a monster trend and being able to explain it in simple ways, right when its about to begin the steep R0 ahead. Well done!
Well, for the research assistant part at least am afraid AI still has some way to go. At least in the fields I know of, results from Elicit would sound very smart to a non-expert - but content is off topic, out of date, or actually wrong.
So at least in my field, the best it can do for now is sounding smart, while not understanding f*k all.
That being said, that will take you a long way in many fields.
Or perhaps the value added of AI is that it will make smart-sounding bullshit cheap - taking away livelihood from BS artists of the world, now, AI is cruel indeed...
Great blog! Have a look at the Futures 2030 - Powered by ACI report I just released www.supermind.design/resources ...for the intersection of generative AI with collective intelligence
This is great! Generative AI seems disposed to probabilistic expansion of text and/or image inputs and I loved reading your examples. It seems the problem with probabilistic expansion is there is no filter for truth or relevance in its output.
Companies like similarinc.com use proprietary anonymised collaborative data (wisdom of the crowd) on top of text and image embeddings to help with correct and relevant information retrieval.
Where LLMs can crawl the public web, cross domain collaborative knowledge graphs are scant.
The semantic web has long focused on machine readability, much to its own setbacks, collaborative data and implicit signals have the potential to create a more autonomous and intuitive web experience. i.e.~ evolving past search engines, which require explicit input and relevance proxies such as backlinks.
Your last two articles have been revelatory, to say the least. Thank you very much for the paradigm shifting info.
Great post thanks for sharing! So you believe building applications on Open AI's models would be setting yourself up to be disrupted when they decide to compete or remove you from their API? It seems you are suggesting that startups should only be building on open source models. I also think beyond GTM and network effects that the quality of the application and outputs generated should determine who succeeds in each space. I am interested in learning about your idea for an AI-enhanced social network.
Last night I sat home talking to my virtual dead parents saying thing we didn’t have time for Then my virtual friend and therapist helped me feel so much better
I re watched some old movies and changed the ending to match my mood and made a new pair of Jeans on my 3D printer Fell asleep playing road warrior after adding more horsepower so I can alway win
Wow! I'm stunned and grateful for what you are doing. I'm not very tech advanced so I'm struggling to grasp the acronyms and follow but I'm getting the potential of all this is greater than I can yet envisions. Two questions:
1. Has someone developed a public education AI that will use logic, persuasion, humor and entertainment, etc to educate, convince, inspire and motivate people to work for the common good like solving global warming, environmental and social justice, inventing cures for diseases, developing more improvements to clean energy, and how to talk with people of differing views to work for the common good and reducing fear of immigrants or others who are different?
2. Is anyone working with AI to develop protective tools to reduce risks for children and adults of things like AI being used to foster bigotry or to enhance human trafficking, or many other harmful endeavors?
Extensive analysis ! Being fascinated by the topic since GPT2 time (try http://homer.paolim.fr/) there is one parameter which I think might be interesting to consider, e.g computational cost. You can run stable diffusion on pretty standard material. No way you can do the same with GPT3 sized model. So the cost of the API which doesn’t make it so useful to scale an app. And smaller model just don’t deliver the wow experience. Lots of people are working on making the smaller models better but for now the breakthrough didn’t happen and it’s not clear if it will. Without this there will be a clear divide between image generation - which is solved - and text generation which, in practical terms, isn’t. But let’s see ;)
This is on par with when you wrote Flatten the Curve. Catching a monster trend and being able to explain it in simple ways, right when its about to begin the steep R0 ahead. Well done!
Well, for me, it's probably the thrill of those electrons whizzing around inside my head.
Well, for the research assistant part at least am afraid AI still has some way to go. At least in the fields I know of, results from Elicit would sound very smart to a non-expert - but content is off topic, out of date, or actually wrong.
So at least in my field, the best it can do for now is sounding smart, while not understanding f*k all.
That being said, that will take you a long way in many fields.
Or perhaps the value added of AI is that it will make smart-sounding bullshit cheap - taking away livelihood from BS artists of the world, now, AI is cruel indeed...
More mind-blowing, thought-provoking and scary stuff...
If the medium is the message
How has a 200 character limit effected us
How will having everything you want made at home by 3D printer change our attitudes and values
Or virtual buddies that always agree and support us
Does AI produce innovation or just more combinations of the old ideas in different juxtapositions
Great blog! Have a look at the Futures 2030 - Powered by ACI report I just released www.supermind.design/resources ...for the intersection of generative AI with collective intelligence
This is great! Generative AI seems disposed to probabilistic expansion of text and/or image inputs and I loved reading your examples. It seems the problem with probabilistic expansion is there is no filter for truth or relevance in its output.
Companies like similarinc.com use proprietary anonymised collaborative data (wisdom of the crowd) on top of text and image embeddings to help with correct and relevant information retrieval.
Where LLMs can crawl the public web, cross domain collaborative knowledge graphs are scant.
The semantic web has long focused on machine readability, much to its own setbacks, collaborative data and implicit signals have the potential to create a more autonomous and intuitive web experience. i.e.~ evolving past search engines, which require explicit input and relevance proxies such as backlinks.
Scary. The idea that someone can have a hoard of AI companions that will listen to anything they say without judging them.