I gave GPT-3 access to Chrome with the objective "please buy me Airpods". Pretty interesting if you ask me 🤔

Jun 17, 2021 · 9:49 AM UTC

58
176
64
1,402
0
It successfully made it to the product page, but got sidetracked with Walmart's privacy policy.
8
2
139
Since even a simplified DOM is far too large for a single prompt, multiple prompts are given different chunks of the DOM, each generating their own "interaction". Another prompt then takes all the proposed interactions and selects the best one, sort of like a tournament bracket.
4
2
1
104
For more complex web pages, the time it takes to generate an action scales at O log(n) with the size of the DOM – really fast! It also gets around token limits, so you could technically process an infinitely large DOM!
3
1
85
Replying to @sharifshameem
This is amazing actually! Super curious about the implementation 🤔
1
5
Sharif Shameem
 @sharifshameem
17 Jun 2021
Replying to @wichmaennchen
Each prompt contains a simplified version of the DOM, the objective, and possible actions (like click on an element).
8
Replying to @sharifshameem
Are you using their semantic search endpoint? I.e. searching over DOM elements to find the best matching one?
1
3
No, just the normal endpoint
1
3
more replies
Replying to @sharifshameem
This was without finetuning?
1
7
No fine tuning, just few shot prompting
24
Replying to @sharifshameem
@domthewop
1
Load more