text feature visualization

[betterze]

Dear OpenAI team,

Thank you for sharing this great implementation, I really kile it.

In the section 'Understanding Language', you mention about:

If we fix a neuron on the vision side, we can search for the text that maximizes the logit. We do this with a hill climbing algorithm to find what amounts to the text maximally corresponding to that neuron.

Would you mind specify how you do this? You use a dataset of sentences, or optimize the senences using pretrained language model? The vision model only connects to language model in the output part, how you get the gradient to do optimization? How you do text feature visualization?

Thank you for your help.

Best Wishes,

Alex