Is there some reason LLMs haven't seen broader use?

Indeed it works great for babble. OpenAI suggests the prompt of "Write a tagline for an ice cream shop" as an example. Using it I was able to generate the following three examples:

• The best ice cream in town!
• A scoop of happiness.
• Delicious ice cream for all!

I would have assumed that you could do pruning just by prompting it to generate an evaluation and a rating. Evaluating the above taglines using the prompt "Explain the advantages and disadvantages of the following tagline for an ice cream shop, and then rate the tagline on a scale from 1 to 10.", I get:

The best ice cream in town!:

• The advantages of the tagline are that it is short, sweet, and to the point. It tells customers exactly what they can expect from the ice cream shop. The disadvantages are that it is somewhat generic and does not really stand out from other ice cream shops. Overall, I would rate the tagline a 7 out of 10.
• The advantage of the tagline is that it is succinct and to the point. The disadvantage is that it is vague and does not give any specific information about the ice cream shop. I would rate the tagline a 6.
• The tagline is straightforward and to the point. It tells customers what they can expect from the ice cream shop. However, it is a bit generic and could apply to any ice cream shop. Rating: 7

A scoop of happiness.:

• The advantage of the tagline is that it is short, simple, and to the point. It tells customers exactly what they can expect from the ice cream shop – happiness. The disadvantage of the tagline is that it is a bit cliché and might not stand out from the competition. Overall, I would rate the tagline a 7.
• The advantage of the tagline is that it is short and catchy. The disadvantage is that it is somewhat corny. I would rate the tagline a 6.
• The tagline is short, catchy, and easy to remember. It conveys a positive message about the product. However, it is somewhat generic and could be used for any type of business. 7/10

Delicious ice cream for all!:

• The tagline is simple and straightforward, and it tells customers what they can expect from the shop. However, it is somewhat generic and does not really stand out from the crowd. I would rate it a 6.
• The tagline is simple and straightforward, which is good. However, it is also somewhat generic and does not really convey anything unique about the shop. It is not a bad tagline, but it is not particularly great either. I would give it a 6 out of 10.
• The tagline is straightforward and to the point. It tells customers that the shop sells delicious ice cream and that everyone is welcome. However, it is somewhat generic and doesn't really stand out from other ice cream shops. It also doesn't say anything about the quality of the ingredients or the variety of flavors available. Overall, I would rate this tagline a 6 out of 10.

 😅I suppose this doesn't tell us much. The evaluations are all very repetitive, but they seem to correctly apply to the generated ideas, it's just that the original ideas are not very distinct.

To try and generate more distinct ideas, I asked GPT-3 to come up with some themes for ice cream shops. It gave the following themes:

• The ice cream shop would have a tropical theme! You could have all sorts of fruity and exotic flavors, and the decor could be bright and colorful.
• The ice cream shop could be called "Frosty's" and would have a winter theme. The walls would be painted blue and white, and the floors would be covered in fake snow. The ceiling would be covered in twinkling lights, and the ice cream would be served in bowls made to look like snowballs.
• The shop would be decorated like an old-fashioned ice cream parlor, with checkered tablecloths, vintage ice cream posters, and a staff dressed in traditional ice cream server uniforms. The menu would feature classic ice cream flavors like vanilla, chocolate, and strawberry, as well as more unique flavors like lavender, Earl Grey, and fig.

This yielded:

• Tropical: The advantages of a tropical-themed ice cream shop would be the wide variety of flavors to choose from, as well as the bright and colorful decor. The disadvantages could include the potential for the shop to be too noisy or crowded, and the lack of variety in terms of toppings and mix-ins. Overall, I would rate this theme a 7.
• The advantages of the theme are that it would be unique and eye-catching. It would also be appropriate for the winter season. The disadvantages are that it could be difficult to keep the floors clean, and the ceiling lights could be a fire hazard. I would rate the theme an 8 out of 10.
• The advantages of this theme are that it would be unique and would likely attract customers who are looking for a more traditional ice cream experience. The disadvantages are that it would be more expensive to set up and maintain, and the menu would be limited to classic and unique flavors, which may not be what some customers are looking for. Overall, I would rate this theme a 7.

This critique doesn't seem great. For instance, ice cream is disproportionately eaten in the summer, yet it praises "Frosty's" for being "appropriate for the winter season". Possibly my prompt is bad though.

But at a first look, it seems like you might be right? Idk.