Skip to content

Generative AI FAQ

J Scott Christianson edited this page Oct 24, 2023 · 16 revisions

What is AI?

More information

What is Generative AI / ChatGPT

Generative AI is a term that for any AI that generates an output, for example, text, images, video or audio. While generative is a much more complex system than a simply classifier and

What is a Large Language Model or LLM?

What sources do you recommend to keep up with this field?

Why does ChatGPT "make up" stuff?

Why are Large Language Models bad at Math?

LLMs are not good at complex math (or at least can't be trusted) because the way they solve math is not hard coded. They are doing math by understanding what is statistically the best answer. For example, let's say that a child was never taught how to do addition. Or what quantity a number represents. But they are around adults who often say that two plus two equals four. The child would learn that when someone says 2 plus 2 equals, the most likely word to come next is four. Just like if I say, the train is leaving the...... You would most likely respond with "station" and not city, town, port, or any other answer that might also fit. But it turns out that math is a little more precise than language. There are not many synonyms for 4, whereas station could be platform, terminal, or perhaps any of the nouns I used above.

If you want to take a deep dive into this topic I recommend starting with Marcus on AI's post: “Math is hard” — if you are an LLM – and why that matters.. Also note that there are plugins for ChatGPT (Wolfram Alpha and Code Interpreter) that allow ChatGPT to do a better job at math they are not perfect (see another Marcus post).

More Information

What is the controversy about pirated books being used to train LLM?

Examples to Try

  • Write in the style of Douglas Adams, etc.
  • Ask it about content that you know is in a copyrighted book.

More Information

How can you use ChatGPT to make Alt Tags for your images/photos?

Prompts to Try

  • describe the image as concisely as possible, explain the context of the image. Capitalize the first letter of each sentence and end whole sentences with a period. Limit your output to 140 characters or less.

More Information

Clone this wiki locally