OpenAI - GPT-3

GPT-3 an AI which can generate Text

Have you ever heard of GPT-3?

It is an AI that can generate text. Over Easter, I tested the tool and was amazed at how well it works. So I thought I’d share it with you here.

Using it is relatively simple; you type in a command/text, and the AI generates text based on the input.

There are many possible applications. Maybe you know copy.ai, a product that uses GPT-3 to create sales texts, product descriptions, and much more.

But there are many more applications, e.g., translating texts and generating stories.

Now briefly, how does this technology work and a few facts.

First, you need a massive amount of data for training; this means many texts.

These are then read by the AI and during training the AI must always generate the next word in the text.

Here is an example:

Text: Who is the president of the USA?

Input during training: Who is the president of the

Expected result: USA

If we do this long enough and, of course, a bit more complex, the AI learns which is the likely next word in the text.

That means we can choose the following text as input after the training:

Translate “Hello” to German.

The AI should then be able to recognize that “Hello“, is the most likely word and output that.

A few facts:

  • The AI has 175 billion parameters, which probably doesn’t mean anything to you, but that means that the AI alone needs 350 gigabytes of memory while it is being used.
  • It was trained on 45 terabytes of text, 92% of which was English text, which was already about 180 billion words.
  • The training alone cost between 10 and 20 million USD.

What’s next?

The company behind the tool, OpenAI, has now also created a similar AI for images, i.e., you enter a text and get a generated image as output.

Finally, I want to share a story wholly generated by the AI, and a video about the AI where images can be generated.

An AI story

The input was: Generate a Story about how to find true freedom according to Martin Heidegger’s philosophy.

Output:

When I was younger, I used to think that freedom was something that came from external sources.

I thought that if I could just find the right place, the right job, the right relationship, then I would finally be free.

But no matter how many times I changed my circumstances, I always found myself back at the same place – feeling trapped and unhappy.

It wasn’t until I came across Martin Heidegger’s philosophy that I began to understand what true freedom really is.

Heidegger says that freedom is found in the actions we take when confronted by our default selves. In other words, it’s not about changing our circumstances, but about changing ourselves.

When we notice our default selves – the parts of us that are unhappy, anxious, or angry – and yet we act independently of that, that is true freedom. It’s not about escaping our problems, but about facing them head-on and choosing to be something different.

This philosophy has changed my life. Now, instead of trying to run away from my problems, I confront them head-on. And instead of feeling trapped by my circumstances, I feel empowered by my ability to choose how I react to them. I am finally free.

I must say I’m pretty impressed with the results, and even more with the new AI that generates images. What do you think about it?

PS: If anyone is interested in these topics, feel free to contact me. Would love to brainstorm business ideas.

PSS: Check out my newsletter on https://nicolashoferer.substack.com/

All the best and have a lovely Sunday

Nic