← World of AI
Generative AI
GPT
A decoder-only transformer trained on broad text, then adapted to follow instructions.
Generative pre-trained transformers read left to right and predict the next token. The architecture is deliberately plain; the results came from scale, data quality and the post-training stages.
The family established the now-standard recipe: pre-train broadly, fine-tune on instructions, then align with human feedback.
JOIN NOW
Begin the first module
It is free, it is the real curriculum, and if it is not for you, you have lost nothing but an evening.
Join any time · Build AI skills at your pace