PhoGPT: Generative Pre-training for Vietnamese (2023)
-
Updated
Nov 12, 2024 - Python
#
generative-pre-trained-transformer
Here are 23 public repositories matching this topic...
An autoregressive language model like ChatGPT.
-
Updated
Oct 10, 2024 - Python
HELM-GPT: de novo macrocyclic peptide design using generative pre-trained transformer
reinforcement-learning de-novo-drug-design generative-pre-trained-transformer macrocyclic-peptide-design
-
Updated
Jul 4, 2024 - Jupyter Notebook
Inspired by Andrej Karpathy’s "Let’s Build GPT", this project guides you step‑by‑step to build a GPT from scratch, demystifying its architecture through clear, hands‑on code.
ai neural-network transformers transformer neural-networks educational gpt stem bigram-model ai-education transformer-architecture transformer-models generative-pre-trained-transformer transformer-model gpt-free gpt-from-scratch
-
Updated
Dec 12, 2025 - Jupyter Notebook
A GPT-2-class language model trained from scratch on OpenWebText with the intent to augment AI Transformer-model education and reverse engineer GPT models from scratch.
machine-learning ai hack chatbot reverse-engineering transformers hacking artificial-intelligence cybersecurity gpt cyber transformer-architecture gpt-2 transformer-models chatgpt chatgpt-api chatgpt-app tiktoken generative-pre-trained-transformer
-
Updated
Mar 4, 2026 - Jupyter Notebook
Simple GPT app that uses the falcon-7b-instruct model with a Flask front-end.
machine-learning ai transformers artificial-intelligence cybersecurity flask-application gpt transformer-architecture huggingface transformer-models huggingface-transformer huggingface-transformers hugging-face llm chatgpt chatgpt-app generative-pre-trained-transformer
-
Updated
Nov 26, 2025 - Python
SARAN: Shallow Auto-Regressive Attention Network
ai custom artificial-intelligence generative-model attention auto-regressive-model gpt attention-mechanism autoregressive generative-pretrained-transformer auto-regressive-models generative-ai generative-pre-trained-transformer agentic generative-pretraining agentic-ai generative-pretrained-transformers auto-regressive gpt-architecture
-
Updated
Jan 9, 2026 - Python
A pure Rust GPT implementation from scratch.
rust ai neural-network artificial-intelligence rust-lang neural-networks artificial-neural-networks rustlang gpt rust-crate gpt-2 gpt2 gpt2-chatbot generative-pretrained-transformer generative-ai generative-pre-trained-transformer generative-pretrained-transformers
-
Updated
Jan 25, 2026 - Rust
I built a GPT model from scratch to generate text
-
Updated
May 8, 2024 - Jupyter Notebook
MicroGPT is a clean, educational implementation of the GPT (Generative Pre-trained Transformer) architecture built from first principles with detailed explanations and comprehensive testing.
python testing machine-learning ai transformers python3 pytorch artificial-intelligence transformer artificial-neural-networks machinelearning gpt stem ai-education gpt2 generative-pretrained-transformer stem-education generative-pre-trained-transformer gpt-from-scratch
-
Updated
Feb 6, 2026 - Python
A implimentation of GPT2 varient.
nlp training machine-learning natural-language-processing ai ml transformers teaching artificial-intelligence transformer generative-adversarial-network generative-model artificial-neural-networks mit-license bert fine-tuning gpt-2 generative-ai generative-pre-trained-transformer
-
Updated
Feb 16, 2024 - Python
Unlock the power of your PDFs with HackWES-PDFChatGenius! This innovative project, developed during the HackWES hackathon, transforms the way you interact with PDF documents. Simply upload your PDF, and engage in a natural conversation to extract information, ask questions, and gain insights from your documents.
react bootstrap google html5 css3 context pdf-viewer firebase-auth amazons3 educational-website generative-pre-trained-transformer retrieval-augmented-generation
-
Updated
Aug 28, 2025 - TypeScript
An Industrial Project about NLP in Finance Application
nlp natural-language-generation finance-application industrial-project generative-pre-trained-transformer
-
Updated
Aug 10, 2023 - Jupyter Notebook
This is a NLP coursework repository for the Honours Bachelor of Artificial Intelligence program at Durham College. This repository contains weekly labs, assignments, and the final project completed during the Winter 2024 term.
-
Updated
May 22, 2025 - Jupyter Notebook
An academic implementation of GPT: only math and raw JAX
-
Updated
Dec 25, 2025 - Python
A Generatively Pretrained Transformer that generates Shakespeare-eque quotes
-
Updated
Apr 16, 2023 - Jupyter Notebook
This notebook builds a complete GPT (Generative Pre-trained Transformer) model from scratch using PyTorch. It covers tokenization, self-attention, multi-head attention, transformer blocks, and text generation and all explained step-by-step with a simple nursery rhyme corpus.
attention gpt attention-mechanism attention-is-all-you-need multi-head-attention multi-head-self-attention generative-pretrained-transformer generative-pre-trained-transformer gpt-from-scratch generative-pretrained-transformers gpt-training
-
Updated
Dec 16, 2025 - Jupyter Notebook
ToyGPT, inspired by Andrej Karpathy’s GPT from scratch, creates a toy generative pre-trained transformer at its most basic level using a simple bigram language model with attention to help educate on the basics of creating an LLM from scratch.
education machine-learning ai neural-network toy neural-networks educational gpt stem bigram-model aritificial-intelligence generative-pretrained-transformer generative-ai generative-pre-trained-transformer generative-pretrained-transformers toygpt
-
Updated
Nov 28, 2024 - Jupyter Notebook
Mechanistic Interpretability (MI) is a subfield of AI alignment and safety research focused on reverse-engineering neural networks to understand their internal computational mechanisms by discovering the actual algorithms and circuits they learn.
model transformers neural-networks gpt model-interpretation mechanistic-interpretability generative-pre-trained-transformer
-
Updated
Jan 27, 2026 - Jupyter Notebook
(GPT-1) | Generative Pre-trained Transformer - 1
-
Updated
Mar 19, 2023
Improve this page
Add a description, image, and links to the generative-pre-trained-transformer topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the generative-pre-trained-transformer topic, visit your repo's landing page and select "manage topics."