A high-throughput and memory-efficient inference and serving engine for LLMs

Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: …

Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)

RL algorithm: Advantage induced policy alignment

A boilerplate for creating a Llama 3 chat app

LLaMA v2 Chatbot

A Large-Scale Dataset for Empathetic Response Generation

A framework for creating grounded instruction based datasets and training conversational domain expert Large Language Models (LLMs).

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models

TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

Supercharge Your LLM Application Evaluations 🚀

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

This repository contains implementations and illustrative code to accompany DeepMind publications

ToK aka Tree of Knowledge for Large Language Models LLM. It's a novel dataset that inspires knowledge symbolic correlation in simple input and output prompts

Instruct-tune LLaMA on consumer hardware

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

State-of-the-Art Text Embeddings

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

Self-contained, minimalistic implementation of diffusion models with Pytorch.

Stable Diffusion web UI

Science-driven chatbot development

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

AI chat for any model.

Inference code for Llama models

Focus on prompting and generating