My vibe math results

RWKV-7 7.2B fp16 15000+ tps decoding @ single 5090

RWKV-LM-V7(https://github.com/BlinkDL/RWKV-LM) Under Lightning Framework

Understand and test language model architectures on synthetic tasks.

NanoGPT (124M) in 90 seconds

Official inference framework for 1-bit LLMs

RWKV-7: Surpassing GPT

Open-Sora: Democratizing Efficient Video Production for All

LLM inference in C/C++

Inference Llama 2 in one file of pure C

LLM training in simple, raw C/CUDA

RWKV in nanoGPT style

Here we collect trick questions and failed tasks for open source LLMs to improve them.

Let us make Psychohistory (as in Asimov) a reality, and accessible to everyone. Useful for LLM grounding and games / fiction / business / finance / governance, and can align agents with human too.

Framework agnostic python runtime for RWKV models

ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

This project aims to make RWKV Accessible to everyone using a Hugging Face like interface, while keeping it close to the R and D RWKV branch of code.

Hua is an AI image editor with Stable Diffusion (and more).

A latent text-to-image diffusion model

RWKV-v2-RNN trained on the Pile. See https://github.com/BlinkDL/RWKV-LM for details.

The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )

LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence

やり直すんだ。そして、次はうまくやる。

The Nala markup, to turn a "Natural Language" sentence into a code-like statement. Nala 标注，将自然语言变为编程语言。

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RN…

AI 写小说，生成玄幻和言情网文等等。中文预训练生成模型。采用我的 RWKV 模型，类似 GPT-2 。AI写作。RWKV for Chinese novel generation.

A *tuned* minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Run, compile and execute JavaScript for Scientific Computing and Data Visualization TOTALLY TOTALLY TOTALLY in your BROWSER! An open source scientific computing environment for JavaScript TOTALLY i…