MassBrainGPT

A project to run the entire internet through a single model.

Goals

1T+ paramm

Steps

Word Structure (openwebtext) ✅ (10,805,078 parameters)

Sentence Structure (super_glue) ❌

Question Answering (???) ❌