Show HN: TurboGPT: train 22KiB transformer in 13s

(github.com)

34 points | by lostmsu 3 hours ago ago

4 comments

  • jey 2 hours ago

    At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little

  • vjsrinivas 31 minutes ago

    Interesting trend of labeling models after how big they are on disk vs how many learnable parameters they have.

  • fleshmonad 32 minutes ago

    Who cares. This will not get you hired. Why do these submissions get any points at all. The same people who upvote this are the ones seething AI cannot create anything new. I don't see it. Not to shit on the work that went into this.

    • kadoban 26 minutes ago

      Jesus. Would hate to see the work you _do_ want to shit on.