hello wonderful people of the internet!

i am jonathan su

i think llms/ai are like a new digital species, and ai researchers are architectural biologists. so, needless to say, it is the coolest thing ever.

right now i am a senior at german swiss international school in hong kong. my interests are in llm architecture (specifically residuals) and pretraining.

here are some things i believe in:

  • simplicity always beats complexity
  • whatever doesn’t kill you makes you stronger and uglier
  • the worst and best aspect of life is that there is no meaning/goal
  • average happiness is positive over a lifetime

things i like

  • cyberpunk 2077 / edgerunners
  • open source llms (olmo series and modded nanogpt)
  • calisthenics
  • pizza
  • intuition/epiphany
  • dark mode
  • chess (not very good)

things i don’t like:

  • large vocab dimensions (softmax bottleneck)
  • mlps with small dims in llm
  • unfused operations

i love talking to new people! if you want, send an email to jon123boss@gmail.com. we can play chess :)(the background is inspired by cyberpunk 2077. click on 3 rogue ais from the blackwall; a surprise is waiting)