hello wonderful people of the internet!
i am jonathan su
i think llms/ai are like a new digital species, and ai researchers are architectural biologists. so, needless to say, it is the coolest thing ever.
right now i am a senior at german swiss international school in hong kong. my interests are in llm architecture (specifically residuals) and pretraining.
here are some things i believe in:
- simplicity always beats complexity
- whatever doesn’t kill you makes you stronger and uglier
- the worst and best aspect of life is that there is no meaning/goal
- average happiness is positive over a lifetime
things i like
- cyberpunk 2077 / edgerunners
- open source llms (olmo series and modded nanogpt)
- calisthenics
- pizza
- intuition/epiphany
- dark mode
- chess (not very good)
things i don’t like:
- large vocab dimensions (softmax bottleneck)
- mlps with small dims in llm
- unfused operations
i love talking to new people! if you want, send an email to jon123boss@gmail.com. we can play chess :)(the background is inspired by cyberpunk 2077. click on 3 rogue ais from the blackwall; a surprise is waiting)