Daniel Han - Low Level Technicals of LLMs

Date
Time
Track
Workshops
Room
YBB Salons 12 - 15

Open Models: This workshop will be split into 3x one hour blocks:

  1. How to analyze & fix LLMs - how to find and fix bugs in Gemma, Phi-3, Llama & tokenizers
  2. Finetuning with Unsloth - continued pretraining, reward modelling, QLoRA & more
  3. Deep dive into LLM technicals - hand deriving derivatives, SOTA finetuning tricks

It's recommended you have Python with Pytorch and Unsloth installed (or use online Google Colab / Kaggle). College level maths and programming would be helpful.

Daniel Han

Daniel Han
Daniel HanCEO

Buy Tickets

We have now sold out of Early Bird tickets; General Admission selling out soon.

Buy Tickets
ticketstickets

* Expo sessions include talks, workshops, and facilitated discussions led by expo partners and organizer-curated speakers in the Expo Arena breakout rooms