AI Engineer Summit

Ben Lower & Justin Uberti - Workshop: Building a RAG powered, multi-modal Sidekick using AI.JSX

AI.JSX is the best way for JavaScript developers to bring the power of LLMs to applications. This workshop will teach you how to build production-grade Sidekicks that use RAG, Tools, and Generative UI...

Date
Time
Location
Hotel Nikko

Style: Code-Along

Level: Intermediate

AI.JSX is the best way for JavaScript developers to bring the power of LLMs to applications. This workshop will teach you how to build production-grade Sidekicks that use RAG, Tools, and Generative UI. You will also learn how to create interactive, conversational voice agents.

In this workshop you will learn:

  • How to quickly get started with AI.JSX, an open source framework for building apps that use LLMs.
  • How to build an AI-powered agent (AKA Sidekick) written in JavaScript and React.
  • What is Retrieval-Augmented Generation (RAG) and how it gives your assistant contextual knowledge.
  • How to move beyond simple text in chat apps by using AI.JSX’s support for Generative UI.
  • How to enable your users to interact with your agent using voice.

You will leave the workshop with a fully deployed and working Sidekick and will have everything you need to go deeper by customizing it.

Prerequisites: Experience programming, ideally in JavaScript, and a GitHub account (we will mint a read-only API token and use it in the project).

Assets: We will base the workshop on the Fixie Sidekick Quickstart. It would be helpful for you to have already set-up your development environment prior to the workshop.

Ben Lower

Ben is the Head of Developer Relations at Fixie, a Seattle-based AI startup building a new computing and application development platform based on Large Language Models (LLMs). Prior to joining Fixie, Ben has held leadership positions at Microsoft, Tableau, and Algolia where he worked on building tools and platforms to help developers build and deliver applications for mobile, Kinect, Hololens, BI + analytics, and search.

Ben Lower
Head of Developer Relations, Fixie.ai

Justin Uberti

Justin Uberti is the CTO and Co-founder of Fixie.ai. Previously, he was a Distinguished Engineer at Google, where he led the development of Google's video conferencing technology and created the WebRTC standard as well as the Google Duo video chat app. Other recent work includes bringing Google’s Stadia cloud gaming service to iOS, and creating the spatial audio experience for Clubhouse. Before Google, Justin was Chief Architect for AOL Instant Messenger.

Justin Uberti
CTO, Fixie.ai