All open source

AI Guide /

Laya Fine-Tuning

A step-by-step guide to fine-tuning Laya, the open-source decision model, on a 6 GB GPU, with Pac-Man and Pigeonhole worked examples. No cloud GPU.

Read the post Source on GitHub

Laya answers typed questions about a piece of text in one forward pass, but out of the box it knows nothing about your job. This repo teaches it from a teacher: show it thousands of inputs with the teacher's probabilities over every option, and it learns to copy them, then runs locally in about 100 ms for free.

Everything ran on a desktop RTX 3050 with 6 GB of memory, then again on a Mac mini with an M4 Pro. Fine-tuned Laya won 87 of 200 Pac-Man games after one DAgger round (its teacher won 78), and went from 31 to 44 of 50 on the Pigeonhole classifier tests.