ADITYA SINHASOFTWARE ENGINEER & TECHNICAL DESIGNER
← All projects
ENGINEERING + DESIGN · TOOLS · LLM

Design Tuning Copilot

ROLEAI Tools Developer

TEAMSolo

DATEOct 2026

TYPEPython Tuning Tool

PROJECT SUMMARY

I built a Python tool that tunes a combat encounter with a hard enemy players should learn to beat. It simulates 4,800 fights, checks first wins, relapses, and time to kill, then asks an LLM for fixes. It resimulates every suggestion and rejects ones that make the fight too easy, and it hit every target in six tuning rounds.

THE PROBLEM

Use an LLM for ideas, not for unverified balance changes.

I wanted a tool that could suggest an iteration when an encounter missed its targets, without treating the suggestion as a result. Every proposed change goes back through the same simulation and checks before I accept it.

THE LOOP
  • I simulate 4,800 fights across player styles and measure first wins, relapses, and time to kill.
  • I identify where the encounter misses its targets and ask an LLM for a constrained change.
  • I resimulate each suggestion and reject any result that makes the fight too easy.
  • I keep only changes that meet the encounter targets, reaching every target in six tuning rounds.
My simulation matrix showing wins and losses across aggressive and cautious player behavior
Each simulated player profile gets a visible outcome, making tuning tradeoffs inspectable rather than anecdotal.
EVIDENCE

Every suggestion has to earn its place.

The tool records whether each round actually improves the learning curve without erasing the encounter’s challenge.

My chart comparing combat encounter win rates before and after tuning
Before and after tuning. The results make the change in win behavior visible across player profiles.

Checked, not trusted.

I use the LLM to propose a direction, then I make the simulation decide whether that direction is acceptable. That keeps tuning grounded in measurable first wins, relapses, and time to kill.

4,800 fights per tuning roundAll targets hit in 6 rounds