LLMs benchmark for decision-making based on a 2D platformer game by evaluating text-described decisions and multiple-choice objectives
Read the original at www.reddit.com→The project I posted here a week ago (https://www.reddit.com/r/LocalLLaMA/comments/1x17ou5/decisions_in_a_js13kgame) is now a benchmark: anyone can run their model on it and contribute reproducible results to a...
Original headline: "The challenge where LLMs try to beat a 2D platformer game is now a benchmark for decision-making"
Coverage timeline
- Oct 16, 16:04 UTC r/LocalLLaMA lead source The challenge where LLMs try to beat a 2D platformer game is now a benchmark for decision-making