LLM Agents Do Not Reliably Follow Company Policies
A new benchmark that tests whether AI agents can follow long company policies during realistic work
Notes tagged AgenticReasoning
-
-
Heavy Thinking: A Test-Time Scaling Pattern for Hard Problems
Now we have GPT Pro at home
-
LLMs Corrupt Your Documents When You Delegate
A large-scale study on long-horizon document tasks.
-
OpenGame: Open Agentic Coding for Games
An agentic framework for end-to-end game creation
-
Research, Plan, Implement Workflow
An approach to agentic software development that I use
-
Self-Generated Agent Context Files Don't Help Either
Self-generated agent context files don't help.
-
Self-Generated Skills Don't Help
Curated skills boost agent performance by 16 points; self-generated ones don't help at all.
-
Spec-First LLM Development
in which the LLM maintains a spec file alongside the project
-
Vibe-Coding Mathematical Discoveries
Using evolutionary algorithms with LLM-coding agents
-
Thinking LLMs: General Instruction Following with Thought Generation (Oct 2024)
a prompting and fine-tuning method that enables LLMs to engage in a "thinking" process before generating responses
