Preprint Open access
When Talk Isn't Code: Comparing LLM Agents That Simulate and Develop Software
LLMs are used both to simulate network protocol implementations, as honeypots do, and to write them. Prior work evaluates the two uses separately, from a model's answers or conversations in one case and from its generated code in the other. We observe that a knowledge probe (asking the model which security checks an im …