Maybe Non-Deterministic Behavior is What We Want When Writing Code

Mike Hostetler tweet about LLM non-determinism

I had always seen the non-deterministic behavior of LLM’s as the shortcoming with code generation, but this comment really had me realizing that doing things incorrectly and unconventionally is how you experiment and come up with new ways to build things

Non-deterministic behavior is not only the path for innovation, but it is also how nature works. Maybe the machines will use this natural non-deterministic nature of building to create software we couldn’t imagine in our tightly controlled box of deterministic code writing.

That is not to say we want the software that runs to be non-deterministic, but the path to getting deterministic software itself doesn’t need to be deterministic.

Original Tweet

# 1:28 pm / ai / llm