Tests As Spec And Ai Accelerated Reimplementation Risk
Sources: 1 • Confidence: High • Updated: 2026-03-02 19:33
Key takeaways
- A comprehensive test suite can enable a fresh reimplementation of an open-source library from scratch, potentially in a different language.
- tldraw is described as not technically open source because its custom license requires a commercial license for production use.
- An issue that seemed to indicate tldraw would move its test suite to a private repository was later revealed to have been intended as a joke.
- tldraw filed a joke issue proposing translating its source code to Traditional Chinese as a defense against external AI coding agents replicating the project.
- A tldraw maintainer argued that moving tests to another repository would complicate and slow development, and that development speed is a higher priority.
Sections
Tests As Spec And Ai Accelerated Reimplementation Risk
- A comprehensive test suite can enable a fresh reimplementation of an open-source library from scratch, potentially in a different language.
- The risk of test-driven reimplementation is presented as especially concerning for projects that pair open distribution with a commercial business model.
- Cloudflare reportedly ported Next.js to use Vite in about a week using AI.
Operational Tradeoffs And Non Code Moats Under Replication Pressure
- tldraw is described as not technically open source because its custom license requires a commercial license for production use.
- A tldraw maintainer argued that moving tests to another repository would complicate and slow development, and that development speed is a higher priority.
- A tldraw maintainer suggested the project's defensible value is in continually making strong product decisions for users rather than preventing others from recreating the code.
Closed Tests Narrative Corrected As Joke
- An issue that seemed to indicate tldraw would move its test suite to a private repository was later revealed to have been intended as a joke.
- tldraw filed a joke issue proposing translating its source code to Traditional Chinese as a defense against external AI coding agents replicating the project.
Unknowns
- Are there documented examples where an independent team produced a close behavioral reimplementation primarily from a public test suite (without source), and how long did it take versus typical development?
- What were the precise scope, quality bar, and methodology of the reported Next.js-to-Vite port (what was ported, what worked, what was omitted, and what 'using AI' entailed)?
- Are other commercially oriented projects actually moving tests (or other high-signal artifacts) out of public repositories, and under what conditions?
- What are the exact terms of the tldraw license described (definitions of 'production use', enforcement posture, and any exceptions)?
- Does keeping tests public measurably increase AI-enabled cloning risk relative to other publicly available artifacts (docs, examples, type definitions), and what mitigations preserve development velocity?