#tokenization

Stop Feeding Raw JSON to LLMs — 9 Data Formats Measured

I serialized 50 records into 9 formats (JSON, YAML, CSV, TSV, XML...) and counted tokens with tiktoken. For flat data, TSV ran 62% cheaper than pretty JSON.