Deterministic chunk ID

A chunk id that comes out the same each time the same input is ingested, such as the document id plus the chunk number or a hash of the chunk's text. Re-running ingestion then updates chunks instead of duplicating them. Old chunks of an edited or shortened document still have to be deleted, because a changed chunk can get a new id.

All terms, A to Z