FIG. 04 // HSPANN.BUILD_TIME FINEWEB · D=768 · N=0→100M · ONE MACHINE
Build time for 100M vectors, batch by batch
Under an hour of indexing, with the tree balanced and searchable after every batch. Later batches cost more, but the total stays small.
view[
to 100M vectors
r6i.32xlarge · 16 insertion workers · 16 balance workers · batches of 1M vectors (the first million in 100K batches, shown as one). Input loading and checkpoint saves are excluded. Switch to per-batch view or hover for the phase timings.