Trillions rows multiplied by a trillion rows P&L: 0 (≃ 0 EUR)
How to write efficient code to multiply two lists of trillion numbers
YAML
Projektas
Casual application scaled their spreadsheet processing engine to handle a billion records.
I want to try do the work to multiply two lists of trillion numbers.
Fast.
So I only have 16GB RAM but we can page in data gradually while we are processing data. So we do it in batches.
https://www.causal.app/blog/scaling
