steren’s Twitter Archive—№ 4,216

krainboltgreene I would do it by chunk. Maybe like this: one service queries the size of the DB, then add tasks to a queue for each chunk to import (using Cloud Tasks). Cloud Tasks then pushes each tasks to the import service, that processes them at the defined rate.