Improve batch image fetch speed and document the pipeline.

Add random queue sampling and a 10s per-painting deadline for fetch-images batches, cap HTTP timeouts to the remaining budget, and update docs plus newly fetched artwork files. Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-19 17:59:32 +03:00
parent d8385d83d6
commit 35c337253d
199 changed files with 206 additions and 69 deletions
@@ -9,3 +9,4 @@ IMAGE_DIR=./data/images
 # Optional — enable extra museum search in fetch-missing-images / search-missing-paintings
 # SMITHSONIAN_API_KEY=
 # HARVARD_ART_API_KEY=
+# FETCH_MAX_WAIT_SEC=10