scholarr/app/services/ingestion
Justin Visser 2c591a0ca3 fix(ingestion,frontend): show live counter immediately on run start
Two issues with the initial implementation:
- Counter only appeared after the first SSE event arrived (scholarProgress null
  kept the v-else static template showing until a scholar completed)
- First events were often dropped because the EventSource hadn't subscribed yet

Fix:
- Backend: emit an initial scholar_progress kickoff event (0/0/N) at the
  start of run_scholar_iteration so the frontend receives total early
- Frontend: gate on isLikelyRunning alone (not scholarProgress); use optional
  chaining with fallbacks so "0 / … visited · 0 finished" shows immediately
  when a run starts, before any SSE events arrive

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-03 18:37:53 +01:00
..
__init__.py ci: add CodeQL security scanning and Dependabot 2026-02-27 00:05:17 +01:00
application.py Bugfixeds 2026-03-01 22:54:23 +01:00
constants.py Initial release prep 2026-02-27 10:46:05 +01:00
enrichment.py fix: URL-length-aware OpenAlex batching and eager scholar metadata hydration 2026-03-01 23:42:15 +01:00
fingerprints.py Initial release prep 2026-02-27 10:46:05 +01:00
page_fetch.py after audit 2026-03-01 18:14:22 +01:00
pagination.py after audit 2026-03-01 18:14:22 +01:00
preflight.py Better crawling safety with preflight checks and cooldowns 2026-02-27 16:44:54 +01:00
publication_upsert.py Bugfixeds 2026-03-01 22:54:23 +01:00
queue.py Bugfixeds 2026-03-01 22:54:23 +01:00
queue_runner.py fix(db,frontend): reserve DB connections for API and reduce frontend polling 2026-03-02 19:09:06 +01:00
run_completion.py after audit 2026-03-01 18:14:22 +01:00
run_enrichment.py after audit 2026-03-01 18:14:22 +01:00
run_guards.py after audit 2026-03-01 18:14:22 +01:00
safety.py ci: add CodeQL security scanning and Dependabot 2026-02-27 00:05:17 +01:00
scheduler.py fix(db,frontend): reserve DB connections for API and reduce frontend polling 2026-03-02 19:09:06 +01:00
scholar_outcomes.py after audit 2026-03-01 18:14:22 +01:00
scholar_processing.py fix(ingestion,frontend): show live counter immediately on run start 2026-03-03 18:37:53 +01:00
types.py Initial release prep 2026-02-27 10:46:05 +01:00