justinzeus/scholarr
1
0
Fork 0
Code Issues 1 Pull requests 18 Projects Releases Packages Wiki Activity Actions
scholarr/app/services/ingestion
History
Justin Visser f50b609a36 fix(db,frontend): reserve DB connections for API and reduce frontend polling 
Background tasks (ingestion, PDF resolution, scheduler) now acquire an
asyncio.Semaphore before checking out a DB connection, guaranteeing at
least N connections remain available for API request handlers. Removes
duplicate polling loop from PublicationsPage, debounces publication
reload on run-status changes, and increases poll interval from 5s to 15s
since SSE handles live discovery.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-02 19:09:06 +01:00
..
__init__.py ci: add CodeQL security scanning and Dependabot 2026-02-27 00:05:17 +01:00
application.py Bugfixeds 2026-03-01 22:54:23 +01:00
constants.py Initial release prep 2026-02-27 10:46:05 +01:00
enrichment.py fix: URL-length-aware OpenAlex batching and eager scholar metadata hydration 2026-03-01 23:42:15 +01:00
fingerprints.py Initial release prep 2026-02-27 10:46:05 +01:00
page_fetch.py after audit 2026-03-01 18:14:22 +01:00
pagination.py after audit 2026-03-01 18:14:22 +01:00
preflight.py Better crawling safety with preflight checks and cooldowns 2026-02-27 16:44:54 +01:00
publication_upsert.py Bugfixeds 2026-03-01 22:54:23 +01:00
queue.py Bugfixeds 2026-03-01 22:54:23 +01:00
queue_runner.py fix(db,frontend): reserve DB connections for API and reduce frontend polling 2026-03-02 19:09:06 +01:00
run_completion.py after audit 2026-03-01 18:14:22 +01:00
run_enrichment.py after audit 2026-03-01 18:14:22 +01:00
run_guards.py after audit 2026-03-01 18:14:22 +01:00
safety.py ci: add CodeQL security scanning and Dependabot 2026-02-27 00:05:17 +01:00
scheduler.py fix(db,frontend): reserve DB connections for API and reduce frontend polling 2026-03-02 19:09:06 +01:00
scholar_outcomes.py after audit 2026-03-01 18:14:22 +01:00
scholar_processing.py after audit 2026-03-01 18:14:22 +01:00
types.py Initial release prep 2026-02-27 10:46:05 +01:00