Simplify the indexed repository dashboard and verify nightly sync - #21
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The dashboard showed all discovered GitHub repositories, including 27 never harvested here, and mixed database counts with search availability. It now lists only repositories with documents in the live Elasticsearch index and shows three totals: indexed repositories, searchable records, and sources scheduled nightly. Remove the Never Harvested Here card, redundant Aardvark/source-count columns, and stale explanatory text. Keep GitHub and filtered Search API links. Report index unavailability explicitly instead of showing misleading zero counts.
The nightly workflow previously succeeded immediately after enqueueing work. It now waits for every child harvest and requires both zero import errors and a successful search-index synchronization. Discovery failures abort before changing source settings; empty, skipped, incomplete, failed, or timed-out batches fail the workflow. The daily 07:15 UTC schedule remains in place, with a five-hour completion deadline inside the six-hour workflow limit.
Validation:
Deployment order: deploy the updated application scripts before the next scheduled workflow uses
--wait. No deployment is included in this PR.