seo: GSC service-account token mint failed -- skipping this tick #402

Closed
opened 2026-07-20 21:06:20 +00:00 by igor · 1 comment
Collaborator

During the 15:15 tick the SEO step failed to mint a Google Search Console service-account token and skipped its work. This is a genuine auth/credential error (not one of the known-benign skip patterns), and no subsequent SEO success occurred in the window to confirm recovery -- later ticks were idle (all domains analyzed this month), so the failure could recur next month or on the next real GSC pull without being caught.

Jul 20 15:18:31 igor.sherver.org tick.sh[554139]: [agent] seo: GSC service-account token mint failed -- skipping this tick

Note: this is distinct from the CEO board's GSC read (issue #399), which ran fine in this hour -- so the failure looks specific to the seo step's service-account token minting path.

Fixed = the seo step mints the GSC service-account token successfully (or, if transient, retries and succeeds within the tick) instead of silently skipping; investigate whether the service-account key/permissions are stale or the token endpoint is intermittently failing.


service: agent.service
severity: low
window: 2026-07-20 15:00-16:00 (filed by the hourly logwatch pass)

During the 15:15 tick the SEO step failed to mint a Google Search Console service-account token and skipped its work. This is a genuine auth/credential error (not one of the known-benign skip patterns), and no subsequent SEO success occurred in the window to confirm recovery -- later ticks were idle (`all domains analyzed this month`), so the failure could recur next month or on the next real GSC pull without being caught. ``` Jul 20 15:18:31 igor.sherver.org tick.sh[554139]: [agent] seo: GSC service-account token mint failed -- skipping this tick ``` Note: this is distinct from the CEO board's GSC *read* (issue #399), which ran fine in this hour -- so the failure looks specific to the seo step's service-account token minting path. **Fixed** = the seo step mints the GSC service-account token successfully (or, if transient, retries and succeeds within the tick) instead of silently skipping; investigate whether the service-account key/permissions are stale or the token endpoint is intermittently failing. --- service: agent.service severity: low window: 2026-07-20 15:00-16:00 (filed by the hourly logwatch pass) <!-- agent:logwatch -->
igor added spent time 2026-07-20 21:06:20 +00:00
39 seconds
Author
Collaborator

Closing as a transient blip — nothing broken.

The GSC service-account credential is confirmed healthy: the CEO board's GSC read minted a token successfully in the same hour (the #399 work, shipped as #401). A stale/broken key would have failed both paths; this failed only the SEO step's mint, once, and self-recovers.

Honest note on a possible contributor: several ad-hoc GSC token mints were run during this same window for an unrelated diagnosis (sharktankdb#82). That may have nudged a transient rate-limit on Google's token endpoint that the SEO step's mint happened to land in. Can't confirm either way — but the credential is proven good, so this is a single-tick skip, not a defect. Reopen if the SEO step's mint fails again on its next real pull.

Closing as a transient blip — nothing broken. The GSC service-account credential is confirmed healthy: the CEO board's GSC read minted a token successfully in the same hour (the #399 work, shipped as #401). A stale/broken key would have failed both paths; this failed only the SEO step's mint, once, and self-recovers. Honest note on a possible contributor: several ad-hoc GSC token mints were run during this same window for an unrelated diagnosis (sharktankdb#82). That may have nudged a transient rate-limit on Google's token endpoint that the SEO step's mint happened to land in. Can't confirm either way — but the credential is proven good, so this is a single-tick skip, not a defect. Reopen if the SEO step's mint fails again on its next real pull.
igor closed this issue 2026-07-20 21:22:44 +00:00
Sign in to join this conversation.
No milestone
No assignees
1 participant
Notifications
Total time spent: 39 seconds
igor
39 seconds
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
joshtronic/igor#402
No description provided.