Skip to content

Error log when deleting environment #1689

Open

Description

@jacob-williamson

When deleting the blueapi env, we always seem to get the following error log: https://graylog.diamond.ac.uk/messages/graylog-prod_34/191b9f73-bcb1-11f1-8254-b62f7662bf00.

eg

Traceback (most recent call last):
  File "/app/.venv/lib/python3.14/site-packages/blueapi/worker/task_worker.py", line 419, in _cycle_with_error_handling
    self._cycle()
    ~~~~~~~~~~~^^
  File "/app/.venv/lib/python3.14/site-packages/observability_utils/tracing/decorators.py", line 151, in wrapper
    return func(*args, **kwargs)
  File "/app/.venv/lib/python3.14/site-packages/blueapi/worker/task_worker.py", line 478, in _cycle
    self._pending_tasks.pop(self._current.task_id)
    ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'cda03323-8aeb-4c0b-b9c4-368779e40d9b'

We've added some slack alerting so we get messages on blueapi errors, and since we delete the blueapi env a lot when testing on the beamline, we get spammed with messages. We can probably filter out this message so it's not urgent, but in general this error is a red herring.

Steps To Reproduce

  1. Delete the blueapi environment
  2. Look at the logs

Acceptance Criteria

  • Specific criteria that will be used to judge if the issue is fixed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingmonitoringLogging, metrics, tracing

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions