Fix description cache invalidation

[emphor11]

Metadata

• Reference Issue: Fixes Implement time-based cache invalidation for dataset description cache #1714
• New Tests Added: No
• Documentation Updated: No
• Change Log Entry: Add TTL-based cache invalidation for dataset description cache

Details

This PR implements time-based cache invalidation for dataset descriptions in _get_dataset_description.

Currently, the dataset description (description.xml) is cached indefinitely once downloaded. However, dataset metadata such as status (e.g., active or deactivated) can change on the server. Because the cache never expires, users may receive outdated dataset metadata if the local cache becomes stale.

This change introduces a simple TTL (time-to-live) mechanism for the cached description file:

• A module-level constant DESCRIPTION_CACHE_TTL is introduced (24 hours).
• When _get_dataset_description is called, the modification time of the cached description.xml file is checked.
• If the file is older than the TTL, it is removed and the description is fetched again from the server.

This ensures that cached dataset descriptions are periodically refreshed while still preserving the existing caching behavior and minimizing additional API calls.

The change addresses the existing TODO in the code suggesting that the cache should invalidate itself after some time.

[emphor11]

Hi @fkiraly
Made changes to implement time-based cache invalidation for _get_dataset_description, addressing the TODO about cache invalidation.

Thanks

[PGijsbers]

Hi! Thanks for taking the time to contribute. We are sorry that it took us so long to respond, and even more sorry to share that I unfortunately have to close this PR. Due to a large influx of PRs, we now close PRs that solve an issue that was created by an external user and never approved for work. We first have a discussion in the issue tracker and when the proposal is accepted, we're open to processing corresponding pull request(s). Thanks for your understanding!