Skip to content

feat: EXPKITS-1571 YAMNet audio event classification - #293

Open
ibori75 wants to merge 4 commits into
mainfrom
feature/EXPKITS_1571/environmental-audio-model
Open

ibori75 wants to merge 4 commits into
mainfrom
feature/EXPKITS_1571/environmental-audio-model

Conversation

@ibori75

@ibori75 ibori75 commented Nov 18, 2026

Copy link
Copy Markdown
Contributor

Pull Request

Goal

Restore YAMNet environmental sound classification, including browser microphone input and structured results.

Change

  • Add YAMNet-compatible log-mel preprocessing and an audio-event parser with sigmoid activation, confidence filtering and top-K selection.
  • Publish typed Classifications results with AudioSet labels and optional terminal debug output.
  • Add the YAMNet model descriptor, opchain and opksrc/opksink pipeline with WebSocket result publishing.
  • Download pinned YAMNet v0.66.0 artifacts through the existing downloader, verifying archive and file checksums. Exclude downloaded binaries from Git and Docker build context.
  • Adopt Model v2 and OpChain v2.1 configuration contracts.
  • Add regression tests, reference comparisons and usage documentation.

Task: EXPKITS-1571

Testing

  • Development-container debug build passed.
  • SDK consistency check passed.
  • Downloader tests passed (5 skipped).
  • Native YAMNet classifications matched the reference implementation for silence, tone, noise and chirp.
  • Full Meson suite: 106 passed, 1 failed. Repository configuration validation rejects the downloaded YAMNet metadata.json filename; this remains to be resolved.
  • Documentation generation could not run inside the development container because Docker/Podman was unavailable there.

Task: EXPKITS-1571

Signed-off-by: Imre Bori <imre.bori@arm.com>
Task: EXPKITS-1571

Signed-off-by: Imre Bori <imre.bori@arm.com>
Task: EXPKITS-1571

Signed-off-by: Imre Bori <imre.bori@arm.com>
…environmental-audio-model

Task: EXPKITS-1571

Signed-off-by: Imre Bori <imre.bori@arm.com>
@ibori75
ibori75 requested review from a team as code owners November 18, 2026 09:10

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant