added a Readme regarding osce testing
Some checks are pending
Autotools / AutoMake/Linux/GCC (push) Waiting to run
Autotools / AutoMake/Linux/GCC/EnableDNN (push) Waiting to run
Autotools / AutoMake/Linux/GCC/EnableCustomModes (push) Waiting to run
Autotools / AutoMake/Linux/GCC/EnableAssertions (push) Waiting to run
CMake / Test build with CMake 3.16.0 (push) Waiting to run
CMake / CMake MINGW (push) Waiting to run
CMake / CMake/Linux/Lib/X64/Release (push) Waiting to run
CMake / CMake/MacOSX/Lib/X64/Release (push) Waiting to run
CMake / CMake/MacOSX/Framework/X64/Release (push) Waiting to run
CMake / CMake/Linux/So/X64/Release (push) Waiting to run
CMake / CMake/MacOSX/So/X64/Release (push) Waiting to run
CMake / CMake/Android/So/ARMv8/Release (push) Waiting to run
CMake / CMake/Android/Lib/ARMv8/Release (push) Waiting to run
CMake / CMake/Android/So/X86/Release (push) Waiting to run
CMake / CMake/Android/Lib/X86/Release (push) Waiting to run
CMake / CMake/Android/So/X64/Release (push) Waiting to run
CMake / CMake/Android/Lib/X64/Release (push) Waiting to run
CMake / CMake/AssertionsFuzz/Linux/Lib/X64/Release (push) Waiting to run
CMake / CMake/AssertionsFuzz/MacOSX/Lib/X64/Release (push) Waiting to run
CMake / CMake/CustomModes/Linux/Lib/X64/Release (push) Waiting to run
CMake / CMake/iOS/Framework/arm64/Release (push) Waiting to run
CMake / CMake/iOS/Dll/arm64/Release (push) Waiting to run
CMake / CMake/iOS/Lib/arm64/Release (push) Waiting to run
CMake / CMake/Windows/Dll/ARMv8/Release (push) Waiting to run
CMake / CMake/Windows/Lib/armv8/Release (push) Waiting to run
CMake / CMake/Windows/Dll/X64/Release (push) Waiting to run
CMake / CMake/Windows/Dll/X86/Release (push) Waiting to run
CMake / CMake/AssertionsFuzz/Windows/Lib/X64/Release (push) Waiting to run
CMake / CMake/Windows/Lib/X64/Release (push) Waiting to run
CMake / CMake/Windows/Lib/X86/Release (push) Waiting to run
DRED / CMake/Android/Lib/ARMv8/Release (push) Waiting to run
DRED / CMake/Android/Lib/X64/Release (push) Waiting to run
DRED / CMake/MacOSX/Lib/X64/Release (push) Waiting to run
DRED / CMake/Linux/Lib/X64/Release (push) Waiting to run
DRED / CMake/iOS/Lib/arm64/Release (push) Waiting to run
DRED / CMake/Windows/Lib/armv8/Release (push) Waiting to run
DRED / CMake/Windows/Lib/X64/Release (push) Waiting to run
DRED / AutoTools/Linux/Clang (push) Waiting to run
DRED / AutoTools/Linux/GCC (push) Waiting to run
Repository / Check trailing white spaces (push) Waiting to run

This commit is contained in:
Jan Buethe 2024-10-20 18:26:18 +02:00
parent eef6d0abef
commit 5733c02fab
No known key found for this signature in database
GPG key ID: 9FF9A25FBE75E37D

View file

@ -0,0 +1,22 @@
This folder contains scripts for creating and running tests for qualifying a speech coding
enhancement method for use with Opus SILK.
The scripts have been tested with python 3.9, 3.10 and 3.11. Python dependencies are listed
in requirements.txt. In addition, the create_bistreams.py script will require sox to be
installed in PATH.
To run the test, download and extract testvectors https://media.xiph.org/opus/ietf/osce_testvectors_v0.zip.
The run_osce_tests.py script requires an executable of the enhanced opus decoder with
the same call signature as opus_demo, i.e.
EXECUTABLE -d SAMPLING_RATE NUMBER_OF_CHANNELS \[OPTIONS\] BITSTREAM PCM_OUTPUT
that produces a 16-bit PCM output file. To start the test, run
python run_osce_tests.py osce_testvectors_v0 my_test_output --opus-demo EXECUTABLE --opus-demo-options OPTIONS
which will prodce a text file my_test_output/test_results.txt containing the results (PASS/FAIL) for each
individual test. Furthermore, reference and test MOC scores are stored in yaml format in my_test_output/TESTNAME_moc.yml
under their group as primary key and clip name as secondary key.
Testvectors have been created from https://media.xiph.org/opus/ietf/osce_test_clips.zip using the script create_bitstreams.py.