v1.7.4

[ggerganov]

Overview

Minor release with mostly build fixes.

What's Changed

• whisper : rename binaries + fix install by @ggerganov in whisper : rename binaries + fix install #2648
• feat(server): Add option to suppress non-speech tokens by @sachaarbonel in feat(server): Add option to suppress non-speech tokens #2649
• whisper : rename suppress_non_speech_tokens to suppress_nst by @ggerganov in whisper : rename suppress_non_speech_tokens to suppress_nst #2653
• feat: expose no-speech probability in segment by @sachaarbonel in feat: expose no-speech probability in segment #2654
• ruby : bug fix on callbacks and no_speech_prob by @KitaitiMakoto in ruby : bug fix on callbacks and no_speech_prob #2656
• Add no_speech_thold to cli by @alubbe in Add no_speech_thold to cli #2663
• Add --suppress_nst support to cli by @alubbe in Add --suppress_nst support to cli #2664
• ruby : Fix of C++ header guard name, model URI support, type signature and more by @KitaitiMakoto in ruby : Fix of C++ header guard name, model URI support, type signature and more #2683
• Enable Windows cublas build by @niksedk in Enable Windows cublas build #2676
• docs: replace Core ML with OpenVINO by @konosky in docs: replace Core ML with OpenVINO #2686
• rename ggml-cpu-aarch64.c to .cpp by @ego in rename ggml-cpu-aarch64.c to .cpp #2687
• readme : fix real-time audio input example build instructions by @samueldurantes in readme : fix real-time audio input example build instructions #2692
• sync : ggml by @ggerganov in sync : ggml #2699
• cli : fix segfault on missing argument by @redzic in cli : fix segfault on missing argument #2700

New Contributors

• @sachaarbonel made their first contribution in feat(server): Add option to suppress non-speech tokens #2649
• @alubbe made their first contribution in Add no_speech_thold to cli #2663
• @niksedk made their first contribution in Enable Windows cublas build #2676
• @konosky made their first contribution in docs: replace Core ML with OpenVINO #2686
• @ego made their first contribution in rename ggml-cpu-aarch64.c to .cpp #2687
• @samueldurantes made their first contribution in readme : fix real-time audio input example build instructions #2692
• @redzic made their first contribution in cli : fix segfault on missing argument #2700

Full Changelog: v1.7.3...v1.7.4

---

This discussion was created from the release v1.7.4.

[itsthisjustin]

Any chance of fixing the Swift package? This repo is now unusable for us with latest two releases due to the new CMAKE build requirements. I've yet to be able to get it to properly build for both architectures and all targets (iOS and macOS)

[rpollestad]

I wanted to chime in and say that I haven't been able to compile a build since 1.7.1 running AlmaLinux 8.10.

[ 62%] Linking CXX executable ../../bin/whisper-cli
../../ggml/src/libggml.so: undefined reference to vtable for std::filesystem::__cxx11::filesystem_error' ../../ggml/src/libggml.so: undefined reference to std::filesystem::__cxx11::directory_iterator::operator*() const'
../../ggml/src/libggml.so: undefined reference to typeinfo for std::filesystem::__cxx11::filesystem_error' ../../ggml/src/libggml.so: undefined reference to std::filesystem::__cxx11::path::_M_find_extension() const'
../../ggml/src/libggml.so: undefined reference to std::filesystem::__cxx11::filesystem_error::~filesystem_error()' ../../ggml/src/libggml.so: undefined reference to std::filesystem::status(std::filesystem::__cxx11::path const&)'
../../ggml/src/libggml.so: undefined reference to std::filesystem::__cxx11::path::_M_split_cmpts()' ../../ggml/src/libggml.so: undefined reference to std::filesystem::__cxx11::directory_iterator::operator++()'
../../ggml/src/libggml.so: undefined reference to std::filesystem::__cxx11::directory_iterator::directory_iterator(std::filesystem::__cxx11::path const&, std::filesystem::directory_options, std::error_code*)' ../../ggml/src/libggml.so: undefined reference to std::filesystem::__cxx11::filesystem_error::_M_gen_what()'
collect2: error: ld returned 1 exit status
gmake[2]: *** [examples/cli/CMakeFiles/whisper-cli.dir/build.make:102: bin/whisper-cli] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:405: examples/cli/CMakeFiles/whisper-cli.dir/all] Error 2
gmake: *** [Makefile:136: all] Error 2

I've run yum updates and tried to install more devtools/libraries but to no avail.

[ggerganov]

I believe you need a newer version of gcc. Which one are you currently using?

[rpollestad]

Looks like AlmaLinux 8.10 has: gcc version 8.5.0 20210514 (Red Hat 8.5.0-22) (GCC)

It does compile on AlmaLinux 9.2, which has: gcc version 11.3.1 20221121 (Red Hat 11.3.1-4) (GCC)

So, you're probably right.

So I'm stuck at 1.7.1 then?

[ggerganov]

Yes. You should either obtain a new version of GCC, or there might be some way to pass extra flags through the CMake options that would enable experimental filesystem module in the GCC that you have. But I'm not sure what are the options and if it would even work at all.

[ket395]

Rocky Linux can be used for desktop and server purposes. It's available for the x86_64, AArch64, ppc64le, and s390x processor architectures.

If you def need compatibility with RHEL which is not FOSS anymore but kinda source available, I strongly recommend testing Rocky Linux first with your older applications if you are not using Rocky Linux already. It has a better chance of fulfilling your needs, but it depends on your needs, their number and nature.

Though there might be Fedora Linux for enterprise-grade purposes/requirements or desktop workstation users. It has a bigger, better community in relative terms and is a better business decision unless you have access to free or ill-earned financial resources. And you could use Rocky Linux for the main/server/master node and the rest could be Fedora Linux but it may not work out as smoothly I've been told.

Thanks.

[sinand99]

Why don't you release exe files for people who can't build this, just like llama.cpp ??

[azkadev]

actually making this executable is easy because it is written well in the readme, by the way maybe ggerganov prefers llama over whisper maybe whisper is not really used for him at the moment

check this if you need quickstart whisper

https://github.com/ggerganov/whisper.cpp#quick-start