Installing nn~ external for RAVE models

renatrigiorese

Hi,

I trained a generative model using RAVE: https://github.com/acids-ircam/RAVE. I want to run it on BELA using the pure data external object 'nn~'. Currently, only Raspberry Pi instructions* are available. Has an anybody installed this object succesfully on BELA?

*https://raw.githubusercontent.com/acids-ircam/nn_tilde/master/install/raspberrypi.sh

giuliomoro

renatrigiorese *https://raw.githubusercontent.com/acids-ircam/nn_tilde/master/install/raspberrypi.sh

Well in principle only this was needed:

use this image https://github.com/BelaPlatform/bela-image-builder/releases/tag/v0.5.0alpha2
connect your board to the internet https://learn.bela.io/using-bela/bela-techniques/connecting-to-wifi/
change all the instances of /usr/local/lib/pd-externals/ for /root/Bela/projects/pd-externals/
remove all the silly > /dev/null 2>&1, as they prevent you from seeing the errors

However, installing torch fails as there is no build available for armv7, so I tried to install it from the Bullseye repos with apt-get:

apt-get install libtorch-dev python3-torch libprotobuf-dev

and that worked (though it installed 500MB of software ...).

Then the configuration stage would fail because it can't find the silly path /usr/lib/lib/libc10.so.1.7.0:

CMake Error at /usr/lib/arm-linux-gnueabihf/cmake/Caffe2/Caffe2Targets.cmake:116 (message):
  The imported target "c10" references the file

     "/usr/lib/lib/libc10.so.1.7.0"

  but this file does not exist.  Possible reasons include:

  * The file was deleted, renamed, or moved to another location.

  * An install or uninstall procedure did not complete successfully.

  * The installation package was faulty and contained

     "/usr/lib/arm-linux-gnueabihf/cmake/Caffe2/Caffe2Targets.cmake"

  but not all the files it references.

Call Stack (most recent call first):
  /usr/lib/arm-linux-gnueabihf/cmake/Caffe2/Caffe2Config.cmake:116 (include)
  /usr/lib/arm-linux-gnueabihf/cmake/Torch/TorchConfig.cmake:40 (find_package)
  backend/CMakeLists.txt:4 (find_package)

This seems to fix it, but don't ask me why it is needed:

ln -s /usr/lib/arm-linux-gnueabihf/ /usr/lib/lib

Anyhow, now that it's more-or-less properly configured it fails when building:

[ 20%] Building CXX object backend/CMakeFiles/backend.dir/backend.cpp.o
/root/nn_tilde/src/backend/backend.cpp: In member function ‘void Backend::perform(std::vector<float*>, std::vector<float*>, int, std::string, int)’:
/root/nn_tilde/src/backend/backend.cpp:22:8: error: ‘InferenceMode’ is not a member of ‘c10’
   22 |   c10::InferenceMode guard;
      |        ^~~~~~~~~~~~~

As c10 seems to come with pytorch, this may mean that we are building against an incompatible version of pytorch? Then maybe you should find the appropriate version of pytorch and build it from source.

I'll stop the debugging here, feel free to go on, but ultimately I am not sure how much performance you can get out of this when running on Bela, given how you won't be able to use the GPU for pytorch and it'll have to run on the CPU... So I am not sure this is worth anyone's time.

IF you are not so focused on [nn~] but more generically DL for Bela, check out https://github.com/rodrigodzf/DeepLearningForBela