emerson
Incidentally, this sort of variability between makefiles is exactly what makes it hard to write a comprehensive, one-size-fits-all Pd externals compiling guide: you will often have to rely in manual inspection to accommodate for these sort of differences

2 months later

I followed their instructions:

You need build-essentials, header files for puredata, libjson-c, libcurl4, liboauth. If you have Debian or a derivative (e.g. Ubuntu, Linux Mint), you can install the build utils and needed headers with apt-get install build-essential puredata-dev libjson-c-dev libcurl4-openssl-dev liboauth-dev. If you are not root, prefix the command with sudo.

If the board is connected to the internet, this is straightforward. Just run apt-get install build-essential libjson-c-dev libcurl4-openssl-dev liboauth-dev (note that I removed puredata-dev as we already have libpd on the board). If it is not, I just put together this script the other day that will do just that (tested on Mac, should work on Linux, possibly on Windows): https://github.com/giuliomoro/bela-random/blob/master/cross-apt-get-install.sh . Using this script, I run

./cross-apt-get-install.sh libjson-c-dev libcurl4-openssl-dev liboauth-dev

make sure this is successful.

Back to their instructions:

Drop the sources in a directory and run make. You will get files with a suffix of pd_linux for each object (json-decode.pd_linux, json-encode.pd_linux, rest.pd_linux, oauth.pd_linux). These are needed to use the library.

So I clone the repo on the host:

git clone --recursive https://github.com/residuum/PuRestJson

(I need the --recursive because it has some subrepo) and then I copy this across to the board:

scp -r PuRestJson root@192.168.7.2

Then I go back on the board and, as instructed, I run make:

ssh root@192.168.7.2 

(Note that all the commands after this will be run on the board.)

cd PuRestJson
make

in less than one minute, I obtain a message : target all in lib purest_json completed. This gives me hope. Then I run ls and I see that the .pd_linux files have indeed been generated. Seems like success!

Testing:
I have no idea what these files are supposed to do, so I just make sure they get loaded.

First: copy somewhere where they can be found. According to the Bela wiki I can just copy these files to the ~/Bela/projects/pd-externals folder in order for al the projects to be able to discover them. So, first I create such folder:

mkdir -p ~/Bela/projects/pd-externals

and then I copy the files there:

cp ~/PuRestJson/*.pd_linux ~/Bela/projects/pd-externals

Last, I create a Pd patch on my computer which uses these externals, then create a new Pd project in the Bela IDE, and I drag the newly created patch on it. I run the project and... there are no errors on the console, which means everything went fine: the objects are correctly loaded! There are also some lines that show that they were indeed loaded correctly.

alt text

Now, whether they work or not, I have no idea. You shall find out. If they don't do things cleverly and they run non-realtime code in the audio thread (as it's commonplace in Pd) then bad news: you may have to rewrite part of them. But maybe they don't and everything is nice!

(It really takes 5 minutes to do all the above. It took me about 30 minutes writing it down, though).

  • cmm likes this.

Thanks so much for going through this. Without an internet connection on the board I was a bit stuck, so looks like a great solution. I've just tried to run your script from my mac but I get the error message: xargs: wget: No such file or directory. Have I missed something?

I guess you don't have wget installed. I rewrote it to use curl instead. Pull the updated version and try again.

  • cmm replied to this.

    That seemed to work, but then I received the following errors during the first process:

    dpkg-deb: error: '/tmp/pkgs//libcurl4-openssl-dev_7.52.1-5+deb9u4_armhf.deb' is not a debian format archive
    dpkg: error processing archive /tmp/pkgs//libcurl4-openssl-dev_7.52.1-5+deb9u4_armhf.deb (--install):
    subprocess dpkg-deb --control returned error exit status 2

    and then, a while later:

    dpkg: dependency problems prevent configuration of liboauth-dev:
    liboauth-dev depends on libcurl4-gnutls-dev | libcurl4-dev; however:
    Package libcurl4-gnutls-dev is not installed.
    Package libcurl4-dev is not installed.

    dpkg: error processing package liboauth-dev (--install):
    dependency problems - leaving unconfigured
    Processing triggers for libc-bin (2.24-11+deb9u3) ...
    Processing triggers for man-db (2.7.6.1-2) ...
    Errors were encountered while processing:
    /tmp/pkgs//libcurl4-openssl-dev_7.52.1-5+deb9u4_armhf.deb
    liboauth-dev

    I tried the next steps anyway just in case, no dice. Would it be worth trying to reinstall wget and going back to your original script?

      giuliomoro actually, is there any chance I could grab those compiled versions from you please? I feel like it'd be worthwhile trying this process with a clear head, but would really appreciate seeing if they work before I try other options for current project.

        Feel like I'm so close! I found that connecting Bela to the internet was much easier than I imagined, so I ran apt-get update just in case, and followed your instructions directly over ssh. Now when I try to make it, I get the following error:

        '''
        ls: cannot access '/m_pd.h': No such file or directory
        ++++ info: using Makefile.pdlibbuilder version 0.5.0
        pd-lib-builder/Makefile.pdlibbuilder:744: Where is Pd API m_pd.h? Do 'make help' for info.
        ++++ info: making target all in lib purest_json
        ++++ info: making src/json-encode.o in lib purest_json
        cc -DPD -I "" -DUNIX -fPIC -DVERSION='"1.4.2"' -I"src/uthash/src" -std=c99 -Wall -Wextra -Wshadow -Winline -Wstrict-aliasing -O3 -ffast-math -funroll-loops -fomit-frame-pointer -march=armv7-a -mfpu=vfpv3 -mfloat-abi=hard -o src/json-encode.o -c src/json-encode.c
        In file included from src/json-encode.c:31:0:
        src/json-encode.h:27:18: fatal error: m_pd.h: No such file or directory
        #include "m_pd.h"
        ^
        compilation terminated.
        pd-lib-builder/Makefile.pdlibbuilder:899: recipe for target 'src/json-encode.o' failed
        make: *** [src/json-encode.o] Error 1
        '''

        I can see m_pd.h referenced further up this thread but not sure where to go from here - ran the help, tried adding same PD_INCLUDE lines as emerson.

          cmm could grab those compiled versions from you please? I

          that wouldn't work: you need the dependencies to be installed for those to work.

          cmm dpkg-deb: error: '/tmp/pkgs//libcurl4-openssl-dev_7.52.1-5+deb9u4_armhf.deb' is not a debian format archive

          So what happened here is that the download failed because the URL of the package is obsolete (and the board - who we trust to provide the URLs) does not know about it because it's not connected to the internet. wget would have not helped.

          cmm I can see m_pd.h referenced further up this thread but not sure where to go from here - ran the help, tried adding same PD_INCLUDE lines as emerson.

          yes I am a bit confused as to why I did not have to do it earlier. On this other board I have now I have to do:

          make PDINCLUDEDIR=/usr/local/include/libpd/
          • cmm replied to this.
          • cmm likes this.

            giuliomoro thank you!! It's working now. This makes transferring presets between Max and Pd/Bela much easier (it's what we use to store the Kellycaster data). Will put the results online soon.

            5 months later

            Hi,

            I know, it's probably all in here but even after four days of trying I'm not able to run Pure Data patches on Bela that make use of externals, because I'm too new to all this.

            Is there someone who could write a step by step guide of how to get this working starting at a very basic level? With 'very' I mean something like: "first you have to create a directory on the board, the necessary command is: XX; then you have to copy the relevant folder into this directory: /XX/YY by using this command: ZZZ" and so on? That would be so helpful!

            I hope someone could help, I'm really lost. Thank you!

            Each external has its own method to be built. There are a lot or similarities, though, so the guidelines above should be applicable to mostly any external, but it's impossible to be more specific than that without knowing exactly which ones you need.

            What externals do you need to build?
            What operating system are you using?

            Hi giuliomoro,

            I need to build a couple of externals, the most important ones are cyclone and ggee and I'm on OS 10.13.6.

            Thank you!

            With Cyclone I've come so far:

            emerson Downloaded the PD fork and copied it into /root/pure-data
            then went back to Bela/projects/pd-externals/externals/cyclone and tried
            'make PDINCLUDEDIR=/root/pure-data/src/ PDLIBDIR=/root/Bela/projects/pd-externals install'

            Then I got these error messages:

            Makefile:305: pd-lib-builder/Makefile.pdlibbuilder: No such file or directory
            make: *** No rule to make target 'pd-lib-builder/Makefile.pdlibbuilder'. Stop.

            The attachment gives an idea what's in the directory ../cyclone.

            Do you know what's wrong? Thank you!

            alt text

            sorry I will hopefully have time tomorrow to try this out myself. It looks like you are missing the pd-lib-builder folder in there. Also, you can delete all of those .pd_darwin files. As per the documentation of the pd-lib-builder/Makefile.pdlibbuilder file, you will need to specify

            # PDINCLUDEDIR:
            # Directory where Pd API m_pd.h should be found, and other Pd header files.
            # Overrides the default search path.

            on the command line. That is the folder where the Pd header files live. On Bela, that is /usr/local/include/libpd/
            So, once you re-add the missing folder, you can re-run the make command (from within the cyclone folder, same as you did earlier, but with an extra command-line option):

            make PDINCLUDEDIR=/usr/local/include/libpd

            however, this may still fail if some files are missing.

            thank you for your help. I included all missing files, ran the "make" command from within the cyclone folder and received some error messages like this one:

            ++++ info: making shared/common/magicbit.o in lib cyclone
            cc -DPD -I "/usr/local/include/libpd" -DUNIX -fPIC -Ishared -DHAVE_STRUCT_TIMESPEC -Wall -Wextra -Wshadow -Winline -Wstrict-aliasing -O3 -ffast-math -funroll-loops -fomit-frame-pointer -march=armv7-a -mfpu=vfpv3 -mfloat-abi=hard -o shared/common/magicbit.o -c shared/common/magicbit.c
            shared/common/magicbit.c:6:22: fatal error: g_canvas.h: No such file or directory
            #include "g_canvas.h"
            ^
            compilation terminated.
            make: *** [shared/common/magicbit.o] Error 1
            pd-lib-builder/Makefile.pdlibbuilder:917: recipe for target 'shared/common/magicbit.o' failed

            Within the cyclone folder I also tried:

            make PDINCLUDEDIR=/root/pure-data/src/ PDLIBDIR=/root/Bela/projects/pd-externals install

            And received:

            root@bela ~/Bela/projects/pd-externals/cyclone# make PDINCLUDEDIR=/root/pure-data/src/ PDLIBDIR=/root/Bela/projects/pd-externals install
            ls:
            cannot access '/root/pure-data/src//m_pd.h'
            ++++ info: using Makefile.pdlibbuilder version 0.5.1
            ++++ info: making target install in lib cyclone
            ++++ info: installpath is '/root/Bela/projects/pd-externals/cyclone'
            : No such file or directory
            ++++ info: making shared/common/magicbit.o in lib cyclone
            cc -DPD -I "/root/pure-data/src/" -DUNIX -fPIC -Ishared -DHAVE_STRUCT_TIMESPEC -Wall -Wextra -Wshadow -Winline -Wstrict-aliasing -O3 -ffast-math -funroll-loops -fomit-frame-pointer -march=armv7-a -mfpu=vfpv3 -mfloat-abi=hard -o shared/common/magicbit.o -c shared/common/magicbit.c
            shared/common/magicbit.c:4:18: fatal error: m_pd.h: No such file or directory
            #include "m_pd.h"
            ^
            compilation terminated.
            make: *** [shared/common/magicbit.o] Error 1
            pd-lib-builder/Makefile.pdlibbuilder:917: recipe for target 'shared/common/magicbit.o' failed

            Do you have an idea what I could do next? It feels as if I am a bit closer now...

            Thank you!

              terbijn shared/common/magicbit.c:6:22: fatal error: g_canvas.h: No such file or directory
              #include "g_canvas.h"
              ^

              yes that's what I meant earlier. Get all the .h files from the src/ folder of this repo and copy them to your board in /usr/local/include/libpd/ then re-run the make commands.

              Excuse me but I couldn’t find that path on the board. Can you tell me where it is located or tell me which command I have to use to copy the files from my desktop there?

              Thank you!

              Now I found some time to do it (Friday night, 2am, of course).

              Preparation:
              - get extra header files needed to compile Cyclone (and ggee, and others) on Bela:
              - on your computer open a terminal and:

              git clone https://github.com/giuliomoro/pure-data &&\
              cd pure-data &&\
              scp src/*h root@192.168.7.2:/usr/local/include/libpd/ 

              - make sure that the pd-externals folder exists on Bela:

              ssh root@192.168.7.2 mkdir -p Bela/projects/pd-externals

              Now, the externals:

              Cyclone:

              • get Cyclone from Github. Go to the releases page. The latest release requires Pd 0.49, but Bela has Pd 0.48-2. So we get the v0.3, RC-1, which requires Pd 0.48-1. Here is the direct link to the source code.
              • Download the code on your computer and uncompress it by double clicking on it. This results into an pd-cyclone-cyclone0.3rc1. In my case, this is on my Desktop.
              • Open a terminal, navigate to the folder containing the pd-cyclone-cyclone0.3rc1 folder. In my case:
                cd ~/Desktop
              • copy the folder to the board:
                scp -r pd-cyclone-cyclone0.3rc1 root@192.168.7.2: 
              • go on the board and go into the cyclone folder we just copied:
                ssh root@192.168.7.2 
                cd pd-cyclone-cyclone0.3rc1/
              • compile Cyclone. The README says that Cyclone uses the pd-lib-builder building system. The provided documentation for pd-lib-builder says that you should invoke make by passing the path to the folder containing the Pd includes (in our case, the /usr/local/include/libpd path we copied the .h files to earlier on). This may take 10 minutes or so to run, and print some warnings, but all should be fine in the end:
                make PDINCLUDEDIR=/usr/local/include/libpd
              • once this is successful, you can install the externals. These go in the ~/Bela/projects/pd-externalsfolder we created earlier, and in order to tell pd-lib-builder about it is to set PDLIBDIR when calling make install:
                make PDLIBDIR=/root/Bela/projects/pd-externals install
              • now if you look into the destination folder you will see all the externals (with extension .pd_linux):
                 ls ~/Bela/projects/pd-externals/cyclone
              • great, test it: open the IDE, create a Pd project, upload a patch like this one:

              alt text

              It works!

              Ggee:

              • I struggled to locate the most up-to-date source code. On my computer, Deken shows that there is a v0.27 version, but I cannot find that online, so I go for the v0.26 available via Sourceforge through the Pd website: https://sourceforge.net/projects/pure-data/files/libraries/ggee/ggee-0.26.tar.gz/download
              • download that file, unzip it on your computer by clicking it. This results into a ggee-0.26 folder. In my case, this is on my Desktop.
              • Open a terminal, navigate to the folder containing the ggee-0.26 folder. In my case:
                cd ~/Desktop
              • copy the folder to the board:
                scp -r ggee-0.26 root@192.168.7.2: 
              • go on the board and go into the cyclone folder we just copied:
                ssh root@192.168.7.2 
                cd ggee-0.26
              • compile ggee. The README does not say much about compiling, so we inspect the Makefile and find that the path to the folder containing the Pd headers is given as the PD_INCLUDE variable.
                make PD_INCLUDE=/usr/local/include/libpd
              • however, the above command fails:
                root@bela:~/ggee-0.26# make PD_INCLUDE=/usr/local/include/libpd
                cc -DPD -I. -I"/usr/local/include/libpd"/pd -Wall -W -g -DVERSION='"0.26"' -fPIC -O6 -funroll-loops -fomit-frame-pointer -o "control/constant.o" -c "control/constant.c"
                control/constant.c:4:18: fatal error: m_pd.h: No such file or directory
                 #include <m_pd.h>
                                  ^
                compilation terminated.
                Makefile:165: recipe for target 'control/constant.o' failed
                make: *** [control/constant.o] Error 1
              • we inspect the error message and notice there that the path provided by -I in the compiler parameters is not, as we expected "/usr/local/include/libpd", but rather it is "/usr/local/include/libpd"/pd. Further inspecting the Makefile we find the line CFLAGS = -DPD -I. -I"$(PD_INCLUDE)"/pd -Wall -W -g, and that is the only place where the PD_INCLUDE variable is used. So instead of passing PD_INCLUDE=, we can pass all the options passed by CFLAGS=, replacing the -I parameter with the correct one. Additionally, we can add some optimization flags here:
                make CFLAGS="-DPD -I. -I"/usr/local/include/libpd" -Wall -W -g -DVERSION='"0.26"' -fPIC -O6 -funroll-loops -fomit-frame-pointer -march=armv7-a -mtune=cortex-a8 -mfloat-abi=hard -mfpu=neon -ftree-vectorize -ffast-math"
              • now install. Further exploring the Makefile we find that pkglibdir= tells make where to install the externals, so:
                make install pkglibdir=/root/Bela/projects/pd-externals
              • now if you look into the destination folder you will see all the externals (with extension .pd_linux):
                 ls ~/Bela/projects/pd-externals/ggee
              • great, test it: open the IDE, create a Pd project, upload a patch like this one:

              alt text

              It works!

              As you can see, there is no hard and fast rule for building externals, though many use pd-lib-builder and therefore will be installed the same way as cyclone. Some others have some different Makefiles, but it's often fairly straightforward to observe the error, inspect the Makefile and figure out what variable needs to be set.