The schematic of the GemStereo is very similar to that of the BelaMini rev C.
Powering from 3.2V may be possible but it will possibly cause some noise issues, as the internal regulators will not be working properly and you'll have to make sure the incoming voltage is well regulated - and that may not even be good enough. Can you not provide something like 3.7V?
That shield seems to be using the 16 digital I/Os. Those are directly connected to the PB2, so you wouldn't care much about what's on the Gem, but only about what pins to use. The below should give you all you need:

Pinout of digital pins is the same for Stereo and Multi. Note that D5, D6 and D8 don't have the "D" (for lack of space).