rsc3/doc-schelp/HelpSource/Guides/Multichannel-Expansion.scrbl

337 lines
10 KiB
Text
Raw Normal View History

2022-08-24 13:53:18 +00:00
#lang scribble/manual
@(require (for-label racket))
@title{Multichannel Expansion}
Explaining multichannel expansion and representation@section{categories}
Server>Nodes, UGens>Multichannel
@section{section}
Multiple channels as Arrays
Multiple channels of audio are represented as link::Classes/Array::s.
@racketblock[
s.boot;
// one channel
{ Blip.ar(800,4,0.1) }.play;
// two channels
{ [ Blip.ar(800,4,0.1), WhiteNoise.ar(0.1) ] }.play;
::
Each channel of output will go out a different speaker, so your limit here is two for a stereo output. If you have a supported multi channel audio interface or card then you can output as many channels as the card supports.
All link::Classes/UGen::s have only a single output. This uniformity facilitates the use of array operations to perform manipulation of multi channel structures.
In order to implement multichannel output, UGens create a separate UGen known as an link::Classes/OutputProxy:: for each output. An OutputProxy is just a place holder for the output of a multichannel UGen. OutputProxies are created internally, you never need to create them yourself, but it is good to be aware that they exist so you'll know what they are when you run across them.
]
@racketblock[
// look at the outputs of Pan2:
Pan2.ar(PinkNoise.ar(0.1), FSinOsc.kr(3)).dump;
play({ Pan2.ar(PinkNoise.ar(0.1), FSinOsc.kr(1)); });
::
]
@section{section}
Multichannel expansion
When an link::Classes/Array:: is given as an input to a unit generator it causes an array of multiple copies of that unit generator to be made, each with a different value from the input array. This is called multichannel expansion. All but a few special unit generators perform multichannel expansion. Only Arrays are expanded, no other type of Collection, not even subclasses of Array.
@racketblock[
{ Blip.ar(500,8,0.1) }.play // one channel
// the array in the freq input causes an Array of 2 Blips to be created :
{ Blip.ar([499,600],8,0.1) }.play // two channels
Blip.ar(500,8,0.1).postln // one unit generator created.
Blip.ar([500,601],8,0.1).postln // two unit generators created.
::
Multichannel expansion will propagate through the expression graph. When a unit generator constructor is called with an array of inputs, it returns an array of instances. If that array is the input to another constructor, then another array is created, and so on.
]
@racketblock[
{ RLPF.ar(Saw.ar([100,250],0.05), XLine.kr(8000,400,5), 0.05) }.play;
// the [100,250] array of frequency inputs to Saw causes Saw.ar to return
// an array of two Saws, that array causes RLPF.ar to create two RLPFs.
// Both RLPFs share a single instance of XLine.
::
When a constructor is parameterized by two or more arrays, then the number of channels created is equal to the longest array, with parameters being pulled from each array in parallel. The shorter arrays will wrap.
for example, the following:
]
@racketblock[
Pulse.ar([400, 500, 600],[0.5, 0.1], 0.2)
::
is equivalent to:
]
@racketblock[
[ Pulse.ar(400,0.5,0.2), Pulse.ar(500,0.1,0.2), Pulse.ar(600,0.5,0.2) ]
::
A more complex example based on the Saw example above is given below. In this example, the link::Classes/XLine:: is expanded to two instances, one going from 8000 Hz to 400 Hz and the other going in the opposite direction from 500 Hz to 7000 Hz.
These two XLines are 'married' to the two Saw oscillators and used to parameterize two copies of link::Classes/RLPF::. So on the left channel a 100 Hz Saw is filtered from 8000 Hz to 400 Hz and on the right channel a 250 Hz Saw is filtered from 500 Hz to 7000 Hz.
]
@racketblock[
{ RLPF.ar(Saw.ar([100,250],0.05), XLine.kr([8000,500],[400,7000],5), 0.05) }.play;
::
]
@section{subsection}
Expanding methods and operators
Many operators and methods also multichannel expand. For example all common math operators:
@racketblock[
{ Saw.ar([100,250]) * [0.5,0.8] }.play;
{ Saw.ar(LFNoise1.kr(1).range(0,100) + [100,250]) }.play;
::
Also the various UGen convenience functions like ]
@racketblock[.clip2::, ]
@racketblock[.lag:: and ]
@racketblock[.range:: :
]
@racketblock[
{ Saw.ar(LFNoise1.kr(1).range(100,[200,300])) }.play;
{ Saw.ar(LFPulse.kr(1).range(100,[200,300]).lag([0.1,0.2])) }.play;
::
The expansion is handled by wrapper-methods defined in link::Classes/SequenceableCollection::.
You can use link::Classes/Object#-multiChannelPerform:: to do multichannel expansion with any method on any kind of object:
]
@racketblock[
["foo","bar"].multiChannelPerform(\toUpper);
::
The shorter arrays wrap:
]
@racketblock[
["foo","bar","zoo"].multiChannelPerform('++', ["l","ba"])
::
]
@section{subsection}
Using flop for multichannel expansion
The method flop swaps columns and rows, allowing to derive series of argument sets:
@racketblock[
(
SynthDef("help_multichannel", { |out=0, freq=440, mod=0.1, modrange=20|
Out.ar(out,
SinOsc.ar(
LFPar.kr(mod, 0, modrange) + freq
) * EnvGate(0.1)
)
}).send(s);
)
::
]
@racketblock[
(
var freq, mod, modrange;
freq = Array.exprand(8, 400, 5000);
mod = Array.exprand(8, 0.1, 2);
modrange = Array.rand(8, 0.1, 40);
fork {
[\freq, freq, \mod, mod, \modrange, modrange].flop.do { |args|
args.postln;
Synth("help_multichannel", args);
0.3.wait;
}
};
)
::
Similarly, link::Classes/Function#flop#Function:flop:: returns an unevaluated function that will expand to its arguments when evaluated:
]
@racketblock[
(
SynthDef("blip", { |freq| Out.ar(0, Line.ar(0.1, 0, 0.05, 1, 0, 2)
* Pulse.ar(freq * [1, 1.02])) }).send(s);
a = { |dur=1, x=1, n=10, freq=400|
fork { n.do {
if(x.coin) { Synth("blip", [\freq, freq]) };
(dur / n).wait;
} }
}.flop;
)
a.value(5, [0.3, 0.3, 0.2], [12, 32, 64], [1000, 710, 700]);
::
]
@section{section}
Pitfalls
Some UGens create stereo output from mono input, and might not behave as expected regarding multichannel expansion.
For example, link::Classes/Pan2:: :
@racketblock[
{ Pan2.ar(SinOsc.ar([500,600]),[-0.5,0.5]) }.play;
::
The expectation here might be that the two sines would get individual pan positions. And they do, but Pan2 expands into two stereo ugens nested in an outer array, resulting in a total of four output channels. ]
@racketblock[play:: will add an link::Classes/Out:: UGen for each of them, resulting in both Pan2's writing to the same output bus:
]
@racketblock[
Pan2.ar(SinOsc.ar([500,600]),[-0.5,0.5])
// prints:
// [ [ an OutputProxy, an OutputProxy ], [ an OutputProxy, an OutputProxy ] ]
::
In this case, the solution is simply to sum the nested four channels into a single stereo-channel:
]
@racketblock[
{ Pan2.ar(SinOsc.ar([500,600]),[-0.5,0.5]).sum }.play;
::
If we take a look at the resulting UGen graph of the code above, we can see that it is correct. The two Pan2 is mixed together to create a single stereo output:
]
@racketblock[
{ Pan2.ar(SinOsc.ar([500,600]),[-0.5,0.5]).sum }.asSynthDef.dumpUGens
// prints:
// [ 0_Control, scalar, nil ]
// [ 1_SinOsc, audio, [ 500, 0 ] ]
// [ 2_Pan2, audio, [ 1_SinOsc, -0.5, 1 ] ]
// [ 3_SinOsc, audio, [ 600, 0 ] ]
// [ 4_Pan2, audio, [ 3_SinOsc, 0.5, 1 ] ]
// [ 5_+, audio, [ 2_Pan2[0], 4_Pan2[0] ] ]
// [ 6_+, audio, [ 2_Pan2[1], 4_Pan2[1] ] ]
// [ 7_Out, audio, [ 0_Control[0], 5_+, 6_+ ] ]
::
]
@section{section}
Protecting arrays against expansion
Some unit generators such as link::Classes/Klank:: require arrays of values as inputs. Since all arrays are expanded, you need to protect some arrays by a link::Classes/Ref:: object.
A Ref instance is an object with a single slot named 'value' that serves as a holder of an object.
@racketblock[Ref.new(object):: is one way to create a Ref, but there is a syntactic shortcut. The backquote ]
@racketblock[`:: is a unary operator that is equivalent to calling ]
@racketblock[Ref.new(something)::. So to protect arrays that are inputs to a Klank or similar UGens you write:
]
@racketblock[
Klank.ar(`[[400,500,600],[1,2,1]], z)
::
You can still create multiple Klanks by giving it an array of Ref'ed arrays.
]
@racketblock[
Klank.ar([ `[[400,500,600],[1,2,1]], `[[700,800,900],[1,2,1]] ], z)
::
is equivalent to:
]
@racketblock[
[ Klank.ar(`[[400,500,600],[1,2,1]], z), Klank.ar(`[[700,800,900],[1,2,1]], z)]
::
Also the Refs multichannelExpand when passed to a Klank:
]
@racketblock[
Klank.ar(`[[[400,500,600], [700,800,900]],[1,2,1]], z)
::
, which is is equivalent to:
]
@racketblock[
[ Klank.ar(`[[400,500,600],[1,2,1]], z), Klank.ar(`[[700,800,900],[1,2,1]], z)]
::
]
@section{section}
Reducing channel expansion with Mix
The link::Classes/Mix:: object provides the means for reducing multichannel arrays to a single channel.
@racketblock[
Mix.new([a, b, c]) // array of channels
::
or
]
@racketblock[
[a, b, c].sum
::
is equivalent to:
]
@racketblock[
a + b + c // mixed to one
::
Mix is more efficient than using + since it can perform multiple additions at a time. But the main advantage is that it can deal with situations where the number of channels is arbitrary or determined at runtime.
]
@racketblock[
// three channels of Pulse are mixed to one channel
{ Mix.new( Pulse.ar([400, 501, 600], [0.5, 0.1], 0.1) ) }.play
::
Multi channel expansion works differently for Mix. Mix takes one input which is an array (one not protected by a Ref). That array does not cause copies of Mix to be made.
All elements of the array are mixed together in a single Mix object. On the other hand if the array contains one or more arrays then multi channel expansion is performed one level down. This allows you to mix an array of stereo (two element) arrays resulting in one two channel array. For example:
]
@racketblock[
Mix.new( [ [a, b], [c, d], [e, f] ] ) // input is an array of stereo pairs
::
is equivalent to:
]
@racketblock[
// mixed to a single stereo pair
[ Mix.new( [a, c, e] ), Mix.new( [b, d, f] ) ]
::
Currently it is not recursive. You cannot use Mix on arrays of arrays of arrays.
Here's a final example illustrating multi channel expansion and Mix. By changing the variable 'n' you can change the number of voices in the patch. How many voices can your machine handle?
]
@racketblock[
(
{
var n;
n = 8; // number of 'voices'
Mix.new( // mix all stereo pairs down.
Pan2.ar( // pan the voice to a stereo position
CombL.ar( // a comb filter used as a string resonator
Dust.ar( // random impulses as an excitation function
// an array to cause expansion of Dust to n channels
// 1 means one impulse per second on average
Array.fill(n, 1),
0.3 // amplitude
),
0.01, // max delay time in seconds
// array of different random lengths for each 'string'
Array.fill(n, {0.004.rand+0.0003}),
4 // decay time in seconds
),
Array.fill(n,{1.0.rand2}) // give each voice a different pan position
)
)
}.play;
)
::
]