AUv3 Video Synthesizer?

[Deleted User]

Are there any options to do video synthesis with AUv3? I was looking at the Eyesy and thinking how I really should be able to do all of that on my iPad. My usb-c dock already has HDMI even.

If not AUv3, are there any great options on iOS at all for producing realtime visuals?

Strizbiz

https://apps.apple.com/us/app/k-machine-audio-visual-engine/id1095617380
https://apps.apple.com/us/app/touchviz/id486139371

Not Auv3 but these 2 come to mind. I haven’t bought either fwiw, but thinking about buying Touchviz. I used to use Vjay but it’s stopped working and it looks like Touchviz does what VJay used to do.
Another cool little app is Rabbit Hole

https://apps.apple.com/us/app/music-visualizer-rabbit-hole/id444658337

I usefully just use the mic input and it reacts to sound or music in your iTunes library. It has a feature where you can record a video ( or you can just use the iPads built in screen capture) but I wish you could load song from AudioShare or the files app.

[Deleted User]

Nice! Maybe I can set up something using midi and touchviz. Gives me a good starting point to dig into. Thanks @Strizbiz!

Strizbiz

@quartzite said:
Nice! Maybe I can set up something using midi and touchviz. Gives me a good starting point to dig into. Thanks @Strizbiz!

Yw, would love to see what you come up with!

mojozart

The AUv3 memory budget may interfere with video capabilities.

There are several threads mentioning audio-reactive visualization apps, including:

• Generate
• GlitchClip
• Monovista
• Party Projector
• Staella
• Tagtool
• Takete
• TouchVIZ
• VFX
• Wizibel
• 100VJ

On desktop, I like the interactive shader format (ISF), which can be audio- and MIDI-reactive.

wim

+1

I kind of doubt there's enough memory available for an AUv3 to do any decent video generation. Plus, all computational tasks have to happen in extremely tight processing windows in an AUv3. That can be a challenge for just audio processing. Video + audio processing could be impractical.

[Deleted User]

@mojozart Thanks for the options

@wim Is it that all AUv3 tasks are performed in the same thread, or is it just the audio tasks? Maybe the video could be multithreaded, especially with iOS 14. Memory is the main limitation though, but I get the feeling I have some to spare on my newer iPad.

I can dream about the future where Drambo 7 included video synthesis.

wim

@quartzite said:
@mojozart Thanks for the options

@wim Is it that all AUv3 tasks are performed in the same thread, or is it just the audio tasks? Maybe the video could be multithreaded, especially with iOS 14. Memory is the main limitation though, but I get the feeling I have some to spare on my newer iPad.

I can dream about the future where Drambo 7 included video synthesis.

I'd be lying if I pretended to know the answers to those questions. Maybe some clever developer could find a way to pull the processing aspects of it off, but the memory limitations seem like they'd be insurmountable to me. That's an only minimally informed opinion, however.

I don't really see the advantage of it being AUv3. As long as it can receive the audio and act on it, I don't see what it being an AUv3 particularly brings to the table. Maybe a preview window in split view or slide over view would be helpful, I guess, but I don't see why it needs to be more than that.

Tamir_Raz_Mataz

@wim said:

@quartzite said:
@mojozart Thanks for the options

@wim Is it that all AUv3 tasks are performed in the same thread, or is it just the audio tasks? Maybe the video could be multithreaded, especially with iOS 14. Memory is the main limitation though, but I get the feeling I have some to spare on my newer iPad.

I can dream about the future where Drambo 7 included video synthesis.

I'd be lying if I pretended to know the answers to those questions. Maybe some clever developer could find a way to pull the processing aspects of it off, but the memory limitations seem like they'd be insurmountable to me. That's an only minimally informed opinion, however.

I don't really see the advantage of it being AUv3. As long as it can receive the audio and act on it, I don't see what it being an AUv3 particularly brings to the table. Maybe a preview window in split view or slide over view would be helpful, I guess, but I don't see why it needs to be more than that.

Perhaps to be able to run it inside an aquivalent to Aum for audio but for video type mixer and mix between different visual generators.

Anyone knows Touchdesigner iPad inspired App? It’s called Pixel Nodes

Toastedghost

@quartzite said:
Nice! Maybe I can set up something using midi and touchviz. Gives me a good starting point to dig into. Thanks @Strizbiz!

Touchviz is an amazing app unfortunately I find I can only trigger with 1 midi channel at a time either A or B. Video A is mixed with B using addative or subtractive modes or other filters. Usless someone les has a work around?