Miditrol - Send BT Midi with Video Game Controller

Poppadocrock

I wish I had more then one PS4 controller.. I think it’s really cool that you can have up to 4 Bluetooth controllers in use. Do PS3 controllers now work too? Or no? I haven’t tried this app yet but it’s definitely one I’m interested in.

luiscript

Hey, thanks.... I got excited about this too, yep it works with multiple controllers even if you have a combination of xbox and playstation controllers...

My personal favorite is the ps4 controller for its touchpad, the touchpad gives you 8 more analog controls than the xbox controller + the motion sensor and the RGB led.

PS3 controllers are not compatible, you can try first connect your controller with iOS, if it works (I think it won't) then it should work with Miditrol.

Poppadocrock

@luiscript Thanks for the info.

Whoa.. that’s really cool. So the touch pad is midi mappable as well, for some reason that didn’t even cross my mind. How does that work? Could it play like a midi cc x/y pad? That would be wild with Rozeta x/y or something similar... Or is it more like a regular midi cc toggle/single parameter control?

luiscript

Yes, the touchpad is midi mappable and the motion sensor too.

The touchpad will give you 4 cc values (per finger), -x, x, -y, and y. With two fingers that's 8 cc analog values. I didn't know that the ps4 controller accepts 2 fingers at the same time until I coded the app. That's why is my favorite controller to play with.

Poppadocrock

@luiscript said:
Yes, the touchpad is midi mappable and the motion sensor too.

The touchpad will give you 4 cc values (per finger), -x, x, -y, and y. With two fingers that's 8 cc analog values. I didn't know that the ps4 controller accepts 2 fingers at the same time until I coded the app. That's why is my favorite controller to play with.

I had no idea it excepted two finger touch either, that’s an amazing feature. Thanks so much for the info.

sigma79

Asked before how to sync audio/video. Obviously you would need to splice but could Miditrol with a ps4 controller trigger an app like this?

https://forum.audiob.us/discussion/17191/midi-camera-out-now

sigma79

Apple has problems even pairing their own devices. I guess Id need to go back to the 1900s. Press play on both device then climb up the wall and mount iphone ( just for stuff to be in sync ) naturally.

Unless Im being stupid?

Thats exactly whats happening. I can actually reach the ceiling plus ipad on stand. There were no need to even theorize any of this.

sigma79

lol

luiscript

@sigma79 said:
Asked before how to sync audio/video. Obviously you would need to splice but could Miditrol with a ps4 controller trigger an app like this?

https://forum.audiob.us/discussion/17191/midi-camera-out-now

If the app supports MIDI or OSC input, Miditrol can send messages to control it. But I don't know if it can record video or take a photo while is running on the background, because Miditrol can't get controller messages while the app is on the background due to an iOS restriction, so please be aware of that.

sigma79

@luiscript said:

@sigma79 said:
Asked before how to sync audio/video. Obviously you would need to splice but could Miditrol with a ps4 controller trigger an app like this?

https://forum.audiob.us/discussion/17191/midi-camera-out-now

If the app supports MIDI or OSC input, Miditrol can send messages to control it. But I don't know if it can record video or take a photo while is running on the background, because Miditrol can't get controller messages while the app is on the background due to an iOS restriction, so please be aware of that.

Its ok luiscript. Were just an idea. Thanks mate

Poppadocrock

@luiscript said:

@sigma79 said:
Asked before how to sync audio/video. Obviously you would need to splice but could Miditrol with a ps4 controller trigger an app like this?

https://forum.audiob.us/discussion/17191/midi-camera-out-now

If the app supports MIDI or OSC input, Miditrol can send messages to control it. But I don't know if it can record video or take a photo while is running on the background, because Miditrol can't get controller messages while the app is on the background due to an iOS restriction, so please be aware of that.

I feel like there has to be some kind of workaround, for this app to work in the background. I’m sure you know way better then me. I know very very little when it comes to coding, But there are plenty of apps that send midi out and work in the background, in standalone... what makes this app different, that won’t allow it to do so? something with the Bluetooth controller connectivity?

any chance it could get the AUv3 treatment, that should theoretically solve the issue, right?

luiscript

@Poppadocrock said:

I feel like there has to be some kind of workaround, for this app to work in the background. I’m sure you know way better then me. I know very very little when it comes to coding, But there are plenty of apps that send midi out and work in the background, in standalone... what makes this app different, that won’t allow it to do so? something with the Bluetooth controller connectivity?

any chance it could get the AUv3 treatment, that should theoretically solve the issue, right?

There's no problem to send MIDI (or OSC) on the background, the problem is that you can't get the game controller events on the background, Apple engineers confirmed to me that there's no way to do that for security reasons.

If an Audio Unit can read the game controller events and send midi to the host app, that could be the solution. I'm working on it.

Poppadocrock

@luiscript said:

@Poppadocrock said:

I feel like there has to be some kind of workaround, for this app to work in the background. I’m sure you know way better then me. I know very very little when it comes to coding, But there are plenty of apps that send midi out and work in the background, in standalone... what makes this app different, that won’t allow it to do so? something with the Bluetooth controller connectivity?

any chance it could get the AUv3 treatment, that should theoretically solve the issue, right?

There's no problem to send MIDI (or OSC) on the background, the problem is that you can't get the game controller events on the background, Apple engineers confirmed to me that there's no way to do that for security reasons.

If an Audio Unit can read the game controller events and send midi to the host app, that could be the solution. I'm working on it.

Ahh, gotcha. I see now. Thanks for the info.

Unfortunately I don’t know. I know AUM can pick up all kinds of Bluetooth controllers, not sure about game controllers though. There are also a few apps/ways to pick up Bluetooth or usb QWERTY keyboards to send midi, but again I don’t know about game controllers. You’re kind of blazing a new trail here, one I don’t know much about, but am excited to see what happens. I mean, you could always start a thread about it, I bet some of the developers who are involved in this forum would be able to help. They will at least be able to provide you with a much better answer then I can. Nonetheless I think this app is exciting, and I wish you all the best. Cheers!

handed

Any idea if this also works with “wired” controllers like the Backbone One?

handed

Or is there a similar app with Audio Unit support? Lots of potential for an app like this.

luiscript

@handed said:
Any idea if this also works with “wired” controllers like the Backbone One?

I have not tried any compatible wired controller, I don't think it will work. Only Xbox, Play Station and MFI gaming controllers. But reading the backbone FAQ's, it seems like when you plugin your controller it acts as a standard game controller, probably it works, if you want to test it, I can give you access to TestFlight before you buy the app, please DM me if you want to test.

@handed said:
Or is there a similar app with Audio Unit support? Lots of potential for an app like this.

I'm currently trying to build an AUV3 for this app, I hope I can make it work soon.

Toastedghost

@luiscript said:
Hello everyone,

I'm the developer of MIDITROL… First, I have to say thank you to @Poppadocrock to share the app in this forum and to everyone else that shares their unconformity about it. I know that this is not the right time to discuss this, but I just discovered this thread, I hope that this don't annoy anyone.

MIDITROL is only compatible with this controllers:

• Xbox Wireless Controller with Bluetooth (Model 1708)
• PlayStation DUALSHOCK®4 Wireless Controller
• MFi (Made for iOS) Bluetooth controllers, like the SteelSeries Nimbus, Horipad Ultimate, and more may be supported.

If iOS does not support your controller, MIDITROL will not work and I can't do nothing about it. You can read more directly at apple

One thing that boders me is that the Apple game controller framework does not work while the app is running on the background, I personally contacted Apple with this issue and unfortunately, a solution for that will never happen because of security issues. Probably that's why some of you can't MIDI map the controls with other apps because you need to have MIDITROL open to make the mapping, I know that it makes difficult the mapping but it's totally posible, I did it before with multiple iOS apps.

I use the app mainly with MacOS and Windows software, I recommend to use it with your phone connected with usb cable to get the lowest latency possible, which I think it's pretty impressive. But you can use it with WiFi too. You can not connect it with midi bluetooth, because your connection is already used for your gamepad. I will post a tutorial in case that you don't know how to do that. But I believe you do, audio people knows how to do a lot of stuff.

I would like to clarify that I was looking for beta testers before the launch of the app, not after. I will never put out something that doesn't work and of course I don't treat my users as beta testers by default, specially with a paid app.

To @TheVimFuego I'm sorry that you spend time in something that it does not work for you, if you have some ideas in how to improve the UI or anything else, and you're willing to give it another try, ping me and I will give a code to download it for free. Just please rate it with 1 star with your suggestions and I will try my best to make it useful to you. Promise.

The mention of @Toastedghost is totally right, I will change my layout and colors in order to be more readable, sorry about that. Maybe for now you can use it in light mode, the colors change and probably it's a little bit better.

I did not understand the problem of charging more that it says but that's totally wrong of course I can not charge more that it says, it has no in app purchases or something like that. The app costs and does what it says nothing less nothing more.

I'm working in a new version that will allow you to change the midi channel for each parameter, for now you just can change the channel in the settings. One more thing to notice is that with the "select" and "start" buttons you can navigate the different CC and Note values so you can access almost all the 127 values, there's a tiny indicator at the top, showing you where you're at the "piano roll".

I know that the app price could be a bit high, but this is a niche app and I probably won't sell much copies of it. But I will consider to lower the price.

And last but not least what @zilld2017 mention is partially right, since Max/Msp just works with wired controllers, the game controller framework from Apple was introduced in 2019. The only solution to connect your wireless gamepad involves a piece of hardware just to get the HID signals into your computer and you will need another piece of software in order to convert your HID values to MIDI or OSC. That piece of hardware is more expensive than my app.

Please keep safe in this difficult moments and let me know if you have any other questions.

Could it work if opened as slidable window in AUM?

Toastedghost

OK. I am a sucker for Midi Controllers as anyone who knows mw knows and so I had to bite the bullet. I can confirm that Miditrol works on an ipad Air 3rd gen 14.06 IOS.
It can not work in the background and the work around is to make it into a slide able window in AUM. Sure it does occupy a 4th of the screen which means a bit of creative window manipulation, but it works!
Just tried it with Spacecraft and it moves so many parameters amazing.
Use bluetooth to find the controller, mine is an Xbox One 1708, and pair the controller as you would the Xbox.

jebni

My workaround for that playing in the background is to use it on my phone and then Bluetooth MIDI my phone and iPad together. It introduces another point of failure for live situations, if that’s your scenario, though.

Toastedghost

Why is Miditrol or the device I am using Xbox One not appear as a listing in bluetooth controls in either AUM or Audiobus?
All my other bluetooth devices show. I can map some apps inside AUM so I do know it is working it just becomes more complicated with!org and other instruments.

NeuM

What a fun idea!

Toastedghost

@NeuM said:
What a fun idea!

Yes its fun, but its “funstrating”, a word I just made up to describe the mixture of fun and frustrating.

NeuM

@Toastedghost said:

@NeuM said:
What a fun idea!

Yes its fun, but its “funstrating”, a word I just made up to describe the mixture of fun and frustrating.

Haha. Well, bugs are all part of the fun, right?

espiegel123

@Toastedghost said:
Why is Miditrol or the device I am using Xbox One not appear as a listing in bluetooth controls in either AUM or Audiobus?
All my other bluetooth devices show. I can map some apps inside AUM so I do know it is working it just becomes more complicated with!org and other instruments.

Have you contacted the developer?
I think the core issues are related to it not exposing its virtual midi out port to other apps and its not having (per your report) a configuration option to choose the midi destination).

Toastedghost

@espiegel123 said:

@Toastedghost said:
Why is Miditrol or the device I am using Xbox One not appear as a listing in bluetooth controls in either AUM or Audiobus?
All my other bluetooth devices show. I can map some apps inside AUM so I do know it is working it just becomes more complicated with!org and other instruments.

Have you contacted the developer?
I think the core issues are related to it not exposing its virtual midi out port to other apps and its not having (per your report) a configuration option to choose the midi destination).

@luiscript the dev said and I quote

There's no problem to send MIDI (or OSC) on the background, the problem is that you can't get the game controller events on the background, Apple engineers confirmed to me that there's no way to do that for security reasons.

If an Audio Unit can read the game controller events and send midi to the host app, that could be the solution. I'm working on it.

espiegel123

@Toastedghost said:

@espiegel123 said:

@Toastedghost said:
Why is Miditrol or the device I am using Xbox One not appear as a listing in bluetooth controls in either AUM or Audiobus?
All my other bluetooth devices show. I can map some apps inside AUM so I do know it is working it just becomes more complicated with!org and other instruments.

Have you contacted the developer?
I think the core issues are related to it not exposing its virtual midi out port to other apps and its not having (per your report) a configuration option to choose the midi destination).

@luiscript the dev said and I quote

There's no problem to send MIDI (or OSC) on the background, the problem is that you can't get the game controller events on the background, Apple engineers confirmed to me that there's no way to do that for security reasons.

If an Audio Unit can read the game controller events and send midi to the host app, that could be the solution. I'm working on it.

I see. Interesting.

luiscript

@Toastedghost said:
Why is Miditrol or the device I am using Xbox One not appear as a listing in bluetooth controls in either AUM or Audiobus?
All my other bluetooth devices show. I can map some apps inside AUM so I do know it is working it just becomes more complicated with!org and other instruments.

Hi, my implementation of MIDI virtual output stopped working since Apple introduced support for MIDI protocol 2.0, it works fine for sending MIDI messages out but it's not listed as a MIDI virtual output in other apps.

I will release a small update to fix this issue. For now, I will recommend to change the global MIDI channel to point to the device/app input that you need. Thanks for your patience.

Toastedghost

@luiscript said:

@Toastedghost said:
Why is Miditrol or the device I am using Xbox One not appear as a listing in bluetooth controls in either AUM or Audiobus?
All my other bluetooth devices show. I can map some apps inside AUM so I do know it is working it just becomes more complicated with!org and other instruments.

Hi, my implementation of MIDI virtual output stopped working since Apple introduced support for MIDI protocol 2.0, it works fine for sending MIDI messages out but it's not listed as a MIDI virtual output in other apps.

I will release a small update to fix this issue. For now, I will recommend to change the global MIDI channel to point to the device/app input that you need. Thanks for your patience.

That makes more sense now, thanks.

Foleslaw

Can this be routed now to send midi to auv3s in AUM?

iamspoon

@Foleslaw said:
Can this be routed now to send midi to auv3s in AUM?

I’d like to know this too.
Is there another App that has similar functionality?
I recall reading about it but I can’t find the topic via search.