any Kinect camera user ..?

nay-seven · Unread post by **nay-seven** » 15 Nov 2010, 11:06

it's seems that 's this new device is yet hacked and an open source driver is ready, could be an interesting device for Usine too..?

http://www.youtube.com/watch?feature=pl ... o6Yhz21BJI

driver here :

http://git.marcansoft.com/?p=libfreenect.git

3D research :

http://idav.ucdavis.edu/~okreylos/ResDe ... index.html

multiphone · Unread post by **multiphone** » 15 Nov 2010, 12:00

Hello Nay,

Thanks for the link.

The "Kinect" is a real exiting proposition, for one time... by Microsoft.

It's certainly very interesting to connect this new capture system with Usine.

Another hard job to integrate and new causes of instability, so a job for an 3D specialist. Such a kind of person exists in the Usine community ?

23fx23 · Unread post by **23fx23** » 15 Nov 2010, 12:20

im gonna investigate, i work in 3d, but im not pgming, this seems a bit more hard than it seems, still very exciting.
will wait a bit for more infos and tests, then may buy it if worth..
this guy on second link turned into real time 3d tracker, it recreates a 3d scene and "camap" = reproj from camera the vid. trippy.

would be awesome if we could get those infos with usine.

multiphone · Unread post by **multiphone** » 15 Nov 2010, 12:31

You are the 3D guy ! Yes of course.

And I'm working in 3D sounds from many years

the application with Usine are realy promising and exiting.

But, for now i'm waiting i little for more info, if i'ts simple job, Senso is aware (I have a serious doubt), i imagine is time for integrate new things is not infinite. I prefer for the moment search the unexplored possibility of Usine.

nay-seven · Unread post by **nay-seven** » 19 Nov 2010, 22:37

some new links :
http://vimeo.com/16992651
http://www.youtube.com/watch?v=z1Wp0HEY ... r_embedded

23fx23 · Unread post by **23fx23** » 19 Nov 2010, 23:55

yeah that's comin . the midi exemple it cool

runagate · Unread post by **runagate** » 24 Nov 2010, 06:03

Hacked Kinect is now a 3D video capture tool
http://www.adafruit.com/blog/2010/11/14 ... ture-tool/

seeing it really lets one understand how well this M$ controller does its job. it seems the most promising thing for my particular futuristic interface wishlist in ages

23fx23 · Unread post by **23fx23** » 01 Dec 2010, 21:23

this one is the first musical use i saw with really low, playable lantency (if sound wasn't realigned with vid offline)

theremin kinekt

YouTube · Unread post by **senso** » 01 Dec 2010, 21:52

I bought a kinect that I'll receive soon, I'll let you know.

23fx23 · Unread post by **23fx23** » 01 Dec 2010, 22:01

great!! that can be awesome with usine!

YouTube · Unread post by **senso** » 02 Dec 2010, 19:53

I hope that the kinect will be implemented for Christmas: first test in Usine promising...

Clearscreen · Unread post by **Clearscreen** » 03 Dec 2010, 01:29

WOW! I think I have a use for this soon... Very cool!

damstraversaz · Unread post by **damstraversaz** » 09 Dec 2010, 12:09

Olivier,
What the main advantages of the kinect for usine ? I saw some video for gaming, and understand the use of the camera , but I'm note sure to understand the use for audio. for exemple, there is some video for using kinct with midi
kinect midi
youtube video
I don't saw the interest of a kinect , as usine have a video tracking module. So I'm surely miss something....
damien

nay-seven · Unread post by **nay-seven** » 09 Dec 2010, 12:27

i suppose the main difference could be the 3D approach , not a full 3D but a better proximity parameters recognition for example ..?
i know we can have something similar with the webcam , but maybe more easy and clean with the kinnect..?

Eskadrone · Unread post by **Eskadrone** » 15 Dec 2010, 02:59

http://openni.org/

nay-seven · Unread post by **nay-seven** » 15 Dec 2010, 13:33

an other project , air guitar..
http://www.chrisoshea.org/lab/air-guitar-prototype

iococoi · Unread post by **iococoi** » 20 Dec 2010, 08:32

hi guys..

just got this link through the animata-mailing list

http://vimeo.com/17978808

kinect to osc...

cheers,
io

nay-seven · Unread post by **nay-seven** » 20 Dec 2010, 09:09

thanks, good and fun démo ! really reactive

23fx23 · Unread post by **23fx23** » 20 Dec 2010, 17:02

impressive

CleverConQueso · Unread post by **CleverConQueso** » 19 May 2011, 21:55

I'm kicking around using Kinect to control a Burningman project. The idea is to have the participant create their natural music. They stand in a space and by moving their body, we detect their mood, collect some environmental data, and trigger drums and notes based upon a probability algorithm. Everyone gets their own song and can change it on their own by trial and error with the instrument.

I love Usine and have killed maybe two months of days trying this then trying that. I'm hoping that if Senso likes his Kinect, we get an input moodule for it.

Here's my early PoC's using a Kaoss Pad KP3 for input.

http://www.youtube.com/watch?v=QpzUuTEw7Ag
http://www.youtube.com/watch?v=Q73qovUSVEY

-CCQ-

nay-seven · Unread post by **nay-seven** » 19 May 2011, 22:10

Microsoft has promise an official driver since some months, so i suppose we maybe need to wait for it...?

CleverConQueso · Unread post by **CleverConQueso** » 20 May 2011, 19:43

I got ambitious and started clicking around. One of the links above to Vimeo shows a tool called OSCeleton.

The install is easy and works great - http://www.codeproject.com/Articles/148 ... -Open.aspx

You have to change the port to 8000 when you launch it.

OSC /user/1 provides body mass left, right and distance. I'm sure you can pull joints data but I haven't found that yet.

But in any case, holy crap!

BTW, Nay7, I totally ripped off your Usinome for the proof of concept videos above, adding probability, which I think is part of your secret sauce, too. So thanks for that. If we ever build this thing, You'll get a credit on the side of it.

-CCQ-

nay-seven · Unread post by **nay-seven** » 20 May 2011, 21:36

thanks , cleverconqueso, glad you like it ( i suppose we can improve it now with the poly function)

About kinect, I've yet see this link and was a little afraid to see all those parts to install, but maybe if i found time i will give a try

thanks

CleverConQueso · Unread post by **CleverConQueso** » 21 May 2011, 02:08

I've got joints movement now.

It's all in here.
- https://github.com/Sensebloom/OSCeleton

Set OSC_Receive to - /joint/l_hand/1
- joint = same in all cases
- l_hand = joint name, listed below
-1 = player number

X, Y, Z are in the data 1, 2, 3

From DOS, run -
OSCeleton.exe -p 8000 -q -f

-q = allows the /joint/n/# format for the OSC message which seems to make it easier on Usine
-p = port

I have it hooked up to the ball synth and the pool ball physical model. You can juggle to music. Amazing.

CleverConQueso · Unread post by **CleverConQueso** » 21 May 2011, 02:20

Sorry. Forgot these.
Joint_Name above is one of -

head
neck
torso
r_collar #not working yet
r_shoulder
r_elbow
r_wrist #not working yet
r_hand
r_finger #not working yet
l_collar #not working yet
l_shoulder
l_elbow
l_wrist #not working yet
l_hand
l_finger #not working yet
r_hip
r_knee
r_ankle
r_foot
l_hip
l_knee
l_ankle
l_foot

nay-seven · Unread post by **nay-seven** » 21 May 2011, 09:35

ok, thanks
I've quickly try ,
1_drivers ok
2_binaries...i've download OpenNI-OpenNI-8c24e16 ( is it the good one, not clear ) now how to install..?

i've found in platform/win32/bin/install/open ni a setup.exe but nothing happen on my vista machine and in seven32 i've an error message this software is maybe not correctly installed, try the good version...

so i'm stopped on stage 2.......

nay-seven · Unread post by **nay-seven** » 21 May 2011, 09:41

ok, found OpenNI-Win32-1.1.0.38-Dev.msi
maybe the good one
gone to try

nay-seven · Unread post by **nay-seven** » 21 May 2011, 13:28

ok, finally succeed to install but I've tried stable and unstable, change the xml files but no way,
I've tried sensor and open ni examples , but nothing happen

damstraversaz · Unread post by **damstraversaz** » 08 Jan 2012, 21:49

Hi
any news on the kinect add ?
best,
damien

gercha1 · Unread post by **gercha1** » 16 May 2012, 07:38

Hi,

here a video to present my first experimentations with Kinect Synapse and Usine

http://youtu.be/g3W53-h0LjE

I control differents sampler parameter such as pitch, volume, delay , reverb, reverse, panner...
just with the body, it's really fun
i can upload the patch if someone are interessed
but it still a work in progress

gercha

damstraversaz · Unread post by **damstraversaz** » 16 May 2012, 07:53

oh, nice !
I will be very interested by the patch.

Damien

multiphone · Unread post by **multiphone** » 16 May 2012, 09:40

Hello Damien,

Nice !

But I have two questions :

1°) Do synapse and Usine was on the same computer ?

Because your processor consumption is very low and seems to correspond only to the consumption of patch treatment.

2°) what version of Synapse did you use?

Best

Hervé.

multiphone · Unread post by **multiphone** » 16 May 2012, 09:54

Sorry my question was for gercha

Best

iococoi · Unread post by **iococoi** » 16 May 2012, 10:32

this looks very promising...finally a chance of getting a dance performance up and running with usine. patch would really be appreciated. best of luck, marco

nay-seven · Unread post by **nay-seven** » 16 May 2012, 10:33

Cool video gercha !
feel free to post the progression, tips here

gercha1 · Unread post by **gercha1** » 16 May 2012, 11:05

thanks and more precisions

@damien for the patch i can upload it soon in one or two weeks
I need to work to clean it and improve it

@multiphone i think it's the last version for windows,
the link here
http://synapsekinect.tumblr.com/post/6610177302/synapse
you need to follow the installation instructions, no problem for me ,
it's was more difficult to understand OSC and the links between Usine and synapse
They are install on the same computer, it's a new and big one for concert !!!!
(windows 7 64bit,core i7,16go RAM, SSD...)

@nayseven OK i will post the work in progress

gercha

multiphone · Unread post by **multiphone** » 16 May 2012, 12:08

Very strange...

I have made a show with Kinect / Usine and dance last years and the main problem was the CPU consumption of Synapse.

And my computer is quite similar with Quad core and SSD but 4Go Ram only and W7 32bits. But the version of Synapse, Nite and Open NI are 32 bits only.

Video here :

http://vimeo.com/29667547

http://www.youtube.com/watch?v=QpuHuzFUhuo

Sorry for the bad quality of the sound.

Best

multiphone · Unread post by **multiphone** » 16 May 2012, 12:12

I forgot ... the versions of drivers and other components used are the same since last year, they have not been up to date.

Best

r.erorr · Unread post by **r.erorr** » 16 May 2012, 12:53

yes, interesting, Gercha1 and so many controlling points. Great!

damstraversaz · Unread post by **damstraversaz** » 16 May 2012, 14:15

that's very interesting. what are you using for visual tracking ?

héliouk 6 · Unread post by **héliouk 6** » 16 May 2012, 14:25

great show!

CleverConQueso · Unread post by **CleverConQueso** » 16 May 2012, 21:00

Super!

My own experience with these Kinect drivers was that it was good if you had a controlled environment and a trained performer but for audience participation, which was our project, it was too cumbersome. However, MSoft released the Windows drivers eventually (too late for our project, we went with the excellent webcam modules in Usine) which were much more friendly to a chaotic environment but required more complex programming and more resources.

@Nay- Sorry, I didn't see your reply a year ago to my post. I never noticed the second page of comments before.

nay-seven · Unread post by **nay-seven** » 16 May 2012, 21:37

no problems, cleverconqueso

multiphone · Unread post by **multiphone** » 17 May 2012, 20:51

Hello,

This is a colaborative work with Mathieu Chamagne (Max/Msp) and Charles Bascou (Electronic live), Aurore Gruel (Dance) and me (With Usine).

We used two kinect, one suspended to the ceiling and the other in front of the dancer. The fist one annalyse the horizontal position of the dancer and draw the visual things on the ground, the second one uses "Synapse" and the skeleton control Usine.

Best

Hervé.

gercha1 · Unread post by **gercha1** » 01 Jun 2012, 15:28

HI

I have upload 2 patch in the uploader
the first get the data from synapse, and send it into data bus (in 0 to 1)
the second get the data bus (you can read it as fader or switch or button)

feedbacks are welcome

nay-seven · Unread post by **nay-seven** » 01 Jun 2012, 23:40

Don't have synapse installed yet but it's a huge work and will certainly bee useful for kinect users, thanks to share.

and here a Patching Art master piece , extracted from your patch ( and added on our facebook page

jmweber · Unread post by **jmweber** » 20 Jun 2012, 09:45

Hello Gercha

Can't find your patches in the uploader ?
Do they have a name ?

thanks

jmw

gercha1 · Unread post by **gercha1** » 20 Jun 2012, 09:51

hi

i don't know how to link the patch in the forum
the names are "kinect SEND A.pat" and "kinect get a2.pat" in the uploader
gercha1

nay-seven · Unread post by **nay-seven** » 20 Jun 2012, 10:03

here the direct links :
Kinect A
Kinect B

and you can learn here : how to create a link or add a picture

jmweber · Unread post by **jmweber** » 20 Jun 2012, 11:28

Thanks to both of you !

jmw

jmweber · Unread post by **jmweber** » 21 Jun 2012, 14:55

Hello Gercha

I have downloaded the patches but they do not work ?
Everything is ok in Max or in Live (Ryan Challinor 's patches)
What is your OS ?
I use W7. Usine seems to send OSC properly but there is no Kinect return !
What is wrong, what do I miss ?
I have no idea at all ?

jmw

jmweber · Unread post by **jmweber** » 21 Jun 2012, 16:18

Ok Gercha, I found the solution !
Configuration/monitorer local host/12345

Yes!

jmw

gercha1 · Unread post by **gercha1** » 21 Jun 2012, 16:52

thank nay
and give me feedbacks jmw,
gercha

Unread post by **oli_lab** » 26 Jun 2012, 21:28

Hi,
I had a go with brekel kinect that installs openNI on the computer, then I made a patch with Processing to have a nice 3D animation and also to send OSC on the network.
I would suggest to have one computer for kinect and one for sound....

mim · Unread post by **mim** » 08 Aug 2012, 14:20

@gercha1

Thank you very much for those awesome kinect patches... Very well done, thanks!

Welcome to %s forums

any Kinect camera user ..?

Who is online

Login • Register