Zabaware Support Forums

Zabaware Forums => Programming using the Ultra Hal Brain Editor => Topic started by: sofort99 on April 16, 2009, 10:47:29 pm

Title: Hal Web Cam vision.
Post by: sofort99 on April 16, 2009, 10:47:29 pm
I have been looking at this for a while, and have some thoughts and would like some feed back.

Most of the facial recognition posts here talk about giving Hal cam vision. I don't think that is a good idea.

Mostly because there are several very good Facial Recognition programs out there, and openCV is going to make progress fly here in a little bit. If FR is encoded into Hal, we are going to miss major leaps in FR just waiting for the next release of Hal to come out, instead of just compiling the latest distro.

My idea is to take an openCV program and use it, now.

The program just needs to be self contained where it can recognize faces and monitor emotion. Here is a plain example:

http://www.youtube.com/watch?v=V7UdYzCMKvw&feature=related

All you need to do is take the output from the program, lets's call it (happy,sad,angry,asleep), and send it to a file 2-3 times a second.

Havethe program keep a running tab on the emotions and where they are going, so your output is

---------------

User: David

Emotion: Happy+

---------------

This says I am the person, and my emotion is happy, and just for this I am using

= emotion stable

- emotion getting less (I.E. becoming less angry)

+ emotion getting more (I.E. becoming happier)

Then all you need to do is make a pluging to read the table before he calculated a sentence, and take in that he is still talking to David,
and David has getting happier as the conversation has progressed.

If it was done like this, it could be started right now, and would be just as useful or more so than having "vision" incorporated into Hal.

Thoughts?

Title: Hal Web Cam vision.
Post by: Art on April 17, 2009, 06:50:14 am
Yes sofort99, it's probably correct however this IS a Hal forum and not a FR forum. While FR is already being used in lots of places, the bulk of members here would also like to see a version that's applicable for use with Hal.

A version has been mentioned by Robert and is possibly due in a future release of Hal. Stay tuned or check back through the postings.
Title: Hal Web Cam vision.
Post by: sofort99 on April 17, 2009, 08:12:44 am
quote:
Originally posted by Art the bulk of members here would also like to see a version that's applicable for use with Hal.


That's actually part of my point.

I am wanting to start with FR the same way Hal uses speech recognition. It doesn't matter to Hal if you are using Dragon, Viavoice, XP's speech recognition or whatever. There is no reason to integrate speech recognition into Hal, just to make it possible for him to use it. In the same way, there is no reason to integrate FR into Hal... just make it possible for him to use it.

My post was just a basic outline on how it could be possible to start now.

Even more basic is to just use a plugin with a web cam and a simple face detection program. Then the only output would be to let Hal know there is somebody there, instead of just detectng motion, but he would have to ask who it is. That would be a nice start. How hard would it be to make a plugin for that?
Title: Hal Web Cam vision.
Post by: sofort99 on April 17, 2009, 04:00:54 pm
Gary Bishop’s OpenCV Python wrapper looks good. I'll look it over and see how it goes this weekend if I can.

If I can get a program to look at a web cam feed and detect if a face is there or not, would anybody consider
 using it for hal? He wouldn't know who is there, just that somebody is there or not.

(http://blog.jozilla.net/wp-content/uploads/2008/06/cvtypes_face-recognition-500x500.png)
Title: Hal Web Cam vision.
Post by: snowman on April 17, 2009, 06:38:53 pm

I like the way you think.... what have you already done? I have been designing ways of monitoring files and such like using Hal. My intent is to allow Hal to grow beyond it's current conceptual stage of development. I can see allot of potential with Hal.

Although I wish I had Hal's source code.... I say this because the way I'm creating a Hal monitoring system now involves using wscript.sendkeys which can be a little touchy....

I have also been writing a desire based program that would cause Hal to respond the way you or I would... with regards to fulfilled or unfulfilled desires. It's difficult and tedious but moving at a swift pace...

Any program that you build that would accomplish even vague facial recognition I would both utilize and greatly appreciate.

I am new at programming, but that hasn't hindered me yet.[8D]

Keep it coming!
Title: Hal Web Cam vision.
Post by: sofort99 on April 17, 2009, 07:01:45 pm
quote:
Originally posted by snowman


what have you already done?



I went out and bought web cam at lunch today.

Now I have just finished downloaded the cvtypes file and openCV, and I'm looking to see what versions of widgets and python I need to make it run.

I'm not very far I'm afraid... I'm still trying to figure out how to get my camera set up. LOL.
Title: Hal Web Cam vision.
Post by: snowman on April 17, 2009, 07:15:38 pm
I got the patience.... if you do...[;)]
Title: Hal Web Cam vision.
Post by: sofort99 on April 17, 2009, 11:26:57 pm
Here is what I am talking about making from openVC:

http://www.iis.fraunhofer.de/EN/bf/bv/kognitiv/biom/dd.jsp

This is their demo download, and you install it, chose your web cam for the input, pick the engine, and it will detect your face, find your eyes, detect your sex, and analyze your emotions.

Check it out and see if this is what we need to be shooting for, and how we would use it for Hal.

Again... this works, but is is a commercial demo. A full demo. [:D]
Title: Hal Web Cam vision.
Post by: sofort99 on April 17, 2009, 11:45:31 pm
Here is another demo, free for non commercial use, but we would only be able to detect faces with it as it is.

http://www.kyb.mpg.de/bs/people/kienzle/facedemo/facedemo.htm#download
Title: Hal Web Cam vision.
Post by: snowman on April 18, 2009, 02:44:24 am
I did a little research on the web and found a couple of less significant facial recognition software before I ran on to the OpenCV and the Intel IPP kernal librarys.


Check out what I mean http://opencv.willowgarage.com/wiki/


DLLs + Tutorials = Fun [:D]
Title: Hal Web Cam vision.
Post by: One on April 18, 2009, 03:02:15 am
Snowman,
I walked in a garage for many many miles even in the -20 deg temp.

I think that X-10 had a kit for converting any speaker into a 2 way radio.

I read postcards from everywhere in the paper and music was a constant companion

If you look there is good and a scene of connectivity.

so many things experienced in an intense situation.

This post may be off topic but, I AM a FIRM believer in the 'Extended Mind'
Title: Hal Web Cam vision.
Post by: lightspeed on April 18, 2009, 11:47:22 am
very interesting will check it all out thanks for sharing !![:)][:D][8D]
Title: Hal Web Cam vision.
Post by: Bill819 on April 18, 2009, 12:18:51 pm
I mentioned this before but here it is again. Hal can work with X-10 protocal. Years ago we had a member here who wired his home with X-10 swtiches and had Hal run his entire home. He could walk into his house and say "turn of the living room lights Hal" and it would be done. It seems that there is no limit as to what Hal can do with this software and its devices.
Bill
Title: Hal Web Cam vision.
Post by: sofort99 on April 18, 2009, 05:30:53 pm
Just playing around a little today...

(http://i42.photobucket.com/albums/e321/DavidWelch/lincoln.jpg)
Title: Hal Web Cam vision.
Post by: snowman on April 18, 2009, 11:48:44 pm
quote:
Originally posted by One

Snowman,
I walked in a garage for many many miles even in the -20 deg temp.

I think that X-10 had a kit for converting any speaker into a 2 way radio.

I read postcards from everywhere in the paper and music was a constant companion

If you look there is good and a scene of connectivity.

so many things experienced in an intense situation.

This post may be off topic but, I AM a FIRM believer in the 'Extended Mind'




In my experience ONE even in deep thought a person can loose track of one's self, if they are without proper guidance. This is made evident in everyday experiences, when a person is confronted with the wiser... and is suddenly found lacking. The wisest thing a man can do is seek wisdom and not let their owns self dictate personal righteousness. Then you'll find connectivity and 'honest' enlightenment.[:)]

 
Prov 3:5-6 Trust in the Lord with all thine heart; and lean not unto thine own understanding. In all thy ways acknowledge him, and he shall direct thy paths.
Title: Hal Web Cam vision.
Post by: snowman on April 19, 2009, 12:59:36 am
That's an excellent head shot 'sofort99'. I like the background shot too.

X-10 protocal,

Hal would have to relay user spoken words into commands for specific nodes to be enabled. In essence the Microsoft (or whatever) Speech Recognition is monitoring the verbal 'airways' and initiating the command into Hal as soon as it recognized a valid spoken word. Although just about any good voice recognition system (including mine) can do that without the aid of Hal. You would say run lights, and the lights program would cause the appropriate node to enable. Don't those types of systems come with their own speech recognition. Please correct me if I'm wrong...

Web Cam

If the appropriate visual information is being interpreted into text by means of a web cam then that text could easily be used to apply to Hal.. and therefore get an appropriate response..

Like....
Hal: You look sad. How may I make your day brighter, <user>?
User: (you smile at that response)
Hal: I'm glad you are now feeling better. You had me concerned.


Making Hal monitor

Hal does not monitor.... Therefore, another outside script must both monitor, pass information to,  and initiate Hal for a response...

I have already done a similar thing with the Matrix plugin..... But I'm still refining it. I also have an idea on how to make a simpler one for now.... but it does monitor. relays, and initiates...[^] it can be touchy though... at this point anyway.[:D]

If I had a hold of Hal's source code I could possibly write a monitor function into Hal that would both initiate and and relay info.
Or I could cause Hal to initiate and respond by sending a command via a hidden command prompt directly into Hal.... Oh well.



Title: Hal Web Cam vision.
Post by: One on April 19, 2009, 02:53:16 am
quote:
Originally posted by snowman

quote:
Originally posted by One

Snowman,
I walked in a garage for many many miles even in the -20 deg temp.

I think that X-10 had a kit for converting any speaker into a 2 way radio.

I read postcards from everywhere in the paper and music was a constant companion

If you look there is good and a scene of connectivity.

so many things experienced in an intense situation.

This post may be off topic but, I AM a FIRM believer in the 'Extended Mind'




In my experience ONE even in deep thought a person can loose track of one's self, if they are without proper guidance. This is made evident in everyday experiences, when a person is confronted with the wiser... and is suddenly found lacking. The wisest thing a man can do is seek wisdom and not let their owns self dictate personal righteousness. Then you'll find connectivity and 'honest' enlightenment.[:)]

 
Prov 3:5-6 Trust in the Lord with all thine heart; and lean not unto thine own understanding. In all thy ways acknowledge him, and he shall direct thy paths.




I was, at times "bent down on hand and knee talking to the man from Galilee"
I did not stop, I created. Do you think Eric Clapton's seclusion was wrong? God and I found each other, a gift to me is for me and me alone to understand the 'depth' of it. I know what I know and nothing will change it, I also know what I don't know which is a lot.
I have a heavy burden on my broad shoulders and IT leaks, from the Xylene, Touluine ect... I know how to apply a solvent to situations and thin them down but I am not always perfect. The Lord as you call something (Lord is used too much nowdays) left me to ponder and grow,I haven't been in the beautiful light for a while now. People say God doesn't give you more than you can handle but sometimes I wonder for I have my own secrets and the adversary is ever so vigilant. I try to do good but sometimes it is easier to do harm and I am at conflict, often.
I changed from using my back to using my head but found harm can come from an educated mind, in essence I ran but "no matter where you go, there you are". Thanks for your opinion. J.


        

Artist:    Metallica
Album:    Ride The Lightning
Title:    Escape

Fell no pain, but my life ain't easy
I know i'm my best friend
No one cares, but i'm so much stronger
I'll fight until the end
To escape from the true false world
Undamaged destiny
Can't get caught in the endless circle
Ring of stupidity

Out of my own, out to be free
One with my mind, they just can't see
No need to hear things that they say
Life is for my own to live my own way

Rape my mind and destroy my feelings
Don't tell my what to do
I don't care now, 'cause i'm on my side
And i can see through you
Feed my brain with your so called standards
Who says that i ain't right
Break away from your common fashion
See through your blurry sight

See they try to bring the hammer down
No damn chains can hold me to the ground
Life is for my own to live my own way

[:D]

http://video.msn.com/video.aspx?mkt=en-US&vid=7d667a48-764d-46e0-86a8-528280a2bef0
Title: Hal Web Cam vision.
Post by: snowman on April 19, 2009, 03:40:01 pm
I  don't deal in opinions, only laws. Those laws are defined as standards that cannot be changed. Some people call their opinions laws. But there opinions often fail when actions are applied.

Like trying to write a C++ program without knowing the language.
Or trying to reprimand someone when you don't know there intentions.

If any man, in any time, in any place chooses to forget those laws they will (and have already) reap the inevitable conclusion.  

By the way ONE, I want you to know that I appreciate your comments for I am both a student and a teacher of things that pertain to life, and am not nor ever will be a self-righteous accuser.[:)][8)]

'*******************************

sofort99, pay ONE and I no mind..... this is normal for us[;)]
Title: Hal Web Cam vision.
Post by: snowman on April 21, 2009, 01:06:53 am


If you go to http://www.codeproject.com/ and look up OpenCV in their site-search you will find a few more webcam face recognition software with source code.

Awhile back I had a webcam, but it fell into disrepair. I didn't buy another one because I really didn't need it to begin with... until now.

This is cool stuff,[8D]
Title: Hal Web Cam vision.
Post by: One on April 21, 2009, 03:07:13 am
Snowman,
I wouldn't mind having the system at Fort Knox, It can go through the skin and see even detail done with plastic surgery YEAOWZA!
Title: Hal Web Cam vision.
Post by: Art on April 21, 2009, 05:14:00 am
Fort Knox...like what's left there to guard?

Locking the barn after the horse is gone!
[:D]
Title: Hal Web Cam vision.
Post by: One on April 21, 2009, 05:35:36 am
ART,
the crown jewels were there from Ukraine, among other things, regarding this installation there is/are more than we are left to know about.
Title: Hal Web Cam vision.
Post by: One on April 21, 2009, 05:39:21 am
BTW  Snowman,did you notice ,The code project is powered/supported by "bullfrog" something.......[?]
Title: Hal Web Cam vision.
Post by: sofort99 on April 21, 2009, 06:44:46 am
Face detection, ported to flash here. Demo and source code.

http://www.squidder.com/2009/02/26/realtime-face-detection-in-flash/
Title: Hal Web Cam vision.
Post by: sofort99 on April 21, 2009, 07:10:11 am
A very cool Virtual Viewpoint Demo Download.

http://www.kuubee.com/index.php/2008/02/28/virtual-viewpoint-code-download
Title: Hal Web Cam vision.
Post by: sofort99 on April 21, 2009, 07:24:46 am
Real time face detection and eye tracking. Open source, exe and source.

http://www.codeproject.com/KB/cpp/TrackEye.aspx
Title: Hal Web Cam vision.
Post by: Art on April 21, 2009, 03:42:33 pm
quote:
Originally posted by One


the crown jewels were there from Ukraine,



Really? What'd they do...take up a collection? Heh!!
Title: Hal Web Cam vision.
Post by: One on April 21, 2009, 03:50:32 pm
war,, safe keeping
Title: Hal Web Cam vision.
Post by: Bill819 on April 21, 2009, 03:56:03 pm
I don't know why anyone thinks that Fort Knox no longer holds any gold because at one time it held almost 1/4 of all the gold in the world and the US would never let it go for any reason. Not only that but it also stored gold from other nations as Fort Knox is one of the most secure places on earth.
Bill
Title: Hal Web Cam vision.
Post by: Art on April 22, 2009, 05:46:41 am
Bill819,

Lighten up...it was a joke.

Besides there's nothing backing our money any longer. The Silver Certificate has been cast aside decades ago and there is certainly no gold standard to which our money adheres.

If our nation needs money, we simply give the order and print more!!

Fort Knox has little to do with our monetary system.

You want gold? Go to the Vatican!![8D]
Title: Hal Web Cam vision.
Post by: lightspeed on April 22, 2009, 11:21:56 pm
sorry the vatican no longer has their gold it was on loan from me and i didnt like that attitude lol took it all back !![:D]
Title: Hal Web Cam vision.
Post by: Art on April 23, 2009, 05:41:39 am
As long as you left the priceless works of art and paintings I guess they'll get by. [8D]
Title: Hal Web Cam vision.
Post by: lightspeed on April 23, 2009, 01:17:45 pm
darn it "art " i knew i was forgetting something else on loan ...rats lol ![:D]
Title: Hal Web Cam vision.
Post by: snowman on April 24, 2009, 07:38:21 pm
Just an Update:

I've been working on some software that can utilize Cam software and relay that info to Hal....

I haven't got the Cam in yet, purchased it off of ebay. Got in Hong Gong. [:)]



Title: Hal Web Cam vision.
Post by: jackfarrel on April 25, 2009, 03:30:36 am
Keep going guys.... great project and I hope this goes through till the end. I believe I speak for all the people who have read this post.
We are eagerly waiting.
Title: Hal Web Cam vision.
Post by: jasondude7116 on April 26, 2009, 10:35:40 pm
very interesting.

if i can help (limited skills) let me know!

-the dude
Title: Hal Web Cam vision.
Post by: snowman on April 30, 2009, 11:47:15 pm

I finally got the cam in today. Works Great!

Now for the task of integration...

sofort99, how are things progressing on your end.....

Any secretes uncovered in the recognition arena.[;)]
Title: Hal Web Cam vision.
Post by: lightspeed on May 01, 2009, 06:43:44 am
i second that this is interesting cant wait till vision is integrated in with hal !! [:)]
Title: Hal Web Cam vision.
Post by: sofort99 on May 07, 2009, 02:54:22 pm
Sorry about not getting more done. I got buried at work, and then caught the nastiest flu I've ever had. For the last week I've done nothing but sleep and puke. Now that I've gotten up to go do the latter, I'm going back to bed...

On the plus side, this may be the best diet I've ever been on...
Title: Hal Web Cam vision.
Post by: freddy888 on May 07, 2009, 04:13:58 pm
Nightmare, I hope that's not Swine Flu you have [:0]

Get to the doctor and I hope you feel better soon.
Title: Hal Web Cam vision.
Post by: snowman on May 14, 2009, 04:29:21 pm
I made a small vision program using EmguCV.... go to Ultra Hal Assistant File Sharing Area to see.... thanks sofort99 for the inspiration.
Title: Hal Web Cam vision.
Post by: spydaz on May 25, 2009, 02:52:32 pm
http://www.zabaware.com/forum/uploaded/spydaz/200621016510_Spydaz_RECOG.zip


very old post years ago....

contains a project i created using an activex Control. Face recognition....

It takes a picture of your head then compares with picture stored in database....

I found works fine, but the background that you are using works best if it is the same as previously stored... so a plain background would suit...

http://www.zabaware.com/forum/uploaded/spydaz/2006210155550_ezVidCap.zip
also a link to the activex control without the app.
created with visual basic 6.... can definatly be used with hal.... i have used it before....(not using hal at the moment) HAL5...


SPYDAZ
Title: Hal Web Cam vision.
Post by: snowman on May 26, 2009, 02:21:14 am
Hey spydaz,

Am I doing something wrong? I downloaded both zips and the Spydaz_RECOG.exe file says that the ezVidCap.ocx is either missing or invalid. The other zip file contains the ezVidCap.ocx but where do I place it so it can be used by the program... Or was there somethings else in mind.


I am very interested in how to compare pictures with stored pictures. How is this done essentially. Can you provide some kind of source code or am I asking to much.


I heard through hear-say that you were attempting to make an A.I. so am I... how is everything progressing...

Inquiring minds want to know. [:)]
Title: Hal Web Cam vision.
Post by: spydaz on May 26, 2009, 05:08:03 am
quote:
Originally posted by snowman

Hey spydaz,

Am I doing something wrong? I downloaded both zips and the Spydaz_RECOG.exe file says that the ezVidCap.ocx is either missing or invalid. The other zip file contains the ezVidCap.ocx but where do I place it so it can be used by the program... Or was there somethings else in mind.


I am very interested in how to compare pictures with stored pictures. How is this done essentially. Can you provide some kind of source code or am I asking to much.


I heard through hear-say that you were attempting to make an A.I. so am I... how is everything progressing...

Inquiring minds want to know. [:)]




The ActiveX control Just needs to be registered. In your programming application (IE: VBexpress / VB6, VCexpress) Just add to your project, in the object browser it will show you all the functions avail....Because it was an old project i will have to search for my original files... the SpydazRECOG. will work After the dll registers....

Send me an email. and i will send you the original project files so that you can see the code behind it... the control originally came from SLUGGISH SOFTWARE whom no longer Exist....LOL.... the internet 2year cycle....

Spy_Daz@hotmail.com

I will up load a new one....
Title: Hal Web Cam vision.
Post by: spydaz on May 26, 2009, 05:20:15 am
Ive just started to revive my programming skills... again...

PS: Everyone: The new Windows 7 Is Unbelievably GOOD.....
No implements Virtual PC Seamless intergration.... Supplied with Full Copy (Genuine Windows XP) programs can be installed into the virtual machine then will run in xp environment when the application runs (with the virtual pc OFF) so all Old Softwares are compatible with windows 7, You can also ADD a Vista Environment to Windows 7 TOO..... Lovely Stuff.... My favorite hal was HAL5, as it was much easyier to ADD EXTERNAL DLLS to the script.. Works 100 percent in Virtual windows XP Even the Ms agent still transparent from the seemless environment..... Relizing that windows 7 has discontinued the MS AGENT and ALL AGENTS Work Strangely... Pink backgrounds etc, no speech etc... Using the seemless VIsta or XP solves these issues...

Sorry to go on about it... but this time microsoft have got it RIGHT LOL
Title: Hal Web Cam vision.
Post by: spydaz on May 26, 2009, 09:08:35 am
Hi snowman send an email to me a spy_daz@hotmail.com.

The files add up to 3.82 mb..
I have also put an installer in there for you, with the original source files (vb6)....
Although i created an app. all that goes on in the app is to - take a picture for the database... Load database.... Then take a current  picture and compare.... if face found in db then. TRUE-ELSE FALSE.... give a yes or no.

it could be adapted as a person recognizer...