1. Do not share user accounts! Any account that is shared by another person will be blocked and closed. This means: we will close not only the account that is shared, but also the main account of the user who uses another person's account. We have the ability to detect account sharing, so please do not try to cheat the system. This action will take place on 04/18/2023. Read all forum rules.
    Dismiss Notice
  2. For downloading SimTools plugins you need a Download Package. Get it with virtual coins that you receive for forum activity or Buy Download Package - We have a zero Spam tolerance so read our forum rules first.

    Buy Now a Download Plan!
  3. Do not try to cheat our system and do not post an unnecessary amount of useless posts only to earn credits here. We have a zero spam tolerance policy and this will cause a ban of your user account. Otherwise we wish you a pleasant stay here! Read the forum rules
  4. We have a few rules which you need to read and accept before posting anything here! Following these rules will keep the forum clean and your stay pleasant. Do not follow these rules can lead to permanent exclusion from this website: Read the forum rules.
    Are you a company? Read our company rules

Head Tracking combined with Motion Sims

Discussion in 'DIY Motion Simulator Projects' started by RufusDufus, Aug 25, 2013.

  1. RufusDufus

    RufusDufus Well-Known Member

    Joined:
    Jul 21, 2013
    Messages:
    681
    Location:
    Adelaide Australia
    Balance:
    15,603Coins
    Ratings:
    +1,008 / 8 / -1
    Hi, I have been doing some testing with head tracking software and thought I would post a vid for those that haven't tried it before.

    I am using the free FaceTrackNoIR available from here http://facetracknoir.sourceforge.net/home/default.htm

    Current test is using the FaceAPI plugin which uses a web cam and simply extracts data by looking for facial features in the video stream to determine the head orientation, surprisingly quite good.

    All software is running on one computer, game video settings are on low but was before trying facetracknoir (E8400 core two duo and Radeon HD6570)

    Almost no setup required – install the software, run, and launch the game will pretty much get you going, but you will soon want to make adjustments (assumes the game supports it, there is quite a big list of compatible games on the facetrack site)

    It tracks the head in 6DOF but for racing I have only enabled track head yaw (Don't need to see the sky!)

    I am lucky to be using my sim in front of a 50in monitor and it is quite natural to turn your head a few degrees to look to the side of the screen when cornering – this is sufficient for facetracknoir to detect. (TV was a $500 special at DSE about 6months ago).

    Unfortunately I haven't been able to get it to work together with the sim software yet – I am really hoping it is possible. So far I have found the experience excellent and hope I can get everything playing nicely together.



    If you are unclear about what is changing look at the left mirror and see how close it is to the left of the tv as the direction of my view changes.

    The question is how will it work when the sim seat is moving around - I think it will be OK because I have limitted the tracking to head yaw only, and it seems pretty good at determining and 6DOFs. Your head yaw is probably the least impacted by the sim (I have a seatmover)

    There are also some other plugins to track infrared or other LED setups mounted to a cap or headphones, etc. The advantage of this plugin is that it doesn't need as much processing power but the disadvantage is the need for a headset and some more config.
    • Like Like x 1
    Last edited: Nov 2, 2013
  2. RufusDufus

    RufusDufus Well-Known Member

    Joined:
    Jul 21, 2013
    Messages:
    681
    Location:
    Adelaide Australia
    Balance:
    15,603Coins
    Ratings:
    +1,008 / 8 / -1
    Ok, I have managed to get facetracking and sim motion working together (sort of).

    It seems my computer isn't really beefy enough to run everything together. The motion is very slow and lags behind the actual game. Also the facetracking is not as smooth either. :thbd:

    I notice the Rx LED on the sim arduino is blinking on and off very randomly confirming the data being sent is very inconsistent... usually it is being sent so fast it looks like the LED is just permanently on.



    You can see at one point in the video the video update actually stops for a second (that was the game not the recording)

    At least it works, next test I will turn graphics to ultra low or try a different game that might not need as much grunt. I guess that is what happens when you spend all your money on a big TV before sorting out the computing power. :blush:

    It also confirms that the facetracking is not overly effected by the movement generated by the seat mover.

    Other things I could try is get out another really old computer I have and offload the facetracking and simmotion to that.
    • Like Like x 1
    Last edited: Nov 2, 2013
  3. eaorobbie

    eaorobbie Well-Known Member SimTools Developer Gold Contributor

    Joined:
    May 26, 2009
    Messages:
    2,574
    Occupation:
    CAD Detailer
    Location:
    Ellenbrook, Western Australia
    Balance:
    20,390Coins
    Ratings:
    +1,683 / 23 / -2
    My Motion Simulator:
    2DOF, DC motor, JRK, SimforceGT, 6DOF
    Been down this road with free track before and yes with a seat mover not very good , but when you have the whole frame moving with the camera on the frame is wasn't too bad but the vibrations of the sim caused the free track to do funny things, haven't had the funds to go with a tracker system as I have seen other users use, but inturn in their videos you can see that they need to hold their heads very still or movement on screen is a bit of a mess. Plus I tested on a AMDx6 going flat out.
    Havent put it all back together to ru on my new AMDx8 , so I may need to do a test, software has seem to come a long way indeed, didn't have face tracking before only infa red led tracking.
    mmmm Nice find mate.
    • Informative Informative x 1
  4. RufusDufus

    RufusDufus Well-Known Member

    Joined:
    Jul 21, 2013
    Messages:
    681
    Location:
    Adelaide Australia
    Balance:
    15,603Coins
    Ratings:
    +1,008 / 8 / -1
    Yes, from what I have read they have made some quite significant improvements recently.

    From my testing what I have found is that the default settings are far to aggressive for car racing games. The default yaw has the view looking out the back of the car with about 30deg turn of the head (may be a bit exagerated but you get what I mean.)

    I wound the settings way back so it just gives enough angle to assist looking into the apex. Below is the yaw curve setting that I am using. As indicated in previous posts I have disabled all other DOF tracking.

    YAW CURVE.JPG

    I have also since disabled the VJoy software that was installed with the package. It was playing up with my G27 in Race07 for some reason. As far as I know it is not needed with games that support the FreeTrack protocols.

    Not sure if it is just my computer setup or not but seems to be important the order you start everything up... So far this works best for me:

    1. Start FaceTrackNoIR
    2. Start the FaceTracking
    3. Start Simtools
    4. Start the game.
    • Informative Informative x 1
  5. Historiker

    Historiker Dramamine Adict Gold Contributor

    Joined:
    Dec 16, 2010
    Messages:
    2,158
    Occupation:
    Retired
    Location:
    Michigan USA
    Balance:
    9,176Coins
    Ratings:
    +2,156 / 19 / -1
    My Motion Simulator:
    3DOF, DC motor, Arduino, Motion platform, 6DOF
    Rufus! Thanks to you I had to revise my motion platform design, lol. :D

    I had forgotten to take into account the mounting of my TrackIR camera (used to use Freetrack as well, it works just as good). So I decided to mount my 32 LCD on the moving platform rather than the base as I had designed it originally. I know this adds wieght but....
  6. RufusDufus

    RufusDufus Well-Known Member

    Joined:
    Jul 21, 2013
    Messages:
    681
    Location:
    Adelaide Australia
    Balance:
    15,603Coins
    Ratings:
    +1,008 / 8 / -1
    Haha... didn't intend to make more work for anyone! :D Anyway I am having fun playing with the head tracking so if you are like me it should be worth the effort. I just had a look at your build in another thread... it's coming along great. Bad luck with the Arduino smoking - I'm sure you'll have it sorted soon!

    I am currently trying re-organise my computers to put all the fastest components into the one machine to make it more responsive.
  7. Historiker

    Historiker Dramamine Adict Gold Contributor

    Joined:
    Dec 16, 2010
    Messages:
    2,158
    Occupation:
    Retired
    Location:
    Michigan USA
    Balance:
    9,176Coins
    Ratings:
    +2,156 / 19 / -1
    My Motion Simulator:
    3DOF, DC motor, Arduino, Motion platform, 6DOF
    Thanks, I ordered the tried and true parts tonight. two 12 volt winch motors and two Pololu JRK 12v12 controllers. That will take care of any issues I am having. I think the problem must be with the motors as they are the common denominator in every attempt.

    I have been using head tracking for many years, started with building a couple of free track systems and then went with TrackIR once I could afford it. I cannot imagine any sim game without it.
  8. Historiker

    Historiker Dramamine Adict Gold Contributor

    Joined:
    Dec 16, 2010
    Messages:
    2,158
    Occupation:
    Retired
    Location:
    Michigan USA
    Balance:
    9,176Coins
    Ratings:
    +2,156 / 19 / -1
    My Motion Simulator:
    3DOF, DC motor, Arduino, Motion platform, 6DOF
    Rufus, I was messing around with Facetracknoir today after learning that I can use a very cheap PS3 "Eye" camera that is capable of 120fps. I had tried the program before but the cheap(ly made) webcam that I had tried was not up to the task. I picked up a PS3 Eye for 10.00 at a GameStop store (used) and tried it out. I must confess that I am impressed. With a little screwing around with the profile the PS3 Eye delivers pretty good performance. Not perfect but very close to my TrackIR rig and I do not have to wear a hat with reflectors on it ;) Considering my TrackIR 5 rig was 150.00 and the FacetracknoIR and PS3 Eye is 10.00 (Total) it is fantastic.

    I tried it out in Arma3 and Il-2 as well as DCS. FacetracknoIR has come a long way.

    I am using version 1.7 of FacetracknoIR.
    • Like Like x 2
  9. eaorobbie

    eaorobbie Well-Known Member SimTools Developer Gold Contributor

    Joined:
    May 26, 2009
    Messages:
    2,574
    Occupation:
    CAD Detailer
    Location:
    Ellenbrook, Western Australia
    Balance:
    20,390Coins
    Ratings:
    +1,683 / 23 / -2
    My Motion Simulator:
    2DOF, DC motor, JRK, SimforceGT, 6DOF
    Sorry off subject @Historiker any issue with settting up the jrks on winchs let me know. Plus if the showdown plugin not a working for you I can edit it , we must have missed it in updating it from v2 - v3 sorry for that.
  10. Historiker

    Historiker Dramamine Adict Gold Contributor

    Joined:
    Dec 16, 2010
    Messages:
    2,158
    Occupation:
    Retired
    Location:
    Michigan USA
    Balance:
    9,176Coins
    Ratings:
    +2,156 / 19 / -1
    My Motion Simulator:
    3DOF, DC motor, Arduino, Motion platform, 6DOF
    Thanks Rob. I do not use JRKs though. I did buy a couple but never used them. Sold them recently as a matter of fact.
  11. bsft

    bsft

    Balance:
    Coins
    Ratings:
    +0 / 0 / -0
    bought and sold? why?
  12. Historiker

    Historiker Dramamine Adict Gold Contributor

    Joined:
    Dec 16, 2010
    Messages:
    2,158
    Occupation:
    Retired
    Location:
    Michigan USA
    Balance:
    9,176Coins
    Ratings:
    +2,156 / 19 / -1
    My Motion Simulator:
    3DOF, DC motor, Arduino, Motion platform, 6DOF
    No need for them, the Arduino setup worked excellent.
  13. Kevin thee Bajan

    Kevin thee Bajan New Member

    Joined:
    Nov 18, 2013
    Messages:
    17
    Balance:
    929Coins
    Ratings:
    +12 / 0 / -0
    I probably would have done the same thing get the 50"
  14. RufusDufus

    RufusDufus Well-Known Member

    Joined:
    Jul 21, 2013
    Messages:
    681
    Location:
    Adelaide Australia
    Balance:
    15,603Coins
    Ratings:
    +1,008 / 8 / -1
    Do you need special Windows drivers for the PS3 eye?
  15. Historiker

    Historiker Dramamine Adict Gold Contributor

    Joined:
    Dec 16, 2010
    Messages:
    2,158
    Occupation:
    Retired
    Location:
    Michigan USA
    Balance:
    9,176Coins
    Ratings:
    +2,156 / 19 / -1
    My Motion Simulator:
    3DOF, DC motor, Arduino, Motion platform, 6DOF
  16. RacingMat

    RacingMat Well-Known Member Gold Contributor

    Joined:
    Feb 22, 2013
    Messages:
    2,233
    Location:
    Marseille - FRANCE
    Balance:
    20,875Coins
    Ratings:
    +2,079 / 21 / -2
    My Motion Simulator:
    2DOF, DC motor, Arduino
  17. RufusDufus

    RufusDufus Well-Known Member

    Joined:
    Jul 21, 2013
    Messages:
    681
    Location:
    Adelaide Australia
    Balance:
    15,603Coins
    Ratings:
    +1,008 / 8 / -1
  18. RacingMat

    RacingMat Well-Known Member Gold Contributor

    Joined:
    Feb 22, 2013
    Messages:
    2,233
    Location:
    Marseille - FRANCE
    Balance:
    20,875Coins
    Ratings:
    +2,079 / 21 / -2
    My Motion Simulator:
    2DOF, DC motor, Arduino
    I'll certainly have a try! :D
    I bought one in a GameShop today : brand new and only 10€!
  19. Historiker

    Historiker Dramamine Adict Gold Contributor

    Joined:
    Dec 16, 2010
    Messages:
    2,158
    Occupation:
    Retired
    Location:
    Michigan USA
    Balance:
    9,176Coins
    Ratings:
    +2,156 / 19 / -1
    My Motion Simulator:
    3DOF, DC motor, Arduino, Motion platform, 6DOF
    • Like Like x 1
  20. Historiker

    Historiker Dramamine Adict Gold Contributor

    Joined:
    Dec 16, 2010
    Messages:
    2,158
    Occupation:
    Retired
    Location:
    Michigan USA
    Balance:
    9,176Coins
    Ratings:
    +2,156 / 19 / -1
    My Motion Simulator:
    3DOF, DC motor, Arduino, Motion platform, 6DOF
    A quick tip: Do not eat potato chips while using FacetracknoIR :confused:

    The chewing motion changes the shape of your face and your viewpoint bounces around, lol. :grin
    • Funny Funny x 3