Jump to content
    1. Welcome to GTAForums!

    1. GTANet.com

    1. GTA Online

      1. Los Santos Drug Wars
      2. Updates
      3. Find Lobbies & Players
      4. Guides & Strategies
      5. Vehicles
      6. Content Creator
      7. Help & Support
    2. Red Dead Online

      1. Blood Money
      2. Frontier Pursuits
      3. Find Lobbies & Outlaws
      4. Help & Support
    3. Crews

    1. Grand Theft Auto Series

      1. Bugs*
      2. St. Andrews Cathedral
    2. GTA VI

    3. GTA V

      1. Guides & Strategies
      2. Help & Support
    4. GTA IV

      1. The Lost and Damned
      2. The Ballad of Gay Tony
      3. Guides & Strategies
      4. Help & Support
    5. GTA San Andreas

      1. Classic GTA SA
      2. Guides & Strategies
      3. Help & Support
    6. GTA Vice City

      1. Classic GTA VC
      2. Guides & Strategies
      3. Help & Support
    7. GTA III

      1. Classic GTA III
      2. Guides & Strategies
      3. Help & Support
    8. Portable Games

      1. GTA Chinatown Wars
      2. GTA Vice City Stories
      3. GTA Liberty City Stories
    9. Top-Down Games

      1. GTA Advance
      2. GTA 2
      3. GTA
    1. Red Dead Redemption 2

      1. PC
      2. Help & Support
    2. Red Dead Redemption

    1. GTA Mods

      1. GTA V
      2. GTA IV
      3. GTA III, VC & SA
      4. Tutorials
    2. Red Dead Mods

      1. Documentation
    3. Mod Showroom

      1. Scripts & Plugins
      2. Maps
      3. Total Conversions
      4. Vehicles
      5. Textures
      6. Characters
      7. Tools
      8. Other
      9. Workshop
    4. Featured Mods

      1. Design Your Own Mission
      2. OpenIV
      3. GTA: Underground
      4. GTA: Liberty City
      5. GTA: State of Liberty
    1. Rockstar Games

    2. Rockstar Collectors

    1. Off-Topic

      1. General Chat
      2. Gaming
      3. Technology
      4. Movies & TV
      5. Music
      6. Sports
      7. Vehicles
    2. Expression

      1. Graphics / Visual Arts
      2. GFX Requests & Tutorials
      3. Writers' Discussion
      4. Debates & Discussion
    1. Announcements

    2. Forum Support

    3. Suggestions

[V|REL][.NET] GTA V Eye Tracking Mod


alex8b
 Share

Recommended Posts

Hello!

I work at the company called Tobii. Tobii develops eye tracking technology and I decided to create a small mod to use it in GTA V.

This mod allows you to control the camera and aim in GTA V with your eyes!

If any skilled mod developers want to help me working on this mod then Tobii will give them few eye trackers FOR FREE. Same applies to popular streamers.

It would be great to hear some feedback so feel free to leave comments and ask questions.
 


On this video I play with a gamepad and mostly control the camera and aim with my eyes. The right joystick is used for fine adjustments while aiming. However eye tracking doesn't replace it, so you can use it as usual combined with eye tracking. The violet circle is not visible to the player.

Download the latest version 0.11
https://github.com/alex8b/gta5eyetracking/releases/

You need to have one of these eye trackers to use it

Tobii Eye Tracker 5 $229/ €229
Tobii Eye Tracker 4C
Tobii EyeX
Follow https://twitter.com/tobiigaming for DISCOUNTS!
- SteelSeries Sentry Gaming Eye Tracker
Alienware m15
Alienware m17
Alienware m17 R3
Alienware Area-51m
Alienware 17
MSI GT72

 

You need to have an XBOX 360 Controller (or any other XInput compatible).

 

If you have a PS4 Controller you can use DS4Windows to emulate XInput.

http://ds4windows.com/

 

Controls

Cheats:
F4 - Cheat menu (Immortality/Give all weapons/Disable cops/Spawn vehicles)
NUMPAD5, NUMPAD4, NUMPAD6, NUMPAD2, NUMPAD8 - Navigate the cheat menu

XBOX 360 Controller:

(LEFT THUMB + START) - Eye tracking settings menu
DPAD - Navigate the eye tracking menu
 
LB (on foot) - Weapon selection menu
LT (on foot) - Aim at gaze
RT (on foot) - Shoot at gaze
RIGHT JOYSTICK (while holding LEFT THUMB) - Fine adjust the crosshair while shooting
 
A - Incinerate at gaze
B - Shoot a missile at gaze
RB - Tase at gaze
 
LB (in vehicle) - Shoot at gaze
X (in vehicle) - Weapon selection


Keyboard and mouse:

F8 - Eye tracking settings menu
ARROWS - Navigate the eye tracking menu
 
B or XBUTTON1 - Shoot at gaze
J or XBUTTON2 - Incinerate at gaze
N or PGUP - Shoot a missile at gaze
H or PGDOWN - Tase at gaze
 
K - Debug info


Source
https://github.com/alex8b/gta5eyetracking

Edited by alex8b
Link to comment
Share on other sites

  • 1 month later...

New release!

0.6.33
- Homing missiles
- Freelook works in the first person vehicle camera
- Support Script Hook V .NET 2.1, Native UI 1.4
- Multi-level menu

Edited by alex8b
Link to comment
Share on other sites

Looks nice :) Where is the difference between EyeX and Sentry? What should i choose for gaming and is it accurate enough to use it in FPS games (offline ofc)?

Link to comment
Share on other sites

Looks nice :) Where is the difference between EyeX and Sentry? What should i choose for gaming and is it accurate enough to use it in FPS games (offline ofc)?

They are very similar in terms of hardware. Sentry comes with some extra software for streaming and analytics in games. Tobii EyeX is targeted to developers. However they both work with this mod.

 

There are no fast FPS games that natively support it at the moment and It may feel like cheating.

 

In FPS it's more practical is to use it for moving the aim only when you zoom in. Throwing grenades, radial menus and object interaction work great as well.

 

Edited by alex8b
Link to comment
Share on other sites

New release!

 

0.6.41

- Correct gaze point projection while the camera is moving

- Gaze point projection works in the first person vehicle camera

- Support Script Hook V .NET 2.2, Native UI 1.5

Edited by alex8b
Link to comment
Share on other sites

  • 2 weeks later...

New release!

 

0.6.44

- Display a missile target lock crosshair when you are in a vehicle

- More robust locking on targets

Link to comment
Share on other sites

New release!

 

0.6.67

- Fix crash on unload/reload

- Code refactoring

- Collect usage statistics (optional)

- Minor bugfixes

Link to comment
Share on other sites

  • 3 months later...

New release!

 

0.6.104

- Hide crosshair in the middle of the screen if aim with gaze is enabled

 

Also Tobii EyeX support comes to the PC Release of Assassin's Creed Syndicate:

 

 

And Tom Clancy’s The Division:

http://www.hardwarezone.com.sg/tech-news-msi-s-lead-gaming-notebook-ship-eye-tracking-hardware

Edited by alex8b
Link to comment
Share on other sites

  • 1 month later...

New release:

 

0.8.184

- Reworked aiming/shooting controller

- Snap gun at gaze when you press zoom button

- Turn player character towards aim direction while shooting

- Added animation to shooting missiles, tasing, incinerating

- Extended view in first person vehicle camera

Link to comment
Share on other sites

  • 3 weeks later...

New release:

 

0.8.201

- Update Script Hook V to 1.0.678.1 (16 Mar 2016)
- Smoother transitions in first person vehicle camera
Link to comment
Share on other sites

  • 3 weeks later...
  • 5 weeks later...
  • 4 months later...

I'm trying to build the mod, after having cloned the current master and having added an accessor for the missile lock, as per your suggestion on gta5-mods.com, but I get an accessability error at Utils.cs Line 201

Matrix matrix = MemoryAccess.CCamera.GetCurrentCameraMatrix(baseAddress, length);

since the signature of the class is internal. I'm not sure if this has something to do with the project/solution settings or if there's another (missing) reference causing it. Any help would be appreciated.

 

Thank you!

Link to comment
Share on other sites

Any help would be appreciated.

 

Thank you!

 

Hi!

 

Direct message me your skype id and we will chat on skype about it.

Link to comment
Share on other sites

  • 3 weeks later...

New release:

 

0.9.223

- Major update with lots of fixes

- Updated extended view feature

- Updated aim at gaze feature

  • Like 2
Link to comment
Share on other sites

a57c742c74e80b22_400x400ar.jpg

Tobii announced a next generation of eye trackers - Tobii Eye Tracker 4C.
- Adding head tracking functionality, making it the only gaming device to provide simultaneous head and eye tracking capabilities, providing a superior experience in simulator titles like Elite: Dangerous. (Currently in Beta)
- Adding Tobii EyeChip, the world’s first eye tracking ASIC, to reduce CPU load and power consumption from the host computer.
- Decreasing the size and visibility of the illuminators.
- Moving to an integrated USB2 cord (USB 2.0 BC 1.2) to increase the amount of compatible host devices.
- Further advancing its industry-leading eye tracking quality with additional performance enhancements.

 

Available for $149 pre-order at TobiiGaming.com on October 25, shipping November 25.

 

http://www.businesswire.com/news/home/20161020005144/en/Tobii-Releases-Generation-Gaming-Eye-Tracker

Edited by alex8b
Link to comment
Share on other sites

  • 2 weeks later...
  • 4 weeks later...
\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\installer.log.10872\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\


[27.11.2016 08:43:37] Installer running: Install Full

[27.11.2016 08:43:37] view.Show

[27.11.2016 08:43:37] Checking for updates False

[27.11.2016 08:43:37] Dispatcher.Run

[27.11.2016 08:43:53] Checking for updates True

[27.11.2016 08:43:53] SetPackagePlannedState: vc120 Present

[27.11.2016 08:43:53] SetPackagePlannedState: vc140 Present

[27.11.2016 08:43:53] SetPackagePlannedState: NetFx452Web Present

[27.11.2016 08:46:34] BootstrapperDispatcher.InvokeShutdown

[27.11.2016 08:46:34] Engine.Quit

[27.11.2016 08:46:34] viewModel.Dispose


\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\ScriptHookV.log \\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\



// GTA V SCRIPT HOOK (build Oct 5 2016, v1.0.877.1)

// © Alexander Blade 2015-2016

[13:15:21] INIT: Started

[13:15:21] INIT: Success, game version is VER_1_0_877_1_STEAM

[13:15:21] INIT: Registering script 'NativeTrainer.asi' (0x00007FFA2332A3C0)

[13:15:21] INIT: Registering script 'ScriptHookVDotNet.asi' (0x00007FFA067C1490)

[13:15:28] INIT: Pool 1 extended

[13:15:28] INIT: Pool 2 extended

[13:15:28] INIT: Pool 3 extended

[13:15:28] INIT: Pool 4 extended

[13:15:33] INIT: GtaThread collection size 187

[13:15:33] INIT: wnd proc 0x00000000FFFF0A3B

[13:15:33] INIT: IDXGISwapChain 0x00007FFA3FD9D058 (0x00007FFA06AAA0D0)

[13:15:33] INIT: IDXGISwapChain set

[13:15:33] INIT: DX init started

[13:15:33] INIT: DX feature level B000

[13:15:33] INIT: DX init succeeded

[13:17:05] CORE: Requesting thread creation

[13:17:05] CORE: Creating threads

[13:17:06] CORE: Started control thread, id 32 active 1

[13:17:06] CORE: Started thread 'NativeTrainer.asi' (0x00007FFA2332A3C0), id 33 active 1

[13:17:06] CORE: Started thread 'ScriptHookVDotNet.asi' (0x00007FFA067C1490), id 34 active 1

[13:17:06] CORE: Launching main() for 'NativeTrainer.asi' (0x00007FFA2332A3C0), id 33

[13:17:06] CORE: Launching main() for 'ScriptHookVDotNet.asi' (0x00007FFA067C1490), id 34

[13:17:06] INIT: Registering script 'ScriptHookVDotNet.DLL' (0x00007FF9FFD91490)



\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\ScriptHookVDotNet-2016-10-23.log\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\


[13:12:51] [DEBUG] Created script domain 'ScriptDomain_A94C5C84' with v2.9.3.

[13:12:51] [DEBUG] Loading scripts from 'D:\games\steamapps\common\Grand Theft Auto V\scripts' into script domain 'ScriptDomain_A94C5C84' ...

[13:12:52] [DEBUG] Found 0 script(s) in 'EasyHook.dll'.

[13:12:52] [ERROR] Failed to load assembly 'EasyHook64.dll':

System.BadImageFormatException: Could not load file or assembly 'file:///D:\games\steamapps\common\Grand Theft Auto V\scripts\EasyHook64.dll' or one of its dependencies. The module was expected to contain an assembly manifest.

File name: 'file:///D:\games\steamapps\common\Grand Theft Auto V\scripts\EasyHook64.dll'

at System.Reflection.RuntimeAssembly._nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)

at System.Reflection.RuntimeAssembly.InternalLoadAssemblyName(AssemblyName assemblyRef, Evidence assemblySecurity, RuntimeAssembly reqAssembly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)

at System.Reflection.RuntimeAssembly.InternalLoadFrom(String assemblyFile, Evidence securityEvidence, Byte[] hashValue, AssemblyHashAlgorithm hashAlgorithm, Boolean forIntrospection, Boolean suppressSecurityChecks, StackCrawlMark& stackMark)

at System.Reflection.Assembly.LoadFrom(String assemblyFile)

at GTA.ScriptDomain.LoadAssembly(String filename)


WRN: Assembly binding logging is turned OFF.

To enable assembly bind failure logging, set the registry value [HKLM\Software\Microsoft\Fusion!EnableLog] (DWORD) to 1.

Note: There is some performance penalty associated with assembly bind failure logging.

To turn this feature off, remove the registry value [HKLM\Software\Microsoft\Fusion!EnableLog].


[13:12:52] [DEBUG] Found 0 script(s) in 'EyeXFramework.dll'.

[13:12:52] [DEBUG] Found 0 script(s) in 'Gta5EyeTracking.dll'.

[13:12:52] [DEBUG] Found 0 script(s) in 'MemoryAccess.dll'.

[13:12:52] [DEBUG] Found 0 script(s) in 'NativeUI.dll'.

[13:12:52] [WARNING] Skipped assembly 'ScriptHookVDotNet.dll'. Please remove it from the directory.

[13:12:52] [DEBUG] Found 0 script(s) in 'SharpDX.dll'.

[13:12:52] [DEBUG] Found 0 script(s) in 'SharpDX.Mathematics.dll'.

[13:12:52] [DEBUG] Found 0 script(s) in 'SharpDX.XInput.dll'.

[13:12:52] [ERROR] Failed to load assembly 'Tobii.EyeX.Client.dll':

System.BadImageFormatException: Could not load file or assembly 'file:///D:\games\steamapps\common\Grand Theft Auto V\scripts\Tobii.EyeX.Client.dll' or one of its dependencies. The module was expected to contain an assembly manifest.

File name: 'file:///D:\games\steamapps\common\Grand Theft Auto V\scripts\Tobii.EyeX.Client.dll'

at System.Reflection.RuntimeAssembly._nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)

at System.Reflection.RuntimeAssembly.InternalLoadAssemblyName(AssemblyName assemblyRef, Evidence assemblySecurity, RuntimeAssembly reqAssembly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)

at System.Reflection.RuntimeAssembly.InternalLoadFrom(String assemblyFile, Evidence securityEvidence, Byte[] hashValue, AssemblyHashAlgorithm hashAlgorithm, Boolean forIntrospection, Boolean suppressSecurityChecks, StackCrawlMark& stackMark)

at System.Reflection.Assembly.LoadFrom(String assemblyFile)

at GTA.ScriptDomain.LoadAssembly(String filename)


WRN: Assembly binding logging is turned OFF.

To enable assembly bind failure logging, set the registry value [HKLM\Software\Microsoft\Fusion!EnableLog] (DWORD) to 1.

Note: There is some performance penalty associated with assembly bind failure logging.

To turn this feature off, remove the registry value [HKLM\Software\Microsoft\Fusion!EnableLog].


[13:12:52] [DEBUG] Found 0 script(s) in 'Tobii.EyeX.Client.Net20.dll'.

[13:17:06] [DEBUG] Created script domain 'ScriptDomain_82C6A918' with v2.9.3.

[13:17:06] [DEBUG] Loading scripts from 'D:\games\steamapps\common\Grand Theft Auto V\scripts' into script domain 'ScriptDomain_82C6A918' ...

[13:17:06] [DEBUG] Found 0 script(s) in 'EasyHook.dll'.

[13:17:06] [ERROR] Failed to load assembly 'EasyHook64.dll':

System.BadImageFormatException: Could not load file or assembly 'file:///D:\games\steamapps\common\Grand Theft Auto V\scripts\EasyHook64.dll' or one of its dependencies. The module was expected to contain an assembly manifest.

File name: 'file:///D:\games\steamapps\common\Grand Theft Auto V\scripts\EasyHook64.dll'

at System.Reflection.RuntimeAssembly._nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)

at System.Reflection.RuntimeAssembly.InternalLoadAssemblyName(AssemblyName assemblyRef, Evidence assemblySecurity, RuntimeAssembly reqAssembly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)

at System.Reflection.RuntimeAssembly.InternalLoadFrom(String assemblyFile, Evidence securityEvidence, Byte[] hashValue, AssemblyHashAlgorithm hashAlgorithm, Boolean forIntrospection, Boolean suppressSecurityChecks, StackCrawlMark& stackMark)

at System.Reflection.Assembly.LoadFrom(String assemblyFile)

at GTA.ScriptDomain.LoadAssembly(String filename)


WRN: Assembly binding logging is turned OFF.

To enable assembly bind failure logging, set the registry value [HKLM\Software\Microsoft\Fusion!EnableLog] (DWORD) to 1.

Note: There is some performance penalty associated with assembly bind failure logging.

To turn this feature off, remove the registry value [HKLM\Software\Microsoft\Fusion!EnableLog].


[13:17:06] [DEBUG] Found 0 script(s) in 'EyeXFramework.dll'.

[13:17:06] [DEBUG] Found 0 script(s) in 'Gta5EyeTracking.dll'.

[13:17:06] [DEBUG] Found 0 script(s) in 'MemoryAccess.dll'.

[13:17:06] [DEBUG] Found 0 script(s) in 'NativeUI.dll'.

[13:17:06] [WARNING] Skipped assembly 'ScriptHookVDotNet.dll'. Please remove it from the directory.

[13:17:06] [DEBUG] Found 0 script(s) in 'SharpDX.dll'.

[13:17:06] [DEBUG] Found 0 script(s) in 'SharpDX.Mathematics.dll'.

[13:17:06] [DEBUG] Found 0 script(s) in 'SharpDX.XInput.dll'.

[13:17:06] [ERROR] Failed to load assembly 'Tobii.EyeX.Client.dll':

System.BadImageFormatException: Could not load file or assembly 'file:///D:\games\steamapps\common\Grand Theft Auto V\scripts\Tobii.EyeX.Client.dll' or one of its dependencies. The module was expected to contain an assembly manifest.

File name: 'file:///D:\games\steamapps\common\Grand Theft Auto V\scripts\Tobii.EyeX.Client.dll'

at System.Reflection.RuntimeAssembly._nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)

at System.Reflection.RuntimeAssembly.InternalLoadAssemblyName(AssemblyName assemblyRef, Evidence assemblySecurity, RuntimeAssembly reqAssembly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks)

at System.Reflection.RuntimeAssembly.InternalLoadFrom(String assemblyFile, Evidence securityEvidence, Byte[] hashValue, AssemblyHashAlgorithm hashAlgorithm, Boolean forIntrospection, Boolean suppressSecurityChecks, StackCrawlMark& stackMark)

at System.Reflection.Assembly.LoadFrom(String assemblyFile)

at GTA.ScriptDomain.LoadAssembly(String filename)


WRN: Assembly binding logging is turned OFF.

To enable assembly bind failure logging, set the registry value [HKLM\Software\Microsoft\Fusion!EnableLog] (DWORD) to 1.

Note: There is some performance penalty associated with assembly bind failure logging.

To turn this feature off, remove the registry value [HKLM\Software\Microsoft\Fusion!EnableLog].


[13:17:06] [DEBUG] Found 0 script(s) in 'Tobii.EyeX.Client.Net20.dll'.



\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\asiloader.log \\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\



// GTA V ASI LOADER (build May 2 2015)

// © Alexander Blade 2015

LIB: "C:\Windows\system32\dinput8.dll" => 00007FFA26300000

API: "DirectInput8Create" => 00007FFA2630A050

API: "DllCanUnloadNow" => 00007FFA263193C0

API: "DllGetClassObject" => 00007FFA26319490

API: "DllRegisterServer" => 00007FFA26322AF0

API: "DllUnregisterServer" => 00007FFA26322D70

LOADER: Loading *.asi plugins

ASI: Loading "D:\games\steamapps\common\Grand Theft Auto V\NativeTrainer.asi"

"NativeTrainer.asi" => 00007FFA23320000

ASI: Loading "D:\games\steamapps\common\Grand Theft Auto V\ScriptHookVDotNet.asi"

"ScriptHookVDotNet.asi" => 00007FFA067C0000

LOADER: Finished loading *.asi plugins



SORRY ......i dont know how to upload attachment ...........

Link to comment
Share on other sites

  • 3 months later...
  • 1 year later...

New release!

 

0.10.285

 

- Bugfix: it was not possible to switch to third person view in vehicles. Now this setting is exposed to the menu.

Link to comment
Share on other sites

  • 1 year later...

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share

  • 1 User Currently Viewing
    0 members, 0 Anonymous, 1 Guest

×
×
  • Create New...

Important Information

By using GTAForums.com, you agree to our Terms of Use and Privacy Policy.