[WIP|C#] Speech Recognition Mod

[julionib]

let me throw some ideas ^^:

 

Add a optinal hotkey that would be hold to enable the voice commands, if no hotkey is set you dont need to hold, works like actual one

 

Add commands like:

Fix car
Fix tyres
End car fire

Extra X (where x is a number between 1 and 9, this will toggle this vehicle extra on/off)

Heal me (increase player health)
I need help (spawn body guard)
Flip car

just some ideas

*edit: Oh yeah, make the reading of Jarvis.txt more "dynamic", dont make user put specific in "c:\program files\", you probably can use ".\Scripts\Jarvis mod\jarvis.txt" as path when reading and tell user to just paste all files in gta Scripts folder

Edited May 23, 2014 by julionib

[LordOfTheBongs]

i like the idea of having to hold down a hotkey, kinda like talking on a walkie talkie (i dont think they use these anymore)

[pedro2555]

i didnt read your source code but, its possible to you recognize a model name? like if i say "Spawn sabregt", it spawn a sabregt? that would be very cool, the problem is that my english is not that good and i would fail spawning some models ^^

It is possible to a certain extent. I've used the Speech SDK a long ago (XP Days), and let's say it wasn't the best Microsoft feature I've seen.

 

Microsoft provided U.S. English and Chinese recognition, but you could get other languages from third parties.

[julionib]

basically what it does is "hear" microfone and return a string?

Edited May 23, 2014 by julionib

[AgentWD40]

basically what it does is "hear" microfone and return a string?

using System;using System.Collections.Generic;using System.ComponentModel;using System.Data;using System.Drawing;using System.Linq;using System.Text;using System.Windows.Forms;using System.Speech.Recognition;namespace WindowsFormsApplication1{  public partial class Form1 : Form  {    public Form1()    {      InitializeComponent();    }    private void Form1_Load(object sender, EventArgs e)    {      // Create a new SpeechRecognitionEngine instance.      SpeechRecognitionEngine recognizer = new SpeechRecognitionEngine();      // Create a simple grammar that recognizes "red", "green", or "blue".      Choices colors = new Choices();      colors.Add(new string[] { "red", "green", "blue" });      // Create a GrammarBuilder object and append the Choices object.      GrammarBuilder gb = new GrammarBuilder();      gb.Append(colors);      // Create the Grammar instance and load it into the speech recognition engine.      Grammar g = new Grammar(gb);      recognizer.LoadGrammar(g);      // use the system's default microphone, you can also dynamically      // select audio input from devices, files, or streams.      speechRecognitionEngine.SetInputToDefaultAudioDevice();      // Register a handler for the SpeechRecognized event.      recognizer.SpeechRecognized +=        new EventHandler<SpeechRecognizedEventArgs>(sre_SpeechRecognized);      // start listening in RecognizeMode.Multiple, that specifies      // that recognition does not terminate after completion.      speechRecognitionEngine.RecognizeAsync(RecognizeMode.Multiple);    }    // Create a simple handler for the SpeechRecognized event.    void sre_SpeechRecognized(object sender, SpeechRecognizedEventArgs e)    {      MessageBox.Show("Speech recognized: " + e.Result.Text);    }  }}

Edited May 23, 2014 by hardsty1e

[julionib]

nice

[Rugz007]

Hey julio thanks for uploding ut on fb.... and teleporting thing i a gonna add..... thanks man.

[julionib]

no problem

[Silent]

i didnt read your source code but, its possible to you recognize a model name? like if i say "Spawn sabregt", it spawn a sabregt? that would be very cool, the problem is that my english is not that good and i would fail spawning some models ^^

It seems to work ONLY when you add the words to a speech dictionary. Before I did that, it'd never properly hear me saying Domestobot, while after adding the word to a dictionary (even without recording a pronouncation) it was 100% accurate. Hopefully that'd be the case with car names too.

 

Now, it'd be even easier if it was possible to define a specific dictionary by script. Is it doable?

[julionib]

mmm, well, at least for car names we could read the handling.dat or some file taht contains all car names (or obtain the car names list elsewhere) and add they as spawn commands with the word spawn + car name, im not sure about the result with cars like supergt, sultanrs

[Rugz007]

Had To Stop Modding Issues

[Silent]

mmm, well, at least for car names we could read the handling.dat or some file taht contains all car names (or obtain the car names list elsewhere) and add they as spawn commands with the word spawn + car name, im not sure about the result with cars like supergt, sultanrs

Wouldn't spawning by a GXT name be more reliable? Just obtain GXT keys and call CText::Get for those.

Edited May 29, 2014 by Silent

[julionib]

i dont know, just i just throw an idea that would work in theory ^^

[Rugz007]

Guys Goto http://www.gta4mmm.blogspot.in/

 

 

now You Can Use This Mod Feature

 

Its In The Tutorials Link

[PlayPrey]

You liar, there is no blogger with that username...

[Wiebrendh]

You liar, there is no blogger with that username...

 

He made a typo, his site is www.gta4mm.blogspot.in

But he did not make this mod by himselfe, he just copy pasted someone else his code

[AgentWD40]

 

You liar, there is no blogger with that username...

 

He made a typo, his site is www.gta4mm.blogspot.in

But he did not make this mod by himselfe, he just copy pasted someone else his code

 

"System.Speech" has memory leaks anyways, i've tested your guys script and it does have issues as well. you can see for yourself with this code.

public void Helper(object sender, GraphicsEventArgs e)        {            if (gHud == true)            {                e.Graphics.Scaling = FontScaling.ScreenUnits;                e.Graphics.DrawText("Memory: " + (Process.GetCurrentProcess().PrivateMemorySize64 / 1024).ToString("0") + " KB", 0.63f, 0.8f);                e.Graphics.DrawText("Counter: ", 0.63f, 0.86f);                if (Game.FPS >= 31)                {                    e.Graphics.DrawText("FPS: " + Game.FPS.ToString(), 0.63f, 0.83f);                    Interval = 0;                }                else if (Game.FPS <= 30)                {                    e.Graphics.DrawText("FPS: " + Game.FPS.ToString(), 0.63f, 0.83f, System.Drawing.Color.Yellow);                    Interval = 40;                }                else if (Game.FPS < 11)                {                    e.Graphics.DrawText("FPS: " + Game.FPS.ToString(), 0.63f, 0.83f, System.Drawing.Color.Red);                    Interval = 200;                }            }        }

Edited June 2, 2014 by hardsty1e

[LordOfTheBongs]

i dont think they understand what a memory leak is and why it is bad... instead of asking u to explain they just ignore, lol

Edited June 2, 2014 by LordOfTheBongs

[sherip008]

 

case "Sports Car":

Vector3 scpos = Player.Character.Position.Around(10.0f);

World.CreateVehicle(new Model("COMET"), scpos);

currentFunction = null;

break;

What's "scpos" mean ?

[gamerzworld]

 

 

case "Sports Car":

Vector3 scpos = Player.Character.Position.Around(10.0f);

World.CreateVehicle(new Model("COMET"), scpos);

currentFunction = null;

break;

What's "scpos" mean ?

 

Sports Car Position.

Edited June 5, 2014 by gamerzworld

[Rugz007]

U got it....still crying

[sherip008]

 

 

1. case "Jarvis":
2. Game.DisplayText("JARVIS Engine On");
3. currentFunction = null;
4. break;
6. case "Normal Car":
7. Vector3 nmpos = Player.Character.Position.Around(10.0f);
8. World.CreateVehicle(new Model("SULTAN"), nmpos);
9. currentFunction = null;
10. break;
12. case "Boat":
13. Vector3 mbpos = Player.Character.Position.Around(10.0f);
14. World.CreateVehicle(new Model("DINGHY"), mbpos);
15. currentFunction = null;
16. break;
17. case "Heal Me":
18. Player.Character.Health = 1000;
19. Player.Character.Armor = 1000;
20. break;
21. case "Fack You":
22. Game.DisplayText("JARVIS Engine Off");
23. Player.Character.Health = 50;
24. Player.Character.Armor = 0;
25. currentFunction = null;
26. break;
28. case "Fix Car":
29. if (Player.Character.isInVehicle())
30. Player.Character.CurrentVehicle.Repair(
31. Player.Character.CurrentVehicle.Wash();
32. break;

[Jitnaught]

 

 

 

1. case "Jarvis":
2. Game.DisplayText("JARVIS Engine On");
3. currentFunction = null;
4. break;
6. case "Normal Car":
7. Vector3 nmpos = Player.Character.Position.Around(10.0f);
8. World.CreateVehicle(new Model("SULTAN"), nmpos);
9. currentFunction = null;
10. break;
12. case "Boat":
13. Vector3 mbpos = Player.Character.Position.Around(10.0f);
14. World.CreateVehicle(new Model("DINGHY"), mbpos);
15. currentFunction = null;
16. break;
17. case "Heal Me":
18. Player.Character.Health = 1000;
19. Player.Character.Armor = 1000;
20. break;
21. case "Fack You":
22. Game.DisplayText("JARVIS Engine Off");
23. Player.Character.Health = 50;
24. Player.Character.Armor = 0;
25. currentFunction = null;
26. break;
28. case "Fix Car":
29. if (Player.Character.isInVehicle())
30. Player.Character.CurrentVehicle.Repair(
31. Player.Character.CurrentVehicle.Wash();
32. break;

 

 

Why exactly did you post this?

Oh and there are 3 problems with this code. Well, actually just two problems, and another thing that should be changed. In the fack you case, you set the health as 50, but the problem is you could actually be giving health, if the player's health is below 50. So it should be this

Player.Character.Health -= 50;//Health = Health - 50

And then the two problems... both are in the fix car case.

1: You forgot to put the begin { and end } brackets for the if. The only time you DON'T put the brackets, is when there is only going to be one line of code in the if.

2: You forgot to put a " ); " at the end of the repair function.