Quantcast
Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
    1. Welcome to GTAForums!   (84,805 visits to this link)

    2. News

    1. GTA Online

      1. Find Lobbies & Players
      2. Guides & Strategies
      3. Vehicles
      4. Content Creator
      5. Help & Support
    2. Crews

      1. Events
      2. Recruitment
    1. Grand Theft Auto Series

    2. GTA Next

    3. GTA V

      1. PC
      2. Guides & Strategies
      3. Help & Support
    4. GTA IV

      1. Episodes from Liberty City
      2. Multiplayer
      3. Guides & Strategies
      4. Help & Support
      5. GTA Mods
    5. GTA Chinatown Wars

    6. GTA Vice City Stories

    7. GTA Liberty City Stories

    8. GTA San Andreas

      1. Guides & Strategies
      2. Help & Support
      3. GTA Mods
    9. GTA Vice City

      1. Guides & Strategies
      2. Help & Support
      3. GTA Mods
    10. GTA III

      1. Guides & Strategies
      2. Help & Support
      3. GTA Mods
    11. Top Down Games

      1. GTA Advance
      2. GTA 2
      3. GTA
    12. Wiki

      1. Merchandising
    1. GTA Modding

      1. GTA V
      2. GTA IV
      3. GTA III, VC & SA
      4. Tutorials
    2. Mod Showroom

      1. Scripts & Plugins
      2. Maps
      3. Total Conversions
      4. Vehicles
      5. Textures
      6. Characters
      7. Tools
      8. Other
      9. Workshop
    3. Featured Mods

      1. DYOM
      2. OpenIV
      3. GTA: Underground
      4. GTA: Liberty City
      5. GTA: State of Liberty
    1. Red Dead Redemption 2

    2. Red Dead Redemption

    3. Rockstar Games

    1. Off-Topic

      1. General Chat
      2. Gaming
      3. Technology
      4. Programming
      5. Movies & TV
      6. Music
      7. Sports
      8. Vehicles
    2. Expression

      1. Graphics / Visual Arts
      2. GFX Requests & Tutorials
      3. Writers' Discussion
      4. Debates & Discussion
    1. Forum Support

    2. Site Suggestions

mmuaz

Getting depth stencil and segmentation data

Recommended Posts

mmuaz

I am trying to run this repository umautobots/GTAVisionExport/native. I have compiled and built it successfully following instructions on the repo.

I posted some issues on this link under name muaz-git. Does anyone have ever tried to run this repository and could help me in running this repository. I am pretty sure that I am either missing some driver or library on runtime otherwise it wouldn't have compiled properly. Also for most of the people it works properly or at least to some extent.
I am kind of new to C++ and not really sure how to debug and figure out what I am doing wrong. here are my complete PC Specs. I would really appreciate if anyone could help me in running this repository. I am struggling on it for months now and finally decided to post here. I will really appreciate your help.
Actually I am not able to get depth maps of the game after pressing the `L` key. After bit of manual debugging I found out that in this line is getting executed for me all the time. Besides that whenever I try to save depth map, the conditions here are not satisfied which is I think the reason that I am not getting depth map. Specifically, `Format` of `D3D11_TEXTURE2D_DESC` doesn't match sometimes also `Width` and `Height` of `D3D11_TEXTURE2D_DESC` are not always greater than `1000` (which is the reason that condition will be trued).
Edited by mmuaz

Share this post


Link to post
Share on other sites
K^2

Do you need to monitor these continuously for the mod, or are you just looking for a snapshot for some external use? Because in the later case, I would recommend to just use RenderDoc.

Share this post


Link to post
Share on other sites
mmuaz

Well, I wanted to use it for external purpose. As I plan to collect segmentation data in order to use them for my thesis. I have looked in to renderdoc as per the guys from Dramstadt have worked on. But as suggested by them, it's kind of semi-automatic. I am looking for something, which should be completely automatic.

Share this post


Link to post
Share on other sites
azathoth42

Well, I wanted to use it for external purpose. As I plan to collect segmentation data in order to use them for my thesis. I have looked in to renderdoc as per the guys from Dramstadt have worked on. But as suggested by them, it's kind of semi-automatic. I am looking for something, which should be completely automatic.

Hi, I am now too using the umautobots/GTAVisionExport as part of my thesis. Few days ago, I managed to get working the automatic gathering of screenshots with depth and stencil data. I proposed pull request with fully working automatic driving and collecting both screenshots to tiff and saving metadata to PostgreSQL database.

Btw, I am racinmat on the github.

How are you proceeding with it? I am now struggling with displaying bounding boxes over the screenshot. Did you figure that out? And what about the depth data? Does it work for you properly?

Share this post


Link to post
Share on other sites
Cuky

Hi guys,

the umautobots/GTAVisionExport is working fine for depth and stencil. But what about full image segmentation? I can't use renderdoc....according to this article https://hackernoon.com/hacking-gta-v-for-carvana-kaggle-challenge-6d0b7fb4c781and the screenshot of the code, I assume that they can extract some kind of a vertex buffer, thus the shapes?!

 

Another approach could be to "map" a pixel of an image to a 3D point in game with raycast.

So first calculating for every pixel in image file, e.g. 1920 x 1080, the 3D coordinates in game, make a raycast to this point and get hash or object class or something like that and save that along pixel and 3D point (maybe usefull for depth info) for every frame.

But this would be over 2 million raycast for a single frame, I don't know if this will work!

 

Do you have any idea how to solve this?

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×

Important Information

By using GTAForums.com, you agree to our Terms of Use and Privacy Policy.