Pages: [1]
  Print  
Author Topic: Extracting position data from recorded DEMO files  (Read 15919 times)
MCP42
Nub


Cakes 0
Posts: 3


« on: December 13, 2012, 04:29:47 AM »

Hi,

I have a project that is about extracting moving paths from 3rd person shooter.
My first idea was to parse a recorded Demo file from OA.
But i can't find a file in the sources were the DEMO file is generated from.
Can anyone tell me where i can find out how this file is generated?


Thanks in advance!
Logged
andrewj
Member


Cakes 24
Posts: 584



« Reply #1 on: December 13, 2012, 06:01:14 PM »

Demo files record the data received from the client from the server.  So if all you want is the client's movement path, this approach will work fine.

But if you wanted the paths of all players in a match, this won't work because the server doesn't transmit the position of players which are out-of-sight of that client (i.e. players not in his or her PVS).

There is code in client/cl_main.c for reading demos, e.g. CL_ReadDemoMessage()
Logged
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #2 on: December 14, 2012, 02:45:12 AM »

Well, at the moment, there is also a "serverside-demo" feature in development, available for testing. See here.
Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
GrosBedo
Member


Cakes 20
Posts: 710


« Reply #3 on: December 27, 2012, 08:48:38 PM »

I am the author of the server-side demo patch quoted above by Gig. This patch is not really in development anymore and I consider it to be pretty much final, since it is quite stable and I can't see what other features I could add (but I have some ideas about making an alternative patch, but that's another story).

About your question, as pointed out by andrewj, the code that writes and read demos are in the client-side part of the engine, and it's quite simple if you want to take a look.

But if you want to get a hang on how recording players states work in the engine, you can take a look at my patch since I've cleaned it up to the minimum and commented it as much as I could, more specifically the sv_demo.c file which contains all the recording and playback code.

If you want to get the quintessence of the mechanisms, you can read this part:
https://github.com/lrq3000/openarena_engine_serversidedemos/blob/latest/code/server/sv_demo.c#L623

Which pretty much sums it all:
- At the starting of the recording, some headers get created and outputted into a file (the demo file). Along the way, we also store the current state of every player (ie: the variables that defines various aspects of the players, like the position, mouse look, velocity, armor, ammos and weapons, etc.).
- Then, at each iteration, we just store the new state of every player. To be more specific, we don't store the whole values, but rather the difference between the previous frame's states and the current frame's players states, which is simply called the Delta in the engine. To achieve that, there are various functions that will do this automatically for you (just search for "delta" in the engine's sourcecode).
- At the end of the recording, we put some footers (EOF flag) and close the file.

Now about the technical format:
In the engine, these "states" and various other informations about the demo are called "messages". A message can contain only one information or a lot of information, depends on the format. For example: "demo_clientCommand" stores one command of one client at a time, while "demo_playerState" stores all players states for a frame (so you can get two or more demo_clientCommand messages, but only one demo_playerState message for one frame). In general, all players/entity states are stored in a single message (I guess for loop efficiency - demo_playerState, demo_entityState, demo_entityShared).
A message is composed of a constant byte header (a flag), which allows you to switch to the right processing chain, and then the data in a fixed format (a byte, then a string, then a long, etc...). In practice, you get the flag, but after you have to know in advance what will follow and decode the data in the right order, else your flow will get corrupted.

Warning: there are 3 major flags that can be confusing but are very different and need to be respected to the letter:
- demo_EOF: which means End Of Flux, not End Of File! This ends the current message, so that you can continue to the next message (but you are still on the same frame).
- demo_endFrame: which ends a frame (no more message for this frame, so another way of thinking about it is to think that it ends all messages). This flag is very important as it tells the engine that it now has to commit the changes (because even if the players states are updated, the players won't move until this flag is met).
- demo_endDemo: which means that it's the final end of the demo (end of all frames).

These flags are those that I use inside my patch, I can't remember if they are standard, but anyway you will meet the same flags (albeit maybe with another name) in any demo recording.


If you want a good example, here is the main playback loop of my patch:
https://github.com/lrq3000/openarena_engine_serversidedemos/blob/latest/code/server/sv_demo.c#L1106

This is clean example that will clearly show you how the processing chain works: you get a flag, then you branch to the right processing chain. Here I have stored every processing chain inside its own function, but in the vanilla engine's code, you will find that the processing chains are not so cleanly splitted, so you can expect to get very long if/else if/else branching where everything is done in a single function.

Recording and playback works the same, so that you can as easily save players states from a live game, or extract them from a demo.

Last note: my patch store a lot more informations than the standard client-side recording facility. For example, in my patch you can find about a dozen flags, when in the client-side recording facility you will find half (it was necessary for this patch to store more types of messages because the server-side engine does not have access to the game engine, contrarily to the client-side engine).

Last note2: if you are not used to this game's architecture, a big notion is the fact that the game is mainly split in 2: the engine, and the game code. The engine manage most of the stuff, but does not have access to most of the game logic, which is the part done by the game code. However, both parts can communicate together some kinds of information via "trap calls".
I know this can be confusing, but anyway for you it's not that important if you are only looking for the position of players, which you can access from both the engine or the game code. But it's still important to know if someday you want to go further.

I hope my explanations can be useful for you. Good luck for your project.
« Last Edit: December 27, 2012, 08:57:17 PM by GrosBedo » Logged
MCP42
Nub


Cakes 0
Posts: 3


« Reply #4 on: January 10, 2013, 06:27:29 PM »

Hey cool, thank You very much for the replies!
And a happy new Year!

I think the serversidedemocode will help me very much!

I compiled the serversideDemo version but it won't start.
Do i have to copy some files from the game version into it or from that version to an oe-x.x version?
Logged
GrosBedo
Member


Cakes 20
Posts: 710


« Reply #5 on: January 20, 2013, 09:42:18 AM »

No you don't need to do any manipulation, normally it should automatically compile using the cross-mingw-xxxxx.sh script.

What is the exact error code you get?

Please also check that you have installed all the required libraries (the same needed to compile ioquake3, like openal, opengl, etc.. check the readme).
Logged
MCP42
Nub


Cakes 0
Posts: 3


« Reply #6 on: January 21, 2013, 01:08:33 PM »

I had no problems with compiling. Only with starting.

But i copied all compiled files into the install folder of open arena and it works now!
I hope that was the right way.


Logged
GrosBedo
Member


Cakes 20
Posts: 710


« Reply #7 on: January 30, 2013, 03:50:10 AM »

Ah yes indeed, my patch only compiles the engine (the openarena.exe binary, or other extension for other OSes), so you have to copy it where your OpenArena data is (models, gamecode .qvm, config files, etc..).
Logged
i6arcia
Nub


Cakes 0
Posts: 3


« Reply #8 on: December 09, 2013, 02:14:17 PM »

Good day.
I amalsointerested in purchasinginvalidation.But nowhow doI haveaccessto information?
Logged
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #9 on: December 09, 2013, 02:51:40 PM »

Good day.
I amalsointerested in purchasinginvalidation.But nowhow doI haveaccessto information?
Excuse me?  Huh Huh Huh What?

That almost seems the post of a spambot, but that account has done (a couple of) proper "human" posts before...
Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
Suicizer
Member
Member
*

Cakes 2
Posts: 402


WWW
« Reply #10 on: December 09, 2013, 04:48:42 PM »

Good day.
I amalsointerested in purchasinginvalidation.But nowhow doI haveaccessto information?
Excuse me?  Huh Huh Huh What?

That almost seems the post of a spambot, but that account has done (a couple of) proper "human" posts before...

Perhaps a hacked account ?
Logged

I'm good at everything but can't do anything...
fromhell
Administrator
GET A LIFE!
**********

Cakes 35
Posts: 14520



WWW
« Reply #11 on: December 09, 2013, 09:33:32 PM »

The IP's first two subnets seem to match the prior post in Nov 4, and that one doesn't match his very first post......
Logged

asking when OA3 will be done won't get OA3 done.
Progress of OA3 currently occurs behind closed doors alone

I do not provide technical support either.

new code development on github
Suicizer
Member
Member
*

Cakes 2
Posts: 402


WWW
« Reply #12 on: December 10, 2013, 04:55:46 AM »

The IP's first two subnets seem to match the prior post in Nov 4, and that one doesn't match his very first post......

So I was right and the account got hacked O.O? Both cases sound creepy...
« Last Edit: December 10, 2013, 04:59:14 AM by Suicizer » Logged

I'm good at everything but can't do anything...
Pages: [1]
  Print  
 
Jump to: