Pages: [1] 2
  Print  
Author Topic: Pre-defined DEMO for timedemo benchmarks  (Read 42534 times)
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« on: November 06, 2011, 04:57:27 AM »

Hi guys!
What about inserting a pre-defined DEMO file with the next OpenArena release?
Do you remember the old times when "timedemo" command was used to run benchmarks with Q3A? Technically, it would be possible with OA, too... (DO NOT LINK) h t t p s : / / openarena . wikia . com/wiki/Demos#Timedemo:_use_demo_as_benchmark
A demo (named "demo088" or something similar?) that all users would have by default, would allow them to compare their systems.

What do you think about it?
« Last Edit: November 06, 2011, 07:11:50 AM by Gig » Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
Peter Silie
Member


Cakes 2008
Posts: 610



« Reply #1 on: November 06, 2011, 06:09:57 AM »

Good idea.
But it should be a real demo with defrag for example - or maybe neons demo map
Logged
fromhell
Administrator
GET A LIFE!
**********

Cakes 35
Posts: 14520



WWW
« Reply #2 on: November 06, 2011, 06:35:56 AM »

It should be a demo with lots of crap going on. it's a benchmark after all

a player doing a looooooooooong jump is not an idea of a benchmark
Logged

asking when OA3 will be done won't get OA3 done.
Progress of OA3 currently occurs behind closed doors alone

I do not provide technical support either.

new code development on github
Peter Silie
Member


Cakes 2008
Posts: 610



« Reply #3 on: November 06, 2011, 06:47:15 AM »

hmmmmmm - you are right XD
Logged
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #4 on: November 06, 2011, 07:08:44 AM »

Defrag? Uhm... It should include baseoa stuff only.

I think it should use a good looking map, include various player models, a good number of players (or bots).

If possible, it would be nice to include stuff as rocketjumps, plasmaclimbs, mid-air rocketing/railing...
Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
Peter Silie
Member


Cakes 2008
Posts: 610



« Reply #5 on: November 06, 2011, 07:28:12 AM »

some skilled players here who like to do such a demo?
do we have to rename to "OA DemoQPlayer" or similar for this?
Logged
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #6 on: November 06, 2011, 07:40:39 AM »

It would be nice if some of us of the forum may organize a certain day/time on a certain server to record a such demo, with "us" appearing there.

We could record more demos at that time, from different players pov, and then choose the best one. One of us could even convert them to avi and use them to create an OA 0.8.8 promotional video to post on youtube or such.

But anyway, for benchmark purposes, even a single player fighting against bots could be enough.
Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #7 on: November 08, 2011, 11:32:33 AM »

Guys, any suggestion about the map to use for that?

And anyone out there that wants to record the demo?
I could try, but I'm not extremely skilled and thus the demo would not show very good things... (and I'm not used to play with g_synchronousclients enabled).
Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
Neon_Knight
In the year 3000
***

Cakes 49
Posts: 3775


Trickster God.


« Reply #8 on: November 08, 2011, 11:41:20 AM »

A graphic-heavy map, of course.

oa_shouse, czest2ctf and czest1dm come to mind.
Logged


"Detailed" is nice, but if it gets in the way of clarity, it ceases being a nice addition and becomes a problem. - TVT
Want to contribute? Read this.
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #9 on: November 08, 2011, 05:10:51 PM »

Hi! I've recorded a demo on a clean 0.8.8 RC installation, to make a test.

- My hardware is about a 2003-2004 machine, so it suffers a bit
- I used g_syncronousclients. I'm not very comfortable with it, and when I tried a couple of RJs, they were unsatisfying (I'm having some little troubles with my wireless mouse, too)
- I played locally, fragging a good number of stupid "I can win" bots.
- I played oa_shouse.
- You can see some "WARNING: unhandled AL error: Invalid value" errors appearing even in the demo.

I think it would be better if someone better than me (in skills and hardware) could do a better demo.

Anyway, I attach it to this message if you want to try it for a DO NOT LINK[/b]) h t t p s : / / openarena . wikia . com/wiki/Demos#Timedemo:_use_demo_as_benchmark]timedemo.
« Last Edit: November 17, 2011, 04:55:04 PM by Gig » Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
sittingduck
Half-Nub


Cakes 1
Posts: 81



WWW
« Reply #10 on: November 10, 2011, 12:00:20 AM »

Hi! I've recorded a demo on a clean 0.8.8 RC installation, to make a test.
Here's my result: 

3398 frames 8.0 seconds 426.1 fps

Logged
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #11 on: November 10, 2011, 12:56:56 AM »

Sounds very good. Mine did it @ little more than 50 fps... @640x480

Anyway the problem with these benchmarks is that there are  a billion of possible video settings combinations (resolution+texture mapping quality+color depth+bloom+filtering+fov+simple items+quality sky+marks on walls, etc. etc.) that it isn't easy to compare two or more systems. Anyway, players could use it to test which settings work better on their machine.

Anone that wants to try to record another demo with many bots?
Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
sittingduck
Half-Nub


Cakes 1
Posts: 81



WWW
« Reply #12 on: November 10, 2011, 01:28:57 AM »

Sounds very good. Mine did it @ little more than 50 fps... @640x480
Anyway the problem with these benchmarks is that there are  a billion of possible video settings combinations (resolution+texture mapping quality+color depth+bloom+filtering+fov+simple items+quality sky+marks on walls, etc. etc.) that it isn't easy to compare two or more systems. Anyway, players could use it to test which settings work better on their machine.
Anone that wants to try to record another demo with many bots?
You can create a baseline benchmark by moving your q3config.cfg and any autoexec, and running the demo with default settings.
Here are some of the relevant bits from my config. (3398 frames 8.0 seconds 426.1 fps)
//Screen
seta r_fullscreen "1"
seta cg_fov "105"
seta r_customwidth "1920"
seta r_customheight "1080"
seta ch_drawspeed "1"
seta cg_drawTimer "1"
seta cg_drawStatus "1"
seta cg_scorePlums "0"
seta cg_drawFPS "0"
seta cg_drawGun "0"
seta cg_zoomfov "40"
seta cg_drawCrosshairNames "1"
seta cg_crosshairPulse "0"
seta cg_simpleItems "1


//visuals
seta r_picmip "0"
seta r_textureMode "GL_LINEAR_MIPMAP_LINEAR"
seta r_detailtextures "1"
seta cg_draw2D "1"
seta color "1"
set cg_centertime "1"
seta cg_oldRail "0"
seta cg_bobroll "0.000"
seta cg_bobpitch "0.000"
seta cg_bobup "0.000"
seta cg_runroll "0.000"
seta cg_runpitch "0.000"
seta cg_shadows "0"
seta cg_marks "1"
seta com_blood "1"
seta r_ext_compressed_textures "1"
seta r_ext_compress_textures "1"
seta r_dynamiclight "0"
seta r_displayRefresh 100
seta cg_lagometer "0"
seta cg_crosshairHealth "0"
seta cg_drawRewards "0"
seta cg_drawAttacker "0"
seta cg_drawAmmoWarning "0"
seta cg_gibs "0"
seta com_blindlyLoadDLLs "1"
seta cg_trueLightning "0.5"
seta r_vertexLight "0"
seta s_mixahead "0.14"
seta r_intensity "1"
seta r_mapoverbrightbits "3"
seta s_khz "11"
seta sv_fps "125"
seta com_maxfps "125"
seta cg_drawCrosshair "4"
seta cg_brassTime "0"
cg_noprojectiletrail 1
cg_altLightning "0"
seta cg_smoke_sg "0"
seta cg_smokegrowth_gl "0"
seta cg_smokegrowth_rl "0"
seta cg_smokeradius_gl "0"
seta cg_smokeradius_rl "0"
seta cg_muzzleFlash 0

With the default config, I got:
3398 frames 9.7 seconds 350.2 fps
Logged
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #13 on: November 10, 2011, 02:38:36 AM »

I did DO NOT LINK[/b]) h t t p s : / / openarena . wikia . com/index.php?title=Manual%2FDemos&action=historysubmit&diff=9206&oldid=9152]this update to the wiki.  Smiley
Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
fromhell
Administrator
GET A LIFE!
**********

Cakes 35
Posts: 14520



WWW
« Reply #14 on: November 10, 2011, 04:47:02 AM »

That's a very strange console for a 0.8.8 test.

I can't exceed 200fps in this demo, for some strange reason. That strange reason seemed to be snd_useOpenAL. Now I enter 230fps.

I should note, OA's legacy rendering path isn't exactly the most optimal thing for modern DX10+ level cards. It does not scale well. IF you want faster, get some GL 2.0 action and make fun use of vertex shaders, vertex buffer objects and other stuff.

I should test the benchmark on a P2 system.

A lot of the slowness experienced in this demo come from player models. They use many surfaces. Kyonshi uses many surfaces AND many textures. She causes a lot of dip...even more than Angelyss. Hence, the whole push for OA3.....

personally I think a benchmark demo should be on a small good looking map (oa_shine, slimefac, etc) with a few "best looking" bots (skelebot, angelyss, grism, gargoyle and sergei are all models that look great) - the probable situation, maybe in spec mode going across them. After all, four dm was on a small map (q3dm6) with a few of the id crew.
Logged

asking when OA3 will be done won't get OA3 done.
Progress of OA3 currently occurs behind closed doors alone

I do not provide technical support either.

new code development on github
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #15 on: November 10, 2011, 05:00:32 AM »

I did it in that map (that Neon suggested), and with many bots, to give more challenge to computers, especially those recent (you see what high fps sittingduck got, unlike me). My problem is that my computer is quite old...

If you wish, I can try something different... or maybe someone more skilled than me could...
Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
Neon_Knight
In the year 3000
***

Cakes 49
Posts: 3775


Trickster God.


« Reply #16 on: November 10, 2011, 05:14:03 AM »

And another problem is that the ioTech3 engine is 10 years old. Newer PCs won't find a big challenge in any OA map, regardless of the size.
Logged


"Detailed" is nice, but if it gets in the way of clarity, it ceases being a nice addition and becomes a problem. - TVT
Want to contribute? Read this.
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #17 on: November 10, 2011, 01:04:59 PM »

My 0.8.alien wtih default settings, did 65.2 fps once, and 64.6 another time, with the demo above.
Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
sittingduck
Half-Nub


Cakes 1
Posts: 81



WWW
« Reply #18 on: November 14, 2011, 07:10:50 PM »

My system is not top of the line at all, but it's pretty decent.

CPU = AMD Phenom II X4 3.7 Ghz
GPU = GeForce GTX 550 Ti (Fermi) 1GB 192-bit GDDR5
RAM = CORSAIR XMS 4GB (2 x 2GB) 240-Pin DDR3 2000 (PC3 16000)
Logged
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #19 on: November 15, 2011, 03:37:41 PM »

Done another test.
This runs quicker than the previous one (another map, maybe some less bots)... but gameplay shown sucks.

I think I will try to do one while spectating bots, like Fromhell suggested... but if in the meanwhile you wanna try it.
I scored something around 91.3 fps here, with default configuration...
« Last Edit: November 17, 2011, 04:54:14 PM by Gig » Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
Peter Silie
Member


Cakes 2008
Posts: 610



« Reply #20 on: November 15, 2011, 03:40:06 PM »

NEVER SPEC BOTS!
you will get mad Wink
Logged
sittingduck
Half-Nub


Cakes 1
Posts: 81



WWW
« Reply #21 on: November 15, 2011, 04:13:41 PM »

Tested only with my normal config:
2083 frames 3.1 seconds 664.2 fps

I couldn't see much more than a brown blur at that speed, so the gameplay shown is pretty irrelevant.  Grin
Logged
Gig
In the year 3000
***

Cakes 45
Posts: 4394


WWW
« Reply #22 on: November 15, 2011, 04:35:29 PM »

Okay, there is a third demo here... it is in slimefac map, spectating bots playing (in spectator mode, not in firstperson!).

I scored 100.2 with default settings, here.

All three of them are released under GPLv2. Excuse me if, for time reasons, I haven't included the "copying" file. UPDATE: Files re-uploaded, "copying" file now included.
@Fromhell... then, do you think you could include a pre-defined demo in 0.8.8?

@Sittingduck: I hoped in a nice looking demo, considering that a pre-defined demo could be played also without the "timedemo" enabled.
« Last Edit: November 17, 2011, 04:56:12 PM by Gig » Logged

I never want to be aggressive, offensive or ironic with my posts. If you find something offending in my posts, read them again searching for a different mood there. If you still see something bad with them, please ask me infos. I can be wrong at times, but I never want to upset anyone.
sittingduck
Half-Nub


Cakes 1
Posts: 81



WWW
« Reply #23 on: November 15, 2011, 04:50:00 PM »

2571 frames 3.5 seconds 725.2 fps (my config)

If you want to see something fun, just go watch Gerbil's videos! Wink

http://www.youtube.com/user/GerbaIity
Logged
Peter Silie
Member


Cakes 2008
Posts: 610



« Reply #24 on: November 15, 2011, 04:52:15 PM »

jep, but this another type of demo.
searched our side, but no file found, which could fit the needs Sad
Logged
Pages: [1] 2
  Print  
 
Jump to: