SCCT - Tactical Test Suite's Results

Go down

SCCT - Tactical Test Suite's Results

Post by Sedat Canbaz on Sun Aug 30, 2015 5:13 pm

Dear Chess Friends,

Update - 30.08.2015:

Code:
Engine                    : Points
Stockfish 170815 x64      : 309
Synapse RZ4 WSET Tact x64 : 301
KingAsad D100815 x64      : 301
SugaR PrO v1.0 64         : 300
DeathDanger 3 x64         : 298
Komodo 9.2 x64            : 291
Ginko 1.2 x64             : 216
Andscacs 0.82 x64         : 191
Tornado 7 x64             : 116
Arminius 060815 x64       :  97
Giraffe 280815 x64        :  93


More Details
TTs official ranking includes only (since 30.08.2015):
1) Public and strongest versions
2) Engines, which are up to 55% similarity (+56% out)
* Exception there will be for:
- Private engine, in case of better performance than the leader (Houdini 4 tactical)
- For derivative engines: in case of +20 points better than based original engine
- For clone engines: in case of +100 points better than based original engine
* Houdini 4 Tactical (based mainly on Rybka) managed to do that...why not other engine?!
* Otherwise, TTs rankings will be based mainly on Stockfish/Rybka derivatives or clones
* Thanks for your understanding !

A few notes more,
Stockfish 170815 performed better than all previous SF development versions
*But however, even this new SF release could not do better than Stockfish 6
Synapse RZ4 WSET Tactical x64 has been tested with 'Tactical mode' enabled
Ginko 1.2 x64 performed 14 points better than previous Ginkgo 1.0e x64
Giraffe 280815 x64 performed 29 points better than Giraffe 010815 x64
Congrats to all engine authors who managed to improve their engines...

Unexpected and disappointed tactical results by some newer versions:
- Komodo 9.2 x64 (17 points less than Komodo 9.01 x64)
- Tornado 7 x64 (12 points less than Tornado 5 x64)
- Andscacs 0.82 x64 (8 points less than Andscacs 0.81 x64)
- Arminius 060815 x64 (1 point less than Arminius 2014 x64)

Some new engines which have analyze bugs:
Alfil 15.8 and Fizbo 1.5 have the same analyze bug as Protector 1.8 and Stockfish 5
I don't know exactly, but it seems some authors copy or study also the bad parts...
Also since today,
I will not use any polyglot adapter for those buggy UCI engines, due to we are in 2015

And I hope the newer versions can analyze and to be better in tactics !)

SCCT - TTs (3 seconds per position) - All Versions:
[You must be registered and logged in to see this link.]

SCCT - TTs Conditions/Rules:
[You must be registered and logged in to see this link.]



Best,
Sedat

Sedat Canbaz
Knight

Posts : 58
ELO : 11169
Join date : 2015-08-11

Back to top Go down

Re: SCCT - Tactical Test Suite's Results

Post by kingasad on Sun Sep 06, 2015 6:27 pm

Sounds good

_________________
Champion is one no one can Take place of champion Even Developers [You must be registered and logged in to see this image.]
avatar
kingasad
Super Admin
Super Admin

Posts : 149
ELO : 2147496886
Join date : 2014-12-29
Age : 28
Location : KAMBER ALI KHAN / PAKISTAN SINDH

Back to top Go down

Re: SCCT - Tactical Test Suite's Results

Post by Sedat Canbaz on Tue Sep 22, 2015 8:31 pm

kingasad wrote:Sounds good

Thanks

Sedat Canbaz
Knight

Posts : 58
ELO : 11169
Join date : 2015-08-11

Back to top Go down

Re: SCCT - Tactical Test Suite's Results

Post by Sedat Canbaz on Tue Sep 22, 2015 8:33 pm

Update: 22.09.2015

Code:
Engine                    : Points
Shark 150915 x64          : 315
Stockfish 190915 x64      : 312
SF TPA0918MZ x64          : 310
SugaR 160915 x64          : 304
Orka 150915 x64           : 300
Stockfish 300815IP x64    : 298
Ultron 1.1 x64            : 240
Judas 1.02 x64            : 211
Mars T34 090545 x64       : 252
Bitfoot 1.0.d9aeb43 x64   :  76
Laser 0.1 x64             :  56
Zurichess Freibourg       :  54
Sayuri 040915 x64         :  49
Supra 21.0 Pro x64        :  25

More Details,
Finely, 2 (two) new SF versions performed better than Stockfish 6
Note that Stockfish 6's tactical result was 310 points

I wonder a lot about who will be the 1st engine programmer,
Who will be able to pass the 3 old Houdini 4...we will wait a lot...?)

Some engines, which dont support analyze mode or I could not run them:
Fischerle 0965, Embla-0.4, Satana.2.1.11

SCCT - TTs (3 seconds per position) - All Versions:
[You must be registered and logged in to see this link.]

SCCT - TTs's Conditions/Rules:
[You must be registered and logged in to see this link.]

Regards,
Sedat

Sedat Canbaz
Knight

Posts : 58
ELO : 11169
Join date : 2015-08-11

Back to top Go down

Re: SCCT - Tactical Test Suite's Results

Post by kingasad on Wed Sep 23, 2015 6:42 pm

Sedat Canbaz wrote:Update: 22.09.2015

Code:
Engine                    : Points
Shark 150915 x64          : 315
Stockfish 190915 x64      : 312
SF TPA0918MZ x64          : 310
SugaR 160915 x64          : 304
Orka 150915 x64           : 300
Stockfish 300815IP x64    : 298
Ultron 1.1 x64            : 240
Judas 1.02 x64            : 211
Mars T34 090545 x64       : 252
Bitfoot 1.0.d9aeb43 x64   :  76
Laser 0.1 x64             :  56
Zurichess Freibourg       :  54
Sayuri 040915 x64         :  49
Supra 21.0 Pro x64        :  25

More Details,
Finely, 2 (two) new SF versions performed better than Stockfish 6
Note that Stockfish 6's tactical result was 310 points

I wonder a lot about who will be the 1st engine programmer,
Who will be able to pass the 3 old Houdini 4...we will wait a lot...?)

Some engines, which dont support analyze mode or I could not run them:
Fischerle 0965, Embla-0.4, Satana.2.1.11

SCCT - TTs (3 seconds per position) - All Versions:
[You must be registered and logged in to see this link.]

SCCT - TTs's Conditions/Rules:
[You must be registered and logged in to see this link.]

Regards,
Sedat
very interesting Tour

_________________
Champion is one no one can Take place of champion Even Developers [You must be registered and logged in to see this image.]
avatar
kingasad
Super Admin
Super Admin

Posts : 149
ELO : 2147496886
Join date : 2014-12-29
Age : 28
Location : KAMBER ALI KHAN / PAKISTAN SINDH

Back to top Go down

Re: SCCT - Tactical Test Suite's Results

Post by Sedat Canbaz on Fri Sep 25, 2015 12:48 pm

Update: 25.09.2015

Code:
Engine                     : Points
Houdini 3 Tactical x64     : 356
StockfishTS 240915 x64     : 317
Schooner 1.4.2 x64         :  87
Clubfoot 1.0.048995d x64   :  57
Galjoen 0.30 w32           :  53

More Details,
-Houdini 3 Tact performed incredible strong, slightly weaker than Houdini 4 Tact
-StockfishTS 240915: best performance so far, comparing with other SF versions


Some engines, which crashed on my systems:
Embla 0.5, Neurone XXIII

SCCT - TTs (3 seconds per position) - All Versions:
[You must be registered and logged in to see this link.]

SCCT - TTs Conditions/Rules:
[You must be registered and logged in to see this link.]

Best,
Sedat

Sedat Canbaz
Knight

Posts : 58
ELO : 11169
Join date : 2015-08-11

Back to top Go down

Re: SCCT - Tactical Test Suite's Results

Post by Sedat Canbaz on Thu Oct 29, 2015 4:33 pm

Update: 29.10.2015
Code:

Engine                     : Points
Stockfish 251015 x64       : 304
NirvanaChess 2.2 x64       : 207
Protector 1.9.0 x64        : 157
Pedone 1.3 x64             : 125
ProDeo 2.0 w32             : 112
Maverick 1.5 x64           : 104
CyberPagno 2.3 w32         :  84
NanoSzachy 4.1 x64         :  78


Details,
- Stockfish 251015 (Author: lucasart) performed 13 points less than StockfishTS 240915
- NirvanaChess 2.2 x64 performed 18 points better than NirvanaChess 2.1c x64
- Protector 1.9.0 is bugy as previous its versions (performed much worse: 157 points)
* Protector 1.8.0 is tested via Polyglot adapter, where v1.9.0 as native (UCI)
- The latest Donna 3.1 x64 version does not support analyze mode too
- Pedone 1.3 x64 performed 3 points less than Pedone 1.2 x64
- ProDeo 2.0 w32 performed 5 points less than ProDeo 1.87 w32
- Maverick 1.5 x64 performed 5 points better than Maverick 1.0 x64
- NanoSzachy 4.1 x64 performed 1 points less than NanoSzachy 4 x64
- CyberPagno 2.3 w32 performed 8 points better than CyberPagno 2.2 w32

*CyberPagno, Maverick, NirvanaChess are the only ones in this update,
which managed to scored better than older versions...congrats to their developers !


More Details,
Probably I will publish my used EPD database after when X chess engine will pass Houdini !)
So till to this date, TTs test positions are planning to be kept as private (as before)
And I really wonder: who will be this hero ?) who will be able to add best tactical improvement!


SCCT - TTs (3 seconds per position) - All Versions:
[You must be registered and logged in to see this link.]

SCCT - TTs Conditions/Rules:
[You must be registered and logged in to see this link.]

Best Regards,
Sedat

Sedat Canbaz
Knight

Posts : 58
ELO : 11169
Join date : 2015-08-11

Back to top Go down

Re: SCCT - Tactical Test Suite's Results

Post by Sponsored content


Sponsored content


Back to top Go down

Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum