SCCT - Tactical Test Suite's Results

Dear Chess Friends,

Update - 30.08.2015:




More Details
TTs official ranking includes only (since 30.08.2015):
1) Public and strongest versions
2) Engines, which are up to 55% similarity (+56% out)
* Exception there will be for:
- Private engine, in case of better performance than the leader (Houdini 4 tactical)
- For derivative engines: in case of +20 points better than based original engine
- For clone engines: in case of +100 points better than based original engine
* Houdini 4 Tactical (based mainly on Rybka) managed to do that...why not other engine?!
* Otherwise, TTs rankings will be based mainly on Stockfish/Rybka derivatives or clones
* Thanks for your understanding !

A few notes more,
Stockfish 170815 performed better than all previous SF development versions
*But however, even this new SF release could not do better than Stockfish 6
Synapse RZ4 WSET Tactical x64 has been tested with 'Tactical mode' enabled
Ginko 1.2 x64 performed 14 points better than previous Ginkgo 1.0e x64
Giraffe 280815 x64 performed 29 points better than Giraffe 010815 x64
Congrats to all engine authors who managed to improve their engines...

Unexpected and disappointed tactical results by some newer versions:
- Komodo 9.2 x64 (17 points less than Komodo 9.01 x64)
- Tornado 7 x64 (12 points less than Tornado 5 x64)
- Andscacs 0.82 x64 (8 points less than Andscacs 0.81 x64)
- Arminius 060815 x64 (1 point less than Arminius 2014 x64)

Some new engines which have analyze bugs:
Alfil 15.8 and Fizbo 1.5 have the same analyze bug as Protector 1.8 and Stockfish 5
I don't know exactly, but it seems some authors copy or study also the bad parts...
Also since today,
I will not use any polyglot adapter for those buggy UCI engines, due to we are in 2015

And I hope the newer versions can analyze and to be better in tactics !)

SCCT - TTs (3 seconds per position) - All Versions:
[You must be registered and logged in to see this link.]

SCCT - TTs Conditions/Rules:
[You must be registered and logged in to see this link.]



Best,
Sedat

Sounds good

kingasad wrote:

Sounds good

Thanks

Update: 22.09.2015



More Details,
Finely, 2 (two) new SF versions performed better than Stockfish 6
Note that Stockfish 6's tactical result was 310 points

I wonder a lot about who will be the 1st engine programmer,
Who will be able to pass the 3 old Houdini 4...we will wait a lot...?)

Some engines, which dont support analyze mode or I could not run them:
Fischerle 0965, Embla-0.4, Satana.2.1.11

SCCT - TTs (3 seconds per position) - All Versions:
[You must be registered and logged in to see this link.]

SCCT - TTs's Conditions/Rules:
[You must be registered and logged in to see this link.]

Regards,
Sedat

Sedat Canbaz wrote:

Update: 22.09.2015

Code:

Engine                    : Points
Shark 150915 x64          : 315
Stockfish 190915 x64      : 312
SF TPA0918MZ x64          : 310
SugaR 160915 x64          : 304
Orka 150915 x64           : 300
Stockfish 300815IP x64    : 298
Ultron 1.1 x64            : 240
Judas 1.02 x64            : 211
Mars T34 090545 x64       : 252
Bitfoot 1.0.d9aeb43 x64   :  76
Laser 0.1 x64             :  56
Zurichess Freibourg       :  54
Sayuri 040915 x64         :  49
Supra 21.0 Pro x64        :  25

More Details,
Finely, 2 (two) new SF versions performed better than Stockfish 6
Note that Stockfish 6's tactical result was 310 points

I wonder a lot about who will be the 1st engine programmer,
Who will be able to pass the 3 old Houdini 4...we will wait a lot...?)

Some engines, which dont support analyze mode or I could not run them:
Fischerle 0965, Embla-0.4, Satana.2.1.11

SCCT - TTs (3 seconds per position) - All Versions:
[You must be registered and logged in to see this link.]

SCCT - TTs's Conditions/Rules:
[You must be registered and logged in to see this link.]

Regards,
Sedat

very interesting Tour

Update: 25.09.2015



More Details,
-Houdini 3 Tact performed incredible strong, slightly weaker than Houdini 4 Tact
-StockfishTS 240915: best performance so far, comparing with other SF versions


Some engines, which crashed on my systems:
Embla 0.5, Neurone XXIII

SCCT - TTs (3 seconds per position) - All Versions:
[You must be registered and logged in to see this link.]

SCCT - TTs Conditions/Rules:
[You must be registered and logged in to see this link.]

Best,
Sedat

Update: 29.10.2015



Details,
- Stockfish 251015 (Author: lucasart) performed 13 points less than StockfishTS 240915
- NirvanaChess 2.2 x64 performed 18 points better than NirvanaChess 2.1c x64
- Protector 1.9.0 is bugy as previous its versions (performed much worse: 157 points)
* Protector 1.8.0 is tested via Polyglot adapter, where v1.9.0 as native (UCI)
- The latest Donna 3.1 x64 version does not support analyze mode too
- Pedone 1.3 x64 performed 3 points less than Pedone 1.2 x64
- ProDeo 2.0 w32 performed 5 points less than ProDeo 1.87 w32
- Maverick 1.5 x64 performed 5 points better than Maverick 1.0 x64
- NanoSzachy 4.1 x64 performed 1 points less than NanoSzachy 4 x64
- CyberPagno 2.3 w32 performed 8 points better than CyberPagno 2.2 w32

*CyberPagno, Maverick, NirvanaChess are the only ones in this update,
which managed to scored better than older versions...congrats to their developers !


More Details,
Probably I will publish my used EPD database after when X chess engine will pass Houdini !)
So till to this date, TTs test positions are planning to be kept as private (as before)
And I really wonder: who will be this hero ?) who will be able to add best tactical improvement!


SCCT - TTs (3 seconds per position) - All Versions:
[You must be registered and logged in to see this link.]

SCCT - TTs Conditions/Rules:
[You must be registered and logged in to see this link.]

Best Regards,
Sedat