Fishnet performance

Fishnet for Lichess performance at different Scaleway nodes

chess

Common environment properties

  • lscpu excerpt: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian NUMA node(s): 1

  • fishnet-x86_64-unknown-linux-gnu v2.2.6, fishnet.ini: cores=3 userbacklog=0 systembacklog=0

Now the comparison goes

Bare metal

Some CPU info, by lscpu:

CPU(s):                       12
Vendor ID:                    GenuineIntel
Model name:                   Intel(R) Core(TM) i7-8750H CPU @ 2.20GHz
CPU MHz / min MHz / max MHz:  800.124 / 800,0000 / 4100,0000
BogoMIPS:                     4399.99

L1d cache:                    192 KiB
L1i cache:                    192 KiB
L2 cache:                     1,5 MiB
L3 cache:                     9 MiB

Flags:                        fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp md_clear flush_l1d

Engine selection, by fishnet:

CPU features: POPCNT | SSE | SSE2 | SSSE3 | SSE41 | AVX2 | FAST_BMI2 | SF_SSE2 | SF_SSSE3 | SF_SSE41_POPCNT | SF_AVX2 | SF_BMI2
Engine: stockfish-x86-64-bmi2 (for GPLv3, run: ./fishnet-x86_64-unknown-linux-gnu license)
Cores: 3

Workin fish sample:

[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#8  
[   |             ] https://lichess.org/... finished (6099 knps)
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#12POPCNT
[   |             ] https://lichess.org/... finished (4864 knps)
[===|=============> 3 cores, 23 queued, latest: https://lichess.org/...#37
><> fishnet/2.2.6: 4017 knps? (nnue), 11 batches, 579 positions, 1.268.401.731 total nodes
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#14 
[   |             ] https://lichess.org/... finished (5687 knps)
[===|=============> 3 cores, 48 queued, latest: https://lichess.org/...#13  
[===|=============> https://lichess.org/... finished (7510 knps)
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#14 
[   |             ] https://lichess.org/... finished (4991 knps)
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#9  
[   |             ] https://lichess.org/... finished (5996 knps)
[===|=============> 3 cores, 32 queued, latest: https://lichess.org/...^C
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#12 
[   |             ] https://lichess.org/... finished (6341 knps)

“DEV1-M” instance

Some CPU info, by lscpu:

CPU(s):               3
Vendor ID:            AuthenticAMD
Model name:           AMD EPYC 7281 16-Core Processor
CPU MHz:              2096.060
BogoMIPS:             4192.12
Virtualization:       AMD-V
Hypervisor vendor:    KVM
Virtualization type:  full

Flags:                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl xtopology cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibpb vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt sha_ni xsaveopt xsavec xgetbv1 virt_ssbd arat npt nrip_save arch_capabilities

Engine selection, by fishnet:

CPU features: POPCNT | SSE | SSE2 | SSSE3 | SSE41 | AVX2 | SF_SSE2 | SF_SSSE3 | SF_SSE41_POPCNT | SF_AVX2
Engine: stockfish-x86-64-avx2 (for GPLv3, run: ./fishnet-x86_64-unknown-linux-gnu license)
Cores: 3

Workin fish sample:

[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#15 
[   |             ] https://lichess.org/... finished (1663 knps)
><> fishnet/2.2.6: 1516 knps??? (nnue), 1 batches, 38 positions, 81.040.209 total nodes
[===|=============> 3 cores, 28 queued, latest: https://lichess.org/...#37
><> fishnet/2.2.6: 1516 knps??? (nnue), 1 batches, 38 positions, 81.040.209 total nodes
[===|=============> 3 cores, 33 queued, latest: https://lichess.org/...#9 
[===|=============> https://lichess.org/... finished (1689 knps)
[===|=============> 3 cores, 27 queued, latest: https://lichess.org/...#15
[===|=============> https://lichess.org/... finished (1264 knps)
[===|=============> 3 cores, 18 queued, latest: https://lichess.org/...#27^C
[===|===========  ] 3 cores, 14 queued, latest: https://lichess.org/...#23
><> fishnet/2.2.6: 1506 knps??? (nnue), 3 batches, 126 positions, 272.377.176 total nodes
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#10 
[   |             ] https://lichess.org/... finished (1262 knps)

“GP1-XS” instance

Some CPU info, by lscpu:

CPU(s):               4
Vendor ID:            AuthenticAMD
Model name:           AMD EPYC 7401P 24-Core Processor
CPU MHz:              1996.250
BogoMIPS:             3992.50
Virtualization:       AMD-V
Hypervisor vendor:    KVM
Virtualization type:  full

Flags:                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibpb vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt sha_ni xsaveopt xsavec xgetbv1 virt_ssbd arat npt nrip_save arch_capabilities

Engine selection, by fishnet:

CPU features: POPCNT | SSE | SSE2 | SSSE3 | SSE41 | AVX2 | SF_SSE2 | SF_SSSE3 | SF_SSE41_POPCNT | SF_AVX2
Engine: stockfish-x86-64-avx2 (for GPLv3, run: ./fishnet-x86_64-unknown-linux-gnu license)
Cores: 3

Workin fish sample:

[===|=============> 3 cores, 61 queued, latest: https://lichess.org/...#7 
[===|=============> https://lichess.org/... finished (2799 knps)
[===|=============> 3 cores, 75 queued, latest: https://lichess.org/...#15
[===|=============> https://lichess.org/... finished (4173 knps)
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#11 
[   |             ] https://lichess.org/... finished (4171 knps)
[===|=============> 3 cores, 46 queued, latest: https://lichess.org/...#59
><> fishnet/2.2.6: 2113 knps??? (nnue), 3 batches, 191 positions, 399.084.159 total nodes
[===|=============> 3 cores, 52 queued, latest: https://lichess.org/...#13
[===|=============> https://lichess.org/... finished (4954 knps)
[===|=============> 3 cores, 37 queued, latest: https://lichess.org/...#10
[===|=============> https://lichess.org/... finished (3644 knps)
[===|=============> 3 cores, 68 queued, latest: https://lichess.org/...#11
[===|=============> https://lichess.org/... finished (3102 knps)
[===|==           ] 3 cores, 5 queued, latest: https://lichess.org/...#15 
><> fishnet/2.2.6: 2579 knps?? (nnue), 6 batches, 361 positions, 758.578.622 total nodes
[===|=============> 3 cores, 69 queued, latest: https://lichess.org/...#11^C
[===|=============> 3 cores, 65 queued, latest: https://lichess.org/...#8 
[===|=============> https://lichess.org/... finished (3602 knps)
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#10 
[   |             ] https://lichess.org/... finished (4464 knps)

“GP1-L” instance

Some CPU info, by lscpu:

CPU(s):               32
Vendor ID:            AuthenticAMD
Model name:           AMD EPYC 7401P 24-Core Processor
CPU MHz:              1996.236
BogoMIPS:             3992.47
Virtualization:       AMD-V
Hypervisor vendor:    KVM
Virtualization type:  full

Flags:                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl xtopology cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibpb vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt sha_ni xsaveopt xsavec xgetbv1 virt_ssbd arat npt nrip_save arch_capabilities

Engine selection, by fishnet:

CPU features: POPCNT | SSE | SSE2 | SSSE3 | SSE41 | AVX2 | SF_SSE2 | SF_SSSE3 | SF_SSE41_POPCNT | SF_AVX2
Engine: stockfish-x86-64-avx2 (for GPLv3, run: ./fishnet-x86_64-unknown-linux-gnu license)
Cores: 3

Workin fish sample:

[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#13 
[   |             ] https://lichess.org/... finished (3412 knps)
[===|=============> 3 cores, 59 queued, latest: https://lichess.org/...#11
[===|=============> https://lichess.org/... finished (3144 knps)
[===|=============> 3 cores, 35 queued, latest: https://lichess.org/...#41
><> fishnet/2.2.6: 1836 knps??? (nnue), 2 batches, 94 positions, 207.083.676 total nodes
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#6  
[   |             ] https://lichess.org/... finished (3121 knps)
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#8  
[   |             ] https://lichess.org/... finished (4301 knps)
[===|=============> 3 cores, 17 queued, latest: https://lichess.org/...#26
><> fishnet/2.2.6: 2198 knps?? (nnue), 4 batches, 190 positions, 423.153.558 total nodes
[===|==========   ] 3 cores, 13 queued, latest: https://lichess.org/...#22^C
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#8  
[   |             ] https://lichess.org/... finished (3015 knps)

“GP1-S” instance

Some CPU info, by lscpu:

CPU(s):               8
Vendor ID:            AuthenticAMD
Model name:           AMD EPYC 7401P 24-Core Processor
CPU MHz:              1996.249
BogoMIPS:             3992.49
Virtualization:       AMD-V
Hypervisor vendor:    KVM
Virtualization type:  full
L1d cache:            64K
L1i cache:            64K
L2 cache:             512K
L3 cache:             16384K

Flags:                fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw perfctr_core ssbd ibpb vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt sha_ni xsaveopt xsavec xgetbv1 virt_ssbd arat npt nrip_save

Engine selection, by fishnet:

CPU features: POPCNT | SSE | SSE2 | SSSE3 | SSE41 | AVX2 | SF_SSE2 | SF_SSSE3 | SF_SSE41_POPCNT | SF_AVX2
Engine: stockfish-x86-64-avx2 (for GPLv3, run: ./fishnet-x86_64-unknown-linux-gnu license)
Cores: 3

Workin fish sample:

[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#15 
[   |             ] https://lichess.org/... finished (3827 knps)
[===|====         ] 3 cores, 7 queued, latest: https://lichess.org/...#17 
><> fishnet/2.2.6: 1732 knps??? (nnue), 1 batches, 32 positions, 72.032.961 total nodes
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#7 
[   |             ] https://lichess.org/... finished (2558 knps)
[===|=============> 3 cores, 64 queued, latest: https://lichess.org/...#9 
[===|=============> https://lichess.org/... finished (3890 knps)
[===|=============> 3 cores, 39 queued, latest: https://lichess.org/...#11
[===|=============> https://lichess.org/... finished (3453 knps)
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#15 
[   |             ] https://lichess.org/... finished (2880 knps)
[===|=============> 3 cores, 43 queued, latest: https://lichess.org/...#49
><> fishnet/2.2.6: 2237 knps?? (nnue), 5 batches, 205 positions, 439.811.836 total nodes
[   |             ] 3 cores, 0 queued, latest: https://lichess.org/...#6  
[   |             ] https://lichess.org/... finished (3022 knps)