Spyke

Posts

technology·Technologybyhttpjames

How well can LLMs solve chess puzzles?

Each LLM is given the same 1000 chess puzzles to solve. See puzzles.csv. Benchmarked on Mar 25, 2024.

ModelSolvedSolved %Illegal MovesIllegal Moves %Adjusted Elo
gpt-4-turbo-preview22922.9%16316.3%1144
gpt-419519.5%18318.3%1047
claude-3-opus-20240229727.2%46446.4%521
claude-3-haiku-20240307383.8%59059.0%363
claude-3-sonnet-20240229232.3%66366.3%286
gpt-3.5-turbo232.3%68368.3%269
claude-instant-1.2101.0%70766.3%245
mistral-large-latest40.4%81381.3%149
mixtral-8x7b90.9%83283.2%136
gemini-1.5-pro-latest*FAIL----

Published by the CEO of Kagi!

How well can LLMs solve chess puzzles?https://github.com/kagisearch/llm-chess-puzzlesOpen linkView original on sh.itjust.works
geforcenow·GeForceNowbyhttpjames

Any other Ultimate or Priority members getting long wait times too?

I've been in line for more than 10 minutes now for Ghostwire: Tokyo as an Ultimate member with 2 people in front of me. This is the first time I've waiting more than one minute in the last multiple years...

EDIT: I received the following message from GFN Live Chat:

We are aware of this. Extremely sorry for this. This is a temporary issue and our developers are working for a quick fix This will surely be fixed in few hours, however as of now we do not have any ETA We suggest you to try after sometime. This is unwanted issue and should be fixed very soon. There is no troubleshooting needed as of now. Please check after some time and it will be fixed ASAP

EDIT 2: No waits for me anymore!

View original on sh.itjust.works
selfhosted·Selfhostedbyhttpjames

VPN gateway server to share one config

I'm paying for a VPN service that has a limited number of concurrent devices but I want to use it on all of my devices. Is there a way to self-host a Wireguard VPN on my Linux server that will forward all WAN traffic to my third-party VPN provider? Ideally, I would generate a Wireguard config for this gateway, and all my devices would connect to my local VPN gateway server, thus allowing me to share that one config across all devices.

My router does not support VPN configuration and modifying its firmware is not an option.

View original on sh.itjust.works