OmniAI OCR Benchmark Using Structured Outputs to evaluate OCR accuracy Published Feb 20, 2025 Overview Are LLMs a total replacement for traditional OCR models? It’s been an increasingly hot topic, especially with models like Gemini 2.0 becoming cost competitive with … Read more
Introducing the Kagi LLM Benchmarking Project, which evaluates major large language models (LLMs) on their reasoning, coding, and instruction following capabilities. LLM Benchmarks The Kagi LLM Benchmarking Project uses an unpolluted benchmark to assess contemporary large language models (LLMs) … Read more
Scott I was recently trying to quantify the tradeoffs in user-experience for a wireless product and successfully nerd-sniped myself into evaluating a super-set of wireless modules and protocols. While standards groups, radio chipset vendors, and IOT system integrators happily talk … Read more
Erasure Coding is a feature at the heart of MinIO. It is one of the cornerstones that provides high availability to distributed setups. In short, objects written to MinIO are split into a number of data shards (M). To supplement … Read more
The price of Solid-state drives (SSDs) has dropped significantly over the last few years. It’s now possible to buy a 1TB solid-state drive for less than €60. However, at such low price points, there is a catch. Although cheap SSDs … Read more
The yearly benchmarking Ruby post 26. December 2022 It’s this time of the year again where Ruby is released and everyone asks: Is it faster? You will find out below! And if you are interested, you can compare the results … Read more
This blog post is about benchmarking Caddy against Nginx and their respective performance metrics as reverse proxies. Be forewarned: I was very thorough and there are tons of graphs and tables in here. I didn’t want to make any mistakes! … Read more
For input device to screen measurement, high frame rate camera on your phone. Accuracy isn’t the best, but what you measure is as real as it gets. To me the question is how do you use that method to measure … Read more
Introduction I recently got a 2021 16″ M1 Max MacBook Pro. It’s amazing for day-to-day use, but I was curious about the actual capabilities of the SOC. Benchmarking is a complex task, and there are plenty of outlets like Anandtech … Read more
Last week I quietly released ec2-boot-bench, a tool for benchmarking EC2 instance boot times. This tool is BSD licensed, and should compile and run on any POSIX system with OpenSSL or LibreSSL installed. Usage is simple — give it AWS … Read more