SQLite Release 3.44.0 On 2023-11-01
A few nice new features in this release. Allowing ORDER BY aggregate functions could be very useful.
Batch size one billion: SQLite insert speedups, from the useful to the absurd
Interesting post on how to speed up batch inserts with SQLite.
SQLite's automatic indexes
Short post about how SQLite sometimes creates indexes just for a single query. The SQLite documentation has a little more information.
It can be worth setting up and monitoring the error log for SQLITE_WARNING_AUTOINDEX warnings as good indication a persistent index should be created.
The Untold Story of SQLite - CoRecursive Podcast
Interview with Richard Hipp about the history of SQLite.
https://corecursive.com/066-sqlite-with-richard-hipp/Open linkView original on lemmy.worldSQLite 3.43.0 released
The main changes look to be contentless-delete FTS5 tables and performance enhancements to the query planner and JSON functions.
sqlite-utils - CLI tool and Python library for manipulating SQLite databases
From the homepage:
This library and command-line utility helps create SQLite databases from an existing collection of data.
Most of the functionality is available as either a Python API or through the sqlite-utils command-line tool.
sqlite-utils is not intended to be a full ORM: the focus is utility helpers to make creating the initial database and populating it with data as productive as possible.
It is designed as a useful complement to Datasette.
Cleaning data with sqlite-utils and Datasette provides a tutorial introduction (and accompanying ten minute video) about using this tool.
sqldiff.exe: Database Difference Utility
Handy utility to diff SQLite databases.
Making SQLite faster in Go
The author managed to reach 56,600 req/s!
While written about Go, not all the techniques used are Go specific.
https://turriate.com/articles/making-sqlite-faster-in-goOpen linkView original on lemmy.worldHow SQLite Scales Read Concurrency
Explains how using WAL allows writes without blocking reads.
https://fly.io/blog/sqlite-internals-wal/Open linkView original on lemmy.worldFerretDB - MongoDB protocol for SQLite or PostgreSQL
Converts MongoDB protocol to SQL using SQLite or PostgreSQL as the database engine.
Could be useful if wanting to migrate off MongoDB.
How SQLite helps you do ACID
High level overview of how SQLite rollback journal works.
sqlpkg - The (unofficial) SQLite package registry.
Registry of SQLite extensions along with a package manager to install them.
SQLite Internals: Pages & B-trees
Interesting brief overview of SQLite internals.
GitHub - nalgeon/sqlean: The ultimate set of SQLite extensions
A useful collection of extensions for SQLite
SQLite experimental high-concurrency backend HC-tree
While not ready for production, it looks really promising.
There’s some tests showing > 1 million write transactions per second in some cases.
SQLite 3.42.0
Adds the ability for JSON functions to read JSON5 which could be handy.

