Cloud Parts

Technologies

All 405 products in the handbook in one table. Type to filter, pick an area or a type, or click a column to sort. Each one links to its page, and to the concept it’s an example of.

38 are projects of The Apache Software Foundation: what that means →32 are made by Cloudflare, Inc.: how they fit together →
Area:
Type:

405 of 405 technologies

CThe small, portable systems language from Bell Labs that Unix, most operating systems and many databases are written in, with memory you allocate and free yourself.Programming languagesCompiled to machine codeOpen sourceISO standard (ISO/IEC 9899:2024); compilers carry their own licences2026-10-08
C++C with classes, templates and destructors: a language for writing abstractions that compile down to code as fast as hand-written C.Programming languagesCompiled to machine codeOpen sourceISO standard (ISO/IEC 14882:2024); compilers carry their own licences2026-10-08
GoA small, statically typed language from Google that compiles in seconds to one static binary, with goroutines, channels and a garbage collector built in.Programming languagesCompiled to machine codeOpen sourceBSD 3-Clause2026-10-08
HaskellA purely functional, lazily evaluated language with type classes, compiled to native code by GHC.Programming languagesCompiled to machine codeOpen sourceBSD-3-Clause (GHC)2026-10-08
RacketA descendant of Scheme built for language-oriented programming: every module names its language on a `#lang` line, and new languages are just libraries.Programming languagesCompiled to machine codeOpen sourceMIT or Apache 2.0, at your option2026-10-08
RustA systems language that frees memory without a garbage collector, because the compiler checks ownership and borrowing rules before the program runs.Programming languagesCompiled to machine codeOpen sourceMIT or Apache 2.0 (your choice)2026-10-08
ZigA pre-1.0 systems language and toolchain with no hidden control flow or allocations, compile-time code in plain Zig, and a built-in C compiler that cross-compiles anywhere.Programming languagesCompiled to machine codeOpen sourceMIT2026-10-08
C#Microsoft’s statically typed, object-oriented language for .NET, which made `async` and `await` mainstream and gains a new version every November.Programming languagesRun on a virtual machineOpen sourceMIT (Roslyn compiler)2026-10-08
ClojureA dynamic Lisp hosted on the JVM, built around immutable persistent data structures and interactive development at the REPL.Programming languagesRun on a virtual machineOpen sourceEclipse Public License 1.02026-10-08
ElixirA dynamic, functional language on the Erlang virtual machine, created by José Valim: Erlang’s processes, supervisors and hot code loading, with modern tooling, macros and gradual types being added to the compiler.Programming languagesRun on a virtual machineOpen sourceApache 2.02026-10-08
ErlangA dynamically typed functional language from Ericsson, built for systems that must never stop: lightweight processes that share nothing, supervisors that restart what fails, and code that can be upgraded while it runs.Programming languagesRun on a virtual machineOpen sourceApache 2.02026-10-08
F#A functional-first language from the ML family that runs on .NET, with type inference, immutable data by default and computation expressions.Programming languagesRun on a virtual machineOpen sourceMIT2026-10-08
JavaA statically typed, object-oriented language that compiles to portable bytecode for the Java Virtual Machine, with a new release every six months.Programming languagesRun on a virtual machineOpen sourceGPL 2.0 with the Classpath Exception (OpenJDK)2026-10-08
ScalaA statically typed language that fuses object-oriented and functional programming, compiles to JVM bytecode and calls Java libraries directly.Programming languagesRun on a virtual machineOpen sourceApache 2.02026-10-08
PythonA dynamically typed language with a large standard library, run by CPython, an interpreter that is finally learning to use many cores at once.Programming languagesInterpretedOpen sourcePSF License 2.02026-10-08
.NET runtime (CLR)Microsoft’s open-source runtime for C#, F# and Visual Basic: the Common Language Runtime loads intermediate language, compiles it with a tiered JIT or ahead of time, and manages memory with a generational garbage collector.Runtime virtual machinesOpen sourceMIT2026-10-08
BEAM (Erlang virtual machine)The virtual machine in Erlang/OTP that runs Erlang and Elixir: millions of lightweight processes, each with its own heap and garbage collection, preemptively scheduled across all cores, with code that can be replaced while the system runs.Runtime virtual machinesOpen sourceApache 2.02026-10-08
Java Virtual Machine (HotSpot)The abstract machine that runs Java bytecode, and OpenJDK’s HotSpot, the implementation most people use: an interpreter, two JIT compilers and a choice of garbage collectors behind Java, Scala, Clojure and other languages.Runtime virtual machinesOpen sourceGPLv2 with the Classpath Exception (OpenJDK)2026-10-08
PyO3Rust bindings for Python: attributes such as `#[pyfunction]` and `#[pyclass]` turn Rust code into a CPython extension module, and the same crate can embed a Python interpreter in a Rust program.Foreign function interfacesOpen sourceApache 2.0 or MIT, at your option2026-10-09
maturinThe build tool that turns a Rust crate with PyO3, CFFI or UniFFI bindings, or a plain Rust binary, into Python wheels, installs it into a virtualenv while you develop, and serves as a PEP 517 build backend.Foreign function interfacesTool for PyO3Open sourceApache 2.0 or MIT, at your option2026-10-09
Haskell containersHaskell’s standard package of persistent containers: `Data.Sequence` (finger trees), `Data.Map` and `Data.Set` (weight-balanced trees), `Data.IntMap` (Patricia trees), plus trees and graphs.Purely functional data structuresFinger treesOpen sourceBSD-3-Clause2026-10-09
Immutable.jsPersistent collections for JavaScript (`List`, `Map`, `Set`, `Record` and more) built on hash array mapped tries and vector tries, with methods named like JavaScript’s own `Array`, `Map` and `Set`.Purely functional data structuresHash array mapped triesOpen sourceMIT (BSD before 4.0)2026-10-09
im (Rust)ArchivedPersistent collections for Rust: an RRB-tree `Vector`, a hash array mapped trie `HashMap` and B-tree `OrdMap`, with O(1) cloning and copy-on-write updates. Unmaintained since 2022.Purely functional data structuresRRB vectorsOpen sourceMPL-2.0 (LGPL-3.0 before version 10)2026-10-09
imblThe maintained fork of Rust’s `im` crate: persistent collections with an RRB-tree `Vector`, a hash array mapped trie `HashMap` and a B+ tree `OrdMap`, with O(1) cloning and copy-on-write updates.Purely functional data structuresRRB vectorsOpen sourceMPL-2.02026-10-09
immerA header-only C++ library of persistent, immutable containers, including an RRB-tree `flex_vector` with O(log n) concatenation and slicing and policy-based memory management.Purely functional data structuresRRB vectorsOpen sourceBoost Software License 1.02026-10-09
PydanticA Python data validation library: declare a class with type hints, and it checks and converts incoming data, serializes it back to dicts or JSON, and describes it as JSON Schema.Data transfer objectsOpen sourceMIT2026-10-09
Active Record (Ruby on Rails)The model layer of Ruby on Rails and the best-known implementation of Fowler’s Active Record pattern: each Ruby class wraps a table, each object a row, and objects load, validate and save themselves.Object-relational mappingFull ORMsOpen sourceMIT2026-10-08
Entity Framework CoreMicrosoft’s object-relational mapper for .NET: you query C# classes with LINQ, a `DbContext` tracks the entities it loads, and `SaveChanges` writes every change back as SQL through a pluggable database provider.Object-relational mappingFull ORMsOpen sourceMIT2026-10-08
Hibernate ORMThe standard object-relational mapper for Java: it maps annotated classes to tables, tracks changes to loaded objects in a session and writes them back as SQL, and implements Jakarta Persistence (JPA).Object-relational mappingFull ORMsOpen sourceApache 2.0 since 7.0 (LGPL 2.1 before)2026-10-08
Prisma ORMA TypeScript ORM driven by a schema file: you declare models once, Prisma generates a fully typed client and SQL migrations from them, and queries return plain JavaScript objects.Object-relational mappingFull ORMsOpen sourceApache 2.02026-10-08
SQLAlchemyA Python database toolkit in two layers: a SQL expression layer (Core) that builds and runs SQL, and an ORM on top of it that maps classes to tables with an identity map and a unit of work.Object-relational mappingFull ORMsOpen sourceMIT2026-10-08
Tortoise ORMAn async-native Python ORM with a Django-style API: models as classes, `await Model.filter(...)` queries, and built-in migrations since 1.0.Object-relational mappingFull ORMsOpen sourceApache 2.02026-10-09
Drizzle ORMA TypeScript library that declares tables in code and queries them through a typed API shaped like SQL, plus a relational API for nested data that always compiles to a single SQL statement.Object-relational mappingQuery buildersOpen sourceApache 2.02026-10-08
jOOQA Java library that models SQL as a type-safe API: a code generator reads your database schema into Java classes, and you write queries against them that the compiler checks.Object-relational mappingQuery buildersOpen sourceApache 2.0 with open-source databases; commercial licence for commercial databases2026-10-08
DapperA micro-ORM for .NET from Stack Overflow: you write the SQL, and Dapper runs it on any ADO.NET connection and fills your objects from the result by matching column names to properties.Object-relational mappingMicro-ORMsOpen sourceApache 2.02026-10-08
binrwA Rust derive macro that generates a reader and a writer for a struct or enum from directives describing its binary layout, reading from any seekable stream.Binary parsing and encodingDeclarative binary layoutsOpen sourceMIT2026-10-09
ConstructA Python library where a binary format is an object built from small pieces, which can both parse bytes into Python values and build values back into bytes.Binary parsing and encodingDeclarative binary layoutsOpen sourceMIT2026-10-09
dekuA Rust derive macro that turns an annotated struct or enum into a bit-level reader and writer for the same binary layout.Binary parsing and encodingDeclarative binary layoutsOpen sourceMIT or Apache 2.02026-10-09
nomA Rust parser combinator library, built for binary formats first, whose parsers return slices of their input instead of copying it and can ask for more data when input arrives in pieces.Binary parsing and encodingParser combinatorsOpen sourceMIT2026-10-09
nanopbA small Protocol Buffers implementation in ANSI C for microcontrollers: a generator turns `.proto` files into C structs, and a runtime of a few kilobytes encodes and decodes them without `malloc`.Binary parsing and encodingCode generated from a schemaOpen sourcezlib2026-10-09
Material UI (MUI)An MIT-licensed React component library that implements Google’s Material Design 2, themed through one JavaScript object, with commercial MUI X packages for advanced data grids, charts and pickers.UI librariesComponent librariesOpen sourceMIT (Material UI and MUI X Community); MUI X Pro and Premium are commercial2026-10-09
TanStackA family of open-source TypeScript libraries (Query, Table, Form, Router, Start and more), each a framework-agnostic core with thin adapters, that handle state and logic while you keep the markup.UI librariesHeadless librariesOpen sourceMIT2026-10-09
EvidenceBI as code: reports written in Markdown with SQL blocks and chart components. It began as a static site generator that ran every query at build time; the current version runs queries when a page loads.Static read modelsData apps built ahead of timeOpen sourceMIT2026-10-09
Observable FrameworkAn open-source static site generator for dashboards and reports: data loaders in any language run at build time and save data snapshots that the pages load as static files.Static read modelsData apps built ahead of timeOpen sourceISC2026-10-09
Visual Studio CodeMicrosoft’s free, extensible editor and the most used one by far, built on the MIT-licensed Code - OSS project that Cursor, Windsurf and Void forked.Editors and terminalsCode editorsOpen sourceMIT (Code - OSS source); Microsoft product licence for the VS Code build2026-10-09
CursorThe best-known AI fork of VS Code, with agents, its own coding models and PR review built in; acquired by SpaceX in August 2026.Editors and terminalsFork of Visual Studio CodeCommercial productProprietary2026-10-09
VoidArchivedAn open-source, VS Code-based AI editor that sent prompts straight to any model provider; paused in August 2025 and deprecated and archived in June 2026.Editors and terminalsFork of Visual Studio CodeOpen sourceApache 2.02026-10-09
Windsurf (now Devin Desktop)RenamedCodeium’s agentic fork of VS Code, bought by Cognition in July 2025 and renamed Devin Desktop on June 2, 2026.Editors and terminalsFork of Visual Studio CodeCommercial productProprietary2026-10-09
ZedA code editor written from scratch in Rust by the team behind Atom, drawn on the GPU, with its own agent and the Agent Client Protocol for outside ones.Editors and terminalsCode editorsOpen sourceGPL 3 (editor), AGPL 3 (server components), Apache 2.0 (GPUI)2026-10-09
WarpA Rust, GPU-drawn terminal that keeps each command and its output in its own block, now open source and built around coding agents.Editors and terminalsTerminalsOpen sourceAGPL 3.0 (UI framework crates MIT)2026-10-09
Claude CodeAnthropic’s coding agent: a terminal program, also available in IDEs, a desktop app and the cloud, that drives Claude models through a loop of reading, running and editing.AI coding agentsTerminal agentsCommercial productProprietary2026-10-09
Gemini CLIGoogle’s open-source terminal agent for Gemini models; since 18 June 2026 it serves only paid API keys and business licences, as Google moved free and consumer users to Antigravity CLI.AI coding agentsTerminal agentsCommercial productApache 2.02026-10-09
OpenAI CodexOpenAI’s coding agent: an open-source CLI, written in Rust, that works in your local repository inside an OS sandbox, plus an IDE extension and Codex cloud for tasks that run on OpenAI’s machines.AI coding agentsTerminal agentsCommercial productApache 2.0 (CLI)2026-10-09
OpenCodeAn open-source (MIT) coding agent that works with 75+ model providers and local models, built as a local server with a terminal interface as one of its clients.AI coding agentsTerminal agentsOpen sourceMIT2026-10-09
Kilo CodeAn open-source coding agent for VS Code, JetBrains and the terminal. It began in 2025 as a fork of Roo Code, and since 2026 every surface runs on Kilo CLI, a fork of OpenCode.AI coding agentsFork of OpenCodeOpen sourceMIT (the Roo Code-based legacy extensions were Apache 2.0)2026-10-09
Augment CodeA commercial coding agent for VS Code, JetBrains and the terminal built around a Context Engine that keeps a live semantic index of your codebase. On 8 October 2026 Harness bought the Context Engine, the Auggie CLI and the Cosmos cloud agents.AI coding agentsEditor agentsCommercial productProprietary2026-10-09
ClineAn open-source coding agent that started as a VS Code extension and now runs the same engine in JetBrains, a terminal CLI, a desktop app and an SDK, with whatever model you bring.AI coding agentsEditor agentsOpen sourceApache 2.02026-10-09
Roo CodeArchivedA fork of Cline that added role-based modes, an orchestrator that hands subtasks to other modes, and semantic codebase search. Its makers shut it down on 15 May 2026.AI coding agentsFork of ClineOpen sourceApache 2.02026-10-09
DevinCognition’s cloud coding agent: each session gets its own VM with a shell, editor and browser, takes a task from Slack, a ticket or the web app, and comes back with a pull request.AI coding agentsCloud agentsCommercial productProprietary2026-10-09
JSRThe JavaScript Registry: an open-source, TypeScript-first package registry where you publish TypeScript source and it generates the docs, JavaScript and `.d.ts` files that npm, pnpm, Yarn, Bun and Deno projects install.Package managersOpen sourceMIT2026-10-12
PoetryA Python tool, written in Python, that resolves a project’s dependencies into `poetry.lock`, keeps a virtualenv per project and builds and publishes packages.Package managersOpen sourceMIT2026-10-09
uvA Python package and project manager written in Rust that resolves, locks and installs dependencies, and installs Python itself, from one fast binary.Package managersOpen sourceApache 2.0 or MIT2026-10-09
OxcThe JavaScript Oxidation Compiler: Rust building blocks (parser, transformer, minifier, resolver) under Rolldown and Vite, plus the Oxlint linter and Oxfmt formatter.Linters, formatters and type checkersLintersOpen sourceMIT2026-10-09
RuffA Python linter and formatter written in Rust that stands in for Flake8 and its plugins, isort, pyupgrade and Black, 10 to 100 times faster.Linters, formatters and type checkersLintersOpen sourceMIT2026-10-09
PyreflyMeta’s Python type checker and language server, written in Rust, built to replace Pyre and fast enough to re-check code on every save.Linters, formatters and type checkersType checkersOpen sourceMIT2026-10-09
PyrightMicrosoft’s open-source static type checker for Python, written in TypeScript, which is also the engine inside the Pylance extension for VS Code.Linters, formatters and type checkersType checkersOpen sourceMIT2026-10-09
basedpyrightA community fork of Pyright that is stricter by default, installs from PyPI without a separate Node.js, and brings Pylance-only editor features to any editor.Linters, formatters and type checkersFork of PyrightOpen sourceMIT2026-10-09
VitestA test runner for JavaScript and TypeScript built on Vite, with a Jest-compatible API, watch mode on by default and a browser mode that runs tests in a real browser.Automated testingTest runnersOpen sourceMIT2026-10-09
toxA Python tool that builds your package and runs its tests, linters or docs build in a separate virtual environment for each Python version or dependency set you list.Automated testingTest environment managersOpen sourceMIT2026-10-09
StorybookA workshop that renders each UI component on its own, one state per story, and turns those stories into documentation and browser tests.Automated testingComponent workshopsOpen sourceMIT2026-10-09
RolldownA JavaScript bundler written in Rust that keeps Rollup’s plugin API at esbuild’s speed; the bundler inside Vite since Vite 8.Bundlers and dev serversOpen sourceMIT2026-10-09
ViteThe dev server and build tool most JavaScript frameworks now build on: native ES modules with instant HMR while you code, a Rolldown bundle for production.Bundlers and dev serversOpen sourceMIT2026-10-09
MintlifyA hosted documentation platform: MDX pages and a `docs.json` file in your Git repository become a docs site with an API playground generated from OpenAPI, search, and `llms.txt`, Markdown and MCP access for AI agents.Documentation sitesCommercial productProprietary2026-10-09
AWS Elastic BeanstalkUpload your code and Elastic Beanstalk builds the AWS setup to run it (EC2 instances, a load balancer, an Auto Scaling group) in your own account, where you can still see and change every piece.Platform as a service (PaaS)Managed service on AWSProprietary2026-10-12
Azure App ServiceAzure’s platform for web apps and APIs: you rent a pool of VMs called an App Service plan, and every app you put in it runs on those VMs without you managing them.Platform as a service (PaaS)Managed service on AzureProprietary2026-10-12
Cloud FoundryAn open-source PaaS you run yourself: `cf push` uploads your code, a buildpack stages it into a droplet, and Diego keeps the requested number of instances running behind the Gorouter.Platform as a service (PaaS)Open sourceApache 2.02026-10-12
DokkuA Heroku-like PaaS on one server of your own: `git push` to it, and Dokku builds the app with buildpacks or a Dockerfile and runs it in Docker containers behind nginx.Platform as a service (PaaS)Open sourceMIT2026-10-12
Fly.ioFly.io turns your Docker image into fast-booting Firecracker microVMs on its own servers in regions around the world, and routes each user to the nearest one.Platform as a service (PaaS)Commercial productProprietary2026-10-12
Google App EngineGoogle’s original platform as a service: describe your app in an `app.yaml`, run one deploy command, and Google runs and scales the instances.Platform as a service (PaaS)Managed service on Google CloudProprietary2026-10-12
HerokuThe platform that defined PaaS: `git push` your code, and Heroku builds it with a buildpack and runs it on managed containers called dynos behind its own HTTP router.Platform as a service (PaaS)Commercial productProprietary (its buildpacks are open source)2026-10-12
RenderRender builds and deploys web services, background workers, cron jobs and managed Postgres and Key Value stores from your Git repo, all described in one `render.yaml` file if you like.Platform as a service (PaaS)Commercial productProprietary2026-10-12
AWS LambdaAWS’s functions service: upload a handler, connect a trigger, and pay per request and per millisecond.Serverless functions (FaaS)Managed service on AWSProprietary2026-10-05
Beta9The open-source engine behind Beam’s cloud: decorate a Python function and it runs as an autoscaling GPU endpoint, task queue or sandbox, on Beam or on your own Kubernetes cluster.Serverless functions (FaaS)Open sourceAGPL-3.02026-10-06
Cloudflare Browser RunRenamedHeadless Chrome on demand in Cloudflare’s network, called Browser Rendering until April 2026: one HTTP call for a screenshot, PDF, Markdown or crawl, or a full browser session driven by Puppeteer, Playwright, CDP or an AI agent.Serverless functions (FaaS)Commercial productProprietary (the Puppeteer and Playwright forks are open source)2026-10-12
Cloudflare WorkersFunctions that run in V8 isolates on Cloudflare’s network, close to the user, with almost no cold start.Serverless functions (FaaS)Commercial productProprietary (the workerd runtime is Apache 2.0)2026-10-05
WranglerThe command-line tool for Cloudflare Workers: it reads `wrangler.jsonc`, runs your Worker locally on the real runtime, deploys it, and manages the D1, KV, R2 and other resources it binds to.Serverless functions (FaaS)Tool for Cloudflare WorkersOpen sourceMIT or Apache 2.02026-10-12
FissionOpen-source functions on Kubernetes: a pool of warm, generic pods takes your code on the first call, so cold starts stay around 100 ms.Serverless functions (FaaS)Open sourceApache 2.02026-10-06
workerdThe open-source JavaScript and WebAssembly server runtime behind Cloudflare Workers, which you can run yourself as an application server, a local dev server or a programmable HTTP proxy.Serverless functions (FaaS)Open sourceApache 2.02026-10-12
Workers AIServerless inference on GPUs in Cloudflare’s network: call one of 50+ open models by name from a Worker binding or a REST API, and pay per unit of GPU work instead of renting GPUs.Serverless functions (FaaS)Commercial productProprietary (the models carry their own open licenses)2026-10-12
Amazon EC2AWS’s virtual machines: pick an instance type, boot an image, and you have a server in minutes.Virtual machinesManaged service on AWSProprietary2026-10-05
HashiCorp VagrantA command-line tool that builds the same development virtual machine for everyone from a `Vagrantfile` kept in the repo.Virtual machinesCommercial productBusiness Source License 1.1 since Vagrant 2.4.0 (October 2023; source-available, not OSI open source); MIT before2026-10-05
KubeVirtAdds virtual machines to Kubernetes as ordinary resources, so VMs and containers share one cluster, one API and one set of tools.Virtual machinesOpen sourceApache 2.02026-10-06
Cloud HypervisorA Rust virtual machine monitor for modern cloud VMs on KVM or Microsoft’s hypervisor: virtio devices only, plus hotplug, VFIO passthrough, live migration, snapshots and Windows guests.HypervisorsOpen sourceApache 2.0 and BSD-3-Clause2026-10-11
KVM (Kernel-based Virtual Machine)The hypervisor built into the Linux kernel: it runs guest code directly on the CPU through `/dev/kvm`, and leaves device emulation to a user-space program such as QEMU or Firecracker.HypervisorsOpen sourceGPL 2.02026-10-11
libvirtA stable API, daemon and `virsh` command line for managing virtual machines, storage and networks, with drivers for QEMU/KVM, Xen, LXC, Cloud Hypervisor, VMware ESX, Hyper-V and more.HypervisorsOpen sourceLGPL 2.1 or later (library); some tools GPL 2.0 or later2026-10-11
Microsoft Hyper-VMicrosoft’s type-1 hypervisor, built into Windows Server and Windows 10 and 11 Pro and Enterprise: a thin hypervisor under a Windows root partition, which also underpins Azure’s hypervisor and Windows features like VBS, WSL 2 and Windows Sandbox.HypervisorsCommercial productProprietary2026-10-11
Oracle VirtualBoxOracle’s free, open-source desktop hypervisor: a type-2 hypervisor that runs VMs as an application on Windows, macOS, Linux and Solaris, scriptable with `VBoxManage` and the default provider for Vagrant.HypervisorsOpen sourceGPLv3 for the base package and Guest Additions (GPLv2 before 7.0); the optional Extension Pack is proprietary: free under the PUEL for personal and educational use, a paid Enterprise license otherwise2026-10-11
Proxmox Virtual EnvironmentA Debian-based server platform from Vienna that runs KVM virtual machines and LXC containers, with clustering, high availability, Ceph and ZFS storage, backups and a web interface in one free ISO.HypervisorsOpen sourceAGPLv32026-10-11
QEMUThe open-source machine emulator and virtualizer: it emulates whole computers in software, or runs them at native speed on a hypervisor such as KVM, and supplies the virtual devices either way.HypervisorsOpen sourceGPL 2.02026-10-11
VMware ESXiVMware’s bare-metal hypervisor (called ESX again since VCF 9), whose own kernel runs VMs directly on servers while vCenter adds vMotion, HA, DRS and vSAN; since Broadcom bought VMware in 2023 it is sold only as per-core subscriptions.HypervisorsCommercial productProprietary2026-10-11
Xen Project hypervisorThe open-source type-1 hypervisor from Cambridge that ran the first Amazon EC2 instances: a small microkernel-style core that boots first, with drivers and management in a privileged VM called dom0.HypervisorsOpen sourceGPL-2.0 (version 2 only)2026-10-11
FirecrackerThe open-source microVM monitor AWS built for Lambda: a full VM boundary that boots in under 125 ms.MicroVMsOpen sourceApache 2.02026-10-05
Kata ContainersA container runtime that starts each pod inside its own lightweight VM, so Kubernetes and Docker keep working but every pod gets its own kernel.MicroVMsOpen sourceApache 2.02026-10-06
smolvmA young, embeddable microVM runtime that boots any OCI image as a real VM on a Mac, Linux or Windows laptop, and can save, branch and pack running machines.MicroVMsOpen sourceApache 2.0 (the hosted smol cloud is a paid service)2026-10-06
AWS FargateRuns ECS tasks and EKS pods without servers: you size each task, AWS finds the machine.ContainersManaged service on AWSProprietary2026-10-05
Cloudflare ContainersLinux container images that run on Cloudflare’s network next to a Worker, each instance started on demand by its own Durable Object and put to sleep when idle.ContainersCommercial productProprietary2026-10-12
Cloudflare Sandbox SDKA way to run untrusted or AI-generated code on Cloudflare: each sandbox is a Linux container in its own microVM, started, fed commands and files, and cut off from the network by a Durable Object you write.ContainersBuilt on Cloudflare ContainersCommercial productApache 2.0 (the SDK); the Containers it runs on are a proprietary service2026-10-12
DockerThe tool that made containers mainstream: build an image from a Dockerfile, then run it anywhere.ContainersOpen sourceApache 2.0 (Docker Engine); Docker Desktop is proprietary2026-10-05
Google Cloud RunGive Google a container that listens on a port; it runs as many copies as traffic needs, down to zero.ContainersManaged service on Google CloudProprietary2026-10-05
gVisorA Linux kernel reimplemented in Go that runs in user space, so a container’s system calls never reach the host kernel directly.ContainersOpen sourceApache 2.02026-10-06
PodmanRuns Docker-style containers without a daemon, as root or as an ordinary user, and hands long-running ones to systemd.ContainersOpen sourceApache 2.0 (Podman and Podman Desktop alike)2026-10-05
HashiCorp NomadA scheduler in one binary that places containers, plain executables, Java apps and VMs across a cluster.Container orchestrationCommercial productBusiness Source License 1.1 since Nomad 1.7 (source-available, not OSI open source); MPL 2.0 up to 1.6.x2026-10-05
KubernetesThe standard open-source orchestrator: declare the containers you want, and controllers keep the cluster matching it.Container orchestrationOpen sourceApache 2.02026-10-05
Amazon EKSAWS runs the Kubernetes control plane for you; you choose how much of the worker side to hand over too.Container orchestrationManaged KubernetesManaged service on AWSProprietary2026-10-06
Azure Kubernetes ServiceMicrosoft’s managed Kubernetes: a control plane that can be free, node pools of Azure VMs, and an Automatic mode that runs the nodes too.Container orchestrationManaged KubernetesManaged service on AzureProprietary2026-10-06
Google Kubernetes EngineGoogle’s managed Kubernetes, the oldest one: Google runs the control plane, and in Autopilot mode the nodes too.Container orchestrationManaged KubernetesManaged service on Google CloudProprietary2026-10-06
K3sA certified Kubernetes distribution in one small binary, built for edge, IoT and other places where a full cluster is too heavy, with SQLite or embedded etcd for state.Container orchestrationKubernetes distributionOpen sourceApache 2.02026-10-06
MicroK8sCanonical’s Kubernetes in one snap package: installs with one command on Linux, forms a highly available cluster by itself at three nodes, and adds features as addons.Container orchestrationKubernetes distributionOpen sourceApache 2.0 (bundled components keep their own licences, e.g. dqlite is LGPLv3 with a static-linking exception)2026-10-06
Red Hat OpenShiftRed Hat’s Kubernetes platform: Kubernetes plus its own OS, operators that install and upgrade everything, and stricter security defaults, sold by subscription.Container orchestrationKubernetes distributionCommercial productProprietary subscription (built from open source; the OKD community distribution is Apache 2.0)2026-10-06
RKE2SUSE’s security-focused Kubernetes distribution: one binary per node, hardened defaults, FIPS-validated crypto and close alignment with upstream.Container orchestrationKubernetes distributionOpen sourceApache 2.02026-10-06
Talos LinuxA Linux distribution that only runs Kubernetes: immutable, minimal, with no shell or SSH, and managed entirely through an API.Container orchestrationKubernetes distributionOpen sourceMPL 2.0 (Omni, its management platform, is source-available under BUSL 1.1)2026-10-06
kindKubernetes IN Docker: each cluster node is a container, so a conformant multi-node cluster starts and disappears inside a CI job.Container orchestrationLocal KubernetesOpen sourceApache 2.02026-10-06
minikubeA local Kubernetes cluster for developers on Linux, macOS or Windows, in a container, a VM or on the host itself, with laptop-friendly extras.Container orchestrationLocal KubernetesOpen sourceApache 2.02026-10-06
kubeadmThe official tool for turning Linux machines you already have into a Kubernetes cluster: `kubeadm init`, then `kubeadm join`.Container orchestrationTool for KubernetesOpen sourceApache 2.02026-10-06
RancherSUSE’s open-source control plane for fleets of Kubernetes clusters: one place to create, import, secure and upgrade them.Container orchestrationTool for KubernetesOpen sourceApache 2.0 (Rancher Prime is a paid subscription)2026-10-06
AgonesRuns dedicated multiplayer game servers on Kubernetes: keeps a fleet of them warm, hands one to each match, and never kills a server while players are on it.Container orchestrationBuilt on KubernetesOpen sourceApache 2.02026-10-06
KlutchA young open-source control plane, built on Crossplane, that lets many application clusters order databases from one central Kubernetes cluster.Container orchestrationBuilt on KubernetesOpen sourceApache 2.02026-10-06
KarpenterA Kubernetes node autoscaler that launches right-sized machines for waiting pods and removes ones you don’t need.AutoscalingOpen sourceApache 2.02026-10-05
AkkaThe JVM toolkit that brought Erlang-style actors, clustering and sharding to Java and Scala; source-available since 2022, with a paid licence for most production use.Actor modelCommercial productBusiness Source License 1.1 since 2.7 (October 2022): free outside production, and each release becomes Apache 2.0 three years after it ships; Apache 2.0 up to 2.6.x2026-10-06
Apache PekkoThe Apache-licensed fork of Akka 2.6: actors, cluster sharding, persistence, streams and HTTP for Java and Scala, run by a foundation instead of a company.Actor modelOpen sourceApache 2.02026-10-06
celldBetaA self-hosted, distributed implementation of Cloudflare Durable Objects that runs an unchanged Workers app across your own machines, with its durable state in an object storage bucket you own.Actor modelOpen sourceApache 2.02026-10-12
Durable ObjectsSingle-threaded JavaScript objects on Cloudflare’s network, each with a globally unique name and its own private SQLite database, that any Worker can call to coordinate state.Actor modelCommercial productProprietary2026-10-12
Cloudflare Agents SDKA TypeScript framework (npm `agents`) in which every AI agent is a Durable Object: one addressable instance per user or task, with its own SQL state, WebSocket clients, scheduled jobs and MCP tools.Actor modelBuilt on Durable ObjectsOpen sourceMIT2026-10-12
QUICA secure, multiplexed transport over UDP: TLS 1.3 is built into its handshake, many streams share one connection without blocking each other, and a connection can survive a change of network.Network protocolsTransport protocolsOpen sourceOpen standard (IETF RFC)2026-10-08
TCPThe Transmission Control Protocol: a handshake opens a connection between two ports, then bytes arrive complete and in order, resent when lost and paced to what the path can carry.Network protocolsTransport protocolsOpen sourceOpen standard (IETF RFC)2026-10-08
UDPThe User Datagram Protocol: ports and a checksum on top of IP, and nothing else. Each datagram is sent on its own, with no connection, no retransmission and no ordering.Network protocolsTransport protocolsOpen sourceOpen standard (IETF RFC)2026-10-08
HTTPThe Hypertext Transfer Protocol: stateless requests and responses (a method, a target, header fields, a status code), with one set of semantics carried by three wire versions, HTTP/1.1, HTTP/2 and HTTP/3.Network protocolsWeb protocolsOpen sourceOpen standard (IETF RFC)2026-10-08
HTTPSHTTP inside TLS: the same requests and responses, sent only after the client has checked the server’s certificate, and encrypted and integrity-protected all the way, on port 443 by default.Network protocolsBuilt on HTTPOpen sourceOpen standard (IETF RFC)2026-10-08
FTPThe File Transfer Protocol: text commands on a control connection to port 21, and a second TCP connection for every listing or file. Everything, passwords included, travels unencrypted.Network protocolsFile transfer protocolsOpen sourceOpen standard (IETF RFC)2026-10-08
FTPSFTP over TLS: the same commands and the same two connections, with TLS negotiated on the control connection (explicit, port 21) or from the first byte (implicit, port 990), and optionally on every data connection.Network protocolsBuilt on FTPOpen sourceOpen standard (IETF RFC)2026-10-08
SFTPThe SSH File Transfer Protocol: binary file-system requests (open, read, write, list, rename) carried inside an encrypted SSH session on port 22. Not FTP, and never finished as an RFC.Network protocolsFile transfer protocolsOpen sourceOpen specification (expired IETF Internet-Draft, never an RFC)2026-10-08
TLSTransport Layer Security: a handshake that authenticates the server (and optionally the client) and agrees on fresh keys, then records that keep everything above it private and tamper-evident.Network protocolsSecurity protocolsOpen sourceOpen standard (IETF RFC)2026-10-08
AWS Application Load BalancerAWS’s managed layer-7 load balancer: routes HTTP requests by host, path or header to EC2, containers, IPs or Lambda.Load balancersManaged service on AWSProprietary2026-10-05
Cloudflare Load BalancingA global load balancer that runs in Cloudflare’s network, health-checks your servers from many data centers and sends each visitor to a healthy pool chosen by failover order, location or measured latency.Load balancersCommercial productProprietary2026-10-12
NGINXAn event-driven web server and reverse proxy that load-balances, caches and terminates TLS for the apps behind it.Load balancersOpen sourceBSD 2-Clause2026-10-05
Amazon CloudFrontAWS’s CDN: more than 750 edge locations that cache your S3 files and front your load balancers and APIs.CDNsManaged service on AWSProprietary2026-10-05
CloudflareA global reverse-proxy network that puts a CDN, DNS, DDoS protection and a WAF in front of your site.CDNsCommercial productProprietary2026-10-05
Cloudflare PagesGit-connected hosting for static and full-stack sites: every push is built and deployed to Cloudflare’s CDN with its own preview URL, and a `functions/` folder becomes Workers behind the site. Cloudflare now tells new projects to use Workers instead.CDNsCommercial productProprietary2026-10-12
Amazon API GatewayAWS’s managed API front door: REST, HTTP and WebSocket APIs that authenticate, throttle and route calls to Lambda and other backends.API gatewaysManaged service on AWSProprietary2026-10-05
Cloudflare AI GatewayA proxy between your application and AI model providers such as OpenAI, Anthropic, Google and Workers AI that logs, caches, rate-limits, retries and bills every call in one place.API gatewaysCommercial productProprietary2026-10-12
Amazon Route 53AWS’s authoritative DNS and domain registrar, with health checks and routing by latency, location or weight.DNSManaged service on AWSProprietary2026-10-05
Amazon VPCYour own isolated network in an AWS Region, split into per-zone subnets with route tables, security groups and gateways.Virtual private cloudsManaged service on AWSProprietary2026-10-05
EnvoyA C++ proxy for the edge and between services, configured live through the xDS APIs; the data plane under Istio, Envoy Gateway, Consul’s mesh and many others.Service discovery & meshOpen sourceApache 2.02026-10-06
HashiCorp ConsulA service registry with health checks and a DNS interface, plus a service mesh that configures Envoy proxies for mTLS between services.Service discovery & meshCommercial productBusiness Source License 1.1 since 1.17 (source-available, not OSI open source); MPL 2.0 before the August 2023 change2026-10-05
IstioThe Kubernetes service mesh started by Google, IBM and Lyft: mutual TLS, traffic routing and telemetry between services, through Envoy sidecars or the sidecar-less ambient mode.Service discovery & meshOpen sourceApache 2.02026-10-06
Apache ThriftFacebook’s 2007 RPC framework: define types and services in one IDL file, generate clients and servers for over 20 languages, and pick the wire protocol and transport separately.Remote procedure callsOpen sourceApache 2.02026-10-06
Cap’n ProtoA binary format laid out like an in-memory struct, so reading needs no parse step, plus an RPC system built on object references and promise pipelining.Remote procedure callsOpen sourceMIT2026-10-06
gRPCGoogle’s open RPC framework: describe a service in a `.proto` file, generate typed clients and servers, and call them over HTTP/2 with streaming, deadlines and standard status codes.Remote procedure callsOpen sourceApache 2.0 since June 2017 (BSD 3-Clause before); the gRPC-Rust preview is MIT2026-10-06
Protocol BuffersGoogle’s schema-first binary encoding: messages defined in `.proto` files, fields identified by number, code generated for each language.Remote procedure callsOpen sourceBSD 3-Clause (Apache 2.0 until version 2.0.2 in September 2008)2026-10-06
GraphQLA query language and runtime for APIs: the server publishes a typed schema, and each client asks one endpoint for exactly the fields it needs.Web APIsOpen sourceSpecification: Open Web Foundation Agreement 1.0 since September 2017; GraphQL.js reference implementation: MIT since September 2017 (BSD plus a patent grant before)2026-10-09
RESTThe architectural style behind most HTTP APIs: resources with URLs, a few standard methods, status codes and cacheable responses, named by Roy Fielding in 2000.Web APIsOpen source–2026-10-06
StarletteA small ASGI toolkit for Python: routing, requests and responses, middleware, WebSockets and a test client, usable as a whole framework or piece by piece, and the base FastAPI is built on.API frameworksHTTP API frameworksOpen sourceBSD 3-Clause2026-10-09
FastAPIA Python API framework built on Starlette and Pydantic: declare parameters and models with type hints, and it validates requests, serializes responses and generates an OpenAPI document with interactive docs.API frameworksBuilt on StarletteOpen sourceMIT2026-10-09
GraphQL-coreThe Python port of GraphQL.js: the parser, validator and executor that Strawberry, Ariadne and Graphene all run on.API frameworksGraphQL librariesOpen sourceMIT2026-10-09
AriadneA schema-first Python GraphQL library: you write the schema in SDL and bind plain Python functions to its fields.API frameworksBuilt on GraphQL-coreOpen sourceBSD 3-Clause2026-10-09
GrapheneThe oldest Python GraphQL library: code first, with its own field classes such as `graphene.String` and a `resolve_` method per field.API frameworksBuilt on GraphQL-coreOpen sourceMIT2026-10-09
Strawberry GraphQLA code-first Python GraphQL library: you write dataclass-style classes with type hints, and Strawberry turns them into the schema.API frameworksBuilt on GraphQL-coreOpen sourceMIT2026-10-09
Amazon SQSAWS’s fully managed message queue: no brokers to run, billed per request.Message queuesManaged service on AWSProprietary2026-10-05
BullMQThe Node.js job queue on Redis, Bull’s successor, with ports to other languages and, since v6, a Postgres backend.Message queuesOpen sourceMIT (BullMQ Pro is commercial)2026-10-06
Cloudflare QueuesA message queue built into Cloudflare Workers: Workers send messages through a binding, and Queues delivers them in batches to a consumer Worker or to any HTTP client that pulls them, at least once.Message queuesCommercial productProprietary2026-10-12
pgmqAn SQS-style message queue made of SQL functions and tables inside Postgres.Message queuesOpen sourcePostgreSQL licence2026-10-06
PgQueSkype’s PgQ engine repackaged as one SQL file: a zero-bloat event log inside any Postgres 14+.Message queuesOpen sourceApache 2.0 (includes ISC-licensed PgQ code)2026-10-06
PgQueuerA Python background-job library that uses Postgres as the broker: `SKIP LOCKED` to claim, LISTEN/NOTIFY to wake.Message queuesOpen sourceMIT2026-10-06
RabbitMQA widely used open-source message broker that routes messages to queues through exchanges.Message queuesOpen sourceMPL 2.02026-10-05
Amazon Kinesis Data StreamsAWS’s serverless event stream, split into shards that each keep records in order.Event streamsManaged service on AWSProprietary2026-10-05
Apache FlussStreaming storage built for Flink: event logs and updatable tables in columnar Arrow format, with key lookups, and older data copied into Paimon, Iceberg, Hudi or Lance tables.Event streamsOpen sourceApache 2.0 (since it was open-sourced in November 2024)2026-10-06
Apache KafkaThe open-source distributed log that most event streaming is built on, or built to be compatible with.Event streamsOpen sourceApache 2.02026-10-05
Apache PulsarA multi-tenant messaging and streaming platform from Yahoo that keeps brokers stateless and stores messages in Apache BookKeeper, so one topic can serve as a log, a pub-sub feed or a work queue.Event streamsOpen sourceApache 2.02026-10-08
Cloudflare K2BetaCloudflare’s serverless event stream: a durable log stored in R2 that Workers and HTTP clients append to, read through independent subscriptions that lease out batches of records.Event streamsCommercial productProprietary2026-10-12
RedpandaA Kafka-compatible streaming broker rewritten in C++ as one binary, with no JVM and no ZooKeeper.Event streamsCommercial productBSL 1.1 (each release becomes Apache 2.0 after four years); enterprise features under the Redpanda Community License2026-10-05
WarpStreamA Kafka-compatible stream that keeps no data on disks: stateless Agents write straight to your object storage bucket.Event streamsCommercial productProprietary (the embedded Bento pipeline engine is MIT)2026-10-05
Apache FlinkThe most widely used open-source engine for stateful stream processing: keyed state, event time and exactly-once recovery from checkpoints.Stream processingOpen sourceApache 2.02026-10-06
ArroyoA stream processing engine in Rust: you write the pipeline as SQL, and it keeps windows and joins running with checkpointed state.Stream processingOpen sourceMIT or Apache 2.0, at your choice (dual-licensed since the first open-source release in 2023)2026-10-05
BytewaxA Python stream processing framework on a Rust engine built on Timely Dataflow; its company wound down in 2025 and the last release is from November 2024.Stream processingOpen sourceApache 2.02026-10-06
Cloudflare Basin PipelinesRenamedCloudflare’s managed streaming ingestion service, called Cloudflare Pipelines until October 2026, that takes events over HTTP or a Workers binding, transforms them with SQL and writes them to R2 as Apache Iceberg tables, Parquet or JSON.Stream processingCommercial productProprietary2026-10-12
DenormalizedArchivedAn embeddable stream processing library in Rust, with Python bindings, built on Apache DataFusion. Abandoned since December 2024 at version 0.0.13.Stream processingOpen sourceApache 2.0 (from the first commit in July 2024)2026-10-06
FelderaAn incremental view maintenance engine in Rust: you write SQL tables and views, and it keeps every view up to date by processing only the changes, based on the award-winning DBSP theory.Stream processingOpen sourceMIT for the open-source edition (the Rust crates are published as MIT OR Apache-2.0); since May 2026 the repository also contains Enterprise-only code, behind a `feldera-enterprise` feature flag, that needs a paid licence. The engine began at VMware Research, also under MIT2026-10-06
Kafka StreamsA Java library, part of Apache Kafka, that turns your own application into a stateful stream processor with no cluster of its own.Stream processingOpen sourceApache 2.02026-10-05
ksqlDBConfluent’s SQL server for Kafka: queries that run forever, turning topics into new topics and into tables you can look up.Stream processingCommercial productConfluent Community License (source-available, not OSI open source); Apache 2.0 until December 20182026-10-05
PathwayA Python framework for streaming ETL and live RAG pipelines: you write table transformations in Python, and a Rust engine built on Differential Dataflow keeps the results up to date.Stream processingCommercial productBusiness Source License 1.1 (source-available, not OSI open source) since the first public release in July 2023; each version becomes Apache 2.0 four years after merge, and no earlier than July 2027. Scale features need a licence key; Enterprise is under a separate commercial licence2026-10-06
Quix StreamsA pure-Python library for stateful stream processing on Kafka: a pandas-like Streaming DataFrame, RocksDB state backed up to Kafka, and no cluster of its own.Stream processingOpen sourceApache 2.0 (since the first open-source release in March 2023); Quix Cloud, the hosted platform, is proprietary2026-10-06
Redpanda ConnectRenamedFormerly Benthos: one Go binary that runs a YAML pipeline of inputs, processors and outputs, with at-least-once delivery and no disk state of its own.Stream processingOpen sourceMixed: the core engine (redpanda-data/benthos) is MIT, most connectors are Apache 2.0, and enterprise connectors and features are under the source-available Redpanda Community License and need a paid licence key; everything was MIT up to Benthos 4.27, and the split came with 4.28 in May 20242026-10-05
RisingWaveA streaming database in Rust that speaks the PostgreSQL protocol: you write materialized views in SQL, and it keeps them up to date as events arrive, with all state in object storage.Stream processingOpen sourceApache 2.0 (since the first open-source release in April 2022); premium features in the same binary need a paid licence key since v2.0 (2024)2026-10-06
StreamFusionAn open-source accelerator for Apache Flink SQL: Flink still plans and coordinates the job, while the operators it can reproduce exactly run natively in Rust on Arrow and DataFusion.Stream processingOpen sourceApache 2.0 (LICENSE file since the repository opened in datafusion-contrib, July 2026)2026-10-06
StreamlingGoldsky’s young Rust pipeline runtime: YAML pipelines of stateless SQL, TypeScript and plugin steps on Arrow, from Kafka or files into Postgres, ClickHouse or webhooks.Stream processingCommercial productFunctional Source License 1.1 with Apache 2.0 future licence (FSL-1.1-ALv2): source-available, not OSI open source; each version becomes Apache 2.0 two years after its release2026-10-06
Timely DataflowA Rust library for data-parallel dataflow with logical timestamps, loops and exact progress tracking; the engine underneath Materialize.Stream processingOpen sourceMIT (since the first commit in 2014)2026-10-06
Amazon SNSAWS’s managed pub/sub topics, which push each message to queues, functions, webhooks, phones and inboxes.Pub/subManaged service on AWSProprietary2026-10-05
Google Cloud Pub/SubGoogle Cloud’s serverless messaging service: fan-out across subscriptions, work sharing within each one.Pub/subManaged service on Google CloudProprietary2026-10-05
Amazon EventBridgeAWS’s serverless event bus, which routes JSON events from apps, AWS services and SaaS tools to targets by matching their content.Event busesManaged service on AWSProprietary2026-10-05
Amazon EventBridge SchedulerEventBridge’s serverless scheduler: millions of one-time or recurring schedules, each of which calls an AWS API at a set time in any time zone.Event busesManaged service on AWSProprietary2026-10-06
AWS Step FunctionsAWS’s serverless workflow engine: state machines in JSON that call AWS services directly.Workflow orchestrationManaged service on AWSProprietary2026-10-05
Cloudflare WorkflowsDurable execution on Cloudflare Workers: a workflow is ordinary TypeScript or Python code split into steps, and each step’s result is saved so a failed run retries that step and carries on instead of starting over.Workflow orchestrationCommercial productProprietary2026-10-12
PrefectA Python workflow orchestrator where a pipeline is an ordinary function decorated with `@flow`, with retries, caching, schedules and a UI added around it.Workflow orchestrationOpen sourceApache 2.0; Prefect Cloud is proprietary2026-10-09
TemporalAn open-source durable execution engine: you write workflows as ordinary code and they survive crashes.Workflow orchestrationOpen sourceMIT2026-10-05
AWS IoT CoreAWS’s managed MQTT broker for devices, with per-device certificates, a SQL rules engine that routes messages into AWS services, and cloud-side device state.IoT device messagingManaged service on AWSProprietary; the AWS IoT Device SDKs are open source (Apache 2.0; the Embedded C SDK is MIT)2026-10-06
Azure IoT HubAzure’s device gateway: a registry of device identities, telemetry into an Event Hubs-compatible stream, and device twins, direct methods and cloud-to-device messages, sold in fixed-price units with a daily message quota.IoT device messagingManaged service on AzureProprietary; the Azure IoT device and service SDKs are open source (MIT)2026-10-06
Eclipse ZenohIncubatingA pub/sub, query and storage protocol that runs peer to peer or through routers, from microcontrollers to the cloud; also a ROS 2 middleware.IoT device messagingOpen sourceDual-licensed: EPL 2.0 or Apache 2.02026-10-06
EMQXAn Erlang MQTT broker built for very large device fleets, with a SQL rule engine, now under the Business Source License.IoT device messagingCommercial productBusiness Source License 1.1 since 5.9.0 (May 2025; source-available, not OSI open source, each version becomes Apache 2.0 after four years); Apache 2.0 core up to 5.8.x; EMQX Cloud is proprietary2026-10-06
HiveMQA Java MQTT broker built for clusters, sold as self-managed software or as HiveMQ Cloud, with an open-source single-node edition.IoT device messagingCommercial productProprietary (HiveMQ Platform and HiveMQ Cloud); the single-node Community Edition, HiveMQ Edge and the MQTT client and CLI are Apache 2.02026-10-06
MQTTThe small publish/subscribe protocol most IoT devices use to talk to a broker, standardised by OASIS and ISO.IoT device messagingOpen sourceOpen standard, free to implement: OASIS Non-Assertion IPR mode; 3.1.1 is also ISO/IEC 209222026-10-06
Amazon S3AWS’s object storage, and the de facto API most object stores copy.Object storageManaged service on AWSProprietary2026-10-05
Apache OpenDALA Rust library, with bindings for Python, Java, Node.js, Go and more, that gives one API (read, write, stat, list, delete) over 50-plus storage backends: S3 and other object stores, local and HDFS file systems, Google Drive and Dropbox, and key-value stores.Object storageOpen sourceApache 2.02026-10-11
Apache OzoneA Hadoop-born object store that serves the same buckets over S3 and as a Hadoop file system.Object storageOpen sourceApache 2.02026-10-05
Azure Blob StorageAzure’s object storage, with three blob types and an optional real directory tree for analytics.Object storageManaged service on AzureProprietary2026-10-05
Backblaze B2 Cloud StorageLow-cost object storage on Backblaze’s own hardware, with its own API and an S3-compatible one.Object storageCommercial productProprietary (the `b2` CLI is open source)2026-10-05
CephA distributed storage cluster that serves S3 buckets, block devices and a file system from the same pool of disks.Object storageOpen sourceLGPL 2.1 or 3 (core)2026-10-05
Cloudflare R2S3-compatible object storage from Cloudflare that charges nothing for data going out.Object storageCommercial productProprietary2026-10-05
GarageA lightweight S3 object store that keeps copies of your data in several sites linked by ordinary Internet connections.Object storageOpen sourceAGPLv32026-10-05
Google Cloud StorageGoogle Cloud’s object storage, where even the archive class answers in milliseconds.Object storageManaged service on Google CloudProprietary2026-10-05
MinIOArchivedA self-hosted object store that speaks the S3 API. The open-source edition is archived and its images are gone from Docker Hub; MinIO now sells AIStor.Object storageOpen sourceAGPLv3 (community edition, now archived); AIStor is proprietary2026-10-05
PGSTY SiloA community-maintained fork of the open-source MinIO server, with builds, images, security fixes and the full web console.Object storageOpen sourceAGPLv32026-10-05
RustFSA young Rust reimplementation of MinIO’s design: S3-compatible, erasure-coded, Apache 2.0, and generally available since September 2026.Object storageOpen sourceApache 2.02026-10-05
SeaweedFSA distributed blob store with an S3 gateway and a file system layer, built to store and serve billions of small files.Object storageOpen sourceApache 2.02026-10-05
TigrisGlobally distributed S3-compatible object storage that moves data to where it’s read, with no egress fees.Object storageCommercial productProprietary (SDKs and CLI MIT; TigrisFS and the TAG cache Apache 2.0)2026-10-05
Versity S3 GatewayA stateless S3 server that exposes an existing file system, or another object store, through the S3 API.Object storageOpen sourceApache 2.02026-10-05
Wasabi Hot Cloud StorageS3-compatible object storage sold at one flat price per TB, with no egress or request fees.Object storageCommercial productProprietary2026-10-05
Zenko CloudServerScality’s open-source Node.js S3 server: a light S3 endpoint for development and tests, and a front end that can store objects in other clouds.Object storageOpen sourceApache 2.02026-10-05
Amazon EBSNetwork-attached virtual disks for EC2 instances, sized and tuned per volume.Block storageManaged service on AWSProprietary2026-10-05
Amazon EFSA managed NFS file system that grows on its own and mounts on many AWS machines at once.File storageManaged service on AWSProprietary2026-10-05
pgBackRestA PostgreSQL-only backup tool in C: parallel full, differential and incremental backups, WAL archiving and point-in-time restores, to disk, S3, Azure, GCS or SFTP.Backup & restoreOpen sourceMIT2026-10-10
VeleroBacks up a Kubernetes cluster’s objects and persistent volumes to object storage, and restores them into the same cluster or a new one.Backup & restoreOpen sourceApache 2.02026-10-06
WAL-GA single Go binary that streams compressed, encrypted Postgres backups and WAL to object storage, and restores them in parallel.Backup & restoreOpen sourceApache 2.0 (the optional LZO support is GPL 3.0 or later)2026-10-06
Alibaba Cloud PolarDBAlibaba Cloud’s cloud-native relational databases: MySQL- and PostgreSQL-compatible clusters whose compute nodes share one copy of the data on distributed storage, plus PolarDB-X, a distributed MySQL-compatible edition.Relational databasesCommercial productProprietary managed service; open-source PolarDB for PostgreSQL (Apache 2.0) and PolarDB-X (Apache 2.0, storage engine GPL 2.0)2026-10-11
CedarDBA PostgreSQL-compatible database rebuilt from scratch at TU Munich, running transactions and analytics on one copy of the data on a single server.Relational databasesCommercial productProprietary; the free Community Edition comes under CedarDB’s own terms (64 GiB data limit, no modification or redistribution)2026-10-06
Cloudflare D1Cloudflare’s serverless SQL database that speaks SQLite, runs each database inside a Durable Object, and bills by rows read and written rather than by the hour.Relational databasesCommercial productProprietary2026-10-12
CloudNativePGA Kubernetes operator that runs highly available PostgreSQL with no Patroni and no StatefulSets: the Kubernetes API itself holds the cluster’s state.Relational databasesOpen sourceApache 2.02026-10-06
CockroachDBA distributed SQL database that speaks the PostgreSQL wire protocol, replicates every slice of data with Raft and keeps transactions serializable across nodes and regions.Relational databasesCommercial productCockroachDB Software License (proprietary, source available) since v24.3 in November 2024; before that Business Source License 1.1 plus the CockroachDB Community License from v19.2 (2019), and Apache 2.0 for the core until v19.12026-10-06
MySQLThe long-standing open-source SQL database behind much of the web, built on the InnoDB engine.Relational databasesOpen sourceGPLv2 or commercial2026-10-05
NeonServerless Postgres that keeps data in a shared storage layer, so compute can scale to zero and a branch of the database is a pointer, not a copy.Relational databasesCommercial productProprietary service; the storage engine and Postgres changes are Apache 2.0 on GitHub2026-10-06
PatroniA Python agent beside each Postgres server that elects one primary through etcd, Consul, ZooKeeper or Kubernetes, and fails over when it dies.Relational databasesOpen sourceMIT2026-10-06
Percona OperatorsFour free Kubernetes operators from Percona that run its builds of MySQL, PostgreSQL and MongoDB, each using the engine’s own replication and backup tools.Relational databasesOpen sourceApache 2.0 (operators). The databases they deploy keep their own licences: Percona Server for MongoDB is source-available under the SSPL2026-10-06
PGO (Crunchy Postgres for Kubernetes)Crunchy Data’s Postgres operator: Patroni in every pod for failover, pgBackRest for backups, and a declarative `PostgresCluster` resource on top.Relational databasesOpen sourceApache 2.0 for the operator code. Crunchy’s prebuilt images are under the Crunchy Data Developer Program terms: free for development, but free in production only for individuals and organisations with fewer than 50 employees2026-10-06
PlanetScaleManaged MySQL on Vitess and managed Postgres, with schema changes shipped through branches and deploy requests.Relational databasesCommercial productProprietary (built on Vitess, Apache 2.0; the `pscale` CLI is Apache 2.0)2026-10-06
PostgreSQLThe open-source relational database that most new projects start on, extensible enough to grow into many niches.Relational databasesOpen sourcePostgreSQL License2026-10-05
ScramDBA brand-new, closed-source database that speaks the PostgreSQL protocol and promises transactions, analytics and vector search on one copy of the data; first builds shipped in summer 2026.Relational databasesCommercial productProprietary, closed source; free single-node Community edition capped at 64 GiB, Enterprise licence key required for clustering; no published licence agreement found2026-10-06
SQLiteA complete SQL database in a library and a single file, with no server to run.Relational databasesOpen sourcePublic domain2026-10-05
TursoA from-scratch Rust rewrite of SQLite with concurrent writes, plus libSQL (an open-contribution SQLite fork) and Turso Cloud, which hosts many small databases on S3.Relational databasesOpen sourceMIT (Turso Database and libSQL); Turso Cloud is a proprietary hosted service2026-10-06
VitessA proxy layer, born at YouTube, that shards MySQL across many servers while the app still sees one database.Relational databasesOpen sourceApache 2.02026-10-06
Amazon DynamoDBAWS’s serverless key-value and document database, with single-digit-millisecond reads at any size.Key-value storesManaged service on AWSProprietary2026-10-05
Amazon ElastiCacheAWS’s managed Valkey, Redis OSS and Memcached, as node-based clusters or a serverless cache.Key-value storesManaged service on AWSProprietary (runs open-source engines: Valkey, Memcached and Redis OSS up to 7.1, all BSD-3-Clause)2026-10-05
Amazon MemoryDBA Valkey- and Redis-compatible database that keeps everything in memory but loses no acknowledged write.Key-value storesManaged service on AWSProprietary (engine compatible with open-source Valkey 7.2 and Redis OSS 7, both BSD-3-Clause)2026-10-05
FoundationDBAn ordered, distributed key-value store with strictly serializable ACID transactions across the whole cluster, built as a small core that other databases are layered on.Key-value storesOpen sourceApache 2.02026-10-12
MemcachedA simple, multithreaded in-memory key-value cache; clients hash keys across independent servers.Key-value storesOpen sourceBSD-3-Clause2026-10-06
RedisAn in-memory data-structure server: the default cache, and also queues, counters and leaderboards.Key-value storesOpen sourceAGPLv3, RSALv2 or SSPLv1 (Redis 8+)2026-10-05
RocksDBThe embedded key-value engine Facebook forked from LevelDB: an LSM tree in a C++ library that many databases and stream processors use as their storage layer.Key-value storesOpen sourceDual: GPLv2 or Apache 2.0, your choice (BSD plus a patent grant until July 2017)2026-10-06
ValkeyThe Linux Foundation’s BSD-licensed fork of Redis 7.2.4: an in-memory key-value server that Redis clients can talk to unchanged.Key-value storesOpen sourceBSD-3-Clause2026-10-06
Workers KVCloudflare’s global key-value store that keeps data in a few central stores and caches it in the data centers where it is read, so reads are fast and writes take up to a minute to show up everywhere.Key-value storesCommercial productProprietary2026-10-12
MongoDBA document database that stores JSON-like records with a flexible schema, from one replica set to a sharded cluster.Document databasesCommercial productSSPL v1 (Community Server)2026-10-05
Apache CassandraA masterless, wide-column database that spreads and replicates partitions around a ring of equal nodes, with consistency chosen per request.Wide-column storesOpen sourceApache 2.02026-10-06
Apache HBaseThe Hadoop world’s Bigtable: huge sorted tables split into regions, each served by one RegionServer, with files kept in HDFS.Wide-column storesOpen sourceApache 2.02026-10-06
ScyllaDBA C++ rewrite of Cassandra’s design with one shard per CPU core, speaking both CQL and the DynamoDB API.Wide-column storesCommercial productScyllaDB Software License Agreement 1.1 (source-available) since 2025.1; AGPL 3.0 up to ScyllaDB Open Source 6.22026-10-06
ArangoDBA multi-model database: JSON documents, key-value lookups, graphs, full-text search and vectors in one engine, queried with one language, AQL.Graph databasesCommercial productBusiness Source License 1.1 since 3.12 (2024), each release converting to Apache 2.0 after four years; the prebuilt Community Edition is under the ArangoDB Community License (internal business use, datasets under 100 GB); Apache 2.0 before 3.122026-10-06
Neo4jThe best-known native graph database: nodes and relationships stored as linked records, queried with Cypher, self-hosted or as AuraDB.Graph databasesOpen sourceGPLv3 (Community Edition); Enterprise Edition and AuraDB are proprietary, and Enterprise source has been closed since 3.5 (November 2018)2026-10-06
HyperdriveA Cloudflare service that makes an existing regional PostgreSQL or MySQL database fast to use from Workers by setting up connections at the edge, pooling them near the database and caching read queries.CachingCommercial productProprietary2026-10-12
Amazon TimestreamAWS’s time-series databases: a serverless engine now closed to new customers, and managed InfluxDB 2 and 3.Time-series databasesManaged service on AWSProprietary service; Timestream for InfluxDB runs open-source InfluxDB 2.x (MIT) and InfluxDB 3 Core (MIT or Apache 2.0), while InfluxDB 3 Enterprise and 2.x read replicas add InfluxData licence fees2026-10-06
Apache IoTDBAn Apache time-series database for industrial IoT that stores everything in its own open file format, TsFile, and lets you model devices as a tree of paths or as SQL tables.Time-series databasesOpen sourceApache 2.02026-10-09
TimechoDBThe commercial edition of Apache IoTDB from the company its creators founded: the same engine plus dual-active pairs, one-way data-diode sync, a Workbench console and vendor support, licensed per machine with activation codes.Time-series databasesApache IoTDB distributionCommercial productProprietary, activated per machine with codes from Timecho (built on Apache 2.0 IoTDB)2026-10-09
ArcA young single-binary time-series database in Go that writes incoming data as Parquet files and queries them with DuckDB SQL.Time-series databasesOpen sourceAGPL-3.0 (Arc OSS); Arc Enterprise features ship in the same binary and are unlocked by a commercial licence key2026-10-06
ArcticDBMan Group’s serverless DataFrame database: a Python library with a C++ engine that stores versioned pandas DataFrames directly in S3, Azure Blob Storage or local LMDB.Time-series databasesCommercial productBusiness Source License 1.1 (source-available, not OSI open source): free for non-commercial, personal and academic use, while any business use, even in research or development, needs a commercial licence. Each version becomes Apache 2.0 two years after its release; 1.0 converted in March 20252026-10-06
GreptimeDBA Rust database that stores metrics, logs and traces as tables on object storage, queried with SQL or PromQL.Time-series databasesOpen sourceApache 2.0 (core); a few enterprise-only features under the GreptimeDB Enterprise License, not built by default2026-10-06
InfluxDBThe best-known time-series database, fed by line protocol and Telegraf; now in its third generation, a Rust rewrite that keeps data as Parquet files on object storage.Time-series databasesOpen sourceMIT or Apache 2.0 (InfluxDB 3 Core); MIT (1.x and 2.x); InfluxDB 3 Enterprise and InfluxDB Cloud are proprietary2026-10-06
kdb+A columnar time-series database that is also an interpreter for q, an array language, used for market data across trading and risk.Time-series databasesCommercial productProprietary, licence key required (free KDB-X Community Edition within limits); the KDB-X Python wrapper is Apache 2.0 apart from its bundled `q.so`2026-10-06
QuestDBA columnar time-series database in Java, C++ and Rust that ingests millions of rows a second and answers time-series SQL, with old partitions kept as Parquet.Time-series databasesOpen sourceApache 2.0 (open source; AGPLv3 from 2016 to 2019); QuestDB Enterprise is proprietary2026-10-06
TDengineA clustered time-series database for IoT and industrial data that gives every device its own table, grouped under “supertables” with tags.Time-series databasesOpen sourceAGPL-3.0 (TDengine TSDB open source); TSDB-Enterprise, IDMP and TDengine Cloud are commercial2026-10-06
TimescaleDBA PostgreSQL extension that turns ordinary tables into time-partitioned, compressed time-series tables.Time-series databasesOpen sourceApache 2.0 (core) and Tiger Data License (full Community Edition)2026-10-05
Workers Analytics EngineCloudflare’s time-series analytics store for Workers: a non-blocking `writeDataPoint()` call to record events with unlimited cardinality, adaptive sampling to keep it cheap, and a SQL API to query them.Time-series databasesCommercial productProprietary2026-10-12
ElasticsearchThe distributed search and analytics engine built on Apache Lucene: JSON documents in, full-text, vector and log queries out, over a REST API.Search indexesCommercial productSource code: AGPLv3, SSPL 1.0 or Elastic License 2.0, your choice, except paid features under `x-pack`, which are Elastic License 2.0 only. Default downloads: Elastic License 2.0. Apache 2.0 up to 7.10.22026-10-06
OpenSearchThe Apache 2.0 fork of Elasticsearch and Kibana 7.10.2 that AWS started in 2021, now run by a Linux Foundation project.Search indexesOpen sourceApache 2.02026-10-06
pg_trgmA PostgreSQL extension that splits text into three-letter pieces, so `LIKE '%foo%'`, regex and typo-tolerant searches can use an index.Search indexesOpen sourcePostgreSQL License2026-10-06
UrsaDBCERT Polska’s byte-trigram index for malware collections: it narrows a YARA hunt over terabytes of files down to a few candidates.Search indexesOpen sourceBSD-3-Clause (mquery, its web front end, is AGPL-3.0)2026-10-06
ChromaAn open-source vector database for AI apps that runs inside a Python or JavaScript process, as a single server, or as a distributed service on object storage.Vector databasesOpen sourceApache 2.0; Chroma Cloud is a paid hosted service2026-10-09
PineconeA managed, serverless vector database that keeps its indexes in object storage and serves dense-vector, sparse-vector and BM25 full-text search from the same index.Vector databasesCommercial productProprietary; managed service2026-10-12
VectorizeCloudflare’s serverless vector database for Workers, which stores embeddings in R2-backed indexes and bills only for vector dimensions stored and queried.Vector databasesCommercial productProprietary2026-10-12
Apache ZooKeeperThe coordination service from Yahoo that a generation of Hadoop-era systems use for leader election, membership and configuration.Coordination servicesOpen sourceApache 2.02026-10-06
etcdThe Raft-replicated key-value store that holds every Kubernetes cluster’s state, built for small, critical data that many machines must agree on.Coordination servicesOpen sourceApache 2.02026-10-06
Axon FrameworkA Java framework, not a database, for building event-sourced applications with CQRS and domain-driven design: commands, events and queries as messages, plus an event store to keep the events in.Persistence: state, events and replayEvent sourcingOpen sourceApache 2.0; the Axoniq Framework modules on top of it are commercial and need a subscription for production2026-10-08
KurrentDBRenamedA database built for event sourcing, formerly EventStoreDB: it stores immutable events in streams on one append-only log and pushes them to subscribers.Persistence: state, events and replayEvent sourcingCommercial productKurrent License v1 (source available, not OSI open source) since 25.0 in March 2025; Event Store License v2 for 24.10; a BSD 3-clause license for earlier versions2026-10-08
Apache ORCA columnar file format born in Hive: typed columns in large stripes, built-in indexes every 10,000 rows, and the storage behind Hive’s ACID tables.File formatsColumnar filesOpen sourceApache 2.02026-10-06
Apache ParquetThe standard columnar file format for analytics: each column stored and compressed on its own, with statistics that let engines skip data.File formatsColumnar filesOpen sourceApache 2.02026-10-05
Apache TsFileA columnar file format for device time series, with per-series indexes and time-series encodings; the storage format of Apache IoTDB and its own Apache project since 2023.File formatsColumnar filesOpen sourceApache 2.02026-10-09
PuffinApache Iceberg’s file format for the data that doesn’t fit in a manifest: a container of typed binary blobs, such as distinct-value sketches and deletion vectors, described by a JSON footer.File formatsColumnar filesOpen sourceApache 2.02026-10-11
VortexA columnar file format and toolkit that keeps data compressed with modern encodings, reads single rows fast and runs filters directly on the compressed data, pitched as a faster successor to Parquet.File formatsColumnar filesOpen sourceApache 2.02026-10-06
Apache ArrowA standard way to lay out columnar data in memory, so libraries, engines and languages can share tables without copying or converting them.File formatsIn-memory columnarOpen sourceApache 2.02026-10-05
TileDBAn embeddable C++ storage engine and open format for dense and sparse multi-dimensional arrays, on local disk or cloud object storage.File formatsArray formatsOpen sourceMIT for the engine (TileDB Embedded), its language APIs and the published format specification; the company’s hosted platform and its new Tile.ai product are commercial2026-10-06
Apache AvroA compact, row-based binary format with a JSON schema, widely used for Kafka messages and record files.File formatsBinary serializationOpen sourceApache 2.02026-10-05
CBORConcise Binary Object Representation: a binary format with JSON’s data model plus byte strings and tags, designed for tiny decoders and readable without a schema.File formatsBinary serializationOpen sourceOpen standard, free to use2026-10-09
JSONThe plain-text data format of web APIs: objects, arrays, strings, numbers, booleans and null, with one small grammar every language can parse.File formatsText and markupOpen sourceOpen standard, free to use; ECMA-404 is also ISO/IEC 217782026-10-06
TOMLA minimal configuration format with explicit types that maps unambiguously to a hash table; the language of `Cargo.toml` and `pyproject.toml`.File formatsText and markupOpen sourceMIT (the specification repository)2026-10-06
XMLThe W3C’s markup language for trees of tagged text, still behind Office documents, SVG, feeds, SOAP and the S3 API.File formatsText and markupOpen sourceOpen standard, free to implement (W3C Recommendation)2026-10-06
YAMLThe indentation-based text format behind most cloud configuration: Kubernetes manifests, CI workflows and Compose files.File formatsText and markupOpen sourceOpen specification, free to implement; the spec may be freely copied unmodified2026-10-06
Kaitai StructA YAML language for describing binary formats that already exist, compiled into ready-to-use parsers for a dozen programming languages.File formatsFormat descriptionsOpen sourceGPLv3+ (compiler, Web IDE and console visualizer); runtime libraries MIT, except JavaScript (Apache 2.0); each spec in the format gallery carries its own licence2026-10-06
Apache HudiA table format built for upserts and incremental pulls, with record-level indexes and built-in table services.Table formatsOpen sourceApache 2.02026-10-05
Apache IcebergThe most widely supported open table format: snapshots of data files, tracked by a tree of metadata and swapped in atomically through a catalog.Table formatsOpen sourceApache 2.02026-10-05
Apache PaimonA lake table format built on LSM trees, so streaming jobs can upsert into object storage and other jobs can read the changes as a stream.Table formatsOpen sourceApache 2.02026-10-06
Apache XTableIncubatingAn incubating Apache project, formerly Onehouse’s OneTable, that makes one set of Parquet files readable as a Delta Lake, Apache Iceberg and Apache Hudi table at once by translating only the table metadata.Table formatsOpen sourceApache 2.02026-10-11
Delta LakeAn open table format built around a transaction log that lives in the table’s own folder; the default on Databricks.Table formatsOpen sourceApache 2.02026-10-05
DuckLakeA lakehouse format that keeps table metadata in an ordinary SQL database and the data in Parquet files.Table formatsOpen sourceMIT2026-10-05
icepickExperimentalA small, experimental Rust CLI and library that commits Parquet files to Apache Iceberg tables and runs compaction and snapshot cleanup through a REST catalog, aimed at Cloudflare’s R2 Data Catalog (now Basin Catalog) and Amazon S3 Tables, with no JVM.Table formatsOpen sourceApache 2.02026-10-11
LanceA file and table format for AI data: columnar like Parquet, but fast at fetching single rows, with vector and full-text indexes, versions and room for images and video.Table formatsOpen sourceApache 2.02026-10-05
Apache PolarisAn open-source Iceberg REST catalog: one server that every engine asks where a table’s current metadata is, with role-based access control and short-lived storage credentials per table.Lakehouse catalogsOpen sourceApache 2.0 (since the first public release in July 2024)2026-10-06
Cloudflare Basin CatalogRenamedCloudflare’s managed Apache Iceberg REST catalog built into R2 buckets, called R2 Data Catalog until it became generally available as Basin Catalog on 1 October 2026, which also compacts tables and expires old snapshots for you.Lakehouse catalogsCommercial productProprietary2026-10-11
LakekeeperAn open-source Apache Iceberg REST catalog written in Rust: a stateless server, backed by PostgreSQL, that tells every engine where each table’s current metadata is, checks permissions, and hands out short-lived storage credentials.Lakehouse catalogsOpen sourceApache 2.02026-10-09
Project NessieAn open-source catalog for Apache Iceberg with Git-like branches, tags and commits that span every table at once, so a set of changes to many tables can be tested on a branch and then merged in one atomic step.Lakehouse catalogsOpen sourceApache 2.02026-10-10
Unity CatalogDatabricks’ catalog and governance layer for tables, files, functions and models, with managed and external tables, an Iceberg REST endpoint and credential vending; a separate Apache 2.0 open-source server lives at LF AI & Data.Lakehouse catalogsCommercial productProprietary as a Databricks service; the open-source Unity Catalog server is Apache 2.02026-10-09
Amazon AthenaAWS’s serverless SQL engine for data in S3: no cluster to run, and on-demand queries cost $5 per TB scanned.Query enginesManaged service on AWSProprietary2026-10-05
Apache Arrow AceroExperimentalThe streaming execution engine inside Arrow’s C++ library: you hand it an exact plan of nodes (scan, filter, project, aggregate, join, sort) and it streams Arrow record batches through them, with no SQL parser or optimizer of its own.Query enginesOpen sourceApache 2.02026-10-11
Apache CalciteA Java framework with everything a database needs to understand a query (SQL parser, validator, relational algebra and a rule-based, cost-based optimizer) but no storage of its own, which Hive, Flink, Druid, Dremio, Beam and many other systems embed as their SQL front end and planner.Query enginesOpen sourceApache 2.02026-10-11
Apache DataFusionA query engine library in Rust, built on Arrow, that other projects embed and extend to build their own databases and data tools.Query enginesOpen sourceApache 2.02026-10-05
Apache DataFusion CometA Spark plugin that keeps Spark’s optimizer and scheduler but runs the physical plan on Apache DataFusion in Rust, over Arrow batches, with no changes to your Spark code, and falls back to Spark for anything it can’t run the same way.Query enginesBuilt on Apache DataFusionOpen sourceApache 2.02026-10-11
Apache HadoopThe project that made big-data clusters normal: a distributed file system (HDFS), a cluster scheduler (YARN) and the MapReduce engine.Query enginesOpen sourceApache 2.02026-10-06
Apache HiveThe first SQL engine for Hadoop, and the source of the Hive Metastore, the table catalog that Trino, Spark, Impala and Flink still read.Query enginesOpen sourceApache 2.02026-10-06
Apache ImpalaAn MPP SQL engine in C++ for interactive queries over Hive tables on HDFS, Kudu, Iceberg and object storage; built and mainly sold by Cloudera.Query enginesOpen sourceApache 2.02026-10-06
Apache PigDormantA step-by-step scripting language, Pig Latin, that compiles to MapReduce, Tez or Spark jobs on Hadoop. Still released, but the project calls itself dormant.Query enginesOpen sourceApache 2.02026-10-06
Apache SparkThe general-purpose distributed engine for large batch jobs, streaming and machine learning, in Python, SQL, Scala, Java or R.Query enginesOpen sourceApache 2.02026-10-05
Apache ZeppelinA self-hosted web notebook where each paragraph runs through an interpreter: Spark, Flink, JDBC, Python and more. Maintained, but behind Jupyter and Databricks in reach.Query enginesOpen sourceApache 2.02026-10-06
chDBThe ClickHouse engine packaged as a library: run ClickHouse SQL inside a Python, Go, Rust or Node.js program, with no server.Query enginesOpen sourceApache 2.02026-10-06
Cloudflare Basin SQLRenamedCloudflare’s serverless, distributed SQL engine for Apache Iceberg tables in Basin Catalog on R2, called R2 SQL until it became generally available on 1 October 2026, billed by the data it scans.Query enginesCommercial productProprietary2026-10-12
DuckDBAn in-process analytical SQL database: a library with no server that queries Parquet, CSV, Iceberg and S3 directly.Query enginesOpen sourceMIT2026-10-05
GizmoSQLA database server that wraps DuckDB (or SQLite) and serves it to many clients over Arrow Flight SQL, with TLS and authentication.Query enginesOpen sourceApache 2.0 (Core); Enterprise features proprietary2026-10-06
GlareDBDormantA small, embeddable SQL engine in Rust for querying Parquet and CSV files locally, over HTTP or in S3 and GCS, from a CLI, Python or the browser. It began as a DataFusion-based federated query service and was rewritten in 2025 on its own engine, and it has had no release since June 2025.Query enginesOpen sourceMIT since the rewrite (0.10.0, April 2025, onward); the DataFusion-based versions up to 0.9.5 were AGPLv32026-10-11
HotdataA managed SQL engine for AI agents, built in Rust on Apache DataFusion and Arrow: each agent gets short-lived “instant databases” to load data into, then runs read-only SQL, vector, full-text and geospatial queries over an HTTP API or CLI.Query enginesCommercial productProprietary managed service; the CLI is MIT, and the DuckLake library it donated to DataFusion is Apache 2.02026-10-11
IbisA Python dataframe API that compiles to SQL, so the same code runs on DuckDB on a laptop and on BigQuery, Snowflake, PostgreSQL or more than 20 other engines.Query enginesOpen sourceApache 2.02026-10-09
PolarsA DataFrame library with a Rust query engine underneath: you write Python (or Rust, SQL, Node.js, R) and it plans, optimises and runs the query on every core, streaming data bigger than memory.Query enginesOpen sourceMIT (Polars Cloud, the company’s managed platform, is a separate commercial service)2026-10-06
Presto (PrestoDB)Facebook’s distributed SQL engine, now governed by the Linux Foundation, moving its workers from Java to C++ on Velox. Trino is its 2019 fork.Query enginesOpen sourceApache 2.02026-10-06
RayforceA small embeddable engine in pure C that runs columnar analytics, graph traversals and recursive Datalog queries in one optimised plan.Query enginesOpen sourceMIT2026-10-06
Spice.ai OSSA single-binary SQL engine in Rust, built on DataFusion and Arrow, that federates queries across databases, warehouses and lakes, keeps hot datasets in a local accelerated copy, and adds search and LLM APIs on top.Query enginesOpen sourceApache 2.02026-10-06
TrinoA distributed SQL engine that queries data where it lives, from Iceberg tables on S3 to a live PostgreSQL database, in one query.Query enginesOpen sourceApache 2.02026-10-05
VeloxMeta’s open-source C++ execution engine library: it takes an already-optimized query plan and runs it with vectorized operators, and it is the engine inside Presto’s C++ workers (Prestissimo) and Apache Gluten’s native Spark.Query enginesOpen sourceApache 2.02026-10-11
ClickHouseAn open-source column-oriented database for real-time analytics, fast enough to serve dashboards over billions of rows.Data warehousesOpen sourceApache 2.02026-10-05
DatabendA cloud data warehouse written in Rust that keeps every table as Parquet blocks and Git-like snapshots in object storage, so stateless compute clusters can start, scale and stop without moving data. Open core: Apache 2.0, with paid features under the Elastic License 2.0.Data warehousesOpen sourceApache 2.0 for the core; enterprise features (src/query/ee, src/meta/ee, BendSave) are under the Elastic License 2.0 and need a paid license key. Both ship in the same binary2026-10-11
Google BigQueryGoogle Cloud’s serverless data warehouse: no clusters, and you pay per TiB scanned or per slot-hour.Data warehousesManaged service on Google CloudProprietary2026-10-05
MotherDuckA serverless cloud data warehouse built on DuckDB, where one query can run partly on your laptop and partly in the cloud.Data warehousesCommercial productProprietary (built on MIT-licensed DuckDB)2026-10-05
SnowflakeA fully managed cloud data warehouse that separates storage from compute, with virtual warehouses billed per second.Data warehousesCommercial productProprietary2026-10-05
Alibaba Cloud HologresAlibaba Cloud’s PostgreSQL-compatible real-time data warehouse, which takes streaming writes, answers analytical queries and serves key lookups from one copy of the data.Real-time analytics databasesCommercial productProprietary (managed service only)2026-10-06
Apache DorisAn open-source MPP analytical database, born at Baidu as Palo, that serves sub-second queries on fresh, updatable data through the MySQL protocol and also queries Iceberg, Hudi, Paimon and Hive tables in place.Real-time analytics databasesOpen sourceApache 2.02026-10-10
Apache DruidAn open-source real-time analytics database that makes Kafka and Kinesis events queryable within seconds and serves fast slice-and-dice queries to dashboards and APIs.Real-time analytics databasesOpen sourceApache 2.0 (GPLv2 until February 2015)2026-10-06
FireboltA cloud data warehouse built for low-latency, high-concurrency queries behind apps and dashboards, also free to self-host as Firebolt Core.Real-time analytics databasesCommercial productProprietary. Firebolt Core, the free self-hosted engine, ships as binaries only under the Elastic License 2.0 (source-available terms, not OSI open source; a custom licence before July 2025). SDKs, dbt adapter and Kubernetes operator are Apache 2.02026-10-06
PivotA young open-source analytics server in Rust that speaks the PostgreSQL protocol and queries Iceberg and Delta Lake tables straight from object storage.Real-time analytics databasesOpen sourceMIT or Apache 2.0, at your option2026-10-06
StarRocksAn open-source MPP analytical database with a vectorized engine that serves fast joins and real-time updates on its own tables, and also queries Iceberg, Hudi, Delta Lake and Hive tables in place.Real-time analytics databasesOpen sourceApache 2.0 (Elastic License 2.0 until December 2022)2026-10-06
TinybirdA hosted ClickHouse platform that turns SQL queries into authenticated REST API endpoints, for analytics inside your product.Real-time analytics databasesCommercial productProprietary (TypeScript SDK MIT-licensed)2026-10-06
AWS Lake FormationAWS’s permission layer for data lakes: database-style `GRANT` and `REVOKE` on Glue Data Catalog databases, tables, columns, rows and cells, enforced by handing query engines short-lived S3 credentials for the data they may read.Data lakesManaged service on AWSProprietary2026-10-09
Amazon S3 TablesA bucket type for Apache Iceberg tables: S3 stores them, acts as their catalog, and compacts and cleans them up for you.LakehousesManaged service on AWSProprietary (the S3 Tables Catalog for Apache Iceberg client library is Apache 2.0)2026-10-06
Apache AmoroIncubatingAn incubating Apache “lakehouse management system”, started at NetEase as Arctic, that watches Iceberg tables and keeps them fast on its own: it compacts small files, rewrites deletes and expires old snapshots and files in the background.LakehousesOpen sourceApache 2.02026-10-11
DatabricksA managed lakehouse platform built on Apache Spark and Delta Lake, with Unity Catalog for governance, on AWS, Azure or Google Cloud.LakehousesCommercial productProprietary2026-10-05
DremioA SQL lakehouse engine built on Apache Arrow, with its own Iceberg catalog and “reflections” that speed up queries without anyone changing them.LakehousesCommercial productProprietary (Dremio Cloud and Enterprise); the free Community Edition is Apache 2.0 (dremio-oss), last released as 26.0.5 in September 20252026-10-06
SpiralA closed-source storage and query engine for multimodal AI data (video, images, sensor traces and tables) that keeps everything as Vortex files in your own object storage, versions every change and streams results to GPUs; access is by request.LakehousesCommercial productProprietary (the Python SDK is published under a proprietary licence); its storage format, Vortex, is Apache 2.02026-10-06
Tiger LakeBetaTiger Cloud’s built-in Iceberg connector, in public beta: it copies a Postgres table or TimescaleDB hypertable into Apache Iceberg, then keeps it current from the write-ahead log.LakehousesCommercial productProprietary (a Tiger Cloud feature)2026-10-11
AirbyteAn ELT platform you can host yourself: hundreds of connectors, each a Docker image speaking one JSON protocol, scheduled by services on Kubernetes.ETL & ELT pipelinesCommercial productElastic License 2.0 (source-available, not OSI open source): the platform since 0.30.0 (September 2021), every connector since July 2025; the Airbyte Protocol, Python CDK and `abctl` are MIT; Airbyte Cloud is proprietary2026-10-06
Apache NiFiA Java dataflow server you program by drawing a graph of processors in a web UI, with buffered queues, back pressure and a record of where every piece of data went.ETL & ELT pipelinesOpen sourceApache 2.02026-10-06
ArtieA managed change data capture service that copies every insert, update and delete from production databases into a warehouse, aiming for under a minute of delay.ETL & ELT pipelinesCommercial productProprietary managed service. Its writer, Artie Transfer, was published on GitHub under the source-available Elastic License 2.0 from 2023, but that repository is no longer public (404 in October 2026); the Terraform provider and CLI are MIT2026-10-06
BruinOne Go command-line tool that ingests data, runs SQL and Python transformations and checks the results, with each step a file in your repo.ETL & ELT pipelinesOpen sourceApache 2.0 (the CLI, since its first commit in 2023); the ingestr engine it installs is FSL-1.1-ALv2 since its 2026 Go rewrite (each release becomes Apache 2.0 after two years; earlier Python versions are MIT); Bruin Cloud is proprietary2026-10-06
DagsterA Python data orchestrator built around assets: you declare the tables, files and models that should exist, and Dagster works out what to run.ETL & ELT pipelinesOpen sourceApache 2.0; Dagster+ (the hosted service) is proprietary2026-10-06
dbtSQL `select` statements in git, built into warehouse tables in dependency order, with tests and docs alongside.ETL & ELT pipelinesOpen sourceApache 2.0 (dbt v1, and the source of dbt v2 built as `dbt-oss`); the default dbt v2 binary adds proprietary features under the dbt product licence; the dbt platform is proprietary SaaS2026-10-06
EstuaryA managed data-movement platform that captures changes from databases and SaaS sources into collections kept as JSON files in your own bucket, then keeps warehouses and other systems in sync, in real time or on a schedule.ETL & ELT pipelinesCommercial productProprietary hosted service. The Flow runtime source (estuary/flow) is under the Business Source License 1.1 (since November 2020), which converts to Apache 2.0 on its change date (2029-11-20 in the current text) and bans offering it as a data processing service to third parties; only `go/protocols` is also available under Apache 2.0. Most connectors are BSL too, and the Gazette broker underneath is MIT2026-10-06
FivetranManaged connectors that copy data from SaaS apps, databases and files into your warehouse or lake, billed by the rows that change each month.ETL & ELT pipelinesCommercial productProprietary; the Python Connector SDK is MIT2026-10-06
MeltanoA command-line ELT tool that runs Singer taps and targets from a `meltano.yml` project kept in git.ETL & ELT pipelinesOpen sourceMIT (the Meltano Singer SDK is Apache 2.0); the managed Meltano Cloud is proprietary2026-10-06
OLakeAn open-source tool in Go that copies databases, Kafka topics and S3 files into Apache Iceberg tables (or plain Parquet), with full loads, incremental syncs and CDC, and no Kafka, Debezium, Spark or Flink in between.ETL & ELT pipelinesOpen sourceApache 2.0 since November 2024 (OLake Go, OLake UI, the Helm chart and OLake Fusion); before that, when the project was called Kaku, Shift and then Gear5, its licence allowed only personal and private use2026-10-06
CubeAn open-source, headless semantic layer: define metrics, joins and access rules once in YAML, query them over SQL, REST or GraphQL, and serve repeated queries from rollups it builds ahead of time.Semantic layersOpen sourceApache 2.0 (Cube Core backend), MIT (client libraries)2026-10-09
HexA hosted SQL and Python notebook whose cells form a reactive graph and can be published as data apps. It now leads with AI agents that answer questions from semantic models and curated context.Data notebooksCommercial productProprietary2026-10-09
GitThe distributed version control system almost everyone uses: every clone holds the full history, stored as objects named by the hash of their content.Version controlOpen sourceGPLv22026-10-06
Argo CDGitOps delivery for Kubernetes: a controller in the cluster keeps what’s running identical to the manifests in a Git repository.CI/CD pipelinesOpen sourceApache 2.02026-10-05
GitHub ActionsCI/CD built into GitHub: YAML workflows in the repository run on GitHub’s VMs or your own machines whenever something happens in the repo.CI/CD pipelinesCommercial productProprietary (the self-hosted runner agent is MIT)2026-10-05
AWS Cloud Development Kit (CDK)Define AWS infrastructure in TypeScript, Python, Java, C# or Go; the CDK turns it into CloudFormation templates and CloudFormation deploys them.Infrastructure as codeManaged service on AWSApache 2.02026-10-06
HashiCorp PackerBuilds machine images (AMIs, Azure and Google images, VMware, Docker) from one HCL template, so every server starts already configured.Infrastructure as codeCommercial productBusiness Source License 1.1 since 1.10.0 (source-available, not OSI open source); MPL 2.0 before the August 2023 change2026-10-05
HCP WaypointHashiCorp’s hosted internal developer platform: developers create apps and add databases from templates that run Terraform modules in HCP Terraform.Infrastructure as codeCommercial productProprietary SaaS (part of HCP, included with HCP Terraform Standard and Premium); the archived community Waypoint was MPL 2.0 up to its last release, 0.11.42026-10-05
OpenTofuThe open-source fork of Terraform, created after HashiCorp’s 2023 licence change: same HCL, same providers, `tofu` instead of `terraform`.Infrastructure as codeOpen sourceMPL 2.02026-10-06
SSTA TypeScript framework that defines a whole app, from Next.js front end to functions, containers and databases, in one config file and deploys it to your own AWS or Cloudflare account.Infrastructure as codeOpen sourceMIT2026-10-06
TerraformThe most widely used infrastructure-as-code tool: declare resources in HCL, review a plan, and apply it through provider plugins.Infrastructure as codeCommercial productBusiness Source License 1.1 since 1.6 (source-available, not OSI open source); MPL 2.0 before the August 2023 change2026-10-05
FlociA young, MIT-licensed family of local emulators for AWS, Azure, Google Cloud and Oracle Cloud, built as a free drop-in for LocalStack and pitched at AI coding agents.Local cloud emulatorsOpen sourceMIT (all four emulators, the CLI and the Testcontainers modules)2026-10-06
LocalStackThe best-known AWS emulator: one Docker container that answers more than 100 AWS APIs on localhost:4566, now free only for non-commercial use.Local cloud emulatorsCommercial productProprietary since the March 2026 single image (an account and auth token are needed for current releases); the archived Community edition source, up to v4.14.0, stays Apache 2.02026-10-06
MiniflareA local simulator for Cloudflare Workers that runs your code in the real `workerd` runtime and fakes the platform around it: KV, R2, D1, Durable Objects, Queues, the Cache API and more.Local cloud emulatorsOpen sourceMIT2026-10-12
Amazon CloudWatchAWS’s built-in monitoring service: metrics from every AWS service, logs, alarms and dashboards, and now traces, OpenTelemetry and PromQL, billed per metric, per GB and per alarm.ObservabilityManaged service on AWSProprietary2026-10-06
Better StackUptime checks, on-call paging and status pages, plus logs, traces, metrics and errors in a ClickHouse-based store, sold as one SaaS billed per responder and per GB.ObservabilityCommercial productProprietary (the Better Stack collector is Apache 2.0)2026-10-05
ClickStackClickHouse’s open-source observability stack: an OpenTelemetry collector, ClickHouse for storage and the HyperDX UI for search, dashboards and alerts on logs, traces, metrics and session replays.ObservabilityOpen sourceMIT (HyperDX UI, API and the ClickStack collector build); Apache 2.0 (ClickHouse and the upstream OpenTelemetry Collector); self-hosted app state in MongoDB, which is SSPL; Managed ClickStack is a proprietary ClickHouse Cloud service2026-10-06
DatadogA hosted monitoring platform: an agent on every host ships metrics, logs and traces to Datadog’s SaaS, which bills per host, per GB and per metric.ObservabilityCommercial productProprietary (the Datadog Agent is Apache 2.0)2026-10-05
GrafanaDashboards and alerts over data that stays where it is: Prometheus, SQL databases, cloud monitoring and more.ObservabilityOpen sourceAGPLv3 (Apache 2.0 until April 2021)2026-10-05
OpenTelemetryThe vendor-neutral standard for producing and shipping traces, metrics and logs, with SDKs for most languages and a Collector to route the data.ObservabilityOpen sourceApache 2.02026-10-05
FluentdA CNCF graduated log collector that tags each event, routes it by tag through plugins, and buffers it until the destination accepts it.LogsOpen sourceApache 2.02026-10-06
LogstashElastic’s JVM-based pipeline that takes events in, parses them with filters such as `grok`, and sends them on, most often to Elasticsearch.LogsOpen sourceApache 2.0 (core and plugins); `x-pack` code under the Elastic License, included in the default download but not in the `-oss` builds2026-10-06
Workers ObservabilityCloudflare’s built-in logging and tracing for Workers: turn it on in `wrangler.jsonc` and every invocation, `console.log` and binding call is stored and queryable in the dashboard, or exported over OpenTelemetry.LogsCommercial productProprietary2026-10-12
PrometheusThe standard open-source metrics system: it pulls numbers from your services over HTTP, stores them as labelled time series and alerts on PromQL queries.MetricsOpen sourceApache 2.02026-10-05
TelegrafInfluxData’s plugin-driven Go agent that collects metrics from systems, services and devices and writes them to InfluxDB, Prometheus, Kafka and hundreds of other targets.MetricsOpen sourceMIT (agent); Telegraf Enterprise and the paid tier of Telegraf Controller are commercial2026-10-06
SentryError tracking first: SDKs in your app catch exceptions with their stack traces and send them to Sentry, which groups them into issues; tracing, logs and session replay sit on top.Error trackingCommercial productFSL-1.1-Apache-2.0: source-available, each release becomes Apache 2.0 after two years (BSL 1.1 from 2019, BSD 3-Clause before); SDKs are MIT2026-10-05
Auth0A hosted login and user-management service: your app redirects to Auth0, which signs users in with passwords, social accounts, passkeys or enterprise SSO and hands back tokens.AuthenticationCommercial productProprietary (SDKs MIT)2026-10-06
WorkOSAPIs that make a SaaS app “enterprise-ready”: SSO over SAML and OIDC, SCIM directory sync, a hosted login (AuthKit), audit logs and authorization.AuthenticationCommercial productProprietary (SDKs and AuthKit UI MIT)2026-10-06
AWS IAMAWS’s identity and access management: JSON policies decide which users, roles and services may call which AWS APIs on which resources.Identity & access (IAM)Managed service on AWSProprietary2026-10-05
Cloudflare Secrets StoreBetaAccount-level secrets that are written once, can never be read back, and are bound by reference into any Worker or AI Gateway that needs them.Secrets managementCommercial productProprietary2026-10-12
DopplerA hosted secrets manager built for developers: one place for every app’s config and secrets per environment, injected with `doppler run` and synced out to clouds and CI.Secrets managementCommercial productProprietary SaaS; the CLI and Kubernetes operator are Apache 2.02026-10-08
HashiCorp VaultA secrets server that can mint short-lived database and cloud credentials on demand, not just store passwords.Secrets managementCommercial productBusiness Source License 1.1 (source-available, not OSI open source); MPL 2.0 before the August 2023 change2026-10-05
HCP Vault RadarA hosted scanner that finds leaked secrets and personal data in code, wikis, tickets and chat, checks which ones still work, and helps move them into Vault.Secrets managementCommercial productProprietary: an HCP software-as-a-service; the `vault-radar` CLI and agent ship as closed-source binaries under a HashiCorp licence agreement2026-10-05
Cloudflare AccessThe identity-aware proxy in Cloudflare One: every request to a protected app must carry a signed token that says who the user is and that a policy allowed them in.Remote accessCommercial productProprietary2026-10-12
Cloudflare TunnelA small daemon, `cloudflared`, dials out from your network to Cloudflare, so servers can be published or reached privately with no public IP and no open inbound ports.Remote accessCommercial productProprietary service (cloudflared is Apache 2.0)2026-10-12
HashiCorp BoundaryAn identity-aware proxy: users sign in once and get one proxied session to one private host or database, with credentials fetched per session.Remote accessCommercial productBusiness Source License 1.1 since 0.14 (source-available, not OSI open source); MPL 2.0 before the August 2023 change2026-10-05
RSigmaA Rust toolkit that parses Sigma rules, compiles them into matchers and evaluates them against log events in real time, correlations included, as one self-contained binary.Threat detection (SIEM)Open sourceMIT2026-10-12
SigmaAn open YAML format for detection rules over log events, with a community repository of more than 3,000 rules and tools that convert them into each SIEM’s query language.Threat detection (SIEM)Open sourceDRL 1.1 (rules); LGPL 2.1 (pySigma, sigma-cli); specification public domain2026-10-12