On this page
Type reference
Built-in types: data
Last updated
Databases, caches, search engines, warehouses and storage: the components that keep data, with the operations their clients send. Generated from data.proschi; component types explains how to read and extend them.
Data #
A component that keeps data: a database, cache, search index, warehouse or bucket.
- Abstract. A node uses a type that extends it.
- Extends: Component
- Extended by: Database, NoSQL Database, Coordination Store, Cache, Search Engine, Data Warehouse, Time Series Store, Object Storage, Shared File System, Block Storage
- Read:
READ,FETCH,LOOKUP - Write:
WRITE,SAVE,STORE,RECORD,MARK,RESERVE,HOLD,BOOK
Database #
A relational database queried with SQL, whose product does not matter.
- Extends: Data › Component
- Extended by: PostgreSQL, MySQL, SQLite, Oracle, SQL Server, Distributed SQL Database, AWS RDS, AWS Aurora, GCP Cloud SQL
- Kind:
database - Protocol:
SQL - Read:
SELECT,WITH,EXPLAIN,SHOW,BEGIN,COMMIT,ROLLBACK, plus 3 from Data - Write:
INSERT,UPDATE,DELETE,UPSERT,MERGE,TRUNCATE,LOCK,CREATE,ALTER,DROP, plus 8 from Data
PostgreSQL #
PostgreSQL, the open source relational database.
- Extends: Database › Data › Component
- Extended by: TimescaleDB, Azure Database for PostgreSQL
- Kind:
database - Protocol:
SQL - Read:
LISTEN, plus 7 from Database, 3 from Data - Write:
NOTIFY,COPY,VACUUM, plus 10 from Database, 8 from Data
MySQL #
MySQL, the open source relational database.
- Extends: Database › Data › Component
- Extended by: MariaDB, Azure Database for MySQL
- Kind:
database - Protocol:
SQL - Read: 7 from Database, 3 from Data
- Write:
REPLACE, plus 10 from Database, 8 from Data
MariaDB #
MariaDB, the community fork of MySQL.
- Extends: MySQL › Database › Data › Component
- Kind:
database - Protocol:
SQL - Read: 7 from Database, 3 from Data
- Write: 1 from MySQL, 10 from Database, 8 from Data
SQLite #
SQLite, the embedded relational database in a single file.
- Extends: Database › Data › Component
- Kind:
database - Protocol:
SQL - Read: 7 from Database, 3 from Data
- Write: 10 from Database, 8 from Data
Oracle #
Oracle Database, the commercial relational database.
- Extends: Database › Data › Component
- Kind:
database - Protocol:
SQL - Read: 7 from Database, 3 from Data
- Write: 10 from Database, 8 from Data
SQL Server #
Microsoft SQL Server, the commercial relational database.
- Extends: Database › Data › Component
- Extended by: Azure SQL
- Kind:
database - Protocol:
SQL - Read: 7 from Database, 3 from Data
- Write: 10 from Database, 8 from Data
TimescaleDB #
TimescaleDB, PostgreSQL extended for time series.
- Extends: PostgreSQL › Database › Data › Component
- Kind:
analytics - Protocol:
SQL - Read: 1 from PostgreSQL, 7 from Database, 3 from Data
- Write: 3 from PostgreSQL, 10 from Database, 8 from Data
Distributed SQL Database #
A relational database that shards and replicates itself across nodes, keeping transactions.
- Abstract. A node uses a type that extends it.
- Extends: Database › Data › Component
- Extended by: CockroachDB, YugabyteDB, TiDB, Vitess, GCP Spanner
- Kind:
database - Protocol:
SQL - Icon:
Database - Read: 7 from Database, 3 from Data
- Write: 10 from Database, 8 from Data
CockroachDB #
CockroachDB, a distributed SQL database that speaks the PostgreSQL protocol.
- Extends: Distributed SQL Database › Database › Data › Component
- Kind:
database - Protocol:
SQL - Read: 7 from Database, 3 from Data
- Write: 10 from Database, 8 from Data
YugabyteDB #
YugabyteDB, a distributed SQL database compatible with PostgreSQL.
- Extends: Distributed SQL Database › Database › Data › Component
- Kind:
database - Protocol:
SQL - Read: 7 from Database, 3 from Data
- Write: 10 from Database, 8 from Data
TiDB #
TiDB, a distributed SQL database compatible with MySQL.
- Extends: Distributed SQL Database › Database › Data › Component
- Kind:
database - Protocol:
SQL - Read: 7 from Database, 3 from Data
- Write: 10 from Database, 8 from Data
Vitess #
Vitess, which shards MySQL behind one SQL endpoint.
- Extends: Distributed SQL Database › Database › Data › Component
- Kind:
database - Protocol:
SQL - Read: 7 from Database, 3 from Data
- Write: 10 from Database, 8 from Data
NoSQL Database #
A non-relational database that partitions data by key, whose product does not matter.
- Extends: Data › Component
- Extended by: DynamoDB, Document NoSQL Database, Wide-Column NoSQL Database, Graph NoSQL Database
- Kind:
database - Read:
GET,SCAN, plus 3 from Data - Write:
PUT,SET,DELETE, plus 8 from Data
DynamoDB #
DynamoDB, the managed key-value and document database: reads by key or partition, a Scan reads the whole table.
- Extends: NoSQL Database › Data › Component
- Extended by: AWS DynamoDB
- Kind:
database - Read:
GetItem,BatchGetItem,Query,TransactGetItems,DescribeTable,Scan(latency ×10, cost ×25), plus 1 from NoSQL Database, 3 from Data - Write:
PutItem,UpdateItem,DeleteItem,BatchWriteItem,TransactWriteItems,ExecuteStatement,CreateTable,UpdateTable,DeleteTable, plus 3 from NoSQL Database, 8 from Data
Document NoSQL Database #
A NoSQL database that stores JSON-like documents and queries their fields.
- Abstract. A node uses a type that extends it.
- Extends: NoSQL Database › Data › Component
- Extended by: MongoDB, CouchDB, Couchbase, GCP Firestore, Azure Cosmos DB
- Kind:
database - Icon:
NoSQL Database - Read: 2 from NoSQL Database, 3 from Data
- Write: 3 from NoSQL Database, 8 from Data
MongoDB #
MongoDB, the document database.
- Extends: Document NoSQL Database › NoSQL Database › Data › Component
- Extended by: AWS DocumentDB
- Kind:
database - Read:
find,findOne,aggregate,countDocuments,estimatedDocumentCount,distinct,watch, plus 2 from NoSQL Database, 3 from Data - Write:
insertOne,insertMany,updateOne,updateMany,replaceOne,deleteOne,deleteMany,findOneAndUpdate,findOneAndReplace,findOneAndDelete,bulkWrite,createIndex, plus 3 from NoSQL Database, 8 from Data
CouchDB #
Apache CouchDB, a document database with an HTTP API and multi-primary replication.
- Extends: Document NoSQL Database › NoSQL Database › Data › Component
- Kind:
database - Read: 2 from NoSQL Database, 3 from Data
- Write: 3 from NoSQL Database, 8 from Data
Couchbase #
Couchbase, a document database with a built-in cache.
- Extends: Document NoSQL Database › NoSQL Database › Data › Component
- Kind:
database - Read:
lookupIn,exists,query, plus 2 from NoSQL Database, 3 from Data - Write:
upsert,insert,replace,remove,mutateIn,touch,increment,decrement, plus 3 from NoSQL Database, 8 from Data
Wide-Column NoSQL Database #
A NoSQL database of rows with many columns, partitioned by key and sorted within a partition.
- Abstract. A node uses a type that extends it.
- Extends: NoSQL Database › Data › Component
- Extended by: Cassandra, HBase, GCP Bigtable
- Kind:
database - Icon:
NoSQL Database - Read: 2 from NoSQL Database, 3 from Data
- Write: 3 from NoSQL Database, 8 from Data
Cassandra #
Apache Cassandra, the wide-column database queried with CQL.
- Extends: Wide-Column NoSQL Database › NoSQL Database › Data › Component
- Extended by: ScyllaDB, AWS Keyspaces
- Kind:
database - Protocol:
CQL - Read:
SELECT, plus 2 from NoSQL Database, 3 from Data - Write:
INSERT,UPDATE,DELETE,BATCH,TRUNCATE, plus 2 from NoSQL Database, 8 from Data
ScyllaDB #
ScyllaDB, a Cassandra-compatible database written in C++.
- Extends: Cassandra › Wide-Column NoSQL Database › NoSQL Database › Data › Component
- Kind:
database - Protocol:
CQL - Read: 1 from Cassandra, 2 from NoSQL Database, 3 from Data
- Write: 5 from Cassandra, 2 from NoSQL Database, 8 from Data
HBase #
Apache HBase, the wide-column database on HDFS.
- Extends: Wide-Column NoSQL Database › NoSQL Database › Data › Component
- Kind:
database - Read:
Exists,Scan(latency ×10, cost ×25), plus 1 from NoSQL Database, 3 from Data - Write:
Increment,Append,CheckAndMutate, plus 3 from NoSQL Database, 8 from Data
Graph NoSQL Database #
A graph database: nodes and relationships, queried by pattern.
- Abstract. A node uses a type that extends it.
- Extends: NoSQL Database › Data › Component
- Extended by: Neo4j, AWS Neptune
- Kind:
database - Protocol:
Cypher - Icon:
NoSQL Database - Read:
MATCH,OPTIONAL,RETURN,CALL, plus 2 from NoSQL Database, 3 from Data - Write:
CREATE,MERGE,DELETE,DETACH,SET,REMOVE, plus 1 from NoSQL Database, 8 from Data
Neo4j #
Neo4j, the graph database queried with Cypher.
- Extends: Graph NoSQL Database › NoSQL Database › Data › Component
- Kind:
database - Protocol:
Cypher - Read: 4 from Graph NoSQL Database, 2 from NoSQL Database, 3 from Data
- Write: 6 from Graph NoSQL Database, 1 from NoSQL Database, 8 from Data
Coordination Store #
A small, strongly consistent store for configuration, leader election and locks.
- Abstract. A node uses a type that extends it.
- Extends: Data › Component
- Extended by: etcd, ZooKeeper
- Kind:
database - Read:
GET,WATCH, plus 3 from Data - Write:
PUT,DELETE, plus 8 from Data
etcd #
etcd, the consistent key-value store behind Kubernetes.
- Extends: Coordination Store › Data › Component
- Kind:
database - Read:
Range,LeaseTimeToLive, plus 2 from Coordination Store, 3 from Data - Write:
DeleteRange,Txn,Compact,LeaseGrant,LeaseRevoke,LeaseKeepAlive, plus 2 from Coordination Store, 8 from Data
ZooKeeper #
Apache ZooKeeper, the coordination service of znodes and watches.
- Extends: Coordination Store › Data › Component
- Kind:
database - Read:
getData,getChildren,exists,getACL,sync, plus 2 from Coordination Store, 3 from Data - Write:
create,setData,setACL,multi, plus 2 from Coordination Store, 8 from Data
Cache #
An in-memory key-value cache, whose product does not matter.
- Extends: Data › Component
- Extended by: Redis, Memcached, Hazelcast, Aerospike
- Kind:
cache - Read:
GET,MGET, plus 3 from Data - Write:
SET,DELETE,EXPIRE, plus 8 from Data
Redis #
Redis, the in-memory data store, used as a cache.
- Extends: Cache › Data › Component
- Extended by: Valkey, KeyDB, Dragonfly, AWS ElastiCache, GCP Memorystore, Azure Cache for Redis
- Kind:
cache - Protocol:
RESP - Read:
GETRANGE,STRLEN,EXISTS,TTL,PTTL,TYPE,KEYS,SCAN,HGET,HMGET,HGETALL,HEXISTS,HKEYS,HVALS,HLEN,HSCAN,LRANGE,LLEN,LINDEX,SMEMBERS,SISMEMBER,SMISMEMBER,SCARD,SRANDMEMBER,SINTER,SUNION,SDIFF,SSCAN,ZRANGE,ZREVRANGE,ZRANGEBYSCORE,ZREVRANGEBYSCORE,ZRANGEBYLEX,ZSCORE,ZMSCORE,ZRANK,ZREVRANK,ZCARD,ZCOUNT,ZSCAN,GETBIT,BITCOUNT,BITPOS,PFCOUNT,GEOSEARCH,GEODIST,GEOPOS,GEOHASH,GEORADIUS,GEORADIUSBYMEMBER,SUBSCRIBE,PSUBSCRIBE,UNSUBSCRIBE,PUNSUBSCRIBE,SSUBSCRIBE,XREAD,XREADGROUP,XRANGE,XREVRANGE,XLEN,XPENDING,XINFO,MULTI,EXEC,DISCARD,WATCH,UNWATCH,PING, plus 2 from Cache, 3 from Data - Write:
SETNX,SETEX,PSETEX,GETSET,GETDEL,GETEX,MSET,MSETNX,APPEND,SETRANGE,INCR,INCRBY,INCRBYFLOAT,DECR,DECRBY,DEL,UNLINK,PEXPIRE,EXPIREAT,PEXPIREAT,PERSIST,RENAME,COPY,HSET,HSETNX,HMSET,HDEL,HINCRBY,HINCRBYFLOAT,LPUSH,RPUSH,LPUSHX,RPUSHX,LPOP,RPOP,BLPOP,BRPOP,LSET,LREM,LTRIM,LINSERT,LMOVE,BLMOVE,SADD,SREM,SPOP,SMOVE,SINTERSTORE,SUNIONSTORE,SDIFFSTORE,ZADD,ZREM,ZINCRBY,ZPOPMIN,ZPOPMAX,BZPOPMIN,BZPOPMAX,ZREMRANGEBYSCORE,ZREMRANGEBYRANK,ZUNIONSTORE,ZINTERSTORE,ZRANGESTORE,SETBIT,BITOP,PFADD,PFMERGE,GEOADD,GEOSEARCHSTORE,PUBLISH,SPUBLISH,XADD,XACK,XCLAIM,XAUTOCLAIM,XDEL,XTRIM,XGROUP,EVAL,EVALSHA,FCALL, plus 3 from Cache, 8 from Data
Valkey #
Valkey, the open source fork of Redis.
- Extends: Redis › Cache › Data › Component
- Kind:
cache - Protocol:
RESP - Read: 68 from Redis, 2 from Cache, 3 from Data
- Write: 80 from Redis, 3 from Cache, 8 from Data
KeyDB #
KeyDB, a multithreaded fork of Redis.
- Extends: Redis › Cache › Data › Component
- Kind:
cache - Protocol:
RESP - Read: 68 from Redis, 2 from Cache, 3 from Data
- Write: 80 from Redis, 3 from Cache, 8 from Data
Dragonfly #
Dragonfly, an in-memory store compatible with Redis.
- Extends: Redis › Cache › Data › Component
- Kind:
cache - Protocol:
RESP - Read: 68 from Redis, 2 from Cache, 3 from Data
- Write: 80 from Redis, 3 from Cache, 8 from Data
Memcached #
Memcached, the simple distributed in-memory cache.
- Extends: Cache › Data › Component
- Kind:
cache - Read:
GETS, plus 2 from Cache, 3 from Data - Write:
ADD,REPLACE,APPEND,PREPEND,CAS,INCR,DECR,TOUCH,GAT,GATS,FLUSH_ALL, plus 3 from Cache, 8 from Data
Hazelcast #
Hazelcast, the in-memory data grid.
- Extends: Cache › Data › Component
- Kind:
cache - Read: 2 from Cache, 3 from Data
- Write: 3 from Cache, 8 from Data
Aerospike #
Aerospike, the key-value store tuned for memory and flash.
- Extends: Cache › Data › Component
- Kind:
cache - Read: 2 from Cache, 3 from Data
- Write: 3 from Cache, 8 from Data
Search Engine #
A full-text search index, whose product does not matter.
- Extends: Data › Component
- Extended by: Elasticsearch, Solr, Meilisearch, Typesense, Algolia, Azure AI Search
- Kind:
search - Read:
Search,Get,KNN, plus 3 from Data - Write:
Index,Upsert,Delete, plus 8 from Data
Elasticsearch #
Elasticsearch, the distributed search engine on Lucene.
- Extends: Search Engine › Data › Component
- Extended by: OpenSearch
- Kind:
search - Read:
Mget,Count,MultiSearch,Scroll,Explain,_search,_msearch,_count, plus 3 from Search Engine, 3 from Data - Write:
Bulk,Update,Create,UpdateByQuery,DeleteByQuery,Reindex,Refresh,_bulk,_doc,_update, plus 3 from Search Engine, 8 from Data
OpenSearch #
OpenSearch, the open source fork of Elasticsearch.
- Extends: Elasticsearch › Search Engine › Data › Component
- Extended by: AWS OpenSearch
- Kind:
search - Read: 8 from Elasticsearch, 3 from Search Engine, 3 from Data
- Write: 10 from Elasticsearch, 3 from Search Engine, 8 from Data
Solr #
Apache Solr, the search server on Lucene.
- Extends: Search Engine › Data › Component
- Kind:
search - Read: 3 from Search Engine, 3 from Data
- Write: 3 from Search Engine, 8 from Data
Meilisearch #
Meilisearch, a fast search engine for search-as-you-type.
- Extends: Search Engine › Data › Component
- Kind:
search - Read: 3 from Search Engine, 3 from Data
- Write: 3 from Search Engine, 8 from Data
Typesense #
Typesense, an in-memory search engine that tolerates typos.
- Extends: Search Engine › Data › Component
- Kind:
search - Read: 3 from Search Engine, 3 from Data
- Write: 3 from Search Engine, 8 from Data
Algolia #
Algolia, the hosted search API.
- Extends: Search Engine › Data › Component
- Kind:
search - Read: 3 from Search Engine, 3 from Data
- Write: 3 from Search Engine, 8 from Data
Data Warehouse #
A column store for analytical SQL over large data, whose product does not matter.
- Extends: Data › Component
- Extended by: Snowflake, ClickHouse, Apache Druid, Apache Pinot, Databricks, AWS Redshift, AWS Athena, GCP BigQuery
- Kind:
analytics - Protocol:
SQL - Read:
SELECT,WITH,EXPLAIN,SHOW, plus 3 from Data - Write:
INSERT,UPDATE,DELETE,UPSERT,MERGE,COPY,TRUNCATE,CREATE,DROP, plus 8 from Data
Snowflake #
Snowflake, the cloud data warehouse.
- Extends: Data Warehouse › Data › Component
- Kind:
analytics - Protocol:
SQL - Read: 4 from Data Warehouse, 3 from Data
- Write: 9 from Data Warehouse, 8 from Data
ClickHouse #
ClickHouse, the column-oriented OLAP database.
- Extends: Data Warehouse › Data › Component
- Kind:
analytics - Protocol:
SQL - Read: 4 from Data Warehouse, 3 from Data
- Write: 9 from Data Warehouse, 8 from Data
Apache Druid #
Apache Druid, the real-time analytics database.
- Extends: Data Warehouse › Data › Component
- Kind:
analytics - Protocol:
SQL - Read: 4 from Data Warehouse, 3 from Data
- Write: 9 from Data Warehouse, 8 from Data
Apache Pinot #
Apache Pinot, the real-time OLAP store for user-facing analytics.
- Extends: Data Warehouse › Data › Component
- Kind:
analytics - Protocol:
SQL - Read: 4 from Data Warehouse, 3 from Data
- Write: 9 from Data Warehouse, 8 from Data
Databricks #
Databricks, the lakehouse platform on Spark.
- Extends: Data Warehouse › Data › Component
- Kind:
analytics - Protocol:
SQL - Read: 4 from Data Warehouse, 3 from Data
- Write: 9 from Data Warehouse, 8 from Data
Time Series Store #
A database of timestamped measurements, queried over time ranges.
- Abstract. A node uses a type that extends it.
- Extends: Data › Component
- Extended by: InfluxDB, Prometheus
- Kind:
analytics - Read:
QUERY,SELECT, plus 3 from Data - Write:
INSERT, plus 8 from Data
InfluxDB #
InfluxDB, the time series database.
- Extends: Time Series Store › Data › Component
- Kind:
analytics - Read: 2 from Time Series Store, 3 from Data
- Write: 1 from Time Series Store, 8 from Data
Prometheus #
Prometheus, the monitoring system and its time series store.
- Extends: Time Series Store › Data › Component
- Kind:
analytics - Read: 2 from Time Series Store, 3 from Data
- Write: 1 from Time Series Store, 8 from Data
Object Storage #
A bucket of objects (files) by key, whose product does not matter.
- Extends: Data › Component
- Extended by: Ceph, AWS S3, GCP Cloud Storage, Azure Blob Storage
- Kind:
storage - Protocol:
HTTP - Read:
GET,HEAD,LIST, plus 3 from Data - Write:
PUT,DELETE,UPLOAD, plus 8 from Data
MinIO #
MinIO, the self-hosted object storage with the S3 API.
- Extends: AWS S3 › Object Storage › Data › Component
- Kind:
storage - Protocol:
HTTP - Read: 11 from AWS S3, 3 from Object Storage, 3 from Data
- Write: 14 from AWS S3, 3 from Object Storage, 8 from Data
Ceph #
Ceph, the distributed object, block and file storage.
- Extends: Object Storage › Data › Component
- Kind:
storage - Protocol:
HTTP - Read: 3 from Object Storage, 3 from Data
- Write: 3 from Object Storage, 8 from Data
Shared File System #
A file system many machines mount at once.
- Abstract. A node uses a type that extends it.
- Extends: Data › Component
- Extended by: HDFS, AWS EFS, Azure Files
- Kind:
storage - Read:
OPEN,LIST, plus 3 from Data - Write:
APPEND, plus 8 from Data
HDFS #
HDFS, the Hadoop distributed file system.
- Extends: Shared File System › Data › Component
- Kind:
storage - Read: 2 from Shared File System, 3 from Data
- Write: 1 from Shared File System, 8 from Data
Block Storage #
A disk attached to one machine.
- Abstract. A node uses a type that extends it.
- Extends: Data › Component
- Extended by: AWS EBS, GCP Persistent Disk, Azure Disk Storage
- Kind:
storage - Read: 3 from Data
- Write: 8 from Data