Cloud Whatis

Dictionary of cloud stuff. (Work in progress…)

See also: Cloud Native (Bookmarks).

(Skip preliminaries — to dictionary.)

Format

  1. I am considering converting this into an app, adding features; this post format is a quick-and-dirty attempt at releasing “early” — this is a small sample, I’ve already well over 400 entries.
  2. Not showing timestamps per term, yet.
  3. Still thinking about RDFa, microformats… (Exposes how Q&D I did data modeling for this. And how hard taxonomies are. ;o)

Classifications

  1. My attempt at a more (semi-)structured knowledge base.
  2. Also, to normalize (standardize?) and de-hype terminology, characterizations.
  3. … turned out to be an impossible task.
  4. Recommended resources:
    1. Detailed classifications of many databases done by dbdb — are linked as canonical.
    2. CNCF SIG Storage whitepaper gives a rudimentary taxonomy.

Dictionary

(Reminder: use Ctrl+F, or “/” on FF. ;o)

Key topics: NoSQL, Kubernetes, continuous, microservices, storage, Hadoop…

    1. h
    2. c
    3. doc
    4. dbdb
    5. W
    6. Tw

    Aerospike

    SSD-optimized distributed key-value database, replicated, secondary indexes.
    Topics
    1. NoSQL
    Data model
    1. key-value
    Query custom API
    Implementation C
    Stored procedures Lua
    Created 2009
    1. Jepsen: Aerospike 3.99.0.3 / 2018: detailed analysis.
    2. Jepsen: Aerospike / 2015: rigorous analysis, especially of what ACID means, critique of version 3.5.4.

    1. c
    2. dbdb

    Akutan (formerly Beam)

    Distributed knowledge graph store — aka RDF or triple store.
    Topics
    1. NoSQL
    Data model
    1. triple store
    Implementation Go
    Created 2019

    1. h
    2. c
    3. doc
    4. CNCF
    5. W
    6. Tw

    Alluxio (formerly Tachyon)

    Virtual distributed file system, used as data orchestration layer, provides multiple data access interfaces, unified mounting name-space, and hierarchical cache, between cloud storage and, eg, Kubernetes workloads, Presto, Spark, Hive, Kubeflow. Multi-cloud.
    Topics
    1. orchestration
    2. storage
    Implementation Java
    Scale petabyte
    Created 2013
    1. CSI implementation to provide POSIX access to Alluxio in containerized environments such as Kubernetes
    2. Using Alluxio to Optimize and Improve Performance of Kubernetes-Based Deep Learning in the Cloud / 2020-05: whitepaper (PDF), detailed usecase, performance analysis.
    3. Improving Presto Latencies with Alluxio Data Caching / Rohit Jain, et al, 2020-06: architecture, performance benchmarks.

    1. W

    Ant (Apache Ant)

    Make-like build tool.
    Topics
    1. continuous
    Implementation Java
    Created 2000

    1. c

    AnyRPC

    Multi-protocol remote procedure call C++ library; supports JSON-RPC, XML-RPC, MessagePack RPC.
    Topics
    1. RPC
    Implementation C++

    1. h
    2. c
    3. img
    4. dbdb
    5. CNCF
    6. W
    7. SO
    8. Tw

    ArangoDB (formerly AvocadoDB)

    Multi-model distributed database, JSON, in-memory with persistent backend. Joins, either multi-collections transactions for ACID, or single-document transactions for performance.
    Topics
    1. NoSQL
    Data model
    1. document
    2. graph
    3. key-value
    4. multi-model
    Query AQL, JSON oriented
    Implementation C++, JavaScript
    Stored procedures JavaScript (as microservices)
    Created 2011
    1. ArangoDB vs Neo4j: detailed comparison; NB: APIs, QL, and clustering.
    2. ArangoDB Foxx repositories

    1. h
    2. dbdb
    3. W

    Aurora (Amazon Aurora)

    AWS managed (by RDS) RDBMS compatible with MySQL and PostgreSQL. Distributed, fault-tolerant, self-healing, low-latency read replicas, point-in-time recovery, continuous backup to S3, and replication across three Availability Zones.
    Topics
    1. AWS
    2. NoSQL
    Created 2014
    Alternatives
    1. MySQL
    2. PostgreSQL

    1. h
    2. c
    3. W

    Brooklyn (Apache Brooklyn)

    Framework for modeling, deploying and managing distributed applications defined using declarative YAML blueprints.
    Topics
    1. orchestration
    Implementation Java
    Created 2012

    1. h
    2. c
    3. W
    4. Tw

    Buildr (Apache Buildr)

    Build tool for Java-based applications.
    Topics
    1. continuous
    Implementation Ruby

    1. h
    2. W

    Calcite (Apache Calcite)

    SQL parser, relational algebra API, query planning engine.
    Topics
    1. NoSQL

    1. W

    Cayenne (Apache Cayenne)

    ORM framework.
    Topics
    1. NoSQL

    1. CNCF

    continuous (CI/CD: continuous integration/​delivery/​deployment)

    Topics
    1. orchestration
    2. provisioning
    Related:

    1. Ansible
    2. Ant
    3. Argo
    4. Artifactory
    5. Auto DevOps
    6. Bazel
    7. BitBucket Pipelines
    8. Brigade
    9. Buildpacks
    10. Buildr
    11. Camel
    12. CFEngine
    13. ChartMuseum
    14. Chef
    15. CloudEvents
    16. Cloudflare
    17. CloudFormation
    18. CloudFront
    19. CodeCommit
    20. CodeDeploy
    21. container image
    22. containers
    23. Dragonfly
    24. Drone
    25. Dropwizard
    26. Flux
    27. Foreman
    28. GitLab
    29. GitOps
    30. Gump
    31. Harness
    32. Helm
    33. in-toto
    34. Jenkins
    35. Keptn
    36. ksonnet
    37. KubeSail
    38. Nexus
    39. Nomad
    40. orchestration
    41. Ouroboros
    42. Packer
    43. Pipeline
    44. provisioning
    45. Pulp
    46. Pulumi
    47. Puppet
    48. Quay
    49. Rancher
    50. Rio
    51. SaltStack
    52. security
    53. Spinnaker
    54. Tekton
    55. Terraform
    56. Travis
    57. Vagrant
    58. Waypoint
    59. werf
    1. CD tools drawbacks / discussion on Reddit /r/devops, 2019-04: *Spinnaker, *GitLab, *Helm…
    2. CNCF SIG Application Delivery Charter: scope and topics of the lifecycle of cloud-native applications.
    3. Model of Cloud-Native App Delivery | Google Slides

    1. h
    2. c
    3. doc
    4. img
    5. dbdb
    6. CNCF
    7. W
    8. SO
    9. Tw

    Couchbase (Couchbase Server, formerly Membase)

    Distributed (shared-nothing) database, JSON document oriented, in-memory, swapped to disk, append-only.
    Topics
    1. NoSQL
    Data model
    1. document
    2. key-value
    Indexes hash, B+ tree, full text
    Query N1QL (SQL extended for JSON)
    Implementation Erlang
    Created 2009

    1. h
    2. c
    3. doc
    4. dbdb
    5. W

    CouchDB (Apache CouchDB, Cluster Of Unreliable Commodity Hardware)

    Document database.
    Topics
    1. NoSQL
    Data model
    1. document
    Query REST API
    Implementation Erlang
    Created 2005

    1. h
    2. doc
    3. W

    Cypher

    Declarative graph query language.
    Topics
    1. NoSQL
    Created 2011

    1. h
    2. c
    3. dbdb
    4. CNCF

    Dgraph

    Distributed graph database. Uses RocksDB.
    Topics
    1. NoSQL
    Data model
    1. graph
    Query GraphQL variant
    Implementation Go
    Created 2015

    1. h
    2. c
    3. doc
    4. dbdb

    Dqlite

    Distributed SQLite, embedded (C library), persistent RDBMS, Raft consensus.
    Topics
    1. NoSQL
    Query SQL
    Implementation C
    Created 2017
    Alternatives
    1. SQLite

    1. h
    2. dbdb
    3. W

    DynamoDB (Amazon DynamoDB)

    AWS key-value and document store, auto-scaling, priced on throughput instead of storage, integration with Hadoop.
    Topics
    1. AWS
    2. Hadoop
    3. NoSQL
    Data model
    1. document
    2. key-value
    Created 2012
    2. If DynamoDB sucks at sorting/querying… which database should we use? / 2020-03: Reddit discussion of DynamoDB features, strenghts/weaknesses, (general NoSQL) design considerations: use it for big data, not relational queries.
    4. DynamoDB’s new autoscaling in action for https://github.com/tj/gh-polls, low traffic either way but at least I don’t have to over-provision! / 2017-07, tweet by TJ Holowaychuk

    1. c
    2. doc
    3. dbdb
    4. W

    Elliptics

    Distributed storage, eventually consistent, distributed hash table (DHT).
    Topics
    1. NoSQL
    Data model
    1. key-value
    Implementation C++, Python, Go
    Created 2008

    1. h
    2. c
    3. doc
    4. dbdb
    5. CNCF
    6. W
    7. Tw

    FoundationDB

    Distributed fault-tolerant database, ACID, for OLTP.
    Topics
    1. NoSQL
    Data model
    1. key-value
    Implementation C++
    Created 2009

    1. h
    2. c
    3. doc
    4. dbdb
    5. SO
    6. Tw

    Geode (Apache Geode)

    Distributed in-memory data grid supporting caching and data computation.
    Topics
    1. NoSQL
    Data model
    1. key-value
    Query OQL
    Implementation Java
    Created 2002

    1. h
    2. c
    3. doc
    4. W
    5. Tw

    GlusterFS (Red Hat Gluster Storage)

    Network file system, software-defined storage.
    Topics
    1. storage

    1. h
    2. W

    Helix (Apache Helix)

    Cluster management framework partitioned and replicated distributed resources.
    Topics
    1. orchestration
    Implementation Java

    1. h
    2. c
    3. doc
    4. dbdb
    5. W

    Ignite (Apache Ignite)

    Distributed in-memory key-value store.
    Topics
    1. NoSQL
    Data model
    1. key-value
    Implementation Java
    Created 2014

    1. h
    2. c
    3. dbdb
    4. CNCF
    5. W
    6. Tw

    Infinispan

    Distributed cache and key-value storage, in-memory.
    Topics
    1. NoSQL
    Data model
    1. key-value
    Implementation Java
    Created 2009

    1. h
    2. c
    3. CNCF
    4. W
    5. Tw

    Kafka (Apache Kafka)

    Stream processing, cluster, middleware for message passing.
    Topics
    1. Hadoop
    2. streaming
    Implementation Java

    key-value (KV)

    Simplest storage model, no other… features? Opaque values (unstructured) and single index imply: no schema, no queries, no joins. Simplicity affords low latency, typically sub-millisecond. Typically used for caching, message queues, *pub-sub…
    Topics
    1. data model
    2. NoSQL
    Related:

    1. 3Box
    2. Accumulo
    3. Aerospike
    4. ArangoDB
    5. BerkeleyDB
    6. Cassandra
    7. Couchbase
    8. DynamoDB
    9. Elliptics
    10. etcd
    11. FoundationDB
    12. Geode
    13. Hazelcast
    14. Ignite
    15. Infinispan
    16. LevelDB
    17. Memcached
    18. OrbitDB
    19. OrientDB
    20. Presto
    21. Redis
    22. Riak
    23. RocksDB
    24. SimpleDB
    25. Tarantool
    26. TiKV

    1. h
    2. c
    3. doc
    4. CNCF
    5. W
    6. Tw

    Kubernetes (Kubes, Kube, K8s)

    Automating deployment, scaling, and management of multi-container applications. Orchestration for ephemeral workloads.
    Topics
    1. containers
    2. networking
    3. orchestration
    Implementation Go
    Created 2014
    Alternatives
    1. Nomad
    2. Swarm
    Related:

    1. Akka
    2. Argo
    3. Brigade
    4. ChartMuseum
    5. CloudEvents
    6. Cluster API
    7. CNAB
    8. containers
    9. CRD
    10. cri-o
    11. Crossplane
    12. CSI
    13. Dataset Lifecycle Framework
    14. Dotmesh
    15. Dragonfly
    16. EKS
    17. Envoy
    18. etcd
    19. Eureka
    20. Falco
    21. Fluent Bit
    22. GKE
    23. Hazelcast
    24. Helm
    25. hyper-converged
    26. ingress
    27. Istio
    28. K3s
    29. Knative
    30. kompose
    31. kops
    32. kubectl
    33. KubeEdge
    34. kubefed
    35. Kubeflow
    36. Kubeless
    37. Kubelet
    38. KubeSail
    39. Kubespray
    40. Kublet
    41. Lens
    42. Loki
    43. MetalK8s
    44. Minikube
    45. MinIO
    46. Nuclio
    47. OCI
    48. Octant
    49. OPA
    50. OpenShift
    51. operator
    52. Operator framework
    53. Rio
    54. Rook
    55. Sentry
    56. sidecar
    57. Skaffold
    58. SMI
    59. Stolon
    60. Tekton
    61. Telepresence
    62. Velero
    63. Volcano
    64. Vulcand
    65. Weave net
    66. Weaveworks
    67. Webhooks
    68. Zenko
    1. awesome-kubernetes: curated bookmarks.
    2. 10 Most Common Reasons Kubernetes Deployments Fail (Part 1) / Ross Kukulinski, 2017-02: nice intro to Kubernetes, orchestration complexity.

    1. W

    NoSQL

    Databases: no SQL, not relational, not only SQL, NewSQL…
    Topics
    1. data lake
    2. data model
    3. storage
    Related:

    1. 3Box
    2. Accumulo
    3. Aerospike
    4. Akutan
    5. ArangoDB
    6. Ascoltatori
    7. Aurora
    8. BerkeleyDB
    9. BigQuery
    10. caching
    11. Calcite
    12. Cassandra
    13. Cayenne
    14. ClickHouse
    15. CockroachDB
    16. Couchbase
    17. CouchDB
    18. CrateDB
    19. Crux
    20. Cypher
    21. data lake
    22. data model
    23. data warehouse
    24. DB/2
    25. Derby
    26. Dgraph
    27. document
    28. DocumentDB
    29. Dqlite
    30. Drill
    31. DuckDB
    32. Dynamo
    33. DynamoDB
    34. Dynomite
    35. EdgeDB
    36. Elasticsearch
    37. Elliptics
    38. Empire-db
    39. etcd
    40. FoundationDB
    41. Geode
    42. Gossip
    43. graph
    44. H2
    45. Hazelcast
    46. HBase
    47. HTAP
    48. Ignite
    49. Infinispan
    50. InfluxDB
    51. key-value
    52. Kudu
    53. Kyoto Cabinet
    54. LevelDB
    55. LMDB
    56. Lucene
    57. MariaDB
    58. Memcached
    59. MongoDB
    60. MySQL
    61. Neo4j
    62. Noms
    63. OLAP
    64. OLTP
    65. OrbitDB
    66. OrientDB
    67. Percona Server
    68. Pig
    69. PostgreSQL
    70. PouchDB
    71. Pravega
    72. query language
    73. Raft
    74. RDS
    75. Redis
    76. Redisson
    77. Redshift
    78. RethinkDB
    79. Riak
    80. RocksDB
    81. rqlite
    82. Scylla
    83. Seata
    84. ShardingSphere
    85. SimpleDB
    86. Snowflake
    87. SODA
    88. Solr
    89. SQLite
    90. Stolon
    91. storage
    92. Tarantool
    93. TDengine
    94. Teradata
    95. TiDB
    96. TiKV
    97. TimescaleDB
    98. Vertica
    99. Vitess
    100. YugabyteDB

    1. h
    2. c
    3. doc
    4. dbdb
    5. W
    6. SO
    7. Tw

    PouchDB

    Document database in JavaScript, designed to run in a browser, derived from/inspired by CouchDB. Browser’s local storage synchronized, when online, with server-side CouchDB or LevelDB.
    Topics
    1. NoSQL
    Data model
    1. document
    Implementation JavaScript
    Created 2010

    1. h
    2. c
    3. W

    Raft (Raft Consensus)

    Consensus algorithm designed as an alternative to *Paxos.
    Topics
    1. NoSQL

    1. h
    2. doc

    RDS (Amazon Relational Database Service, Amazon RDS)

    Web service that makes it easier to set up, operate, and scale a relational database. Available for, eg, Aurora, PostgreSQL, MySQL, MariaDB, Oracle.
    Topics
    1. AWS
    2. NoSQL

    1. h
    2. c
    3. dbdb
    4. W

    Riak

    Distributed key-value database, pluggable backend store, supports LevelDB.
    Topics
    1. NoSQL
    Data model
    1. key-value
    Implementation Erlang
    Created 2009

    1. h
    2. c
    3. CNCF
    4. Tw

    ShardingSphere (Apache ShardingSphere)

    JDBC middleware/proxy for sharding, distributed transactions. Planned sidecar.
    Topics
    1. NoSQL
    Implementation Java
    Created 2018

    1. h
    2. c

    SODA (Simple Oracle Document Access)

    Set of NoSQL-style APIs to use Oracle database as document store.
    Topics
    1. NoSQL
    Data model
    1. document

    1. h
    2. c
    3. dbdb
    4. W

    Solr (Apache Solr)

    Full-text search server with a REST-like API. Features include hit highlighting, faceted search, near real-time indexing, dynamic clustering, database integration, and geospatial search. Uses/merged into Lucene.
    Topics
    1. NoSQL
    Data model
    1. document
    2. search engine
    Implementation Java
    Created 2004

    1. doc

    Swarm (Swarm mode)

    Docker includes swarm mode for natively managing a cluster.
    Topics
    1. orchestration
    Alternatives
    1. Kubernetes
    1. Why I’m leaving Kubernetes for Swarm / Jonathan Kosgei, 2017-02: “Humans should not have to write/read config files”. Discussion.
    2. docker-swarm-cluster: configurations for combining several tools for creating a Docker Swarm cluster: Swarm Dashboard, Traefik, Portainer, Prometheus, Grafana…
    3. terraform-docker-swarm-aws: Terraform script to set up a Docker Swarm on AWS .

    1. h
    2. c
    3. doc
    4. dbdb

    Tarantool

    Multi-threaded database, stored procedures in Lua/C, partial SQL.
    Topics
    1. NoSQL
    Data model
    1. key-value
    Implementation C, Lua
    Created 2008

    1. h
    2. c
    3. doc
    4. dbdb
    5. CNCF
    6. Tw

    TiDB

    Distributed, hybrid transactional and analytical processing (HTAP). Uses TiKV.
    Topics
    1. NoSQL
    2. OLAP
    Query SQL
    Implementation Go
    Created 2015

    1. h
    2. c
    3. doc
    4. pkg
    5. CNCF
    6. Tw

    Zenko

    Multi-cloud data management, multiple backends, file systems and S3 compatible. Collection of microservices written mostly in JavaScript.
    Topics
    1. Kubernetes
    2. storage
    Implementation JavaScript

Posted 2020-10-22 | Tagged , | Permalink

Comments are closed.