License & Deployment Mix: 39 tools – 27 OSS, 12 SaaS. (OSS and SaaS counts can overlap when an open-source tool also offers a vendor-hosted edition.)

What Is a Data Warehouse?

A data warehouse is a centralized repository optimized for analytical queries across large volumes of structured data. Unlike transactional databases (OLTP) that handle fast reads and writes of individual records, data warehouses use columnar storage, compression, and pre-aggregation to deliver fast analytical performance over billions of rows.

Traditional data warehouses (Snowflake, BigQuery, Redshift) store structured, cleaned data loaded through ETL/ELT pipelines. They enforce schemas, optimize for aggregation queries, and serve as the single source of truth for business intelligence and reporting.

The information on these pages was researched by a combination of human review and large language models. To suggest an addition or correction, please contact us. Prepared by Rhodium Systems Inc., author of the ResorsIT platform — a unified IT operations management platform for IT teams and MSPs that integrates a curated suite of open-source, commercial, and SaaS applications into a single system with shared identity, single sign-on, access control, and a common audit trail. Use this catalogue only as a starting point for your own research, and review any tool carefully against your own requirements before relying on it. Catalogue data version 2026.197.

Comparison

This comparison covers the OLAP, ETL, lakehouse, and data catalog landscape.


SSO / OIDC Comparison

OIDC is the preferred SSO protocol; the notes below assume Authentik as the external identity provider.

ToolOIDCSAMLSCIMAuthentik Notes
ClickHouseNoNoNoHTTP Basic / LDAP; reverse proxy for OIDC
Apache DruidYesNoNoOIDC via Pac4j; Authentik as IdP
StarRocksNoNoNoLDAP auth; reverse proxy for OIDC
Apache DorisNoNoNoLDAP auth; reverse proxy for OIDC
Apache PinotNoNoNoBasic auth only; reverse proxy for OIDC
GreenplumNoNoNoLDAP/Kerberos; reverse proxy for OIDC
MonetDBNoNoNoNative auth only; reverse proxy for OIDC
SnowflakeYesYesYesNative OIDC, SAML, SCIM; Authentik as IdP
BigQueryYes*YesYesGoogle IAM; Authentik via Workforce Identity
RedshiftYes*YesNoAWS IAM; Authentik via SAML federation
Azure SynapseYes*YesYesEntra ID; Authentik federation possible
DatabricksYesYesYesNative OIDC and SAML; SCIM provisioning
MotherDuckYesNoNoOIDC via Google/GitHub; custom OIDC possible
TrinoYesNoNoNative OIDC support; Authentik as IdP
DuckDBN/AN/AN/AEmbedded engine; no built-in auth
PrestoYesNoNoOIDC via pluggable auth; Authentik as IdP
DremioYesYesNoNative OIDC and SAML; Authentik as IdP
Spark SQLNoNoNoKerberos/LDAP; reverse proxy for OIDC
StarburstYesYesYesNative OIDC, SAML, SCIM; Authentik as IdP
DataFusionN/AN/AN/ALibrary; no built-in auth
Apache IcebergN/AN/AN/AFormat spec; auth via catalog (REST/Hive)
Delta LakeN/AN/AN/AFormat spec; auth via engine
Apache HudiN/AN/AN/AFormat spec; auth via engine
DuckLakeN/AN/AN/AFormat spec; auth via catalog DB
Apache PaimonN/AN/AN/AFormat spec; auth via engine
dbtN/AN/AN/ACLI tool; auth via target warehouse
Apache AirflowYesNoNoNative OIDC via Flask-AppBuilder; Authentik as IdP
DagsterYesYesNoOIDC and SAML in Dagster Cloud; OSS via reverse proxy
PrefectYesYesNoOIDC and SAML in Prefect Cloud; OSS via reverse proxy
MeltanoN/AN/AN/ACLI tool; no built-in web UI auth
Apache NiFiYesNoNoNative OIDC support; Authentik as IdP
SingerN/AN/AN/ACLI specification; no built-in auth
AirbyteYesNoNoOIDC in Cloud/Enterprise; OSS Keycloak-based
FivetranYesYesYesNative OIDC, SAML, SCIM; Authentik as IdP
StitchNoYesNoSAML SSO; Authentik as SAML IdP
MatillionYesYesNoNative OIDC and SAML; Authentik as IdP
DataHubYesNoNoNative OIDC; Authentik as IdP
OpenMetadataYesYesNoNative OIDC and SAML; Authentik as IdP

* = via cloud provider identity federation

Best SSO support: Snowflake, Databricks, Starburst, Fivetran (OIDC + SAML + SCIM)

No built-in auth: DuckDB, DataFusion, dbt, Meltano, Singer (CLI or library tools)

Format specs: Iceberg, Delta Lake, Hudi, DuckLake, Paimon inherit auth from the engine or catalog that accesses them


API Comparison

ToolAPI TypeAuthWebhooksSDKs
ClickHouseHTTP, Native TCPBasic, JWTNoPython, Go, Java, JS, Rust
Apache DruidRESTBasic, OIDCNoPython, Java
StarRocksMySQL protocolMySQL authNoJDBC, Python
Apache DorisMySQL, HTTPMySQL auth, tokenNoJDBC, Python
Apache PinotRESTBasic, tokenNoJava, Python
GreenplumPostgreSQL protocolPG authNolibpq, JDBC, Python
MonetDBMAPI protocolNative authNoPython, Java, ODBC
SnowflakeREST, SQLOAuth2, key pairYesPython, Go, Java, JS, .NET
BigQueryREST, gRPCOAuth2YesPython, Go, Java, JS, .NET
RedshiftPostgreSQL protocolIAM, PG authNoJDBC, ODBC, Python
Azure SynapseREST, T-SQLOAuth2, AADYes.NET, Python, Java
DatabricksREST, SQLOAuth2, PATYesPython, Java, Go, JS, R
MotherDuckDuckDB protocolTokenNoPython, JS
TrinoREST, JDBCOIDC, JWT, BasicNoJDBC, Python, Go
DuckDBIn-processN/AN/APython, R, Java, JS, Rust, Go
PrestoREST, JDBCOIDC, BasicNoJDBC, Python
DremioREST, JDBC, ODBCOAuth2, PATNoJDBC, ODBC, Python
Spark SQLThrift, RESTKerberos, tokenNoPython, Scala, Java, R
StarburstREST, JDBCOIDC, JWTNoJDBC, Python
DataFusionLibrary APIN/AN/ARust, Python
dbtCLI, Cloud APIToken (Cloud)Yes (Cloud)Python
Apache AirflowRESTJWT, sessionYesPython
DagsterGraphQL, RESTTokenYes (Cloud)Python
PrefectRESTTokenYes (Cloud)Python
MeltanoCLIN/ANoPython
Apache NiFiRESTBearer, certNoPython, Java
SingerCLI (pipes)N/ANoPython
AirbyteRESTBearerYesPython, Java
FivetranRESTAPI keyYesPython, Go
StitchRESTAPI tokenNoPython
MatillionRESTAPI keyYesNone official
DataHubREST, GraphQLTokenNoPython, Java
OpenMetadataRESTJWT, BasicYesPython, Java

DW Feature Comparison

Self-Hosted OLAP

FeatureClickHouseDruidStarRocksDorisPinotGreenplumMonetDB
Storage modelColumnarColumnarColumnarColumnarColumnarColumnar (row + col)Columnar
CompressionLZ4, ZSTD, DeltaLZ4, ZSTDLZ4, ZSTDLZ4, ZSTDSnappy, ZSTDZSTD, LZ4, ZlibLightweight
PartitioningYes (by expression)Yes (time-based)Yes (range, list, expression)Yes (range, list, hash)Yes (time, column)Yes (range, list, hash)Yes (range)
Materialized viewsYesNo (pre-aggregation)YesYesNoYesNo
ReplicationYes (multi-shard)Yes (deep storage)Yes (multi-replica)Yes (multi-replica)Yes (segment)Yes (mirrors)No
JoinsYes (distributed)Limited (lookup)Yes (distributed)Yes (distributed)Limited (lookup)Yes (MPP)Yes
Real-time ingestYes (Kafka, insert)Yes (Kafka, Kinesis)Yes (Kafka, routine load)Yes (Kafka, routine load)Yes (Kafka, Kinesis)No (batch ETL)No (batch)
SQL dialectClickHouse SQLDruid SQLMySQL-compatibleMySQL-compatiblePresto SQLPostgreSQL-compatibleSQL:2003
Iceberg supportYes (external)NoYes (external catalog)Yes (external catalog)NoNoNo
Cluster modeYes (sharded)Yes (ZooKeeper)Yes (FE/BE nodes)Yes (FE/BE nodes)Yes (Helix/ZK)Yes (segments)No (single-node)

Cloud / Commercial

FeatureSnowflakeBigQueryRedshiftAzure SynapseDatabricksMotherDuck
Storage modelColumnar (micro-partition)Columnar (Capacitor)ColumnarColumnarDelta Lake (Parquet)Columnar (DuckDB)
CompressionAutomaticAutomaticAZ64, LZO, ZSTDAutomaticDelta + ZSTDDuckDB native
PartitioningMicro-partitions (auto)Native + clusteringDistribution + sort keysDistributionsDelta partitioningN/A (auto)
Materialized viewsYesYesYesYesYes (Delta Live Tables)No
Separation of computeYes (virtual warehouses)Yes (serverless)Yes (RA3 nodes)Yes (serverless/dedicated)Yes (clusters)Partial (hybrid)
Time travelYes (90 days)Yes (7 days)NoYes (restore points)Yes (Delta time travel)No
Iceberg supportYes (Iceberg tables)Yes (BigLake)Yes (Spectrum)Yes (via Fabric)Yes (UniForm)No
ServerlessYes (virtual WH)Yes (native)Yes (Serverless)Yes (on-demand)Yes (SQL warehouses)Yes (hybrid)
Multi-cloudAWS, Azure, GCPGCP onlyAWS onlyAzure onlyAWS, Azure, GCPAWS (DuckDB hybrid)

Query Engine Comparison

FeatureTrinoDuckDBPrestoDremioSpark SQLStarburstDataFusion
ArchitectureDistributed MPPIn-processDistributed MPPDistributedDistributedDistributed MPPIn-process
ConcurrencyHighSingle-processHighHighMediumHighSingle-process
LatencySub-second (warm)Microseconds (local)Sub-second (warm)Sub-secondSeconds-minutesSub-secondMicroseconds
Connectors50+ (Hive, Iceberg, Delta, MySQL, PG, S3, etc.)Parquet, CSV, JSON, Iceberg, S3, PG, MySQL30+ (similar to Trino)20+ (S3, RDBMS, Iceberg, Delta)Hive, Iceberg, Delta, JDBC, S3Trino + enterprise connectorsParquet, CSV, JSON, S3
IcebergYes (native catalog)Yes (v2, read/write)YesYes (native)YesYesYes (read)
Delta LakeYes (connector)Yes (read)YesYes (native)Yes (native)YesYes (read)
HudiYes (connector)NoYesNoYes (native)YesNo
S3/MinIOYesYes (httpfs)YesYesYesYesYes (object_store)
FederationYes (cross-catalog)No (single-process)YesYes (virtual datasets)LimitedYes (enhanced)No
Cost-based optimizerYesYesYesYesYesYes (enhanced)Yes
LanguageJavaC++JavaJavaScala/JavaJavaRust
LicenseApache-2.0MITApache-2.0Apache-2.0 (Community)Apache-2.0ProprietaryApache-2.0

Lakehouse Format Comparison

FeatureIcebergDelta LakeHudiDuckLakePaimon
LicenseApache-2.0Apache-2.0Apache-2.0MITApache-2.0
ACID transactionsYesYesYesYesYes
Time travelYes (snapshot)Yes (version)Yes (timeline)YesYes (snapshot)
Schema evolutionYes (full)Yes (add/rename)Yes (add/rename)YesYes
Partition evolutionYes (hidden)No (requires rewrite)NoN/AYes
File formatParquet, ORC, AvroParquetParquet, ORCParquetORC, Parquet
CatalogREST, Hive, AWS Glue, NessieUnity, Hive, AWS GlueHive, AWS GluePostgreSQL, DuckDBHive, filesystem
Engine supportTrino, DuckDB, Spark, Flink, Presto, Athena, Snowflake, BigQuery, DatabricksSpark, Trino, Flink, DuckDB, DatabricksSpark, Trino, Flink, PrestoDuckDBFlink, Spark, Trino
Streaming ingestYes (via Flink)Yes (Spark Structured Streaming)Yes (native CDC/upserts)NoYes (native Flink)
Merge-on-ReadYes (v2)Yes (deletion vectors)Yes (native)NoYes
Copy-on-WriteYesYesYesYesYes
CompactionYes (rewrite)Yes (OPTIMIZE)Yes (inline/async)YesYes (auto)
Industry momentumHighest (converging standard)High (Databricks ecosystem)Medium (Uber/AWS)Emerging (DuckDB ecosystem)Growing (Flink ecosystem)

ETL / ELT Comparison

Self-Hosted

FeaturedbtAirflowDagsterPrefectMeltanoNiFiSinger
Primary roleTransform (T)OrchestrateOrchestrate + assetsOrchestrateELT (E+L+T)Data flowExtract + Load (E+L)
LicenseApache-2.0Apache-2.0Apache-2.0Apache-2.0MITApache-2.0AGPL-3.0
LanguageSQL + JinjaPythonPythonPythonPython + YAMLJava (visual)Python
Connectors50+ adapters (warehouse targets)N/A (orchestrates tasks)N/A (orchestrates)N/A (orchestrates)300+ Singer taps/targets300+ processors300+ taps/targets
IncrementalYes (incremental models)Via task logicVia asset partitionsVia task logicVia Singer stateVia FlowFile stateVia state messages
CDC supportVia sources/snapshotsVia operatorsVia sensorsVia tasksVia CDC tapsYes (native)Via CDC taps
dbt integrationN/A (is dbt)Yes (operator)Yes (asset)Yes (task)Yes (native)NoNo
Web UIdbt Docs (static)Yes (Airflow UI)Yes (Dagit/Dagster UI)Yes (Prefect UI)No (CLI)Yes (NiFi UI)No (CLI)
SchedulingVia orchestratorYes (cron, sensors)Yes (schedules, sensors)Yes (schedules)Yes (Airflow or cron)Yes (CRON scheduling)Via orchestrator
TestingYes (schema + data tests)Via task assertionsYes (asset checks)Via task assertionsVia dbt testsNo (monitoring)No
DockerYesYesYesYesYesYesYes (via Meltano)

Cloud / Commercial

FeatureAirbyteFivetranStitchMatillion
Primary roleExtract + Load (E+L)Extract + Load (E+L)Extract + Load (E+L)ETL + ELT
LicenseELv2 (Community)ProprietaryProprietaryProprietary
Connectors350+400+200+100+
IncrementalYes (CDC, cursor)Yes (log-based CDC)Yes (incremental)Yes
dbt integrationYes (dbt Cloud)Yes (dbt Core/Cloud)NoYes (dbt Core)
NormalizationYes (basic)Yes (automatic)Yes (basic)Yes (transformation UI)
Self-hostedYes (OSS/Enterprise)No (SaaS only)No (SaaS only)Yes (hybrid)
Pricing modelRows syncedMonthly Active RowsRows replicatedCredits

Data Catalog Comparison

FeatureDataHubOpenMetadata
LicenseApache-2.0Apache-2.0
DiscoveryYes (search, browse, tags)Yes (search, browse, tags, tiers)
LineageYes (column-level)Yes (column-level)
GovernanceYes (policies, domains, glossary)Yes (policies, teams, glossary)
Ingestion50+ sources (push/pull)70+ sources (pull-based)
Data qualityVia integrations (Great Expectations)Yes (native test suites)
CollaborationYes (threads, tasks)Yes (conversations, tasks)
SSOOIDC (native)OIDC, SAML (native)
LanguageJava, PythonJava, Python
ArchitectureKafka + Elasticsearch + MySQL/PGElasticsearch + MySQL/PG
DockerYesYes
KubernetesYes (Helm chart)Yes (Helm chart)

Deployment Comparison

ToolSelf-HostedDockerKubernetesCloud OptionLanguage
ClickHouseYesYesYes (Operator)ClickHouse CloudC++
Apache DruidYesYesYes (Helm)Imply CloudJava
StarRocksYesYesYes (Operator)CelerData CloudC++/Java
Apache DorisYesYesYes (Operator)SelectDB CloudC++/Java
Apache PinotYesYesYes (Helm)StarTree CloudJava
GreenplumYesYesYesVMware TanzuC/Python
MonetDBYesYesNoNoC
SnowflakeNoNoNoSnowflake (SaaS)
BigQueryNoNoNoBigQuery (GCP)
RedshiftNoNoNoRedshift (AWS)
Azure SynapseNoNoNoSynapse (Azure)
DatabricksNoNoNoDatabricks (multi)
MotherDuckNoNoNoMotherDuck (SaaS)
TrinoYesYesYes (Helm)Starburst GalaxyJava
DuckDBYes (embedded)N/AN/AMotherDuckC++
PrestoYesYesYes (Helm)Ahana CloudJava
DremioYesYesYes (Helm)Dremio CloudJava
Spark SQLYesYesYes (Operator)Databricks, EMRScala/Java
StarburstYesYesYesStarburst GalaxyJava
DataFusionYes (library)N/AN/ANoRust
dbtYes (CLI)YesN/Adbt CloudPython
AirflowYesYesYes (Helm)MWAA, AstronomerPython
DagsterYesYesYes (Helm)Dagster CloudPython
PrefectYesYesYesPrefect CloudPython
MeltanoYes (CLI)YesN/ANoPython
NiFiYesYesYes (Operator)ClouderaJava
SingerYes (CLI)Via MeltanoN/ANoPython
AirbyteYesYesYes (Helm)Airbyte CloudJava/Python
FivetranNoNoNoFivetran (SaaS)
StitchNoNoNoStitch (SaaS)
MatillionYes (hybrid)YesYesMatillion ETLJava
DataHubYesYesYes (Helm)Acryl CloudJava/Python
OpenMetadataYesYesYes (Helm)Collate CloudJava/Python

Licensing & Pricing

ToolLicensePricing ModelFree Tier
ClickHouseApache-2.0Free (OSS); Cloud: usage-basedYes (OSS); Cloud free tier
Apache DruidApache-2.0Free (OSS); Imply: usageYes (OSS)
StarRocksApache-2.0Free (OSS); CelerData: usageYes (OSS)
Apache DorisApache-2.0Free (OSS); SelectDB: usageYes (OSS)
Apache PinotApache-2.0Free (OSS); StarTree: usageYes (OSS)
GreenplumApache-2.0Free (OSS)Yes (OSS)
MonetDBMPL-2.0Free (OSS)Yes (OSS)
SnowflakeProprietaryCredits (compute + storage)Trial
BigQueryProprietaryPay-per-query + storage1 TB/month free queries
RedshiftProprietaryPer-node-hour or ServerlessTrial
Azure SynapseProprietaryPay-per-query or provisionedTrial
DatabricksProprietaryDBU (compute units)Community Edition
MotherDuckProprietaryUsage-basedFree tier
TrinoApache-2.0Free (OSS)Yes (OSS)
DuckDBMITFree (OSS)Yes (OSS)
PrestoApache-2.0Free (OSS)Yes (OSS)
DremioApache-2.0 (Community)Free (Community); EnterpriseYes (Community)
Spark SQLApache-2.0Free (OSS)Yes (OSS)
StarburstProprietaryEnterprise subscriptionStarburst Galaxy free tier
DataFusionApache-2.0Free (OSS)Yes (OSS)
Apache IcebergApache-2.0Free (spec + libs)Yes
Delta LakeApache-2.0Free (spec + libs)Yes
Apache HudiApache-2.0Free (spec + libs)Yes
DuckLakeMITFree (OSS)Yes
Apache PaimonApache-2.0Free (spec + libs)Yes
dbtApache-2.0Free (Core); Cloud: per-seatYes (Core)
AirflowApache-2.0Free (OSS)Yes (OSS)
DagsterApache-2.0Free (OSS); Cloud: per-seatYes (OSS)
PrefectApache-2.0Free (OSS); Cloud: per-taskYes (OSS)
MeltanoMITFree (OSS)Yes (OSS)
NiFiApache-2.0Free (OSS)Yes (OSS)
SingerAGPL-3.0Free (OSS)Yes (OSS)
AirbyteELv2Free (OSS); Cloud: per-rowYes (OSS)
FivetranProprietaryPer Monthly Active RowTrial
StitchProprietaryPer row replicatedTrial
MatillionProprietaryPer creditTrial
DataHubApache-2.0Free (OSS); Acryl managedYes (OSS)
OpenMetadataApache-2.0Free (OSS); Collate managedYes (OSS)

Tools

38 tools.

Airbyte

Airbyte is the leading data ingestion platform for building EL (extract-load) pipelines. It offers 350+ pre-built connectors covering databases, SaaS APIs, file formats, and event streams.

License: LicenseRef-Airbyte-ELv2 (source-available) · Kind: web · Deploy: docker, k8s, saas · SSO: none

Website

Amazon Redshift

Amazon Redshift is AWS’s fully managed cloud data warehouse service, launched in 2013. It was the first major cloud data warehouse and popularized the concept of elastic, pay-as-you-go analytical databases.

License: Proprietary (proprietary) · Kind: web · Deploy: saas · SSO: none

Website

Apache Airflow

Apache Airflow is the industry-standard workflow orchestrator for data pipelines. Originally created at Airbnb in 2014 and donated to the Apache Software Foundation, Airflow defines pipelines as Python code using DAGs (directed acyclic grap…

License: Apache-2.0 (OSS) · Kind: web · Deploy: native, docker, k8s · SSO: OIDC

Website · Source

Apache DataFusion

Apache DataFusion is an extensible query engine library written in Rust, designed to be embedded inside other applications and systems rather than deployed as a standalone service.

License: Apache-2.0 (OSS) · Kind: web · Deploy: k8s · SSO: none

Website · Source

Apache Doris

Apache Doris is a real-time analytical database with MySQL protocol compatibility, originally developed as Palo at Baidu and donated to the Apache Software Foundation in 2018.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

Apache Druid

Apache Druid is a real-time analytics database designed for sub-second OLAP queries on event- driven data. Originally created at Metamarkets and open-sourced in 2012, Druid became an Apache top-level project in 2018.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

Apache Hudi

Apache Hudi (Hadoop Upserts Deletes and Incrementals) is an open table format created at Uber to solve the problem of efficiently ingesting and managing rapidly changing datasets on data lakes.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

Apache Iceberg

Apache Iceberg is the leading open table format for large-scale analytical datasets, originally created at Netflix and donated to the Apache Software Foundation.

License: Apache-2.0 (OSS) · Kind: web · Deploy: saas · SSO: none

Website · Source

Apache NiFi

Apache NiFi is a visual data flow platform designed for real-time data routing, transformation, and system mediation.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native, docker · SSO: OIDC

Website · Source

Apache Paimon

Apache Paimon is a streaming-first lakehouse table format that originated from the Apache Flink ecosystem. Originally developed as Flink Table Store, it was renamed to Apache Paimon and graduated to an Apache top-level project.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

Apache Pinot

Apache Pinot is a real-time distributed OLAP datastore designed for low-latency, high- throughput user-facing analytics.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

Apache Spark SQL

Apache Spark SQL is the SQL module of Apache Spark, the general-purpose distributed computing framework for large-scale data processing.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

Azure Synapse Analytics

Azure Synapse Analytics is Microsoft’s unified analytics service on Azure, combining enterprise data warehousing with big data analytics in a single platform.

License: Proprietary (proprietary) · Kind: web · Deploy: saas · SSO: none

Website

ClickHouse

ClickHouse is the fastest open-source columnar OLAP database, originally developed at Yandex for web analytics and open-sourced in 2016. It is written entirely in C++ and optimized for real-time analytical queries over billions of rows.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

Dagster

Dagster is an open-source data orchestrator built around software-defined assets, offering a visual asset graph, partitions, sensors, type checking, and strong dbt integration for data pipelines.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native, docker, k8s · SSO: none

Website · Source

Databricks

Databricks is the leading lakehouse platform, combining data lake flexibility with data warehouse performance and governance.

License: Proprietary (proprietary) · Kind: web · Deploy: saas · SSO: OIDC

Website

DataHub

DataHub is an open-source metadata platform originally developed at LinkedIn and donated to the community under the Apache-2.0 license.

License: Apache-2.0 (OSS) · Kind: web · Deploy: docker, k8s, saas · SSO: none

Website · Source

dbt

dbt (data build tool) is the industry-standard SQL transformation framework for the “T” in ELT pipelines.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native, docker · SSO: none

Website · Source

Delta Lake

Delta Lake is an open table format created by Databricks that adds ACID transactions, scalable metadata handling, and time travel to data stored as Parquet files on object storage.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

Dremio

Dremio is a lakehouse query engine built on Apache Arrow that provides SQL analytics directly on data lake storage without requiring data movement or ETL pipelines.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: OIDC

Website · Source

DuckDB

DuckDB is an in-process OLAP database engine, often described as “SQLite for analytics.” Unlike distributed query engines that require cluster infrastructure, DuckDB runs as an embedded library inside the host application process – no serv…

License: MIT (OSS) · Kind: web · Deploy: saas, docker · SSO: none

Website · Source

DuckLake

DuckLake is a lakehouse table format created by DuckDB Labs in 2025 that takes a fundamentally different approach to metadata management.

License: MIT (OSS) · Kind: web · Deploy: saas · SSO: none

Website · Source

Fivetran

Fivetran is the market-leading managed EL (extract-load) platform purpose-built for automated data replication into cloud data warehouses.

License: Proprietary (proprietary) · Kind: web · Deploy: saas · SSO: none

Website

Google BigQuery

Google BigQuery is a fully managed, serverless cloud data warehouse on Google Cloud, using the Dremel engine to query large datasets in SQL, with columnar storage, BigQuery ML, and BigLake governance.

License: Proprietary (proprietary) · Kind: web · Deploy: saas · SSO: none

Website

Greenplum

Greenplum is a massively parallel processing (MPP) analytical database built on PostgreSQL. Originally developed by Greenplum Inc.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

Matillion

Matillion is a visual ETL/ELT platform for cloud data warehouses such as Snowflake, BigQuery, Redshift, and Databricks, using pushdown transformation that compiles logic into warehouse-native SQL.

License: Proprietary (proprietary) · Kind: web · Deploy: saas · SSO: none

Website

Meltano

Meltano is a Singer-based ELT platform originally created by GitLab as an internal data integration tool and later spun out as an independent open- source project.

License: MIT (OSS) · Kind: web · Deploy: native, docker · SSO: none

Website · Source

MonetDB

MonetDB is a pioneering columnar analytical database developed at CWI (Centrum Wiskunde & Informatica) in Amsterdam, with research origins dating back to the 1990s.

License: MPL-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

MotherDuck

MotherDuck is a serverless cloud analytics platform built on DuckDB, the open-source in- process analytical database.

License: Proprietary (proprietary) · Kind: web · Deploy: saas · SSO: none

Website

OpenMetadata

OpenMetadata is an open-source metadata platform that provides data discovery, lineage, governance, and data quality capabilities in a single unified platform.

License: Apache-2.0 (OSS) · Kind: web · Deploy: docker, k8s, saas · SSO: none

Website · Source

Prefect

Prefect is a Python-native workflow orchestrator designed to be simpler and more Pythonic than Airflow.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native, docker, k8s · SSO: none

Website · Source

Presto

Presto is a distributed SQL query engine originally created at Facebook (Meta) in 2012 for interactive analytics over the Hive data warehouse.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

Singer

Singer is an open-source specification for data extraction and loading. It defines a JSON-based protocol for communication between “taps” (extractors that pull data from sources) and “targets” (loaders that push data to destinations).

License: AGPL-3.0-only (OSS) · Kind: web · Deploy: native, docker · SSO: none

Website · Source

Snowflake

Snowflake is the dominant independent cloud data warehouse platform, operating as a fully managed SaaS service across AWS, Azure, and GCP.

License: Proprietary (proprietary) · Kind: web · Deploy: saas · SSO: none

Website

Starburst

Starburst is the commercial distribution of Trino, created and maintained by the company founded by the original Trino creators.

License: Proprietary (proprietary) · Kind: web · Deploy: native · SSO: OIDC

Website

StarRocks

StarRocks is a high-performance analytical database designed for real-time, sub-second queries on large datasets.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: none

Website · Source

Stitch

Stitch is a managed data replication service owned by Qlik (acquired via Talend). It focuses on simple, reliable EL (extract-load) from SaaS applications and databases into cloud data warehouses.

License: Proprietary (proprietary) · Kind: web · Deploy: saas · SSO: none

Website

Trino

Trino is a distributed SQL query engine designed for interactive analytical queries across massive datasets and heterogeneous data sources.

License: Apache-2.0 (OSS) · Kind: web · Deploy: native · SSO: OIDC

Website · Source

ResorsIT Tools Catalog Search