AI Index / Open-source data pipeline tools / History

Open-source data pipeline tools — AI Recommendation History

What AI assistants recommended for open-source data pipeline tools, date by date. Every ranking we publish is frozen the day it publishes, so this is a record of what was said — not a re-computation of what today's data would say about the past.

Record: 26 dated snapshots · Aug 14, 2026 – Sep 8, 2026

Answer archive Methodology Data studies JSON

What changed

Computed by comparing each dated snapshot with the one before it. Share moves smaller than 1pp are treated as noise and left out — the same threshold that suppresses trend arrows on the ranking.

Sep 8, 2026vs Sep 7, 2026

No change above the noise floor.

Sep 7, 2026vs Sep 6, 2026

No change above the noise floor.

Sep 6, 2026vs Sep 5, 2026

Methodology change: extraction rules 5-7 → 7 between these dates. Differences below may reflect the rule change rather than a change in what AI recommends — see the methodology changelog.

▲ INDagster entered the top 10 (#11 → #9)
▼ OUTdlt left the top 10 (#9 → #11)
▲dbt moved #8 → #5
▼Apache Hop moved #5 → #7
▲Dagster moved #11 → #9
▼dlt moved #9 → #11
▼NiFi moved #7 → #8
▼dlt -10.5pp (34.2% → 23.7%)
▲dbt +7.9pp (36.8% → 44.7%)
▼Apache Hop -5.3pp (42.1% → 36.8%)
▼Meltano -2.7pp (71.1% → 68.4%)
▼NiFi -2.7pp (39.5% → 36.8%)
▼Singer -2.6pp (57.9% → 55.3%)
▲Dagster +2.6pp (31.6% → 34.2%)
▼Apache NiFi -2.6pp (34.2% → 31.6%)

Sep 5, 2026vs Sep 4, 2026

Methodology change: extraction rules 4-7 → 5-7 between these dates. Differences below may reflect the rule change rather than a change in what AI recommends — see the methodology changelog.

▲ INApache Airflow entered the top 10 (#12 → #6)
▲ INNiFi entered the top 10 (#11 → #7)
▼ OUTDagster left the top 10 (#8 → #11)
▼ OUTKubernetes left the top 10 (#9 → #15)
▲Apache Airflow moved #12 → #6
▼Kubernetes moved #9 → #15
▲NiFi moved #11 → #7
▼dbt moved #5 → #8
▼Dagster moved #8 → #11
▲Airflow moved #6 → #4
▼dlt moved #7 → #9
▼Apache Hop moved #4 → #5
▲Airflow +17.8pp (37.5% → 55.3%)
▼Kubernetes -13.4pp (29.2% → 15.8%)
▲Apache Airflow +12.9pp (29.2% → 42.1%)
▲NiFi +10.3pp (29.2% → 39.5%)
▼dbt -9pp (45.8% → 36.8%)
▼Apache Hop -7.9pp (50% → 42.1%)
▲Apache NiFi +5pp (29.2% → 34.2%)
▼Singer -4.6pp (62.5% → 57.9%)
▼Airbyte -4.4pp (83.3% → 78.9%)
▼Meltano -3.9pp (75% → 71.1%)
▲Dagster +2.4pp (29.2% → 31.6%)

Sep 4, 2026vs Sep 3, 2026

▲ INDagster entered the top 10 (#12 → #8)
▲ INKubernetes entered the top 10 (#11 → #9)
▼ OUTApache Airflow left the top 10 (#8 → #12)
▼ OUTNiFi left the top 10 (#9 → #11)
▲Dagster moved #12 → #8
▼Apache Airflow moved #8 → #12
▲Apache Hop moved #6 → #4
▼Airflow moved #4 → #6
▲Kubernetes moved #11 → #9
▼NiFi moved #9 → #11
▼Airflow -16.6pp (54.1% → 37.5%)
▼Apache Airflow -14pp (43.2% → 29.2%)
▼dlt -9.9pp (43.2% → 33.3%)
▼Apache NiFi -8.6pp (37.8% → 29.2%)
▼NiFi -8.6pp (37.8% → 29.2%)
▼dbt -5.6pp (51.4% → 45.8%)
▲Apache Hop +4.1pp (45.9% → 50%)
▲Singer +3pp (59.5% → 62.5%)
▲Dagster +2.2pp (27% → 29.2%)
▲Meltano +2pp (73% → 75%)

Sep 3, 2026vs Sep 2, 2026

No change above the noise floor.

Sep 2, 2026vs Sep 1, 2026

No change above the noise floor.

Sep 1, 2026vs Aug 31, 2026

No change above the noise floor.

Aug 31, 2026vs Aug 30, 2026

No change above the noise floor.

Aug 30, 2026vs Aug 29, 2026

No change above the noise floor.

Aug 29, 2026vs Aug 28, 2026

No change above the noise floor.

Aug 28, 2026vs Aug 27, 2026

No change above the noise floor.

Aug 27, 2026vs Aug 26, 2026

▲dlt moved #10 → #7
▼Apache Airflow moved #6 → #8
▲Singer moved #4 → #3
▼Airflow moved #3 → #4
▲Apache Hop moved #7 → #6
▼NiFi moved #8 → #9
▼Apache NiFi moved #9 → #10
▼Airflow -10.6pp (64.7% → 54.1%)
▼Apache Airflow -9.7pp (52.9% → 43.2%)
▼NiFi -7.3pp (45.1% → 37.8%)
▼Apache NiFi -7.3pp (45.1% → 37.8%)
▼Airbyte -2.5pp (86.3% → 83.8%)
▼dbt -1.5pp (52.9% → 51.4%)
▼Apache Hop -1.2pp (47.1% → 45.9%)

Aug 26, 2026vs Aug 25, 2026

No change above the noise floor.

Aug 25, 2026vs Aug 24, 2026

No change above the noise floor.

Aug 24, 2026vs Aug 23, 2026

No change above the noise floor.

Aug 23, 2026vs Aug 22, 2026

▲dlt +8.4pp (34.7% → 43.1%)
▼Apache Hop -4.3pp (51.4% → 47.1%)
▼Airflow -2pp (66.7% → 64.7%)
▲Singer +1.9pp (56.9% → 58.8%)
▲Meltano +1.7pp (70.8% → 72.5%)

Aug 22, 2026vs Aug 21, 2026

No change above the noise floor.

Aug 21, 2026vs Aug 20, 2026

No change above the noise floor.

Aug 20, 2026vs Aug 19, 2026

No change above the noise floor.

Aug 19, 2026vs Aug 18, 2026

No change above the noise floor.

Aug 18, 2026vs Aug 17, 2026

▲ INdlt entered the top 10 (#12 → #10)
▼ OUTDagster left the top 10 (#10 → #11)
▼Apache Hop moved #4 → #7
▲Singer moved #6 → #4
▲dbt moved #7 → #5
▲dlt moved #12 → #10
▲Meltano moved #3 → #2
▼Airflow moved #2 → #3
▼Apache Airflow moved #5 → #6
▼Dagster moved #10 → #11
▼Apache Hop -7.9pp (59.3% → 51.4%)
▼Apache Airflow -6.5pp (59.3% → 52.8%)
▼Apache NiFi -5.6pp (50% → 44.4%)
▼NiFi -5.4pp (51.2% → 45.8%)
▼Airflow -4.2pp (70.9% → 66.7%)
▲Meltano +2.2pp (68.6% → 70.8%)
▲dlt +2.1pp (32.6% → 34.7%)
▼Airbyte -1.1pp (87.2% → 86.1%)
▲Singer +1.1pp (55.8% → 56.9%)

Aug 17, 2026vs Aug 16, 2026

No change above the noise floor.

Aug 16, 2026vs Aug 15, 2026

▲dbt +1.1pp (52.4% → 53.5%)

Aug 15, 2026vs Aug 14, 2026

Methodology change: extraction rules 4-5 → 4-7 between these dates. Differences below may reflect the rule change rather than a change in what AI recommends — see the methodology changelog.

▲Apache Hop moved #5 → #4
▼Apache Airflow moved #4 → #5
▼Airflow -3.6pp (75% → 71.4%)
▼Apache Airflow -2.3pp (61.8% → 59.5%)
▼dbt -1.5pp (53.9% → 52.4%)
▼NiFi -1.4pp (52.6% → 51.2%)
▼Apache NiFi -1.3pp (51.3% → 50%)
▼Dagster -1pp (35.5% → 34.5%)

The ranking, date by date

Top 10 on each archived date, exactly as published. Cite a date and it stays true: snapshots are append-only, and a correction appends a new revision rather than overwriting the original.

Sep 8, 202638 sampled answers · window 2026-08-11 – 2026-09-08 · rules v7

#1Airbyte78.9%
#2Meltano68.4%
#3Singer55.3%
#4Airflow55.3%
#5dbt44.7%
#6Apache Airflow42.1%
#7Apache Hop36.8%
#8NiFi36.8%
#9Dagster34.2%
#10Apache NiFi31.6%

Sep 7, 202638 sampled answers · window 2026-08-10 – 2026-09-07 · rules v7

#1Airbyte78.9%
#2Meltano68.4%
#3Singer55.3%
#4Airflow55.3%
#5dbt44.7%
#6Apache Airflow42.1%
#7Apache Hop36.8%
#8NiFi36.8%
#9Dagster34.2%
#10Apache NiFi31.6%

Sep 6, 202638 sampled answers · window 2026-08-09 – 2026-09-06 · rules v7

#1Airbyte78.9%
#2Meltano68.4%
#3Singer55.3%
#4Airflow55.3%
#5dbt44.7%
#6Apache Airflow42.1%
#7Apache Hop36.8%
#8NiFi36.8%
#9Dagster34.2%
#10Apache NiFi31.6%

Sep 5, 202638 sampled answers · window 2026-08-08 – 2026-09-05 · rules v5-7

#1Airbyte78.9%
#2Meltano71.1%
#3Singer57.9%
#4Airflow55.3%
#5Apache Hop42.1%
#6Apache Airflow42.1%
#7NiFi39.5%
#8dbt36.8%
#9dlt34.2%
#10Apache NiFi34.2%

Sep 4, 202624 sampled answers · window 2026-08-07 – 2026-09-04 · rules v4-7

#1Airbyte83.3%
#2Meltano75%
#3Singer62.5%
#4Apache Hop50%
#5dbt45.8%
#6Airflow37.5%
#7dlt33.3%
#8Dagster29.2%
#9Kubernetes29.2%
#10Apache NiFi29.2%

Sep 3, 202637 sampled answers · window 2026-08-06 – 2026-09-03 · rules v4-7

#1Airbyte83.8%
#2Meltano73%
#3Singer59.5%
#4Airflow54.1%
#5dbt51.4%
#6Apache Hop45.9%
#7dlt43.2%
#8Apache Airflow43.2%
#9NiFi37.8%
#10Apache NiFi37.8%

Sep 2, 202637 sampled answers · window 2026-08-05 – 2026-09-02 · rules v4-7

#1Airbyte83.8%
#2Meltano73%
#3Singer59.5%
#4Airflow54.1%
#5dbt51.4%
#6Apache Hop45.9%
#7dlt43.2%
#8Apache Airflow43.2%
#9NiFi37.8%
#10Apache NiFi37.8%

Sep 1, 202637 sampled answers · window 2026-08-04 – 2026-09-01 · rules v4-7

#1Airbyte83.8%
#2Meltano73%
#3Singer59.5%
#4Airflow54.1%
#5dbt51.4%
#6Apache Hop45.9%
#7dlt43.2%
#8Apache Airflow43.2%
#9NiFi37.8%
#10Apache NiFi37.8%

Aug 31, 202637 sampled answers · window 2026-08-03 – 2026-08-31 · rules v4-7

#1Airbyte83.8%
#2Meltano73%
#3Singer59.5%
#4Airflow54.1%
#5dbt51.4%
#6Apache Hop45.9%
#7dlt43.2%
#8Apache Airflow43.2%
#9NiFi37.8%
#10Apache NiFi37.8%

Aug 30, 202637 sampled answers · window 2026-08-02 – 2026-08-30 · rules v4-7

#1Airbyte83.8%
#2Meltano73%
#3Singer59.5%
#4Airflow54.1%
#5dbt51.4%
#6Apache Hop45.9%
#7dlt43.2%
#8Apache Airflow43.2%
#9NiFi37.8%
#10Apache NiFi37.8%

Aug 29, 202637 sampled answers · window 2026-08-01 – 2026-08-29 · rules v4-7

#1Airbyte83.8%
#2Meltano73%
#3Singer59.5%
#4Airflow54.1%
#5dbt51.4%
#6Apache Hop45.9%
#7dlt43.2%
#8Apache Airflow43.2%
#9NiFi37.8%
#10Apache NiFi37.8%

Aug 28, 202637 sampled answers · window 2026-07-31 – 2026-08-28 · rules v4-7

#1Airbyte83.8%
#2Meltano73%
#3Singer59.5%
#4Airflow54.1%
#5dbt51.4%
#6Apache Hop45.9%
#7dlt43.2%
#8Apache Airflow43.2%
#9NiFi37.8%
#10Apache NiFi37.8%

Aug 27, 202637 sampled answers · window 2026-07-30 – 2026-08-27 · rules v4-7

#1Airbyte83.8%
#2Meltano73%
#3Singer59.5%
#4Airflow54.1%
#5dbt51.4%
#6Apache Hop45.9%
#7dlt43.2%
#8Apache Airflow43.2%
#9NiFi37.8%
#10Apache NiFi37.8%

Aug 26, 202651 sampled answers · window 2026-07-29 – 2026-08-26 · rules v4-7

#1Airbyte86.3%
#2Meltano72.5%
#3Airflow64.7%
#4Singer58.8%
#5dbt52.9%
#6Apache Airflow52.9%
#7Apache Hop47.1%
#8NiFi45.1%
#9Apache NiFi45.1%
#10dlt43.1%

Aug 25, 202651 sampled answers · window 2026-07-28 – 2026-08-25 · rules v4-7

#1Airbyte86.3%
#2Meltano72.5%
#3Airflow64.7%
#4Singer58.8%
#5dbt52.9%
#6Apache Airflow52.9%
#7Apache Hop47.1%
#8NiFi45.1%
#9Apache NiFi45.1%
#10dlt43.1%

Aug 24, 202651 sampled answers · window 2026-07-27 – 2026-08-24 · rules v4-7

#1Airbyte86.3%
#2Meltano72.5%
#3Airflow64.7%
#4Singer58.8%
#5dbt52.9%
#6Apache Airflow52.9%
#7Apache Hop47.1%
#8NiFi45.1%
#9Apache NiFi45.1%
#10dlt43.1%

Aug 23, 202651 sampled answers · window 2026-07-26 – 2026-08-23 · rules v4-7

#1Airbyte86.3%
#2Meltano72.5%
#3Airflow64.7%
#4Singer58.8%
#5dbt52.9%
#6Apache Airflow52.9%
#7Apache Hop47.1%
#8NiFi45.1%
#9Apache NiFi45.1%
#10dlt43.1%

Aug 22, 202672 sampled answers · window 2026-07-25 – 2026-08-22 · rules v4-7

#1Airbyte86.1%
#2Meltano70.8%
#3Airflow66.7%
#4Singer56.9%
#5dbt52.8%
#6Apache Airflow52.8%
#7Apache Hop51.4%
#8NiFi45.8%
#9Apache NiFi44.4%
#10dlt34.7%

Aug 21, 202672 sampled answers · window 2026-07-24 – 2026-08-21 · rules v4-7

#1Airbyte86.1%
#2Meltano70.8%
#3Airflow66.7%
#4Singer56.9%
#5dbt52.8%
#6Apache Airflow52.8%
#7Apache Hop51.4%
#8NiFi45.8%
#9Apache NiFi44.4%
#10dlt34.7%

Aug 20, 202672 sampled answers · window 2026-07-23 – 2026-08-20 · rules v4-7

#1Airbyte86.1%
#2Meltano70.8%
#3Airflow66.7%
#4Singer56.9%
#5dbt52.8%
#6Apache Airflow52.8%
#7Apache Hop51.4%
#8NiFi45.8%
#9Apache NiFi44.4%
#10dlt34.7%

Aug 19, 202672 sampled answers · window 2026-07-22 – 2026-08-19 · rules v4-7

#1Airbyte86.1%
#2Meltano70.8%
#3Airflow66.7%
#4Singer56.9%
#5dbt52.8%
#6Apache Airflow52.8%
#7Apache Hop51.4%
#8NiFi45.8%
#9Apache NiFi44.4%
#10dlt34.7%

Aug 18, 202672 sampled answers · window 2026-07-21 – 2026-08-18 · rules v4-7

#1Airbyte86.1%
#2Meltano70.8%
#3Airflow66.7%
#4Singer56.9%
#5dbt52.8%
#6Apache Airflow52.8%
#7Apache Hop51.4%
#8NiFi45.8%
#9Apache NiFi44.4%
#10dlt34.7%

Aug 17, 202686 sampled answers · window 2026-07-20 – 2026-08-17 · rules v4-7

#1Airbyte87.2%
#2Airflow70.9%
#3Meltano68.6%
#4Apache Hop59.3%
#5Apache Airflow59.3%
#6Singer55.8%
#7dbt53.5%
#8NiFi51.2%
#9Apache NiFi50%
#10Dagster34.9%

Aug 16, 202686 sampled answers · window 2026-07-19 – 2026-08-16 · rules v4-7

#1Airbyte87.2%
#2Airflow70.9%
#3Meltano68.6%
#4Apache Hop59.3%
#5Apache Airflow59.3%
#6Singer55.8%
#7dbt53.5%
#8NiFi51.2%
#9Apache NiFi50%
#10Dagster34.9%

Aug 15, 202684 sampled answers · window 2026-07-18 – 2026-08-15 · rules v4-7

#1Airbyte86.9%
#2Airflow71.4%
#3Meltano67.9%
#4Apache Hop59.5%
#5Apache Airflow59.5%
#6Singer56%
#7dbt52.4%
#8NiFi51.2%
#9Apache NiFi50%
#10Dagster34.5%

Aug 14, 202676 sampled answers · window 2026-07-17 – 2026-08-14 · rules v4-5

#1Airbyte86.8%
#2Airflow75%
#3Meltano67.1%
#4Apache Airflow61.8%
#5Apache Hop59.2%
#6Singer55.3%
#7dbt53.9%
#8NiFi52.6%
#9Apache NiFi51.3%
#10Dagster35.5%

Read any date directly

Every archived date is machine-readable at /api/index/open-source-data-pipeline-tools/as-of/<YYYY-MM-DD>, which returns the ranking as it stood, with the extraction version and revision it was published under. Dates before the record begins return no_record rather than a recomputation — we do not reconstruct history on demand and present it as what we said. See what the engines actually said.

[ORBATOR]