Registry / database / duckdb-extension-httpfs

duckdb-extension-httpfs

library1.5.3pypypi✓ verified 85d ago

Pip-installable DuckDB httpfs extension for reading/writing remote files via HTTP(S) and S3. Version 1.5.1 is the latest, compatible with DuckDB 1.5.1. Releases track DuckDB versions. Development is active.

database data http-networking aws

pip install duckdb-extension-httpfs==1.5.1

github ↗package ↗docs ↗

INSTALL

IMPORT

SIG · DUCKDB-EXTENSION-H

duckdb-extension-httpfs

databasepythonv1.5.3

Install

2.4s avg

Import

—

Disk

95MB

Pass rate

4/ 10

Env Coverage4 / 10

glibc

3.9–3.13

musl

3.9–3.13

Install & Compatibility

Where this runs

tested against v1.5.3 · pip install

no network on importno background threads

Install × environment matrix

Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux

musl

glibc

py 3.10

✕ build_error

✓ 2.85s

py 3.11

✕ build_error

✓ 2.45s

py 3.12

✕ build_error

✓ 2.2s

py 3.13

✕ build_error

✓ 2.25s

py 3.9

✕ build_error

1/2 runs

95MB installed

● package 95MB

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

duckdb_extension_httpfs

✓ import duckdb_extension_httpfs

✗ import duckdb; duckdb.load_extension('httpfs')

Load the httpfs extension and query S3 data. Replace ACCESS_KEY/SECRET_KEY with your credentials.

import duckdb duckdb.load_extension('httpfs') db = duckdb.connect() db.execute(""" SET s3_access_key_id = 'ACCESS_KEY'; SET s3_secret_access_key = 'SECRET_KEY'; SET s3_region = 'us-east-1'; CREATE TABLE test AS SELECT * FROM read_parquet('s3://bucket/file.parquet') """) print(db.execute('SELECT COUNT(*) FROM test').fetchone())

Debug

Known issues

breakingPython 3.8 is no longer supported starting from version 1.4.0. Requires Python >=3.9.

fix

Upgrade to Python 3.9+ or use duckdb-extension-httpfs==1.3.2 for Python 3.8 support.

affects: >=1.4.0

gotchaThe extension version must exactly match the DuckDB major.minor version (e.g., both 1.5.x). Mixing versions (e.g., httpfs 1.5.0 with DuckDB 1.4.4) will cause load failures.

fix

Use the same DuckDB and duckdb-extension-httpfs version (e.g., both 1.5.1).

affects: all

deprecatedDirect Python module import (from duckdb_extension_httpfs import ...) was never officially supported. The only supported way is duckdb.load_extension('httpfs').

fix

Use duckdb.load_extension('httpfs') after importing duckdb.

affects: all

gotchaS3 credentials are set with session-level SET statements, not using environment variables by default. Forgetting to set s3_access_key_id/s3_secret_access_key causes permission errors.

fix

Set S3 configuration via SET s3_access_key_id = '...'; SET s3_secret_access_key = '...'; SET s3_region = '...'; in the session.

affects: all

Upgrade

Version history

1.5.3latest on PyPI · released May 29, 2026

Audit

Dependencies

duckdbrequiredThe extension must be loaded into a DuckDB database connection.

Agent activity

35 hits · last 30 days

node

OpenAI (training)

Resources

githubhttps://github.com/santosh-d3vpl3x/duckdb_extensions#readme ↗

packagehttps://pypi.org/project/duckdb-extension-httpfs/ ↗

docshttps://github.com/santosh-d3vpl3x/duckdb_extensions#readme ↗