Registry / ai-ml / databricks-feature-engineering

databricks-feature-engineering

JSON →
library0.16.1pypypi✓ verified 29d ago

The `databricks-feature-engineering` library provides a Python client for interacting with Databricks Feature Engineering. It allows users to programmatically create, manage, and utilize feature tables within Databricks, streamlining the development and deployment of machine learning features. It integrates with Databricks Workflows and MLflow. The current version is 0.14.0, with frequent minor releases introducing new features, bug fixes, and occasional breaking changes due to its pre-1.0 status.

pip install databricks-feature-engineering
INSTALL
IMPORT
SIG · DATABRICKS-FEATURE
D
databricks-feature-engineering
ai-mlpythonv0.16.1
Install
22.5s avg
Import
—
Disk
319MB
Pass rate
10/ 10
Env Coverage10 / 10
glibc
3.9–3.13
musl
3.9–3.13
Install & Compatibility
Where this runs
tested against v0.16.1 · pip install
no network on importno background threads
Install × environment matrix
Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux
musl
py 3.10–3.95 runs
installs and imports cleanly · install 0.0s · import 0.000s · 329.6MB
glibc
py 3.10–3.95 runs
installs and imports cleanly · install 22.5s · import 0.000s · 322MB
319MB installed
● package 319MB
Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

FeatureEngineeringClient
✓ from databricks.feature_engineering.client import FeatureEngineeringClient
✗ from databricks.feature_engineering.client import FeatureEngineeringClient

Initializes the `FeatureEngineeringClient`. This client automatically handles authentication if run within a Databricks environment or if `DATABRICKS_HOST` and `DATABRICKS_TOKEN` environment variables are set. While the client can initialize without `pyspark`, most feature table operations (like `create_feature_table` or `write_table`) require an active SparkSession.

import os from databricks.feature_engineering import FeatureEngineeringClient # For local execution outside a Databricks notebook, ensure these # environment variables are set for authentication. # os.environ['DATABRICKS_HOST'] = os.environ.get('DATABRICKS_HOST', 'https://<your-databricks-instance>.cloud.databricks.com') # os.environ['DATABRICKS_TOKEN'] = os.environ.get('DATABRICKS_TOKEN', 'dapi...') try: # The client automatically picks up credentials from the Databricks environment # or DATABRICKS_HOST/DATABRICKS_TOKEN environment variables. fe_client = FeatureEngineeringClient() print(f"Successfully initialized Databricks Feature Engineering Client: {type(fe_client)}") print("\nNote: Most Feature Engineering operations (like creating, writing, or reading tables)") print("require an active SparkSession, which is typically available in a Databricks notebook") print("or when using Databricks Connect (ensure it's configured locally).") print("\nFor example, to create a feature table or write data, you would need a 'spark' object.") except Exception as e: print(f"Failed to initialize Databricks Feature Engineering Client: {e}") print("Please ensure you are running in a Databricks environment or have 'DATABRICKS_HOST' and 'DATABRICKS_TOKEN' environment variables set.")
Debug
Known issues
breakingThe `online_store_client` parameter in `fe_client.write_table()` was renamed to `databricks_online_table_client`.
fix
Update calls to `write_table` to use the new parameter name: `databricks_online_table_client` instead of `online_store_client`.
affects: >=0.10.0
breakingThe `DatabricksDbfsClient` class was removed from the library.
fix
Migrate any usage of `DatabricksDbfsClient` to alternative methods for interacting with DBFS, typically using the `dbutils.fs` in Databricks notebooks or the `databricks-sdk`'s `DbfsAPI`.
affects: >=0.11.0
breakingThe `online_store_client` argument was removed from `fe_client.create_online_table()` and `fe_client.drop_online_table()` methods.
fix
Remove the `online_store_client` argument from calls to `create_online_table` and `drop_online_table`. The online store client is now managed internally.
affects: >=0.14.0
gotchaWhile the `FeatureEngineeringClient` can be instantiated independently, most core functionalities like creating, writing, or reading feature tables fundamentally rely on a SparkSession. Attempting these operations without one will result in errors.
fix
Ensure your code runs within a Databricks notebook/job or has Databricks Connect properly configured and initialized, providing access to an active `SparkSession`.
affects: All versions
Upgrade
Version history
0.16.1latest on PyPI · released Jul 20, 2026
Audit
Dependencies
databricks-sdkrequiredCore dependency for authentication and general Databricks API interactions.
pysparkoptionalRequired for most feature table operations (creating, writing, reading dataframes). The client can initialize without it, but core functionality relies on a SparkSession.
Agent activity
20 hits · last 30 days
node
16
OpenAI (training)
2
Resources
databricks-feature-engineering — pip install databricks-feature-engineering · libregistry