The Qubole Data Service (QDS) Python SDK provides a programmatic interface for interacting with the Qubole Data Service API, allowing users to manage clusters, submit commands (e.g., Hive, Spark, Presto), and access query results. The library is actively maintained, with version 1.17.0 being the latest, and typically sees several releases per year to add features and ensure compatibility.
pip install qds-sdk==1.17.0Verified import paths — ran on the pinned version, not inferred.
This quickstart demonstrates how to configure the Qubole SDK with API credentials and submit a simple Hive command. It requires setting `QDS_API_TOKEN` and `QDS_API_URL` as environment variables, and optionally `QDS_CLUSTER_ID` for targeting a specific cluster. The example submits a query, waits for its completion, and then fetches the results.
Upgrade to Python 2.7+ or preferably Python 3.6+ for continued support and security updates. For Python 2.x users, explicitly install `qds-sdk<1.13.1` if upgrading Python is not an option.
Ensure your AWS S3 buckets and configurations support Signature Version V4. If encountering S3 authentication issues, check your Qubole cluster S3 settings and potentially AWS IAM policies.
Upgrade to `qds-sdk==1.17.0` or newer when using Python 3.12 to ensure full compatibility and avoid unexpected behavior.
Always refer to the latest QDS SDK documentation or `help()` for specific command/resource creation methods to understand required and optional parameters. Be mindful of new parameters that might become mandatory or change default behavior in future releases.