Registry / http-networking / scrapinghub

scrapinghub

JSON →
library2.7.0pypypi✓ verified 90d ago

Client interface for the Scrapinghub API, used to manage and monitor scraping jobs, collections, items, and more. Current version is 2.7.0, requires Python >=3.10. Release cadence is irregular.

pip install scrapinghub
INSTALL
IMPORT
SIG · SCRAPINGHUB
S
scrapinghub
http-networkingpythonv2.7.0
Install
2.2s avg
Import
679ms
Disk
20MB
Pass rate
10/ 10
Env Coverage10 / 10
glibc
3.9–3.13
musl
3.9–3.13
Install & Compatibility
Where this runs
tested against v2.7.0 · pip install
no network on importno background threads
Install × environment matrix
Each cell = how many times install + import succeeded across repeated harness runs. Partial = flaky.
glibc = Debian/Ubuntu slim · musl = Alpine Linux
musl
py 3.10–3.95 runs
installs and imports cleanly · install 0.0s · import 0.722s · 21.6MB
glibc
py 3.10–3.95 runs
installs and imports cleanly · install 2.2s · import 0.636s · 22MB
20MB installed
● package 20MB
Code
Verified usage

Verified import paths — ran on the pinned version, not inferred.

ScrapinghubClient
✓ from scrapinghub import ScrapinghubClient
✗ from scrapinghub.client import ScrapinghubClient
Old or incorrect import path. The main class is directly under the package.

Initialize client with API key, fetch a project, and list jobs.

from scrapinghub import ScrapinghubClient api_key = os.environ.get('SHUB_APIKEY', '') client = ScrapinghubClient(api_key) # Access a project project = client.get_project(123456) print(project.key) # List jobs (spiders) in a project for job in project.jobs.iter(): print(job['key'])
Debug
Known issues
deprecatedThe 'hubstorage' package is deprecated and merged into scrapinghub since version 1.9.0. Use 'scrapinghub' instead.
fix
Replace 'from hubstorage import HubstorageClient' with 'from scrapinghub import ScrapinghubClient'.
affects: <1.9.0
breakingPython 3.3 and 3.4 support dropped in version 2.3.1 and 2.0.0 respectively.
fix
Upgrade to Python 3.10+.
affects: >=2.0.0 <2.3.1
gotchaThe API key can be provided via environment variable 'SH_APIKEY' or 'SHUB_JOBAUTH'. If both are missing, client initialization will fail.
fix
Set either SH_APIKEY or SHUB_JOBAUTH environment variable before creating a client.
affects: all
gotchaJob IDs are strings in the format 'project_id/spider_id/job_id', not just numeric.
fix
Use full job key strings when referencing jobs in API calls.
affects: all
Errors
Common errors & fixes
ModuleNotFoundError: No module named 'hubstorage'
The hubstorage package is deprecated and merged into scrapinghub.
fix
pip install scrapinghub and change imports to 'from scrapinghub import ScrapinghubClient'.
ImportError: cannot import name 'ScrapinghubClient' from 'scrapinghub.client'
Incorrect import path; ScrapinghubClient is at the top-level package.
fix
from scrapinghub import ScrapinghubClient
ScrapinghubError: ('Connection error: ...')
Often due to invalid API key or network issues.
fix
Verify SH_APIKEY environment variable is set correctly and that you have internet access.
Upgrade
Version history
2.7.0latest on PyPI · released Apr 7, 2026
Audit
Dependencies
msgpackrequiredserialization of data
requestsrequiredHTTP client
retryingrequiredretry logic for HTTP errors
Agent activity
14 hits · last 30 days
node
12
OpenAI (training)
1
Resources
scrapinghub — pip install scrapinghub · libregistry