- Reorder FastAPI endpoints for clarity.
- Truncate long logs to avoid overloading the server.
- User-Agent for better analytics tracking.
- Expose the ability to create container auth.
- Emulate webhooks for local testing when using
rp_serve_api
flag.
- Updated aiohttp from 3.9.2 to 3.9.3
- [BREAKING] rename
registry_auth
toregistry_auth_id
for clarity. - Added additional details to the FastAPI page.
- Rust Serverless Core Passing all tests.
- GitHub Action and Python package updates
- Changelog date typo
- Expose cuda selection when creating a pod.
- Expose
flashboot
when creating a new endpoint. - Expose bucket name for rp_upload.
- Exposed
containerRegistryAuthId
for template creation.
- ReadMe typo start_pod -> resume_pod
- Edge case when using RunPod Serverless Core that return
None
for function output. - Missing Job ID for logging.
- Concurrency modifier not adhering to the maximum concurrency.
- Improved in progress job tracking and counting.
- Expanded RunPod Serverless Core testing.
- Prevent stream from hanging on the final output.
- Allow
GET
method forstream
test endpoint. - Updated async runner for endpoint API calls.
- Updated sls-core to
0.0.2
- Optional serverless core implementation, use with environment variable
RUNPOD_USE_CORE=True
orRUNPOD_CORE_PATH=/path/to/core.so
- Reduced await asyncio.sleep calls to 0 to reduce execution time.
- Added defaults for optional parameters in
rp_fastapi
to be compatible with pydantic.
- Local test API server includes simulated endpoints that mimic the behavior of
run
,runsync
,stream
, andstatus
. - Internal job tracker can be used to track job inputs.
- [BREAKING] concurrency is now handled by
concurrency_modifier
which is a user provided function that takes in the current concurrency and returns the new concurrency. This allows for more complex concurrency logic to be implemented by the user. - Updated the
colorama
requirement version to>= 0.2.5, < 0.4.5
- Streaming support for calling endpoints.
- Stream support for calling endpoints.
- Catch timeouts when checking for available jobs.
- Updated and pinned aiohttp to 3.9.1
- Restrict version of
aiohttp
to 3.8.6 to avoid breaking changes in 3.9.0
- Robust
get_job
error handling project.toml
now includes required dependencies
- Logs are now JSON formatted
- Exposed logging
job_id
nowrequest_id
get_endpoints
exposed to return all endpoints for a given user
- Method of creating logs with job id.
- Reduced polling when checking for job completion.
- Removed print statements for endpoint calls.
- Serverless progress updates no longer restricted to only strings.
- Removed
pillow
dependency. - Removed
python-dotenv
dependency. - Removed
setuptools_scm
from required dependencies.
- Removed
setup.cfg
and moved all configuration tosetup.py
- [BETA] Clean exit CLI when ctl+c is pressed.
test_output
can be passed in as an arg to compare the results oftest_input
- Generator/Streaming handlers supported with local testing
- [BETA] CLI DevEx functionality to create development projects.
- Backwards compatibility with Python >= 3.8
- Consolidated install dependencies to
requirements.txt
- Corrected helper link for rp_uploads, closes issue #169
- Force
urllib3
logging toWARNING
level to avoid spamming the console if global logging level is set toDEBUG
.
- Handler called twice.
- Default container disk size removed if template is provided when creating a new pod.
- Job outputs that were not dictionaries, bool, or str were swallowed by the serverless worker. This has been fixed.
- User queries and mutations are now available in the python API wrapper.
start_ssh
added with defaultTrue
when creating new pods.network_volume_id
can now be passed in when creating new pods, correct data center is automatically selected.template_id
can now be passed in when creating new pods.
- Dependencies updated to latest versions.
- Reduced circular imports for version reference.
support_public_ip
is not default toTrue
when creating new pods.
- Reduce pool_connections for ping requests to 10.
- Double timeout for ping requests.
- Version reported when an error is returned in serverless.
- Log level can be set with
RUNPOD_LOG_LEVEL
environment variable. - SIGTERM handler initialized when starting serverless worker to avoid hung workers.
- Progress update method exposed
runpod.serverless.progress_update
can be called with the job object and string.
- Region is included when using S3 storage via rp_upload, automatically filled in for Amazon S3 buckets and Digital Ocean Spaces.
- Command Line Interface (CLI)
- Can generate a credentials file from the CLI to store your API key.
get_gpu
now supportsgpu_quantity
as a parameter.
- Minimized the use of pytests in favor of unittests.
- Re-named
api_wrapper
toapi
for consistency. aiohttp_retry
packaged replacedrp_retry.py
implementation.
- Serverless bug that would not remove task if it failed to submit the results.
- Added missing
get_pod
- Remove extra print statement when making API calls.