Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rasterio source module #1115

Merged
merged 97 commits into from
May 29, 2023
Merged
Show file tree
Hide file tree
Changes from 90 commits
Commits
Show all changes
97 commits
Select commit Hold shift + click to select a range
4336a34
draft rasterio driver
12rambau Aug 11, 2022
07f085e
unify docstring
12rambau Aug 11, 2022
d5ee2e1
apply black formatting
12rambau Aug 11, 2022
831c6ce
flake8 checks
12rambau Aug 11, 2022
f185517
use camelCase instead of snakeCase
12rambau Aug 11, 2022
5d814b7
edit color functions
12rambau Aug 11, 2022
8f44b28
isort
12rambau Aug 11, 2022
c15d4d8
isort and black disagree
12rambau Aug 11, 2022
e223cf1
last check before draft PR
12rambau Aug 11, 2022
ff0f5c3
add the tests
12rambau Aug 11, 2022
d5bf1eb
Merge branch 'master' into rasterio
12rambau Aug 11, 2022
2fab721
add the alphatest
12rambau Aug 11, 2022
ea90ca9
add rasterio source to setup
12rambau Aug 11, 2022
21a3e0e
bug fixes
12rambau Aug 12, 2022
4145c4a
import Proj, Transformer and CRS directly
12rambau Aug 12, 2022
885f63e
use affine
12rambau Aug 12, 2022
28bf3fa
indexes is 1 indexed
12rambau Aug 12, 2022
d3f47d0
debug against tests step 1
12rambau Aug 12, 2022
7f89243
Merge branch 'master' into rasterio
banesullivan Nov 18, 2022
16af499
Formatting
banesullivan Nov 18, 2022
6160222
Make getInternalMetadata JSON serializable
banesullivan Nov 18, 2022
e3b0395
Hackily support srs in getBounds
banesullivan Nov 18, 2022
53295b4
Fix getTile when extent is larger than image
banesullivan Nov 18, 2022
892c514
Fix add_alpha issues
banesullivan Nov 18, 2022
3a8bcc8
Check metadata for None
banesullivan Nov 18, 2022
1e72b5c
Catch rio_cogeo import error
banesullivan Nov 18, 2022
4782121
format_ -> format
banesullivan Nov 18, 2022
2bbb823
Formatting
banesullivan Nov 18, 2022
e7d6b9d
tox -e format
banesullivan Nov 18, 2022
3422f68
Merge branch 'master' into rasterio
banesullivan Nov 21, 2022
5dd8f18
Autopep8 and cleanup
banesullivan Nov 21, 2022
ca287dc
Autopep8 tests
banesullivan Nov 21, 2022
9fac7df
Make GeoFileTileSource base class
banesullivan Nov 22, 2022
5c4f9e2
Merge branch 'master' into rasterio
banesullivan Nov 22, 2022
9435e77
Formatting
banesullivan Nov 22, 2022
39a87ae
Skip <python3.8 for rasterio tests
banesullivan Nov 22, 2022
21b1fb4
Clean up _rasterioParameters
banesullivan Nov 22, 2022
f75b4b3
Cherry pick @manthey's changes
banesullivan Nov 22, 2022
000ccf3
Bump rasterio to Python 3.8+
banesullivan Nov 22, 2022
e4b256a
Fix
banesullivan Nov 22, 2022
cfcb9f8
Merge branch 'master' into rasterio
banesullivan Jan 30, 2023
0405493
Merge branch 'master' into rasterio
banesullivan Feb 8, 2023
5703743
Merge branch 'master' into rasterio
banesullivan Feb 10, 2023
448b2f4
Fix projection issue
banesullivan Feb 10, 2023
873f76b
Fix odd issues
banesullivan Feb 10, 2023
718a573
Fix no projection tile issues
banesullivan Feb 10, 2023
d4b5f5e
Fix no projection getRegion issue
banesullivan Feb 10, 2023
535df6b
Setup.py metadata
banesullivan Feb 10, 2023
6ebaecf
getRegion working
banesullivan Feb 14, 2023
90c5a94
Remove _getRegionVrt
banesullivan Feb 14, 2023
aa32fcb
TODO
banesullivan Feb 15, 2023
8870e4f
Merge branch 'master' into rasterio
banesullivan Feb 15, 2023
634de24
Merge branch 'master' into rasterio
banesullivan Feb 15, 2023
e452ec3
Reproject with getRegion
banesullivan Feb 15, 2023
14545ab
Merge branch 'master' into rasterio
banesullivan Apr 18, 2023
899281d
Cleanup merge artifacts
banesullivan Apr 18, 2023
ca9412d
Merge branch 'master' into rasterio
banesullivan May 7, 2023
26349b2
Catchup
banesullivan May 7, 2023
adeab4d
Fix palettized default styles
banesullivan May 7, 2023
3b3c9a2
[wip] combine testing
banesullivan May 8, 2023
5a938fa
Refactor geo testing
banesullivan May 8, 2023
ffac5ac
Fix tests
banesullivan May 8, 2023
d08da31
Migrate some common methods
banesullivan May 8, 2023
36c0c97
Support rasterio dataset handles
banesullivan May 10, 2023
f78836c
Support rasterio MemoryFile
banesullivan May 10, 2023
a43f09f
[wip]
banesullivan May 24, 2023
4c14c57
Merge branch 'master' into rasterio
banesullivan May 24, 2023
39a17e4
Catchup tests with #1155
banesullivan May 24, 2023
1fa8ab6
Fix projection issues
banesullivan May 24, 2023
7b69542
Make testAlphaProjection GDAL-specific
banesullivan May 24, 2023
157980e
Move tiled getRegion tests to GDAL only
banesullivan May 24, 2023
c662b3f
Ignore Mapnik inconsistencies
banesullivan May 24, 2023
3fac445
Formatting
banesullivan May 24, 2023
c9bc138
Install sources/rasterio
banesullivan May 24, 2023
64c665d
Add cog extras
banesullivan May 25, 2023
5ff1c6d
Fix constant values
banesullivan May 25, 2023
e26bbb1
Use [all] as extras name
banesullivan May 25, 2023
c8b6c92
Fix import
banesullivan May 25, 2023
940e171
Fix cacheName
banesullivan May 25, 2023
b51182f
File file not found code path
banesullivan May 25, 2023
8d5b3bc
Prevent netCDF files
banesullivan May 25, 2023
5389a6e
Fix VSI path handling
banesullivan May 25, 2023
b1b1d65
Clean up code duplication
banesullivan May 25, 2023
36306e4
Merge branch 'master' into rasterio
banesullivan May 26, 2023
c1eeb4b
Fix python_version for tests
banesullivan May 26, 2023
4d264d6
Ignore NotGeoreferencedWarning
banesullivan May 26, 2023
9d21ed1
Fix getRegion (size still broken)
banesullivan May 26, 2023
4bd0f70
Fix output size of getRegion
banesullivan May 26, 2023
9b018d8
Test tiled getRegion
banesullivan May 26, 2023
7f4fa37
Write colormaps with getRegion
banesullivan May 26, 2023
870ef5b
Fix some tests
manthey May 26, 2023
d21d13b
Use Resampling.nearset for all read operations
banesullivan May 26, 2023
5d26d08
More Resampling.nearest
banesullivan May 26, 2023
a1af612
Formatting
banesullivan May 26, 2023
070ddc5
Harmonize band range calculations
manthey May 29, 2023
dfc0738
Move isGeospatial into geospatial sources
manthey May 29, 2023
381c586
Reduce mapnik source's priority
manthey May 29, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .circleci/make_wheels.sh
Original file line number Diff line number Diff line change
Expand Up @@ -45,6 +45,8 @@ cd "$ROOTPATH/sources/openslide"
pip wheel . --no-deps -w ~/wheels && rm -rf build
cd "$ROOTPATH/sources/pil"
pip wheel . --no-deps -w ~/wheels && rm -rf build
cd "$ROOTPATH/sources/rasterio"
pip wheel . --no-deps -w ~/wheels && rm -rf build
cd "$ROOTPATH/sources/test"
pip wheel . --no-deps -w ~/wheels && rm -rf build
cd "$ROOTPATH/sources/tiff"
Expand Down
6 changes: 6 additions & 0 deletions .circleci/release_pypi.sh
Original file line number Diff line number Diff line change
Expand Up @@ -106,6 +106,12 @@ cp "$ROOTPATH/LICENSE" .
python setup.py sdist
pip wheel . --no-deps -w dist
twine upload --verbose dist/*
cd "$ROOTPATH/sources/rasterio"
cp "$ROOTPATH/README.rst" .
cp "$ROOTPATH/LICENSE" .
python setup.py sdist
pip wheel . --no-deps -w dist
twine upload --verbose dist/*
cd "$ROOTPATH/sources/test"
cp "$ROOTPATH/README.rst" .
cp "$ROOTPATH/LICENSE" .
Expand Down
10 changes: 10 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -41,6 +41,13 @@ coverage.xml
# pyenv
.python-version

# IPython
profile_default/
ipython_config.py

# Jupyter Notebook
.ipynb_checkpoints

# dotenv
.env

Expand All @@ -64,3 +71,6 @@ docs/source/*
!docs/source/*.py
!docs/source/*.rst
.pre-commit-config.yaml

*.ipynb
NOTES.md
Comment on lines +74 to +76
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These are from my dev environment. Maybe remove?

1 change: 1 addition & 0 deletions docs/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,7 @@
_build/large_image_source_openjpeg/modules
_build/large_image_source_openslide/modules
_build/large_image_source_pil/modules
_build/large_image_source_rasterio/modules
_build/large_image_source_test/modules
_build/large_image_source_tiff/modules
_build/large_image_source_tifffile/modules
Expand Down
1 change: 1 addition & 0 deletions docs/make_docs.sh
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ sphinx-apidoc -f -o _build/large_image_source_ometiff ../sources/ometiff/large_i
sphinx-apidoc -f -o _build/large_image_source_openjpeg ../sources/openjpeg/large_image_source_openjpeg
sphinx-apidoc -f -o _build/large_image_source_openslide ../sources/openslide/large_image_source_openslide
sphinx-apidoc -f -o _build/large_image_source_pil ../sources/pil/large_image_source_pil
sphinx-apidoc -f -o _build/large_image_source_rasterio ../sources/rasterio/large_image_source_rasterio
sphinx-apidoc -f -o _build/large_image_source_test ../sources/test/large_image_source_test
sphinx-apidoc -f -o _build/large_image_source_tiff ../sources/tiff/large_image_source_tiff
sphinx-apidoc -f -o _build/large_image_source_tifffile ../sources/tifffile/large_image_source_tifffile
Expand Down
4 changes: 4 additions & 0 deletions large_image/constants.py
Original file line number Diff line number Diff line change
Expand Up @@ -67,6 +67,10 @@ class SourcePriority:
'millimeter': 'mm',
'millimeters': 'mm',
'fraction': 'fraction',
'projection': 'projection',
'proj': 'projection',
'wgs84': 'proj4:EPSG:4326',
'4326': 'proj4:EPSG:4326',
}

# numpy dtype to pyvips GValue
Expand Down
Loading