Test datasets

Obtaining / creating test datasets

If a test dataset can be created in code, do that instead. If it is used in a single test, create the test dataset as part of that test. If it is used in more than a single test, add it to pyogrio/tests/conftest.py instead, as a function-scoped test fixture.

If you need to obtain 3rd party test files:

• add a section below that describes the source location and processing steps to derive that dataset
• make sure the license is compatible with including in Pyogrio (public domain or open-source) and record that license below

Please keep the test files no larger than necessary to use in tests.

Included test datasets

Natural Earth lowres

naturalearth_lowres.shp was copied from GeoPandas.

License: public domain

GPKG test dataset with null values

test_gpkg_nulls.gpkg was created using Fiona backend to GeoPandas:

from collections import OrderedDict

import fiona
import geopandas as gp
import numpy as np
from pyogrio import write_dataframe

filename = "test_gpkg_nulls.gpkg"

df = gp.GeoDataFrame(
    {
        "col_bool": np.array([True, False, True], dtype="bool"),
        "col_int8": np.array([1, 2, 3], dtype="int8"),
        "col_int16": np.array([1, 2, 3], dtype="int16"),
        "col_int32": np.array([1, 2, 3], dtype="int32"),
        "col_int64": np.array([1, 2, 3], dtype="int64"),
        "col_uint8": np.array([1, 2, 3], dtype="uint8"),
        "col_uint16": np.array([1, 2, 3], dtype="uint16"),
        "col_uint32": np.array([1, 2, 3], dtype="uint32"),
        "col_uint64": np.array([1, 2, 3], dtype="uint64"),
        "col_float32": np.array([1.5, 2.5, 3.5], dtype="float32"),
        "col_float64": np.array([1.5, 2.5, 3.5], dtype="float64"),
    },
    geometry=gp.points_from_xy([0, 1, 2], [0, 1, 2]),
    crs="EPSG:4326",
)

write_dataframe(df, filename)

# construct row with null values
# Note: np.nan can only be used for float values
null_row = {
    "type": "Fetaure",
    "id": 4,
    "properties": OrderedDict(
        [
            ("col_bool", None),
            ("col_int8", None),
            ("col_int16", None),
            ("col_int32", None),
            ("col_int64", None),
            ("col_uint8", None),
            ("col_uint16", None),
            ("col_uint32", None),
            ("col_uint64", None),
            ("col_float32", np.nan),
            ("col_float64", np.nan),
        ]
    ),
    "geometry": {"type": "Point", "coordinates": (4.0, 4.0)},
}

# append row with nulls to GPKG
with fiona.open(filename, "a") as c:
    c.write(null_row)

License: same as Pyogrio

OSM PBF test

This was downloaded from https://github.com/openstreetmap/OSM-binary/blob/master/resources/sample.pbf

License: Open Data Commons Open Database License (ODbL)

Test files for geometry types that are downgraded on read

line_zm.gpkg was created using QGIS to digitize a LineString GPKG layer with Z and M enabled. Downgraded to LineString Z on read. curve.gpkg was created using QGIS to digitize a Curve GPKG layer. Downgraded to LineString on read. curvepolygon.gpkg was created using QGIS to digitize a CurvePolygon GPKG layer. Downgraded to Polygon on read. multisurface.gpkg was created using QGIS to digitize a MultiSurface GPKG layer. Downgraded to MultiPolygon on read.

License: same as Pyogrio