plateau.io.testing.read module

This module is a collection of tests which should be implemented by all plateau.

read backends. The tests are not subject to the semantic versioning scheme and may change with minor or even patch releases.

To use the tests of this module, add the following import statement to your test module and ensure that the following fixtures are available in your test environment.

` from plateau.io.testing.read import *  # noqa `

Fixtures required to be implemented:

• output_type - One of {dataframe, metpartition, table} to define the outptu type of the returned result.

• bound_load_dataframes - A callable which will retrieve the partitions in the format specified by output_type. The callable should accept all keyword arguments expected for a plateau reader.

Source test data

• dataset - A fixture generating test data (TODO: Expose this as a testing function)

• store_factory - A function scoped store factory

• store_session_factory - A session scoped store factory

Feature toggles (optional):

The following fixtures should be present (see tests.read.conftest) * use_categoricals - Whether or not the call retrievs categorical data. * dates_as_object - Whether or not the call retrievs date columns as objects.

class plateau.io.testing.read.NoPickle

Bases: object

plateau.io.testing.read.dataset_dispatch_by(metadata_version, store_session_factory, dataset_dispatch_by_uuid)

plateau.io.testing.read.dataset_dispatch_by_uuid()

plateau.io.testing.read.dates_as_object(request)

plateau.io.testing.read.mark_nopickle(obj)

plateau.io.testing.read.no_pickle_factory(url)

plateau.io.testing.read.no_pickle_store(url)

plateau.io.testing.read.store_input_types(request, tmpdir)

plateau.io.testing.read.test_binary_column_metadata(store_factory, bound_load_dataframes)

plateau.io.testing.read.test_datetime_predicate_with_dates_as_object(dataset, store_factory, bound_load_dataframes, metadata_version, output_type, partition_on, datetype, comp)

plateau.io.testing.read.test_empty_predicate_pushdown_empty_col_projection(dataset, store_session_factory, bound_load_dataframes, backend_identifier)

plateau.io.testing.read.test_extensiondtype_rountrip(store_factory, bound_load_dataframes)

plateau.io.testing.read.test_non_default_table_name_roundtrip(store_factory, bound_load_dataframes)

plateau.io.testing.read.test_read_dataset_as_dataframes(dataset, store_session_factory, dataset_factory, use_dataset_factory, bound_load_dataframes, use_categoricals, output_type, dates_as_object)

plateau.io.testing.read.test_read_dataset_as_dataframes_columns_primary_index_only(store_factory, bound_load_dataframes, metadata_version)

plateau.io.testing.read.test_read_dataset_as_dataframes_columns_projection(store_factory, bound_load_dataframes, metadata_version)

plateau.io.testing.read.test_read_dataset_as_dataframes_dispatch_by_empty(store_session_factory, dataset_dispatch_by, bound_load_dataframes, backend_identifier, output_type, metadata_version, dataset_dispatch_by_uuid)

plateau.io.testing.read.test_read_dataset_as_dataframes_dispatch_by_multi_col(store_session_factory, bound_load_dataframes, output_type, dataset_dispatch_by, dataset_dispatch_by_uuid)

plateau.io.testing.read.test_read_dataset_as_dataframes_dispatch_by_single_col(store_session_factory, dataset_dispatch_by, bound_load_dataframes, backend_identifier, dispatch_by, output_type, metadata_version, dataset_dispatch_by_uuid)

plateau.io.testing.read.test_read_dataset_as_dataframes_predicate(dataset, store_session_factory, bound_load_dataframes, predicates, output_type)

plateau.io.testing.read.test_read_dataset_as_dataframes_predicate_empty(dataset_partition_keys, store_session_factory, output_type, bound_load_dataframes)

plateau.io.testing.read.test_read_dataset_as_dataframes_predicate_with_partition_keys(dataset_partition_keys, store_session_factory, bound_load_dataframes, predicates, output_type)

plateau.io.testing.read.test_read_dispatch_by_with_predicates(store_session_factory, dataset_dispatch_by_uuid, bound_load_dataframes, dataset_dispatch_by, dispatch_by, output_type, expected_dispatches, predicates)

plateau.io.testing.read.test_store_input_types(store_input_types, bound_load_dataframes)

plateau.io.testing.read.use_categoricals(request)

plateau.io.testing.read.use_dataset_factory(request, dates_as_object)