aligned.sources.s3.AwsS3ParquetDataSource

class documentation

class AwsS3ParquetDataSource(CodableBatchDataSource, DataFileReference, ColumnFeatureMappable): (source)

View In Hierarchy

Undocumented

Method job_group_key A key defining which sources can be grouped together in one request.
Async Method read_pandas Undocumented
Async Method to_lazy_polars Undocumented
Async Method write_pandas Undocumented
Async Method write_polars Undocumented
Class Variable config Undocumented
Class Variable mapping_keys Undocumented
Class Variable parquet_config Undocumented
Class Variable path Undocumented
Class Variable type_name Undocumented
Property storage Undocumented
Property url Undocumented

Inherited from CodableBatchDataSource:

Property as_markdown Undocumented
Class Method _deserialize Undocumented
Method _serialize Undocumented

Inherited from BatchDataSource (via CodableBatchDataSource):

Class Method multi_source_features_for Undocumented
Method __hash__ Undocumented
Method all Undocumented
Method all_between_dates Undocumented
Method all_columns Undocumented
Method all_data Undocumented
Method depends_on Undocumented
Async Method feature_view_code Setup the code needed to represent the data source as a feature view
Method features_for Undocumented
Method filter Undocumented
Async Method freshness .table("my_table") .freshness()
Method location_id Undocumented
Method needed_configs Undocumented
Async Method schema Returns the schema for the data source
Method source_id An id that identifies a source from others.
Method tags Undocumented
Method transform_with_polars Undocumented
Method with_loaded_at Undocumented
Method with_view Undocumented

Inherited from ColumnFeatureMappable (via CodableBatchDataSource, BatchDataSource):

Method columns_for Undocumented
Method feature_identifier_for Undocumented
Method with_renames Undocumented
def job_group_key(self) -> str: (source)
overrides aligned.data_source.batch_data_source.BatchDataSource.job_group_key

A key defining which sources can be grouped together in one request.

async def read_pandas(self) -> pd.DataFrame: (source)

Undocumented

async def to_lazy_polars(self) -> pl.LazyFrame: (source)

Undocumented

async def write_pandas(self, df: pd.DataFrame): (source)

Undocumented

async def write_polars(self, df: pl.LazyFrame): (source)

Undocumented

config: AwsS3Config = (source)

Undocumented

mapping_keys: dict[str, str] = (source)
overrides aligned.data_source.batch_data_source.ColumnFeatureMappable.mapping_keys

Undocumented

parquet_config: ParquetConfig = (source)

Undocumented

path: str = (source)

Undocumented

type_name: str = (source)
overrides aligned.data_source.batch_data_source.CodableBatchDataSource.type_name

Undocumented

storage: Storage = (source)

Undocumented

url: str = (source)

Undocumented