aligned.sources.azure_blob_storage.AzureBlobCsvDataSource

class documentation

class AzureBlobCsvDataSource(CodableBatchDataSource, DataFileReference, ColumnFeatureMappable, AzureConfigurable): (source)

View In Hierarchy

Undocumented

Class Method multi_source_features_for Undocumented
Method all_between_dates Undocumented
Method all_data Undocumented
Method features_for Undocumented
Method job_group_key A key defining which sources can be grouped together in one request.
Async Method schema Returns the schema for the data source
Async Method to_lazy_polars Undocumented
Async Method to_pandas Undocumented
Method with_view Undocumented
Async Method write Undocumented
Async Method write_pandas Undocumented
Async Method write_polars Undocumented
Class Variable config Undocumented
Class Variable csv_config Undocumented
Class Variable date_formatter Undocumented
Class Variable mapping_keys Undocumented
Class Variable path Undocumented
Class Variable type_name Undocumented
Property storage Undocumented
Property to_markdown Undocumented

Inherited from CodableBatchDataSource:

Class Method _deserialize Undocumented
Method _serialize Undocumented

Inherited from BatchDataSource (via CodableBatchDataSource):

Method __hash__ Undocumented
Method all Undocumented
Method all_columns Undocumented
Method depends_on Undocumented
Async Method feature_view_code Setup the code needed to represent the data source as a feature view
Method filter Undocumented
Async Method freshness .table("my_table") .freshness()
Method location_id Undocumented
Method source_id An id that identifies a source from others.
Method tags Undocumented
Method transform_with_polars Undocumented
Method with_loaded_at Undocumented

Inherited from ColumnFeatureMappable (via CodableBatchDataSource, BatchDataSource):

Method columns_for Undocumented
Method feature_identifier_for Undocumented
Method with_renames Undocumented
@classmethod
def multi_source_features_for(cls, facts: RetrivalJob, requests: list[tuple[AzureBlobCsvDataSource, RetrivalRequest]]) -> RetrivalJob: (source)
overrides aligned.data_source.batch_data_source.BatchDataSource.multi_source_features_for

Undocumented

def all_between_dates(self, request: RetrivalRequest, start_date: datetime, end_date: datetime) -> RetrivalJob: (source)
overrides aligned.data_source.batch_data_source.BatchDataSource.all_between_dates

Undocumented

def all_data(self, request: RetrivalRequest, limit: int | None) -> RetrivalJob: (source)
overrides aligned.data_source.batch_data_source.BatchDataSource.all_data

Undocumented

def features_for(self, facts: RetrivalJob, request: RetrivalRequest) -> RetrivalJob: (source)
overrides aligned.data_source.batch_data_source.BatchDataSource.features_for

Undocumented

def job_group_key(self) -> str: (source)
overrides aligned.data_source.batch_data_source.BatchDataSource.job_group_key

A key defining which sources can be grouped together in one request.

async def schema(self) -> dict[str, FeatureType]: (source)
overrides aligned.data_source.batch_data_source.BatchDataSource.schema

Returns the schema for the data source

`python source = FileSource.parquet_at('test_data/titanic.parquet') schema = await source.schema() >>> {'passenger_id': FeatureType(name='int64'), ...} `

Returns:
dict[str, FeatureType]: A dictionary containing the column name and the feature type
async def to_lazy_polars(self) -> pl.LazyFrame: (source)

Undocumented

async def to_pandas(self) -> pd.DataFrame: (source)

Undocumented

def with_view(self, view: CompiledFeatureView) -> AzureBlobCsvDataSource: (source)
overrides aligned.data_source.batch_data_source.BatchDataSource.with_view

Undocumented

async def write(self, job: RetrivalJob, requests: list[RetrivalRequest]): (source)

Undocumented

async def write_pandas(self, df: pd.DataFrame): (source)

Undocumented

async def write_polars(self, df: pl.LazyFrame): (source)

Undocumented

config: AzureBlobConfig = (source)
overrides aligned.sources.azure_blob_storage.AzureConfigurable.config

Undocumented

csv_config: CsvConfig = (source)

Undocumented

date_formatter: DateFormatter = (source)

Undocumented

mapping_keys: dict[str, str] = (source)
overrides aligned.data_source.batch_data_source.ColumnFeatureMappable.mapping_keys

Undocumented

path: str = (source)

Undocumented

type_name: str = (source)
overrides aligned.data_source.batch_data_source.CodableBatchDataSource.type_name

Undocumented

@property
storage: Storage = (source)

Undocumented

@property
to_markdown: str = (source)

Undocumented