aligned.sources.redis.RedisStreamSource

class documentation

class RedisStreamSource(StreamDataSource, SinkableDataSource, ColumnFeatureMappable): (source)

View In Hierarchy

Undocumented

Method consumer Returns a consumer that actually can load data
Method make_redis_friendly Undocumented
Method map_values Undocumented
Method with_coder Undocumented
Async Method write_to_stream Undocumented
Class Variable config Undocumented
Class Variable name Undocumented
Class Variable topic_name Undocumented
Instance Variable mapping_keys Undocumented
Instance Variable record_coder Undocumented

Inherited from StreamDataSource:

Class Method _deserialize Undocumented
Method _serialize Undocumented

Inherited from ColumnFeatureMappable (via StreamDataSource, SinkableDataSource):

Method columns_for Undocumented
Method feature_identifier_for Undocumented
Method with_renames Undocumented
def consumer(self, from_timestamp: str | None = None) -> ReadableStream: (source)
overrides aligned.data_source.stream_data_source.StreamDataSource.consumer

Returns a consumer that actually can load data

E.g: ```python redis_config = RedisConfig(env_var="REDIS_URL")

consumer = redis_config.consumer() ```

Returns:
ReadableStream: A stream you can read records from
def make_redis_friendly(self, data: pl.LazyFrame, features: set[Feature]) -> pl.LazyFrame: (source)

Undocumented

def map_values(self, mappings: dict[str, str]) -> RedisStreamSource: (source)

Undocumented

def with_coder(self, coder: RecordCoder) -> RedisStreamSource: (source)

Undocumented

async def write_to_stream(self, job: RetrivalJob): (source)
overrides aligned.data_source.stream_data_source.SinkableDataSource.write_to_stream

Undocumented

config: RedisConfig = (source)

Undocumented

name: str = (source)
overrides aligned.data_source.stream_data_source.StreamDataSource.name

Undocumented

topic_name: str = (source)
overrides aligned.data_source.stream_data_source.StreamDataSource.topic_name

Undocumented

mapping_keys: dict[str, str] = (source)
overrides aligned.data_source.batch_data_source.ColumnFeatureMappable.mapping_keys

Undocumented

record_coder: RecordCoder = (source)

Undocumented