module documentation

Undocumented

Class OpenAiConfig Undocumented
Class OpenAiEmbeddingPredictor Undocumented
Class OpenAiExtractModel Undocumented
Class OpenAiPromptModel Undocumented
Async Function chunk_batch_embedding_request Undocumented
Async Function embed_texts Undocumented
Async Function make_batch_embedding_request Undocumented
Function write_batch_request Creates a .jsonl file for batch processing, with each line being a request to the embeddings API.
Variable logger Undocumented
async def chunk_batch_embedding_request(texts: list[str], model: str, client: AsyncClient) -> pl.DataFrame: (source)

Undocumented

async def embed_texts(texts: list[str], model: str, skip_if_n_chunks: int | None, client: AsyncClient) -> list[list[float]] | str: (source)

Undocumented

async def make_batch_embedding_request(texts: list[str], model: str, client: AsyncClient) -> pl.DataFrame: (source)

Undocumented

def write_batch_request(texts: list[str], path: Path, model: str, url: str): (source)

Creates a .jsonl file for batch processing, with each line being a request to the embeddings API.

Undocumented