message_data.py

Source: sunholo/chunker/message_data.py

Functions

handle_azure_blob(message_data: str, metadata: dict, vector_name: str)

Processes a message from Azure Blob storage, downloads the file, processes it, and returns chunks and metadata.

Args: message_data (str): URL of the Azure blob. metadata (dict): Metadata associated with the file. vector_name (str): Vector name for processing.

Returns: chunks (list): List of document chunks. metadata (dict): Updated metadata.

handle_gcs_message(message_data: str, metadata: dict, vector_name: str)

No docstring available.

handle_github_message(message_data: str, metadata: dict, vector_name: str)

No docstring available.

handle_google_drive_message(message_data: str, metadata: dict, vector_name: str)

No docstring available.

handle_http_message(message_data: str, metadata: dict, vector_name: str)

No docstring available.

handle_json_content_message(message_data: dict, metadata: dict, vector_name: str)

No docstring available.