Return an absolute local path for a local file/directory, for a network related path, return as is.
Return loader type among, file, dir or in-memory.
Return an absolute source path of source of loader based on the keys present in Document.
Fetch the current Framework and Runtime details.
Fetch local runtime ip address.
Generate batches of documents based on page_content size. Args: docs: List of documents to be batched. max_batch_size: Maximum size of each batch in bytes. Defaults to 100*1024(100KB) Returns: List[List[Document]]: List of batches of documents
Fetch owner of local file path.
Fetch size of source path. Source can be a directory or a file.
Calculate the content size in bytes:
