Bvh ddlmZmZmZmZddlmZmZmZm Z ddl Z ddl Z ddl mZddlZGddeeZGddeeZy) ) Embeddings DocumentsEmbeddingFunctionSpace)ListDictAnyOptionalNvalidate_config_schemaceZdZdZ ddeededefdZdedefd Z e defd Z de fd Z dee fd Ze d eeefddfdZdeeeffdZdeeefdeeefddfdZe d eeefddfdZy)HuggingFaceEmbeddingFunctionz This class is used to get embeddings for a list of texts using the HuggingFace API. It requires an API key and a model name. The default model name is "sentence-transformers/all-MiniLM-L6-v2". Napi_key model_nameapi_key_env_varc ddl}|tjdt ||_|xstj||_ |jstd|d||_ d||_ |j|_ |jjjdd |jiy#t$r tdwxYw) a Initialize the HuggingFaceEmbeddingFunction. Args: api_key_env_var (str, optional): Environment variable name that contains your API key for the HuggingFace API. Defaults to "CHROMA_HUGGINGFACE_API_KEY". model_name (str, optional): The name of the model to use for text embeddings. Defaults to "sentence-transformers/all-MiniLM-L6-v2". rNUThe httpx python package is not installed. Please install it with `pip install httpx`Direct api_key configuration will not be persisted. Please use environment variables via api_key_env_var for persistent storage.zThe z! environment variable is not set.zAhttps://api-inference.huggingface.co/pipeline/feature-extraction/ AuthorizationBearer )httpx ImportError ValueErrorwarningswarnDeprecationWarningrosgetenvrr_api_urlClient_sessionheadersupdate)selfrrrrs k/RAG/venv/lib/python3.12/site-packages/chromadb/utils/embedding_functions/huggingface_embedding_function.py__init__z%HuggingFaceEmbeddingFunction.__init__s     MM_"  /<"))O"< ||tO#44UVW W$[\f[gh    $$o7O%PQ) g  s B==Cinputreturnc|jj|j|ddidj}|Dcgc]'}t j |tj )c}Scc}w)a Get the embeddings for a list of texts. Args: input (Documents): A list of texts to get embeddings for. Returns: Embeddings: The embeddings for the texts. Example: >>> hugging_face = HuggingFaceEmbeddingFunction(api_key_env_var="CHROMA_HUGGINGFACE_API_KEY") >>> texts = ["Hello, world!", "How are you?"] >>> embeddings = hugging_face(texts) wait_for_modelT)inputsoptionsjsondtyper!postrr.nparrayfloat32r$r'response embeddings r%__call__z%HuggingFaceEmbeddingFunction.__call__6si ==%% MM!/?.FG&  $&  HPPx)"**5xPPPs,A.cy)N huggingfacer<r%namez!HuggingFaceEmbeddingFunction.nameNsr=cyNcosiner<r$s r% default_spacez*HuggingFaceEmbeddingFunction.default_spaceRr=c gdSN)rAl2ipr<rBs r%supported_spacesz-HuggingFaceEmbeddingFunction.supported_spacesU%%r=configEmbeddingFunction[Documents]cv|jd}|jd}||Jdt||S)NrrzThis code should not be reachedrr)getr)rKrrs r%build_from_configz.HuggingFaceEmbeddingFunction.build_from_configXsG **%67ZZ -  "j&8 ;; ;5++   r=c4|j|jdS)NrNrNrBs r% get_configz'HuggingFaceEmbeddingFunction.get_configds#'#7#7tWWr= old_config new_configc"d|vr tdy)NrzSThe model name cannot be changed after the embedding function has been initialized.)rr$rSrTs r%validate_config_updatez3HuggingFaceEmbeddingFunction.validate_config_updategs! : %e  &r=ct|dy) Validate the configuration using the JSON schema. Args: config: Configuration to validate Raises: ValidationError: If the configuration does not match the schema r;Nr rKs r%validate_configz,HuggingFaceEmbeddingFunction.validate_configos v}5r=)Nz&sentence-transformers/all-MiniLM-L6-v2CHROMA_HUGGINGFACE_API_KEY)__name__ __module__ __qualname____doc__r strr&rrr9 staticmethodr>rrCrrIrr rPrRrWr[r<r=r%rr s!"&B; %R#%R%R %RNQiQJQ0#u&$u+&  $sCx.  5S    XDcNXsCx.6:38n  6S#X 64 6 6r=rceZdZdZ ddedeedeefdZdedefd Z e defd Z de fd Z dee fd Ze d eeefddfdZdeeeffdZdeeefdeeefddfdZe d eeefddfdZy)HuggingFaceEmbeddingServerz This class is used to get embeddings for a list of texts using the HuggingFace Embedding server (https://github.com/huggingface/text-embeddings-inference). The embedding model is configured in the server. Nurlrrc ddl}|tjdt ||_||_|j)|xstj|j|_ n||_ ||_ |j|_ |j5|jjjdd|jiyy#t$r tdwxYw)aa Initialize the HuggingFaceEmbeddingServer. Args: url (str): The URL of the HuggingFace Embedding Server. api_key (Optional[str]): The API key for the HuggingFace Embedding Server. api_key_env_var (str, optional): Environment variable name that contains your API key for the HuggingFace API. rNrrrr)rrrrrrrerrrrrr r!r"r#)r$rerrrs r%r&z#HuggingFaceEmbeddingServer.__init__s     MM_"  .    +"Ebii0D0D&EDL"DL%   << # MM ! ! ( (/WT\\N;S)T U $/ g  s C C r'r(c|jj|jd|ij}|Dcgc]'}t j |tj )c}Scc}w)a Get the embeddings for a list of texts. Args: input (Documents): A list of texts to get embeddings for. Returns: Embeddings: The embeddings for the texts. Example: >>> hugging_face = HuggingFaceEmbeddingServer(url="http://localhost:8080/embed") >>> texts = ["Hello, world!", "How are you?"] >>> embeddings = hugging_face(texts) r+r-r/r1r6s r%r9z#HuggingFaceEmbeddingServer.__call__sZ ==%%dmm8U:K%LQQSHPPx)"**5xPPPs,A+cy)Nhuggingface_serverr<r<r=r%r>zHuggingFaceEmbeddingServer.names#r=cyr@r<rBs r%rCz(HuggingFaceEmbeddingServer.default_spacerDr=c gdSrFr<rBs r%rIz+HuggingFaceEmbeddingServer.supported_spacesrJr=rKrLcz|jd}|jd}| tdt||S)Nrerz3URL must be provided for HuggingFaceEmbeddingServerrer)rOrrd)rKrers r%rPz,HuggingFaceEmbeddingServer.build_from_configs=jj **%67 ;RS S)c?SSr=c4|j|jdS)NrmrmrBs r%rRz%HuggingFaceEmbeddingServer.get_configsxxD4H4HIIr=rSrTcHd|vr|d|jk7r tdyy)NrezLThe URL cannot be changed after the embedding function has been initialized.)rerrVs r%rWz1HuggingFaceEmbeddingServer.validate_config_updates5 J :e#4#@^ $A r=ct|dy)rYriNr rZs r%r[z*HuggingFaceEmbeddingServer.validate_configs v';rrCrrIrr rPrRrWr[r<r=r%rdrd}s&*.!% (V (V"#(V# (VTQiQJQ*$#$$u&$u+&T$sCx.T5STTJDcNJsCx.6:38n  =S#X =4 = =r=rd)chromadb.api.typesrrrrtypingrrr r rnumpyr3*chromadb.utils.embedding_functions.schemasr rrrdr<r=r%rusFNN,, Mq6#4Y#?q6ho=!29!=o=r=