When I try to download this embedding model I encounter a sigterm. This does not happen when running on my M1 Macbook Air but does when running on a huggingface space with upgraded CPU and persistent memory. Any help would be appreciated!
Code
model = "BAAI/bge-base-en-v1.5"encode_kwargs = {"normalize_embeddings": True}embeddings = HuggingFaceBgeEmbeddings( model_name=model, encode_kwargs=encode_kwargs, model_kwargs={"device": "cpu"})Error
tokenizer.json: 100%|██████████| 711k/711k [00:00<00:00, 45.3MB/s]tokenizer_config.json: 0%| | 0.00/366 [00:00<?, ?B/s]tokenizer_config.json: 100%|██████████| 366/366 [00:00<00:00, 335kB/s]vocab.txt: 0%| | 0.00/232k [00:00<?, ?B/s]vocab.txt: 100%|██████████| 232k/232k [00:00<00:00, 49.4MB/s]modules.json: 0%| | 0.00/349 [00:00<?, ?B/s]modules.json: 100%|██████████| 349/349 [00:00<00:00, 214kB/s][nltk_data] Downloading package punkt to /home/user/nltk_data...[nltk_data] Unzipping tokenizers/punkt.zip.[nltk_data] Downloading package averaged_perceptron_tagger to[nltk_data] /home/user/nltk_data...[nltk_data] Unzipping taggers/averaged_perceptron_tagger.zip.[2023-12-31 02:14:14 +0000] [1] [CRITICAL] WORKER TIMEOUT (pid:7)[2023-12-31 02:14:14 +0000] [7] [INFO] Worker exiting (pid: 7)[2023-12-31 02:14:15 +0000] [1] [ERROR] Worker (pid:7) was sent SIGKILL! Perhaps out of memory?[2023-12-31 02:14:15 +0000] [173] [INFO] Booting worker with pid: 173