lacethespace@sh.itjust.worksEnglish · 1 year agoWhich models do you use daily?plus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareWhich models do you use daily?plus-squarelacethespace@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
actually-a-cat@sh.itjust.worksEnglish · edit-21 year agokobold.cpp now supports NTK scaling and it worksplus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squarekobold.cpp now supports NTK scaling and it worksplus-squareactually-a-cat@sh.itjust.worksEnglish · edit-21 year agomessage-square0fedilink
Mixel@feddit.deEnglish · 1 year agobest method do use amd GPU for inference on linuxplus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squarebest method do use amd GPU for inference on linuxplus-squareMixel@feddit.deEnglish · 1 year agomessage-square0fedilink
notfromhere@lemmy.oneEnglish · 1 year agoVicuna-33B-1-3-SuperHOT-8K-GPTQplus-squarehuggingface.coexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkVicuna-33B-1-3-SuperHOT-8K-GPTQplus-squarehuggingface.conotfromhere@lemmy.oneEnglish · 1 year agomessage-square0fedilink
noneabove1182@sh.itjust.worksEnglish · 1 year agoOpenOrca, an open-source dataset and series of instruct-tuned language modelsplus-squareerichartford.comexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkOpenOrca, an open-source dataset and series of instruct-tuned language modelsplus-squareerichartford.comnoneabove1182@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
noneabove1182@sh.itjust.worksEnglish · 1 year agoKoboldcpp 1.33 released and dockerizedplus-squaregithub.comexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkKoboldcpp 1.33 released and dockerizedplus-squaregithub.comnoneabove1182@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
Matburnx@sh.itjust.worksEnglish · 1 year agoTorch models download path ?plus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareTorch models download path ?plus-squareMatburnx@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
emasters@sh.itjust.worksEnglish · 1 year agoSalesforce gets into the open source LLM gameplus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareSalesforce gets into the open source LLM gameplus-squareemasters@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
Wilshire@sh.itjust.worksEnglish · 1 year agoMosaicML Launches 30B Model — Takes on LLaMA, Falcon and GPTplus-squarethenewstack.ioexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkMosaicML Launches 30B Model — Takes on LLaMA, Falcon and GPTplus-squarethenewstack.ioWilshire@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
SkySyrup@sh.itjust.worksMEnglish · 1 year agoPruning LLMs with Wanda, minimal degredationplus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squarePruning LLMs with Wanda, minimal degredationplus-squareSkySyrup@sh.itjust.worksMEnglish · 1 year agomessage-square0fedilink
noneabove1182@sh.itjust.worksEnglish · 1 year agoMicrosoft makes new 1.3B coding LLM that outperforms all models on MBPP except GPT-4, reaches third place on HumanEval above GPT-3.5, and shows emergent propertiesarxiv.orgexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkMicrosoft makes new 1.3B coding LLM that outperforms all models on MBPP except GPT-4, reaches third place on HumanEval above GPT-3.5, and shows emergent propertiesarxiv.orgnoneabove1182@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
noneabove1182@sh.itjust.worksEnglish · 1 year agoAnnouncing GPTQ & GGML Quantized LLM support for Huggingface Transformers – PostgresMLplus-squarepostgresml.orgexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkAnnouncing GPTQ & GGML Quantized LLM support for Huggingface Transformers – PostgresMLplus-squarepostgresml.orgnoneabove1182@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
noneabove1182@sh.itjust.worksEnglish · 1 year agoUpdate to my text-generation-webui docker image - now with ExLlama support!plus-squarehub.docker.comexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkUpdate to my text-generation-webui docker image - now with ExLlama support!plus-squarehub.docker.comnoneabove1182@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
noneabove1182@sh.itjust.worksEnglish · edit-21 year agoOptimalScale's new Robin v2 models by TheBlokeplus-squaretwitter.comexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkOptimalScale's new Robin v2 models by TheBlokeplus-squaretwitter.comnoneabove1182@sh.itjust.worksEnglish · edit-21 year agomessage-square0fedilink
django@sh.itjust.worksEnglish · 1 year agoAny way to prune LLMs?plus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareAny way to prune LLMs?plus-squaredjango@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
flamdragparadiddle@sh.itjust.worksEnglish · 1 year agoCan someone smarter than me figure out how to add a generic API to Gorilla7B?plus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareCan someone smarter than me figure out how to add a generic API to Gorilla7B?plus-squareflamdragparadiddle@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
noneabove1182@sh.itjust.worksEnglish · 1 year agoMore docker images! Now for oobabooga's text-generation-webui, CPU and GPU versionsplus-squarehub.docker.comexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkMore docker images! Now for oobabooga's text-generation-webui, CPU and GPU versionsplus-squarehub.docker.comnoneabove1182@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
Yahma@kbin.social · 1 year agoRobin V2 reaches top of Open LLM leaderboardplus-squaremedium.comexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkRobin V2 reaches top of Open LLM leaderboardplus-squaremedium.comYahma@kbin.social · 1 year agomessage-square0fedilink
noneabove1182@sh.itjust.worksEnglish · 1 year agoDocker image for koboldcppplus-squarehub.docker.comexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkDocker image for koboldcppplus-squarehub.docker.comnoneabove1182@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink
noneabove1182@sh.itjust.worksEnglish · 1 year agoSlimPajama: A 627B token cleaned and deduplicated version of RedPajama - Cerebrasplus-squarewww.cerebras.netexternal-linkmessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkSlimPajama: A 627B token cleaned and deduplicated version of RedPajama - Cerebrasplus-squarewww.cerebras.netnoneabove1182@sh.itjust.worksEnglish · 1 year agomessage-square0fedilink