Salesforce gets into the open source LLM game
Long Sequence Modeling with XGen: A 7B LLM Trained on 8K Input Sequence Length -- https://blog.salesforceairesearch.com/xgen/
View original on sh.itjust.works
Long Sequence Modeling with XGen: A 7B LLM Trained on 8K Input Sequence Length -- https://blog.salesforceairesearch.com/xgen/
Have they mentioned if they will be releasing larger models?
Seems like they're sticking with the 7b series for the time being.
Honest question, who trusts Salesforce doing something good, unless Salesforce bought it ready?