Long Sequence Modeling with XGen: A 7B LLM Trained on 8K Input Sequence Length -- https://blog.salesforceairesearch.com/xgen/
3 replies
Have they mentioned if they will be releasing larger models?
Seems like they're sticking with the 7b series for the time being.
Honest question, who trusts Salesforce doing something good, unless Salesforce bought it ready?