Spyke

Posts

localllama·LocalLLaMAbyMatburnx

Training a model without a GPU

Hi, I'm currently starting to learn how LLM works in depth, so I started using nanoGPT to understand how to train a model and I'd like to play around with the code a little more. So I set myself a goal to train a model that can write basic French, it doesn't to be coherent or deep in its writing, just French with correct grammar. I only have a laptop that doesn't have a proper GPU, so I can't really train a model with billions of parameters. Do you think it's possible without too much dataset or intensive training? Is it a better idea if I use something different from nanoGPT?

TLDR: I'd like to train my own LLM on my laptop which doesn't have a GPU. It's only for learning purpose, so my goal is that it can write basic French. Is it doable? If it is, do you have any tips to make this easier?

View original on sh.itjust.works
14
localllama·LocalLLaMAbyMatburnx

Torch models download path ?

This might seem like a dumb question, but my disk space is currently pretty low and I'd like to clean some of my files.

A lot of space has been taken by the models I downloaded with different projects like the one from oobabooga or LocalGPT, however I can't find the file where they were downloaded. So I'd like to know if anyone knows where it is.

I'm on Windows if it changes anything. Thanks in advance for your answers

View original on sh.itjust.works
9

You reached the end