Spyke

Best practices for navigating file structure via terminal?

I've just started my Linux journey earlier this year. As a goal to learn how to self-host applications and services that will allow me to take back some control of my data. Immich instead of Google Photos, for example.

I have a local server running Unraid and 22 docker containers now. And then a VPS (Ubuntu 20.04 LTS) running two apps. I've learned a ton but one thing I can't seem to wrap my brain around is navigation through the file structure using only terminal. My crutch has been to open a SFTP session in Cyberduck to the same device I'm SSH'd to and try to figure things out that way. I know enough to change directories, make directories, using Tree to show the file structure at different levels of depth. But I feel like I'm missing some efficient way to find my way to files and folders I need to get to. Or are y'all just memorizing it and know where everything is by now?

I come from a Windows background and even then I sometimes catch myself checking via explorer where a directory is instead of using CMD or PowerShell to find it.

I'd love to hear any tips or tricks!

EDIT: I've been using Termius because they have a great Android client, but I wasn't about to pay $5/mo for sync. Especially to sync to someone else's cloud. Which led me to Tabby, which I understand has quite a large footprint resource-wise. But I guess I either don't know enough yet to be mad about it or it hasn't impacted any of my systems negatively yet. No Android client though, but you can bring your own sync solution and it has a handy little shortcut to SFTP to the current directory you're in. Between that and stuff like ranger, it's made it so much easier to learn my way around!

View original on lemmy.ml
lemmy.ml

I think it’s just a matter of getting used to it. I had the same issue at first and the more I used the command line, the more I started to prefer it to GUI apps for certain tasks.

A couple things that I use all the time:

  • tab completion is incredible
  • cd - goes back to the last directory you were in (useful for bouncing back and forth between locations)
  • !$ means the last argument. So if you ls ~/Downloads and then decide you want to go there, you can cd !$.
  • :h removes the last piece of a path. So I can do vim /etc/network/interfaces and then cd !$:h will take me to /etc/network.
66

Besides using !$, alt+. on bash copies the last argument into the line you are typing, which might be better if you want to edit it.

13
lemmy.ml

I've used the cd - several times, it is very handy. the others are new to me so I'll check it out.

5

I might be wrong here, but "cd" without any arguments works as "cd -" for me.

0
ExLisperreply
linux.community

!$ means the last argument. So if you ls ~/Downloads and then decide you want to go there, you can cd !$.

Nice, I usually do !!:n. This is a lot better.

3
datavoidreply
lemmy.ml

Nothing like extremely cryptic shell scripts

2

Not sure if you just misread the commands or not, but that's a pretty different usecase than what they're describing.

1
aussie.zone

You're pressing the tab key for auto completion right?

52
lemmy.ml

Um...no. I'll admit I didn't know that was an option. Weirdly I do it all the time in PowerShell. Though I am using Termius right now and at least on Android it doesn't support tab auto complete. That said, it does auto suggest as you type to get you in the ballpark. I'll have to try it again from my PC once I get my office put back together.

11
einsteinx2reply
programming.dev

I use Termius on iOS and double tapping the screen sends a tab (I may have enabled it in settings but I don’t think so). I think you can also put a button for it above the keyboard. In any case it does work for tab completion. I know I’m on iOS and not Android but I’d be really surprised if the Android version had no way to send a tab…

5
lemmy.ml

You are correct, I just tried it. I have a keyboard on my Galaxy Tab S7+ and it will recognize the Tab key in normal text entry fields but doesn't seem to work in Termius. The double tap is pretty clutch!

2
SnachBarrreply
lemm.ee

Why use a separate command when “cd -“ works just fine to take you to the previous directory

8
teawrecksreply
sopuli.xyz
cd a
cd b
cd c
popd
popd
// you're now in "a"
cd a
cd b
cd c
cd -
cd -
// you're now in "c" and need to manually cd to "a"
10
z3brareply
lemmy.sdf.org

You mean

cd a
pushd b
pushed c
popd
popd

Right ?

Depending on your shell, pushd/popd might not be an option. For a similar functionality, I like to use a subshell which is portable across all shells:

cd a
$SHELL
cd b
cd c
# do work here
^D
# you're back in "a"
3

Ah, I guess I have auto_pushd enabled in zsh, so it just happens when I cd. TIL.

3
feddit.nl

I am old and I like ‘mc’ (Midnight Commander) a lot when doing many/complex file operations

21

Reminder that mc has the ability to make directory bookmarks (Ctrl + /).

5

Others have mentioned using interactive tools like zoxide to easily get to frequently visited directories.

In addition, I also use nnn (https://github.com/jarun/nnn), which is a terminal file manager that you can navigate through. You can create shortcuts, snippets and bookmarks with this. I use this and zoxide + fzf regularly on CLI to navigate.

Some here also mention ranger, which is another terminal file manager. In my limited experience with ranger, I feel like the start up time is much slower than nnn; but I haven’t tried much. Tho with ranger + graphic-accelerated terminals like kitty, I believe you can preview images and files, which seems to be a great feature. So it depends on your need.

21
feddit.nl

Something I haven't seen mentioned here is Ctrl + R on the command line to quick-search history. You start typing/backspacing and it shows the most recent matching history entry. Press Ctrl + R or Ctrl + Shift + R to navigate up and down through matching entries. Press Enter to pick an entry, Ctrl + C to cancel.

18

Also, if OP is new, they may not yet be aware of aliases and functions. Generally you'd out those in a ~/.bashrc file that gets automatically executed when a terminal starts. They'll allow you to save a more complex command as a really simple one. And particularly can be useful when things you want to run are in unusual directories. Eg, maybe you have a git repo somewhere that contains some project you spend most of your time on, so you could have an alias that just cd's you to it's directory. Git also has its own way of doing aliases and that's really nifty for the more complicated git commands (or the more commonly used, like st for status).

7

I saw that mentioned in another comment and I've been testing it out while I try to get Cryptpad installed on my VPS and its very nice!

5

You can also make this the default behaviour as you start typing a command.

Create ~/.inputrc and add these lines:

$include /etc/inputrc

## arrow up
"\e[A":history-search-backward
## arrow down
"\e[B":history-search-forward```
3
lemmy.sdf.org
  • ls / cd for basic stuff

  • fzf if I want to find my way through the history

  • broot if I want to search for a file

  • ripgrep if I want to find a file with specific contents.

I know that the last 3 are not available by default, but they are good pieces of software, so I'm just going to install them.

17
feddit.de

I did 4 things, that helped me a lot:

  1. Make aliases for the most visited directories

alias cem=’cd /home/drops/.config/emacs’

  1. Make aliases for moving up the tree tree:

alias. .=’cd. . && ls’

Three points for two levels up, etc...

  1. Name all directories lowercase, 3-5 letters long, and try to avoid directories with the same starting letter as siblings That way you can use tab completion with just a single letter

  2. Use the option to jump to subdirectories of /home/user from everywhere.

16

Instead of aliases, I use variables that I set in my .bashrc.

For example, on WSL I have export WINDOWS_HOME=/mnt/c/Users/username. Then I can just cd $WINDOWS_HOME. Or cp $WINDOWS_HOME/Downloads/some_file .

4
Ricazreply
lemmy.ml

Instead of aliases, I just have lots of symlinks in my homedir.

I do have .. and ... aliases though.

Mostly if I'm gonna work with files I just use ranger, or FZF from my shell to find stuff.

2

Ranger looks like how my brain wants to work. I'll have to check that out. I like the idea of symlinks too.

1
thelemmy.club

Not strictly file browsing advice, but you can quickly search for previously issued commands by hitting ctrl-r and starting to type. (and you can press it again to search further back)

15
SandySocksreply
lemmy.world

Can't believe I've never heard of this before, thanks for the tip!

5

I just use ls, cd, tree and tab completion. Sometimes I will use rg to find files which contains specified string, and use locate to find files which I known name but path.

11
lemmy.ml

For navigating files quickly fzf is pretty much crucial to my workflow. Being able to get my home directory to the directory of the project I want to work on in two seconds flat is such a nice feeling after manually typing the path in for months. https://github.com/junegunn/fzf

11
skimmreply
lemmy.sdf.org

I've got to agree. It's replaced z for me and its just a great multipurpose tool

5

I'm using both of them:) zoxide comes with a zi command which lets you search through your recent directories

3

Agreed, fzf (and similar fuzzy finders) have been a game-changer with regards to the way in which I navigate the shell. Add in a couple of one-liners and I'm never more than a second away from any nested directory

Here are some of the most used aliases in my configs if anyone would like to try it out

Note that they use fd and exa but they can easily be swapped out for find and ls if those aren't available on your system (which would allow for shorter aliases since they're the fzf defaults IIRC)

alias update-cdd='fd -Ha -td -d1 -E "\.config" -E "\.local" "^\." ~ > ~/.cddignore'

alias cdd='cd "$(fd -H -td --ignore-file ~/.cddignore . ~ | fzf --preview "exa -lF --no-permissions {}" --tiebreak=length,end,begin --preview-window=up,20%)"'

alias cdf='cd "$(fd -H -tf --ignore-file ~/.cddignore . ~ | fzf --preview "bat --style=header-filename,header-filesize -r 40: --color=always {}" --tiebreak=length,end,begin --preview-window=up,20% | xargs dirname)"'
1
kbin.social

But after the 2.5 years it takes to build the Windows index wouldn't it be the same - just searching through a built index?

11

It's been a while since I've had a Windows machine, but doesn't Windows index the content of files as well as their names? If so, that would have fairly profound differences from slocate.

4
whodatdairreply
lemm.ee

lol i remember hunting and systematically ripping out the file indexer in like vista? I think? It was terrible lol

3

It was honestly hilarious how bad it was and how much it could slow the system down in some situations. I'd be curious to see just how much of it was a byproduct of HDD's - that is to say, just how slow is it even in solid state drives!

5

Unless you use everything (that's what the software is called) to search.

It's so fast I'm amazed why microsoft can't have something similar out of the box.

2
sh.itjust.works

Check out ranger fm, helps navigate through files very quickly, also has a ton of features

10

lf sounds interesting, too. Haven't tried it yet. The link is a guide on migrating from ranger.

1

To navigate quickly between directories in ssh, I recommend you using zoxide as cd replacement.

Zoxide remembers the directories you visited, then you can jump to them very quickly.

9

There are a few directory structures I have memorized, like my programming projects for instance. For everything else, I use the GUI. That's what it's there for. Mixing and match to get the best of both worlds. Some handy tips:

  • xdg-open will act like clicking on a file in the GUI, and is an easy way to open folders from the terminal when you want to browse them.
  • Use sshfs or even just whatever is built into your desktop environment to connect to remote servers and browse them
  • Most terminals let you drag files or folders into them to paste their paths
9
lemmy.sdf.org

Not necessarily navigation, but ncdu will give the total size of your directories. It's a simple but very useful tool

9

Oh that is handy. I've been trying to figure out wtf is taking up so much room on my VPS that's only running Miniflux and Wallabag.

5

Useful one I find is the z program you can install it with package manager and it's also included with zsh shell. It's basically like a smart cd command. Instead of having to type the entire path for cd, when using z you can just type the destination folder and if it's in your history it will resolve the path by itself.

8
lemmy.ml

I use ls and ranger, to find files i use find -name and remember that * is used as a wildcard so you can use it when searching for stuff with in incomplete filename or when copying or moving files/directories. You could also use colorls to add some flare to your ls, and oh-my-zsh for syntax highlighting and tab autocomplete

7
nathrisreply
lemmy.ca

I know there is probably a historical reason but I hate how find parses its arguments.

Any other app would be fine --name or find -n.

Every time I use it I have to spend a few minutes checking the results to make sure that it's actually doing what I want it to do.

5

That's one of the reasons why the more modern fd is a nice alternative: it accepts command line args as you'd expect.

4

Depending on system, something like locate/mlocate might be installed, and is almost certainly available if the following seems like a good idea.

Tools/daemons like them are quicker for finding files - basically because they index all files except those in specified places. (Or potentially only those in specified places depending on tool/configuration.)

That way, rather than find -name 'some_wildcard_string', it's instead locate 'partial_filename_match or locate --regex 'some_regex_string'.

As for speed: locate / | wc -c returned 565035, the count of files currently indexed by mlocate on my computer, in 0.3 seconds. Quite a bit quicker than find! (locate / literally returns any file with a / in the full pathname, which basically means every single file in its DB).

2

@craigevil @Father_Redbeard

Hi I use Ranger in BASH terminal a lot, let me weigh in on how very useful it is and how easy to customize to my needs it has been. There is a similar app written in C++ But I couldn't script it as easy. Until I found Ranger I also used MC as my workhorse.

1

mc is killer. All the features of a desktop file manager but in your terminal!

1
lemmy.world

Just using "cd -" to go back where you were is useful.

history command and ! and the number in history, like

!123

For instance, it's useful

5
lemmy.world

pushd and popd are good for keeping a history and going back to different directories.

4
bayazreply
kbin.social

If you like those, using cdr within zsh is amazing. It automatically keeps track of where you've been, and you can set up tab completion to show the history with a number next to each directory for easy switching.

Iirc, that was my main reason for switching to zsh a few years ago

4

That's really cool. I guess the only advantage is pushd and popd is that they're usually already installed.

2

you can also put !! for the most recent history entry, useful if you forget to put sudo

3

I love ranger. Mostly I just use the basic shell, but when I'm doing a lot of random file transfer, seeing what I'm doing with ranger is nice.

It's super fast and intuitive if you're already into vim and vim-style keybindings.

2
lemmy.ml

I just type ls everytime I cd into something. It's not that efficient honestly but I usually remember where I want to go after going there a couple times. Also if you hit tab twice after typing cd and a space, it shows all of the files in the directory.

5
z3brareply
lemmy.sdf.org

I think pressing TAB sends Alt+I to the terminal so yeah.

2
z3brareply
lemmy.sdf.org

Forgot a word sorry. I said pressing TAB or Alt+I are the same thing. But I was mistaken, it's tab and Ctrl+I.

2
lemmy.ml

That's where I'm at now. And it does work. But I knew there had to be something out in the wild that folks use to traverse or at least understand where they are better. I do like Tree for a more in depth ls though. I don't recall the options you can throw at the end of tree off the top of my head but you can specify how many layers you want to go down to see a visual of the file structure.

2

Problem with most tips and tricks is that they require customizations to the OS. Many people who use Linux in a more advanced fashion, tend to also use lots of different systems, e.g. because they're a system administrator. And you don't want to have to make customizations to every system just to be able to get around. So, you learn to work with the lowest common denominator (mostly POSIX commands).

Many of us do still choose to make some customizations to our most used systems, but yeah, we try to keep it lightweight and mostly just utilize tools that aid in using the POSIX commands, not replace them.

5

exa is a nice alternative to ls and tree commands. Just add an alias to them based on the views you want.

But like other comment points out avoid lots of customization if you work on various shared systems, esp SSHing in.

With my keyboard layout and other keybind customizations my system is pretty unusable to others except basic mouse on browser. Like wise i have trouble using others' systems and need to setup any new installs to a precise way before able to work. Slightly regret going too much into customization in certain aspects.

2
lemmy.ml

You can quickly display the filesystem hierarchy using the tree command.

5

Yeah I've been messing with that. I like that you can limit how deep you want to go, like if you just want to see folders but not the files within, for example.

5

Look into your shell’s tab completion abilities, the find command, and fzf. There’s also stuff like midnight commander but I find that to be a little overkill for my tastes.

4
lemm.ee

Not to be "that guy", but you can use a gui file manager to access your files the same way you do so in windows. Most of them support ssh keys as well. If you'd like to check out the cli stuff, nnn or ranger can be useful. Something like midnight as abckup is good too. Definitely install fzf on both your vps and local machine. You can also go over board and run xorg over ssh and run a small window manager, maybe awesomewm or even xfce (not that small but works fine).

4
lemmy.ml

I was speaking more towards my VPS , which of course has no OS GUI. In Unraid I do use the very nice GUI regularly though.

3

There are tools like sshfs that let you mount remote directories as if they're local. Most of the time I tend to use nnn with some of the little extra bits you can find in the docs like cd to last directory on quit and multi-colored tabs etc.

2

On my personal computer, zoxide, fzf, fzf tab completion allow me to jump around anywhere quite easily, I still use exa/cd for the most part. Look into this if you need more visualization. I still use a GUI file browser from time to time.

Oh my server though, I still use the default shell, so yes I just memorize where things are. But a trick is to allow for a large history file, and I use the command history search (Ctrl-R) because I tend to run the same things constantly. My setup helps too, I run things in docker, and have a data and a config directory, things go into each accordingly, and I bind mount those directories instead of using volumes.

If you edit config files a lot, in vim or nvim, :bro old will give you a list of files you recently edited and you can jump to them by inputting a number.

3

Yes. It's (cd -) in most cases much more convenient.

3

I'm surprised I didn't see fasd fasd (pronounced 'fast') uses 'frecency' (frequency + recently) in order to jump to or open your most frecent documents or directories. A dumber version is z which works as a supliment to cd

3

I find that zsh with plugins makes my life very easy. And if I need to quickly find something, fzf works wonders

3

Often I don't find myself navigating directories when I reach for my file manager, but looking for something. Learning to use find or fzf gets rid of a fair amount of shuffling through your file system. Also, don't be afraid to type out full paths when performing copy or move commands. There isn't any reason to go to /home/documents/12/directories/deep when you can simply put the path in your ls or other command. And of course, tab complete is your friend (/ho[tab}/doc[tab]/12/[tab]/deep, etc...)

3

I felt the same. Simple tasks I do in terminal, but when I have to deal with too many files and folders I use filebrowser. Its amazing docker container with simple GUI

2

That's a good question 💯 In my case too, it took me some time (read years 😂) to figure out what I'm comfortable w/.

I can think of 3 major ways that you can navigate the filesystem while being able to drop to a shell when you need it:

  • If you're familiar w/ Emacs, you can either:
    • Use dired and tramp on your machine to access/navigate the target machine.
    • Install Emacs (emacs-nox) on the target machine, SSH and then run emacs-nox and voila! No need for tramp in this scenario.
  • Use Midnight Commander (mc) which offers a TUI pretty much like Norton Commander (nc) from the days of yore.
  • Get used to the semi-standard structure of the file system and just use plain Bash (cd, pushd & popd) to move around. That is
    • Understand what usually goes into common directories (like /usr/share or /opt) and try to follow the same pattern when rolling your own software installations.
    • Learn how to use your distro's package manager to query packages and find out where things, like configurations and docs, are stored. Something as simple as rpm -q --list is what you usually need.

HTH

2

@Father_Redbeard
alias !="cd .."

Works wonders on azerty keyboards, where ! is close to return key. I guess you could pair another key with ctrl for the same effect ?

2
lemmy.ca

Take some bash tutorials on the internet there are loads of them

Learn rsync, it's the best!

I've been a 20 year Linux desktop and server user. I spent my time either in an IDE for development, on a browser, or in shells. Last time I touched a graphical file manager has been years ago, if not decades. Cli shells are so so so so so much more efficient in getting shit done than GUI programs it's not even funny.

Welcome to the dark side, we have cookies!

If you use Linux desktop (you should, it rocks, use KDE!) then install yakuake! It's the friggin best awesome thing ever! F12 and 25 shells drop down on my screen. F12 and I got my browser back.

1
lemmy.ml

I just finished buttoning up my new PC build and installed Linux on it, actually. Pop!_OS though because I like the layout and it's very un-Windows-like which is what I was after. I'm excited to learn more!

1
Phoenixzreply
lemmy.ca

Still, get yakuake. It's probably my favorite apo

1

Depends on your workflow and file structure, but nvim with nvchad works great for coding. I also sometimes use ranger to better see file structures.

1