Which Linux tool or command is surprisingly simple, powerful, and yet underrated?"
Which Linux command or utility is simple, powerful, and surprisingly unknown to many people or used less often?
This could be a command or a piece of software or an application.
For example I'm surprised to find that many people are unaware of Caddy, a very simple web server that can make setting up a reverse proxy incredibly easy.
Another example is fzf. Many people overlook this, a fast command-line fuzzy finder. It’s versatile for searching files, directories, or even shell history with minimal effort.
361
Comments317
I think a lot of people don't realise that yt-dlp works for many sites, not just YouTube
I used it recently for watching a video from tiktok without having to use their god awful web UI and it was amazing
Also works on Twitch with the added benefit of NOT playing ads (you still get breaks, just with a placeholder screen instead of the commercial).
mpv has yt-dlp support built in, so it can just play the streams directly.
Since everyone keeps mentioning yt-dlp I gotta ask: what's wrong with the original youtube-dl? I keep using it, it works, it's still being updated.
yt-dlp has sponsorblock features, youtube-dl does not.
There are minor feature differences there's also a convenience factor: youtube-dl people for some reason stopped doing releases, so you can't get a fresh version from pypi (only installing from github or their site). Yt-dlp is on pypi, including nightly builds.
It also supports ripping playlists. Fantastic to archive a set locally...
The huge list of sites can be found here https://github.com/yt-dlp/yt-dlp/tree/master/yt_dlp/extractor
A few that I use every day:
I heard about helix from you and I've used it for a year and a half or so now, it's by far the best editor I've used so far and I can definitely vouch for it
Nice!
Just commenting to give more love to helix. It's my favorite "small quick edits" editor.
I've actually been testing with fish recently coming from zsh, though I might wait until 4.0 fully releases before I make a more conclusive decision to move or not.
With that said, I remember looking through omf themes and stumbled onto Starship that branched off one of the themes and really liked the concept.
One thing that holds people back sometimes is that bash scripts that set environment variables don't work by default. https://github.com/edc/bass is an easy solution
Could you explain them in more depth? I opened them and don’t know
Helix is a terminal based text editor. It’s much like vim / neovim, but unlike those editors it’s good to go right out of the box, no configuration or plugins needed to make it work well.
Topgrade is one I haven’t used, but it looks like its intended purpose is to let you upgrade your apps with one command, even if you use multiple different package managers (I.e. if you were on Ubuntu, you could use it to upgrade your apt packages, at the same time as your snap packages, as well as flatpak, nix, and homebrew if you’ve added those.)
Thank you for explaining. I would never have understood topgrade without your example :)
Fish is a replacement of bash that's a bit more user friendly (has some cool auto completion features out of the box and more sane behaviour like handling of spaces when expanding variables). I personally started to use nutshell recently but unlike fish it's very different from bash.
Starship is a "prompt" for various shells (that bit of text in terminal before you enter the command that shows current user and directory in bash). I haven't used it but AFAIK it has many features like showing current time, integration with git, etc.
Yep, here's my Starship prompt, for example:
So, I have it configured to show:
$means I have something stashed,Thanks for adding this. What does stashed mean
Oh, when you're coding something in a Git repo and you realize that you need to make a different change before you continue coding (e.g. switch to a branch, pull newest changes, or just create a separate smaller commit for part of your change), then you can run
git stash pushto put away your current changes, then make your other change, and then rungit stash popto bring your ongoing changes back. I recommend readinggit stash --help, if you want to use it.Sometimes, though, you might end up just taking it into a different direction altogether or simply forget that you had something stashed. That's when that indicator comes in handy. Because while you can have multiple things stashed, I do find it's best not to keep them around for too long. If you do want to keep them for longer, then you can always create a branch and commit it as WIP onto there, so that you can push it onto a remote repo.
This is sick!! Would you mind sharing your config?
Nope, I'm glad to share.
I personalized it from the "Gruvbox Rainbow" preset from here: https://starship.rs/presets/
So, you might prefer that, if you're not, well, me.
You will need to set up a NerdFont, like the Starship installation guide says.
Here's my configuration: ::: spoiler Spoiler
:::
Thanks!
Once Helix gets plugin support and someone makes a Clojure REPL plugin as good as Conjure I am never touching
vimagain!It does have clojure lsp support, but you'll probably have to use a command line for most repls.
Yeah the clojure lsp support is top notch, but there being no support for "jacking in" to a repl is the big thing keeping me from using helix full time. There's a way of doing it if you use kitty, but it's pretty janky.
Do you have experience with either ranger, lf, or yazi? I'm wondering how broot compares. Big fan of file ranger, and this looks very similar.
I've used ranger, but I'm not as big a fan of it as broot.
I use fuck to fix typos
That's fantastic, I can't wait to go home and install it
If you'd map it to just
fit's even more handyYou gain efficiency, but lose fun
Game changer!
That sounds dangerous. I hope it never tries to fix anything with
rmYou have to confirm any command before it runs, so no more dangerous than baseline rm
this just reminds me of
pleasewhich runs the previous command withsudoWill also run the previous command with sudo, fwiw.
I use fuckit to fix exceptions
grep goes crazy if you know your regex
Relevant xkcd
I was expecting this one.
I thought you meant this one
I can never get grep to work consistently on Mac and Linux. Now, ripgrep OTOH....
That’s because Macs generally use BSD-based command line tools instead of GNU ones. You have to do a lot of Homebrew jiggery-pokery to approximate a GNU environment. Know Your Tools: Linux (GNU) vs. Mac (BSD) Command Line Utilities
Alas, doesn't fit my purpose since it requires action by the script user. I usually just use perl in those situations
I love flexibility with regex, personally I use ugrep as it also allows utilization of boolean and/or/not logic for more complicated searches.
Check out my chapter on GNU grep BRE/ERE for those wanting to learn this regex flavor: https://learnbyexample.github.io/learn_gnugrep_ripgrep/breere-regular-expressions.html (there's also another chapter for PCRE)
jq - super powerful json parser. Useful by hand and in scripts
I love jq, but I wouldn't call it "surprising simple" for anything but pretty-formatting json. It has a fairly steep learning curve for doing anything with all but the simplest operations on the simplest data structures.
It’s not even pretty or accessible. 2-spaced indentation is incredibly hard to read.
It can also format minimized JSON from cURL API requests
Combine with jc to process CSV files. This is how I get data into my plain text accounting system.
jqandyqare both things I install on pretty much every machine I have.I use it occasionally but every time I need to do something a tiny bit more complex than "extract field from an object" I have to spend half an hour studying its manual, at which point it's faster to just write a Python script doing exactly what I need it to do.
Check out https://www.nushell.sh/ I use it for exactly that, i.e. complex extract and convert files
I actually installed it recently out of curiosity, but I'm hesitant about learning its advanced features like that. At least jq is a standalone tool that's more ubiquitous than nushell, so you can rely on it even in environments that you don't fully control (e.g. CI like GitHub Actions). And if you use it in some public code/scripts then other people will be more familiar with it too.
yq can do both JSON and YAML :)
Funny how this was one of the first tools I learnt once I "seriously" started my linux journey, lol
I'm a big fan of
screenbecause it will let me run long-running processes without having to stay connected via SSH, and will log all the output.I do a lot of work on customers' servers and having a full record of everything that happened is incredibly valuable for CYA purposes.
I'd recommend
tmuxfor that particular use. Screen has a lot of extras that are interesting but don't really follow the GNU mentality of "do one thing and do it well."Tmux / Screen is like the emacs/vim of the modern day Linux I think.
Screen is more than capable, but for those who have moved to Tmux, they will absolutely advocate for it.
The thing that got me to switch was being able to maintain my pane layout between connections. The various window and pane management niceties (naming, swapping, listing and the like) got me to stay. Now you can keep your screen, but you'd have to pry tmux from my cold, dead, tty.
Tmux was purpose built for terminal multiplexing. You can assign session names for organizing and manipulating multiple instances. Send keys to and read output from detached sessions. It's easy to script.
Sorry, it was, just not for exploring all of those instances at once. Should have called out the tiling function. Screen also built in a serial terminal emulator and started playing with a few other things.
This was a few years ago so maybe it has improved, but I found that screen would crash and lose my session history and layout too often. That was bad enough, but when it happened it had some bullshit error message about a dungeon roof falling in. I don't mind some comedy in code or even the interface, but don't make light of the user losing their stuff. I tried tmux and it is much more stable than screen was.
There is also zellij, which can do the same but also has modern functionality specific for development workspaces!
(Although
screenortmuxwill still probably be more widely available on remote machines etc)I know everyone likes tmux but screen is phenomenal. I have a .screenrc I deploy everywhere with a statusbar at the bottom, a set number of pre-defined tabs, and logging to a directory (which is cleaned up after 30 days) so I can go back and figure out what I did. Great tool.
Woah screen is seeing active development again? There was like a decade where it stagnated. So much so that different distros were packaging different custom feature patches (IIRC only Ubuntu had a vertical split patch by default?) Looking at it now, the new screen maintainers had to skip a version to not conflict with forks that had become popular.
When tmux stabilized I jumped ship immediately and never looked back.
tmux with control mode in iterm is god mode for me on all my machines. Absolutely love it.
nohupis similarI've had nohup fail to keep things running after my session ended quite frequently. It's like it just goes to the next step in the process then gives up.
It's likely that you're using a systemd based system and the admin hasn't enabled
lingerfor your user.The servers are very locked down, so I'm sure that's part of our compliance requirements. I haven't looked into fixing it because I just wrote a script to hit Enter every 10 minutes to keep it alive.
Ha! Faking key presses, truly an elegant weapon for a more civilized age. If it works, it works.
It's not as useful, sadly. Nohup disconnects standard input, output, and error. With screen or tmux, you can reattach them later.
The pipe (
|), which if you think about it is the basis for function composition.Control+r == search through your bash history.
I used linux for ten years before finding out about that one.
nano was and still is vital to me learning and using linux, I will not learn how to use vim so if the distro forces it to be default im not using it.
Why is editing text so convoluted for seemingly no reason.. also hate that vim must be used for certain files.
You can change your hate to love by using vim
one of my favorite linux youtubers is named vimjoyer so maybe one day I will try to learn it
I've liked helix a bit more. It takes less initial set up, and generally has the mentality of showing what you're about to change before inputting a change command.
It's totally worth it. But be aware that you might get some :w sprinkled over your documents you are forced to write in other editors or word processors which does not speak vim...
I use vim mode everywhere I can and vim in the console, it took a bit of effort to learn but it was fun and satisfying. Highly recommend, I'm a vim user now for 7 years.
You can change that by changing your editor global variable
Wow you triggered a lot of vim users !
Maybe give micro a shot :) It's nano but more sane defaults and comes with customization in mind.
It's for people to memorize hundreds of arcane shortcuts and shit so they can feel like a smug hacker and gloat over the rest of us using other editors and getting just as much done as they are.
Also for graybeards that haven't realized it's not 1985 anymore.
For the average user you're definitely right, but I will say for the sysadmin of headless systems, having a powerful cli editor is a godsend. While it may seem arcane and unnecessary, learning vim is easier than managing remote x or sshfs or copying files to and from a system.
I didn't learn vim to be a contrarian; I learned it because it seemed (and still seems to be) the path of least resistance for many workflows.
I learned vi so I would not have to use ed or emacs!
Wait until you meet an emacs user! ;p
It's for people that don't want a big bulky IDE and are willing to put a little work in to get used to it. I do all my coding in the terminal with vim and tmux and I like the simplicity and that with two dotfiles I can migrate my whole development environment to whatever PC, server or RaspberryPi that I need.
I've used Vim for some pretty non-nerdy stuff. Like ripping my DVD collection, when I got to the TV section I had a lot of file names to modify in bulk, and Vim let me do that. Also guitar tablature, the ability to edit plaintext both horizontally and vertically is surprisingly handy. Just having a macro to be able to add a bar line saves a shocking amount of time.
It was mostly a joke. I was just trying to mess with people 😉
Which I'll use as a lighthearted excuse to mention things like the block edit mode.
Yeah, to this day vim still isn't intuitive for me, so I just use nano as it's either often included or simple to install on most Distros.
Unless a script is hardcoded for vim I haven't had to use it.
It's weird but VIM is so powerful and I love it but i also agree it wouldn't be the default just an option if you needed it. It's like with notepad ++ on windows it's wonderful but not everyone needs it from day one notepad will work just fine for basic typing.
seems like you need to try micro. It's like nano, but with more sensible standard keybinds imho, as well as syntax highlighting and global clipboard use.
vim must be used for certain files??
Cant remember exactly but it had something to do with a file relating to sudo and it only was allowed to be edited with a vim style editor.
There's a separate command called
visudofor this purpose.You CAN use any ol' text editor but visudo has built-in validation specific to the sudoers file. This is helpful because sudoers syntax is unique and arcane, and errors are potentially quite harmful.
But visudo can use any editor if you set SUDO_EDITOR or EDITOR variables. If you don't want to use vi(m) you should probably set EDITOR in your .bashrc and visudo and probably other programs will use your editor of choice.
visudo?There may be certain times where it's all that's available, I think I remember having to edit fstab in some recovery state in vi
/etc/sudoers?
you can just edit that with nano or whatever, the visudo thing they tell you to use is goofy and I don't like it
igtfo<ESC>
:q!
I used nano when I started but now I am using vim for one year already. I'd recommend taking a few days where you only use vim and I think you will see why people like it. With a few motions you can be much faster than you would be in Nano.
One of the big reasons I switched to nixos is that I mostly need to use the console only for updating my system by editing the configuration file using nano. I do very little besides that thankfully while the GUI side of linux gets better everyday.
I’m using Linux since 1998 and still like nano. I can use vi, but prefer nano when it’s available.
Nano is hella confusing too. Since when is
^= Ctrl?And why dont they tell you that Ctrl+S Ctrl+C Ctrl+X works?
^C has been notation for ctrl-c for decades.
I grew up with the ^ symbol meaning CTRL. Kids these days.
Yes but I am not that old and never saw it anywhere. So while it makes as much sense as hjkl it is not beginner friendly.
I find myself using tldr a lot since finding out about it. It's just so useful for commands that I don't use enough to commit to memory.
What is it?
You type tldr and then some command. For example, tldr tar. It gives you a small list of examples and common use cases for the command.
That sounds excellent, can't wait to try it.
Sometimes manpages are frustrating as hell because there are no examples. They read more like the developer making notes for themselves who is already intricately familiar with the program on how it works, rather than teaching someone to use the program.
So many times I'm shaking me head, like please show me an example of a syntactically correct command, what is wrong with you!!
awkCame here to say both of these things. (Awk and "> simple".)
To be totally honest, I don't think awk is any more complicated than something like grep, it's just that regular expressions get used more often so they're typically more familiar. In the same way that programming languages with c-like syntax (like Java and C#) often feel easier than ones that don't (like Haskell and Clojure).
Awk is a turing complete programming language.
I know
tmuxis incredibly popular, but a good use case for it that isn’t common is teaching people how to do things in the terminal. You can both be attached to the same tmux session, and both type into the same shell.Tmux is so much better than screen, and yes that is the hill I will die on
Specially when confined with tmuxp , it's how I handle Game servers that can run headless to start at boot without losing access to giving commands to the server via its server console
zoxide. It's a fabulous
cdreplacement. It builds a database as you navigate your filesystem. Once you've navigated to a directory, instead of having to typecd /super/long/directory/path, you can typezoxide pathand it'll take you right to/super/long/directory/path.I have it aliased to
zd. I love it and install it on every systemYou can do things like using a partial directory name and it'll jump you to the closest match in the database. So
zoxide pawould take you to/super/long/directory/path.And you can do partial paths. Say you've got two directories named
datain your filesystem.One at
/super/long/directory/path1/dataAnd the other at
/super/long/directory/path2/dataYou can do
zoxide path2 dataand you'll go to/super/long/directory/path2/dataI usually would just do
z 2data. Yes, I'm lazy. It's the perfect tool for lazy people.Nice! I guess I can be even lazier when navigating!
Sounds a lot like autojump
I'm not familiar with
autojumpBetter than fasd?
Not powerful, but often useful,
column -taligns columns in all lines. EGIt's a simple command line calculator! I use it all the time.
yesThe most positive command you'll ever use.
Run it normally and it just spams 'y' from the keyboard. But when one of the commands above is piped to it, then it will respond with 'y'. Not every command has a true -y to automate acceptance of prompts and that's what this is for.
Also, you can make
yesreturn anything:What's the syntax here? Do I go
I'm not sure if I've had a use case for it, but it's interesting.
That's really neat but also seems like it could be quite dangerous in a lot of use-cases!
I don't see anyone mentions
htop. So, I will:) Just works, could be installed in any distro. Much more friendly than top but isn't bloated with features as some other alternatives are.My fav for the past few years is https://github.com/ClementTsang/bottom
Check out BTOP++ -- it blows htop out of the water.
Bashtop if you want something more graphical
Using rust rewrite of coreutils you can
cp -gto see progress. Set an alias :)Holy shit I was just talking about cp with progress today. Awesome
Where can this variant of coreutils be found? This is the first time I have heard of it.
https://github.com/uutils/coreutils
Enjoy.
Gripes:
starship and all these shell frameworks are overbloated. Just write your own prompt command and be done with it.
restic, ongoing issue with the author to allow people to backup without a password. Seems like a no-brainer but he's being difficult
Why would you want password less backups?
I understand if the reason is 'just because', but seriously, why? I just write down the password in a text file for restic --password and I am done.
write down the password where though, somewhere I can guarantee it will always be there 10 years from now? That's a big ask of me
I keep mine in Bitwarden, I export that data every 3 months and store it in a Backblaze backup, I have it written on a piece of paper stored in a locked fire box in my house, and that paper scanned in my phone.
I can't imagine not having at least one of those in 10 years and I can't imagine all four failing in the same week.
Does that give you any helpful ideas that would work for you?
None that I can see persisting, as I move around a lot and my backups tend to get boxed up for periods of time before being unboxed. But, I appreciate the effort
I've gotta agree here that passwords - (and encryption) - should be optional.
That is true for lots of things.
Moreover I use one easy "default" password for all basic stuff, and its always the same known to my spouse and written down on paper.
At least my offsite backups are protected from prying eyes. Maybe uneeded for local backups, but doesn't hurt to have.
10 years? Boy you are joung :)
I have encrypted files from w 20 years ago, and unencrypted files from 30 years ago.
And digitized stuff from analogic of 40 and 50 years ago.
CTRL-L to clear your terminal output. Or type clear
Also
Ctrl+Dto exit any shell andCtrl+Rfor reverse searching your history!tmux - makes managing remote SSH sessions a breeze.
tomb - A little FOSS encryption utility that runs in the CLI. Easy, cute, effective. Tomb Utility
yq is crazy cool for converting between different text-based data formats such as yaml, json, xml, csv and others, and it has a super nice pretty-printing function as well. I use it all the time!
Just be aware that your distroy might come with a yq variant too, but possibly one that isn't as powerful as the one I linked. I know this to be true at least for Ubuntu.
Can it handle a file that has corrupt json? Or does it just tell you "no"
See also https://github.com/TomWright/dasel
I used jq for something similar before, recently I've discovered Nu Shell and have been using that for converting and analyzing data since a full shell is a lot more powerful than a command (e.g. open a yaml, for each element on key X grab the first element of list Y and export to a CSV)
pipeviewer or
pvGreat call!
pvis deceptively powerful. Being able to see progress and rate limit a pipe is incredibly useful.I've switched from using
ddto usingpvto write disk images to removable media.Man
I love
ncdufor seeing where all my storage is being taken up.ddis probably well known, but one of the simplest and most powerful ways to accidentally delete all data on your hard drive.dd if=/dev/random of=/dev/sdaddrescue (or gddrescue) is a great version if you have a sick drive. It'll try to copy the good areas first then go back to hammer on the sick areas.
Not perfect as it doesn't know about the file system so it tries to copy the entire surface, but generally a good tool.
@bamboo @mfat , DD, great tool. Utilize it so often, but it is powerful and dangerous. I always double, triple, quadruple check my target disks with multiple programs to avoid destroying my production workstation. Might be best if I just designated a RPi for the job. 😅
You can destroy it all the same with
cporcat.Discovered about rg recently and it is cool!
https://github.com/BurntSushi/ripgrep
socat- connect anything to anythingfor example
socat - tcp-connect:remote-server:12345socat tcp-listen:12345 -socat tcp-listen:12345 tcp-connect:remote-server:12345sshfs
I'm not sure how underrated it is but the exec feature in
findis so useful, there are so many bulk tasks that would just be incredibly difficult otherwise but instead are just one lineJust be careful with files with spaces in the name. There's an incantation with
xargsthat I always have to look up when I want to use it safely.vd(VisiData) is a wonderful TUI spreadsheet program. It can read lots of formats, like csv, sqlite, and even nested formats like json. It supports Python expressions and replayable commands.I find it most useful for large CSV files from various sources. Logs and reports from a lot of the tools I use can easily be tens of thousands of rows, and it can take many minutes just to open them in GUI apps like Excel or LibreOffice.
I frequently need to re-export fresh data, so I find myself needing to re-process and re-arrange it every time, which visidata makes easy (well, easier) with its replayable command files. So e.g. I can write a script to open a raw csv, add a formula column, resize all columns to fit their content, set the column types as appropriate, and sort it the way I need it. So I can do direct from exporting the data to reading it with no preprocessing in between.
ncdu
I think socat is a really powerful und underrated tool
I’ve used it in high-throughput production environments to do things that netcats can’t.
xargs
probably well known at this point but rsync is incredible and I use it all the time
Nothing new, just forgotten.
This looks amazing. Do you know how well it works in dispatching and tracking jobs over remote servers (over SSH)?
We've been using tsp at my work for years and it works well. It is just a very basic queueing system so if you can run the job from the command line then you can run it via tsp.
Our workflow is to have concurrent jobs run on the remote servers with cron and tsp but you should be able to trigger remote jobs over SSH also if you prefer to have a single machine in charge of task allocation.
batcat
It's like cat but better. Great for when you just want to look at the contents of a file, without loading a whole text editor.
Oh also, tldr
My procedure for learning how to use a cli command goes tldr page -> --help if the tldr fails to help me -> THEN the full manpage
kde connect
I'd like to interject for a moment. There is also a tool called bat that is just cat with extra features. It prints out and works just like cat, but when the contents get too big, it works like less. The is syntax highlighting and works with git.
It's replaced my need for cat and less.
Try bat....
Yes! I use less all the time, combine it with grep, etc.
cat | more
Useless use of cat award!
Underrated? I'd say lftp is the best FTP command line client there is. And Midnight Commander is a very very good file browser. I don't see either praised enough.
The terminal-based file browser space is so filled today but for my part I love what vifm has done for the dual-pane midnight commander concept - it's the same basic idea, uses (somewhat) vim-like bindings by default and is super extensible.
Lftp is fast. Those parallel chunked downloads are not a joke
Did you know it can connect to HTTP directory listings and do the same things it does over S/FTP?
I did not! Interesting feature.
A really simple one but surprisingly useful is
calCool
caltrick, it knows about the Gregorian calendar reform:cal 9 1752Very useful for having a quick glance at calendar. Although it's annoying that there's no option to have week start on monday.
alias cal="cal -m"Oh. I just assumed it didn't have that option on linux either because macOS cal doesn't have it.
Maybe it's a regional thing...
caldefaults to starting on a Monday for meI like https://github.com/aristocratos/btop personally. It's way prettier than the normal top command which you use to watch processes to find the one that's hogging all of the CPU or whatever. And it's not so much that it's underrated so much as it's not very well known or distributed by default.
netstat -tunlshows all open ports on the machine to help diagnose any firewall issues.miniserve
A static file server, I use it for temporary file share in company, just run
miniserve .in the folder.dua
Alternative of
ducommand, rundua ifor a text UIAlso useful in this regard, python comes with a sìmple file server built in,
python -m http.server --directory /dir/would serve /dir/ on port 8000.awk
..for parsing the output of other commands quickly and simply. Then that parsed output can be used to create simple log messages or be passed as args to other scripts. Powerful.
awk and sed have always been intimidating for me with that cryptic syntax.
I agree with your sentiment regarding confusing syntax, however I think that confusion simply requires a calculated approach to dispell it.
It's a prime example of why I use scripts as reminders as much as I use them functionally. I work out the syntax once.. save it to an example script, then save myself 20 minutes of remembering by just $ cat ./path/to/script.sh and copying said syntax.
So if you can change your workflow such that learned things stay around as examples, I feel that you will pick it up much more quickly :)
mlocateDo you have to wear the fedora to run this command?
No sorry, I should have elaborated. The package name is
mlocatebut the command islocate. Occasionally runupdatedbas it populates an sqlite db with every file on your system that you can then list out usinglocatefollowed by the filename you want to locate.EDIT: Lol. Sorry barely read your reply. Yes, you should wear a fedora while installing
mlocate.I immediately had flashbacks of diagnosing bad I/O performance on CentOS 5 servers. That was the week when I learned what updatedb is and why it was always running in the background (there was a lot of files)
I love locate! I have a cronjob that updates the db every night, then I can just find a file without having to think about where it is
I like btop Maybe not really "unknown", but hey for those that don't know about it, check it out!
Pandoc.
Idk a lot of commands but I think wget for downloading webpages and rsync for syncing devices are pretty awesome
The first time I used wget I felt so awesome. I was grabbing some extra music files I think it was for Ur-Quan Masters.
I love
httpiefor hitting urls when i want to see the headers or body without downloading to a file eg testing an apiall of them
Pick one
find?
Underrated or not widely known?
I love lazygit and I'm still surprised at how many people are shocked when they see it for the first time. Not exactly a command, but a very handy text UI tool.
For more elementary tools, I can't believe how many people know about ! and ctrl+r who don't also know about fc and edit-and-execute-command.
Lazygit perfectly fits my lifestyle:) thanks for sharing
degitis a tool that will check out a git repo (or a specific branch or commit), but not set it up as a git repo. Basically just downloading a specific commit to a directory.So just clone a git and delete the .git folder? Seems pretty useless to me.
If you want to waste bandwidth downloading the entire commit history, go ahead.
--depth=1? I use this all the time when I clone the kernel.Edit: reread that you wanted to download code at a particular commit.
--single-branchCan single-branch handle cloning from a particular commit? I know that it's possible to clone particular branches and particular tags with depth=1, but OP states cloning at a particular commit, not HEAD.
motion
After spending years dealing with shady freeware and junk software on windows, I was floored by how easy and nonchalantly I was able to set up a simple security camera on my PC
Lightweight sudo alternatives, hard to google too. I know ssu and rdo, please mention others.
Thanks, couldn't get it ever to work tho, and it doesn't come with a default config in Arch.
Because it's so simple, a good default config can be a one-liner. For similar functionality to default sudo:
Allows members of
wheelto run commands as any user (if you just rundoas <cmd>it will default to root), and "persists" for 5 minutes, ie if you run doas then for the next 5 minutes in the same session you won't have to enter your password to run doas again, similar to default sudo settings.https://wiki.archlinux.org/title/Doas
What problems were you having where you couldn't get it to work?
Always got permission denied, no matter what in the config. But thanks, i'll try again.
Why should I use a sudo alternative?
Because sudo is best suited for server administration, way overengineered (with the occasional critical vulnerability) for desktop use.
Alternatives can fit the required functionality for desktop use in 150 loc C code while sudo has what, something over 100'000 loc?
Bat, a cat alternative.
Lsd, an ls alternative.
Procs, a ps alternative.
Renane, because it's great.
Love LSD. I always install it first with btop and zoxide
Zoxide? Will check it out. Thanks.
People always sleep on
script. It's badass and let's you do goofy things like this while keeping standard terminal formatting: https://github.com/StaticRocket/dotfiles/blob/043e9a56cc9515060188ec4642e4048c0dd6c000/dot_bashrc#L79-L94From your example, I have a hard time inferring what is it doing.
Executing a command, capturing all terminal formatting and escape codes so I can do some light manipulation on leading whitespace before dumping it back to the terminal.
GNU datamash (https://www.gnu.org/software/datamash/alternatives/) - handy tool for data munching. There's also https://github.com/BurntSushi/xsv
Wow, I might try learning this over the next few days. Nice replacement for tidyverse on the cli
+1 to caddy. There are some services that set safe headers following the recommendations outlined by Mozilla but others don't control headers as strictly. Caddy is the only web server that I found that supports loose default header values. These values will be selected unless the upstream application specifies their own values.
You can do something similar in nginx but it requires playing with maps and has a little more indirection than I'd like.
Just wish caddy was capable of starting as root and stepping down permissions like Nginx. I have certs being managed by other tools and have to make sure they are installed and chowned for caddy's use when they are cycled.
I just started the process of switching from nginx Proxy Manager to Caddy yesterday, and even before setting up a single rule, I'm enjoying it more than NPM. Really wish I would have heard about it sooner!
I'm currently using NPM and don't have any problems with it for at least my use case. Is there something I'm missing out on never having tried Caddy, or is it one of those no need to switch if there's Nothing bugging you situations? That last bit is how I feel about Bazzite on the Steam Deck when people ask of they should switch.
watch -g-gis not documented, what does it do?Note: this made me discover topless (SFW) and its Caveat section.
-g, --chgexit Exit when the output of command changesAs someone who has to do installs and admin at work a lot I'm constantly dealing with yum/dnf. I cry when I have to work with AIX.
We install
dnfon our AIX boxes. Works okayish.I tried grabbing it and couldn't even get it to install. If you have a link to a good install...
I can't find the docs I followed, but this seems to be more or less the same process: https://www.ibm.com/support/pages/node/6585774
There are version-specific AIX Toolbox installation scripts, so make sure you've got the right version (
oslevelshould help).I think the version issues blocked me. I've put the toolbox on some of our test systems but dnf seems to be excluded from it. I'd probably have to build it.
It sounds scary lol
What is AIX
Maybe it's the old IBM AIX https://en.m.wikipedia.org/wiki/IBM_AIX
An OS used by IBM on their mainframes. I have to work with it because some big orgs, especially financial and gov, still use it and run our apps on it.
ip eg:
The first incantation - ip address (you can abbreviate whilst it is unambiguous) gets you a quick report of interfaces, MAC, IPs and so on. The second command assigns another IP address to an interface. Handy for setting up devices which don't do DHCP out of the box or already have an IP and need a good talking to.
Oh and you can completely set up your IP stack, interfaces and routing etc with it. Throw in nft or iptables (old school these days - sigh!) for filtering and other network packet mangling shenanigans.
nmap *your_local_ip_address*for example
nmap 192.168.1.43/24will show you what devices are connected to the local network, and what ports are open there. really useful, for example, when you forgot the address of your printer or raspi yet again.you can also use it to understand what ports on your computer are open from an attacker's perspective, or simply to figure out what services are running (ssh service).
edir, can use GUI editors too.
On the subject of editors,
joeis just awesome: lightweight, powerful, had coffee coloring and line numbers, and you can choose it with Ctrl+C:)Inshellisense is teaching me a lot. :) It's an autocompleter.
https://github.com/microsoft/inshellisense
Also, Atuin for history.
https://github.com/atuinsh/atuin
glances! Way better than
topand does a bazillion cool things!https://nicolargo.github.io/glances/
I loved glances until I switched to
btopwith Hot Purple Traffic Light theme, and I doubt I'll switch again. Check it out!This looks very cool. Thanks for sharing.
yes
y
y
y
y
y
y
y
yes no maybepaste. I don't think a lot of people know this command, but it can be handy at times
losetupit's useful for dealing with virtual disk images. like a real physical hard disk, but it's a file on the computer. you can mount it, format it, and write it to a real physical disk.
it's sometimes used with virtual machines, with iso images, or when preparing a bootable disk.
I abused debfoster for years... it kept my machines running very, very clean.
Cool. I'd never heard of this and I've used Debian for years.
Most listed in some form elsewhere, but
I've also been enjoying Kate. It's a decent text editor, but the ability to Ctrl + / to pipe selected lines through any Linux command (Uniq, shuf, etc) is a bit of a superpower for an editor
pdfgrep for the well maintained company's project folder of your choice.
I use
nodeas a calculator a lot. It can be dangerous, because it suffers from floating point errors, but it’s generally more powerful than a calculator if you know the Math lib well.Why not just use python as a calculator then?
Because I don’t know Python.
Fair enough, but Python is not that hard, especially for simple calculations. Start up the repl and type away!
inxi saves you time 90% of the time that you would use for lsXXX commands and grepping. Really useful for quick hardware and kernel module checks.
The mouse.
Bring on the downvotes. 🎉
Hey, still the quickest way to copy any damn text from a terminal elsewhere is with the mouse. Tmux is a joke for this.
Why can't terminal emulators just make this easy
Wezterm has made this easy : shift + ctrl + x and your in vim motion moving all over with yank line or word or visual mode. It's super awesome! I never touch my mouse. You can also remap the keymap of course.
Gotta try this