Often times the highest quality sites are some of the least popular.

Choices have slowly been running out when it comes to effective search engines. It seems inevitable an open source search engine project independent from big tech will be needed.

Some of my own tricks are:

• Use the blacklist plugin to block sites from search.
• Search for forum sites and communities instead of specific queries. (Wikipedia has a list of forums that might be useful)
• For technical questions favor Q&A websites like stack exchange.
• YouTube videos often offer better information than results from search engines. (Use search engines instead of YT search)
• Look for blogs and journals that specialize in the topic you're searching for.
• Use boolean search when possible.
• Self-host and customize your own metadata search engine. Create a graph network linking websites based on subject/topic. You may not be able to query specific questions but you can discover sites that you otherwise can't in traditonal search. This is a great way to discover hidden gems! (Example: https://internet-map.net/)
• (Difficult) Self-host and scrape sites across the web in order to create your own query-able database. This would be the most effective way to search the internet and would be completely independent from potential enshittification and censorship. The cost however is quite high both in term of hardware and time. Kiwix offers a way to download websites for offline use. (Ex: Wikipedia, Stack exchange). This is a good starting point to build your own custom search engine.

I would love to hear the tips and tricks you use! I hope this post helps others in more efficiently finding information on the internet!

Recently noticed some amazon items are 80% more expensive than ebay. Made this post for some tips and tricks on finding the best prices, deals or services for general items.

Here are some off the top of my head.

• Government auctions often have the best bang for your buck on some items. (Tech, tools, etc)
• Retailmenot.com seems to be the only real coupon website with real coupons. I don't know of any others.
• Some mobile and internet providers will offer a discount if you try and cancel.
• Insurance companies have been caught buying sensor data from your phone and using it to raise premiums if they detect stuff like sudden stops. To get the best deal, avoid their tracking and don't opt in to their driving performance tracking program.

Here are some potental topics

• Bank/credit unions plans
• Insurance plans
• Food/Groceries
• Hardware store supplies
• Tools/House work
• E-shopping
• Couponing
• Pitfalls

The goal of this post is to provide a hub to discover some powerful internet resources out there.

For example here's one I wanted to share.

• Open Source Ecology is a project for open source hardware that is significantly cheaper than retail costs. Some of the equipment include open source designs for CNC machines, windmills, tractors, plasma cutters, power supplies, motors, generators, and much more!

https://www.opensourceecology.org/

Additional Resources

• The List of Awesome: https://github.com/topics/awesome
• Library Genesis: https://en.wikipedia.org/wiki/Library_Genesis

The goal of this post is to provide a hub to discover some powerful internet resources out there.

For example here's one I wanted to share.

• Open Source Ecology is a project for open source hardware that is significantly cheaper than retail costs. Some of the equipment include open source designs for CNC machines, windmills, tractors, plasma cutters, power supplies, motors, generators, and much more!

https://www.opensourceecology.org/

Additional Resources

• The List of Awesome: https://github.com/topics/awesome
• Library Genesis: https://en.wikipedia.org/wiki/Library_Genesis

I hope this post offers a good way to discover new communities.

Here's a list of internet forums from Wikipedia

• https://en.wikipedia.org/wiki/List_of_Internet_forums

I noticed many were people were having problems finding where to voice your response to the Open Source AI Regulation request by the NTIA. I have provided a link below. Click on "comments" and provide your message.

It is important that we provide a well reasoned and thoughtful response to counter the flood of fearmongers.

Please do so as open source AI will depend upon it.

https://www.regulations.gov/document/NTIA-2023-0009-0001

This would be a good opportunity to provide a thoughtful, sane, and coherent response to voice your opinion on the future regulation policies for AI to counter the fearmongering.

How to submit a comment: https://www.regulations.gov/document/NTIA-2023-0009-0001

All electronic public comments on this action, identified by Regulations.gov docket number NTIA–2023–0009, may be submitted through the Federal e-Rulemaking Portal. The docket established for this request for comment can be found at www.Regulations.gov, NTIA–2023–0009. To make a submission, click the ‘‘Comment Now!’’ icon, complete the required fields, and enter or attach your comments. Additional instructions can be found in the “Instructions” section below, after “Supplementary Information.”

What free resources do you know on the internet that everyone should use?

Potential Category Ideas

• FOSS Software
• Quality of Life
• Public Services
• Other List of Lists
• Personal Finance
• Github Awesome Repositories
• Firefox Addons
• Free Research/Books
• Piracy Sites & Lists
• Real Life Resources

Links and Resources

• Github - Awesome
• Lemmy - What are some useful links everyone should know?
• Reddit - Mirror Post
• Wikipedia - FOSS List

What are your favorite mathematics channels/videos on YouTube?

There are tons of great videos on YT, but I'll list some resources from 3Blue1Brown's SoME3 contest if you want to discover more math explainers.

SoME3 Resources

• YouTube - 25 Math explainers you may enjoy
• YouTube - SoME3 424 Video Playlist
• 3Blue1Brown - Summer of Math Exposition (Non-videos)

This is a continuation to my original "What are the most mindblowing things in mathematics?" post.

Additional Resources

• YouTube - 3Blue1Brown Channel
• Lemmy - What are the most mindblowing things in mathematics?
• YouTube - PBS Infinite Series
• YouTube - Numberphile

It is becoming near impossible to find relevant information from search engines. Duckduckgo, SearXNG, Bing, Google, and so many more mainstream engines have a significantly high noise to signal ratio, and it is getting worse.

Here are a collection of the best search engines I know, please add more to the list.

• Forum Search Engine: https://crowdview.ai/
• Non-commercial Search: https://search.marginalia.nu/
• Libre Meta Search Engine: https://librey.devol.it/
• Golden Age Search Engine: https://www.wiby.org/
• Yandex: https://yandex.com/

If no more high quality search engines exist, would it be possible to host your own?

EDIT: Some new discoveries. The addon uBlacklist and filters can block super SEO sites from appearing in search.

• https://addons.mozilla.org/en-US/firefox/addon/ublacklist/
• https://github.com/rjaus/awesome-ublacklist
• https://github.com/NotaInutilis/Super-SEO-Spam-Suppressor

It is becoming near impossible to find relevant information from search engines. Duckduckgo, SearXNG, Bing, Google, and so many more mainstream engines have a significantly high noise to signal ratio, and it is getting worse.

Here are a collection of the best search engines I know, please add more to the list.

• Forum Search Engine: https://crowdview.ai/
• Non-commercial Search: https://search.marginalia.nu/
• Libre Meta Search Engine: https://librey.devol.it/
• Golden Age Search Engine: https://www.wiby.org/
• Yandex: https://yandex.com/

If no more high quality search engines exist, would it be possible to host your own?

EDIT: Some new discoveries. The addon uBlacklist and filters can block super SEO sites from appearing in search.

• https://addons.mozilla.org/en-US/firefox/addon/ublacklist/
• https://github.com/rjaus/awesome-ublacklist
• https://github.com/NotaInutilis/Super-SEO-Spam-Suppressor

Feel free to post multiple suggestions for different genres. For example, atmospheric, sci-fi, adventure-like, etc.

I wanted to make this post so we can share all the resources we have with each other on anything machine learning related.

Please feel free to add all of your resources as well even if they are duplicates.

PS: The best way to grow a lemmy community is to produce high quality posts.

Some ideas of things you could share:

• What people do you follow for AI? Such as on YT, Twitter, etc.
• What other social media forums provide great information?
• What GUI do you use for local LLMs?
• What parameters are "best"?
• Is there a Wiki you use?
• Where do you go to learn about LLMs/AI/Machine Learning?
• How do you find quality models?
• What Awesome github repositories do you know?
• What do you think would be useful to share?

General Information - Awesome

• Awesome-LLM: https://github.com/Hannibal046/Awesome-LLM
• Awesome Jailbreaks: https://github.com/0xk1h0/ChatGPT_DAN
• Awesome Prompts: https://github.com/f/awesome-chatgpt-prompts
• Prompt-Engineering-Guide: https://github.com/dair-ai/Prompt-Engineering-Guide
• AI Explained (Great channel for AI news): https://piped.video/channel/UCNJ1Ymd5yFuUPtn21xtRbbw
• Lex Fridman (In depth podcasts): https://piped.video/channel/UCSHZKyawb77ixDdsGog4iWA

LLM Leaderboards:

• LLM Logic Tests: https://docs.google.com/spreadsheets/d/1NgHDxbVWJFolq8bLvLkuPWKC7i_R6I6W/edit#gid=2011456595
• llm-leaderboard: https://github.com/LudwigStumpp/llm-leaderboard
• Chat leaderboard: https://chat.lmsys.org/?leaderboard
• Gotzmann LLM Score v2.4: https://docs.google.com/spreadsheets/d/1ikqqIaptv2P4_15Ytzro46YysCldKY7Ub2wcX5H1jCQ/edit#gid=0
• LLM Worksheet: https://docs.google.com/spreadsheets/d/1kT4or6b0Fedd-W_jMwYpb63e1ZR3aePczz3zlbJW-Y4/edit#gid=0
• CanAiCode Leaderboard: https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
• AlpacaEval Leaderboard https://tatsu-lab.github.io/alpaca_eval/
• Measuring Massive Multitask Language Understanding: https://github.com/hendrycks/test
• Awesome-LLM-Benchmark: https://github.com/SihyeongPark/Awesome-LLM-Benchmark

Places to Find Models

• Discovery the LLMs: https://llm.extractum.io/
• Open LLM Models List: https://github.com/underlines/awesome-marketing-datascience/blob/master/llm-model-list.md
• OSS_LLMs: https://docs.google.com/spreadsheets/d/1PtrPwDV8Wcdhzh-N_Siaofc2R6TImebnFvv0GuCCzdo/edit#gid=0
• OpenLLaMA: An Open Reproduction of LLaMA: https://github.com/openlm-research/open_llama
• open-llms: https://github.com/eugeneyan/open-llms

Training & Datasets

• Uncensored Models: https://erichartford.com/uncensored-models
• LLMsPracticalGuide: https://github.com/Mooler0410/LLMsPracticalGuide
• awesome-chatgpt-dataset: https://github.com/voidful/awesome-chatgpt-dataset
• awesome-instruction-dataset: https://github.com/yaodongC/awesome-instruction-dataset

There are still many more resources out there I'm sure. Please share what you use to try to keep up with the fast pace of AI development.

I hope some of my resources have helped you! I'm eager to hear what other resources are out there!

I wanted to make this post so we can share all the resources we have with each other on anything machine learning related.

Please feel free to add all of your resources as well even if they are duplicates.

PS: The best way to grow our lemmy community is to produce high quality posts.

Some ideas of things you could share:

• What people do you follow for AI? Such as on YT, Twitter, etc.
• What other social media forums provide great information?
• What GUI do you use for local LLMs?
• What parameters are "best"?
• Is there a Wiki you use?
• Where do you go to learn about LLMs/AI/Machine Learning?
• How do you find quality models?
• What Awesome github repositories do you know?
• What do you think would be useful to share?

General Information - Awesome

• Awesome-LLM: https://github.com/Hannibal046/Awesome-LLM
• Awesome Jailbreaks: https://github.com/0xk1h0/ChatGPT_DAN
• Awesome Prompts: https://github.com/f/awesome-chatgpt-prompts
• Prompt-Engineering-Guide: https://github.com/dair-ai/Prompt-Engineering-Guide
• AI Explained (Great channel for AI news): https://piped.video/channel/UCNJ1Ymd5yFuUPtn21xtRbbw
• Lex Fridman (In depth podcasts): https://piped.video/channel/UCSHZKyawb77ixDdsGog4iWA

LLM Leaderboards:

• LLM Logic Tests: https://docs.google.com/spreadsheets/d/1NgHDxbVWJFolq8bLvLkuPWKC7i_R6I6W/edit#gid=2011456595
• llm-leaderboard: https://github.com/LudwigStumpp/llm-leaderboard
• Chat leaderboard: https://chat.lmsys.org/?leaderboard
• Gotzmann LLM Score v2.4: https://docs.google.com/spreadsheets/d/1ikqqIaptv2P4_15Ytzro46YysCldKY7Ub2wcX5H1jCQ/edit#gid=0
• LLM Worksheet: https://docs.google.com/spreadsheets/d/1kT4or6b0Fedd-W_jMwYpb63e1ZR3aePczz3zlbJW-Y4/edit#gid=0
• CanAiCode Leaderboard: https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
• AlpacaEval Leaderboard https://tatsu-lab.github.io/alpaca_eval/
• Measuring Massive Multitask Language Understanding: https://github.com/hendrycks/test
• Awesome-LLM-Benchmark: https://github.com/SihyeongPark/Awesome-LLM-Benchmark

Places to Find Models

• Discovery the LLMs: https://llm.extractum.io/
• Open LLM Models List: https://github.com/underlines/awesome-marketing-datascience/blob/master/llm-model-list.md
• OSS_LLMs: https://docs.google.com/spreadsheets/d/1PtrPwDV8Wcdhzh-N_Siaofc2R6TImebnFvv0GuCCzdo/edit#gid=0
• OpenLLaMA: An Open Reproduction of LLaMA: https://github.com/openlm-research/open_llama
• open-llms: https://github.com/eugeneyan/open-llms

Training & Datasets

• Uncensored Models: https://erichartford.com/uncensored-models
• LLMsPracticalGuide: https://github.com/Mooler0410/LLMsPracticalGuide
• awesome-chatgpt-dataset: https://github.com/voidful/awesome-chatgpt-dataset
• awesome-instruction-dataset: https://github.com/yaodongC/awesome-instruction-dataset

There are still many more resources out there I'm sure. Please share what you use to try to keep up with the fast pace of AI development.

I hope some of my resources have helped you! I'm eager to hear what other resources are out there!

What concepts or facts do you know from math that is mind blowing, awesome, or simply fascinating?

Here are some I would like to share:

• Gödel's incompleteness theorems: There are some problems in math so difficult that it can never be solved no matter how much time you put into it.
• Halting problem: It is impossible to write a program that can figure out whether or not any input program loops forever or finishes running. (Undecidablity)

The Busy Beaver function

Now this is the mind blowing one. What is the largest non-infinite number you know? Graham's Number? TREE(3)? TREE(TREE(3))? This one will beat it easily.

• The Busy Beaver function produces the fastest growing number that is theoretically possible. These numbers are so large we don't even know if you can compute the function to get the value even with an infinitely powerful PC.
• In fact, just the mere act of being able to compute the value would mean solving the hardest problems in mathematics.
• Σ(1) = 1
• Σ(4) = 13
• Σ(6) > 10^10^10^10^10^10^10^10^10^10^10^10^10^10^10 (10s are stacked on each other)
• Σ(17) > Graham's Number
• Σ(27) If you can compute this function the Goldbach conjecture is false.
• Σ(744) If you can compute this function the Riemann hypothesis is false.

Sources:

• YouTube - The Busy Beaver function by Mutual Information
• YouTube - Gödel's incompleteness Theorem by Veritasium
• YouTube - Halting Problem by Computerphile
• YouTube - Graham's Number by Numberphile
• YouTube - TREE(3) by Numberphile
• Wikipedia - Gödel's incompleteness theorems
• Wikipedia - Halting Problem
• Wikipedia - Busy Beaver
• Wikipedia - Riemann hypothesis
• Wikipedia - Goldbach's conjecture
• Wikipedia - Millennium Prize Problems - $1,000,000 Reward for a solution

An Internet Portal is an information hub connecting you a much wider portion of the internet.

For example:

• Wikipedia's Content Portal: https://en.wikipedia.org/wiki/Wikipedia:Contents/Portals
• Github's List of Awesome: https://github.com/topics/awesome
• Wikipedia's List of list of lists: https://en.wikipedia.org/wiki/List_of_lists_of_lists
• Wikipedia Internet Forums List: https://en.wikipedia.org/wiki/List_of_Internet_forums

What Internet Portals do you know of that you would like to share?

Search engines have been dropping in quality significantly within the past decade, and especially within this past year. The noise to signal ratio has been frankly painful.

Can you please share some resources you use when trying to find answers to technical questions?

For example, STEM, academia, engineering, programming, etc.

What social media platforms do you use and want to recommend to others? Front ends could also be a suggestion, along with lists of great communities.

For example: https://sub.rehab/

Which is a collection of communities from different platforms.