Large neural networks have created interest in low-precision arithmetic, fitting more numbers in memory. But low-precision memory brings back old problems.

A repository for the most elegant and useful UNIX commands. Great commands can be shared, discussed and voted on to provide a comprehensive resource for working from the command-line

With the advent of Llama 2, running strong LLMs locally has become more and more a reality. Its accuracy approaches OpenAI's GPT-3.5, which serves well for many use cases.

In this article, we will explore how we can use Llama2 for Topic Modeling without the need to pass every single document to the model. Instead, we are going to leverage BERTopic, a modular topic modeling technique that can use any LLM for fine-tuning topic representations.

Have you noticed that Git is so integral to working with code that people hardly ever include it in their tech stack or on their CV at all? The assumption is you know it already, or at least enough to get by, but do you?

Git is a Version Control System (VCS). The ubiquitous technology that enables us to store, change, and collaborate on code with others.

Many Linux users have experienced a lasting sense of accomplishment after composing a particularly clever command that achieves multiple actions in just one line or that manages to do in one line what usually takes 10 clicks and as many windows in a graphical user interface (GUI). Aside from being the stuff of legend, one-liners are great examples of why the terminal is considered to be such a powerful tool.

An LLM is no black box but an ML model (based on Neural Networks) that predicts the ‘next’ token given a sequence of previously predicted tokens and input prompt.
How is it able to get the context of the input? Using multi-head attention helps in focusing on important words compared to other tokens in the input sentence. If you’re interested in mathematics, you can read the below blog.

Over the summer, after finally getting around to learning Vim motions, I quickly fell down the Neovim rabbithole and have been procrastinating work by tinkering away at my configurations ever since! This post will be sharing setup that I have currently landed at to turn my Neovim editor into a supercharged workhorse.

nGPT: A hypersphere-based Transformer achieving 4-20x faster training and improved stability for LLMs.

Play 2048 on any device, anywhere.

The oPhysics website is a collection of interactive physics simulations. It is a work in progress, and likely always will be. Content will be added as time allows.

About The Author

All of the content on this site was created by me, Tom Walsh. I retired after teaching high school physics for 27 years, and AP Physics for 25 years. Please click my name above to send me feedback about these simulations or suggestions for new simulations I could create.

Stop letting ChatGPT destroy your developer potential. Over-reliance on AI is wrecking your future as a developer!

Cognitive load is how much a developer needs to think in order to complete a task.

With so many different things to do in parallel, I find myself completely agreeing with the arguments in this article.
It is so fun that some simple examples of "simple code" look similar to the ones I come up using in my programs to simplify the understanding of the code when I have to return on it after many months.

There are three questions you have when you’re hiring a programmer (or anyone, for that matter): Are they smart? Can they get stuff done? Can you work with them? Someone who’s smart but doesn’t get stuff done should be your friend, not your employee. You can talk your problems over with them while they procrastinate on their actual job. Someone who gets stuff done but isn’t smart is inefficient: non-smart people get stuff done by doing it the hard way and working with them is slow and frustrating. Someone you can’t work with, you can’t work with.

Read more...

alphaXiv is a platform where you can comment line-by-line on any arXiv paper and join the academic dialogue. You can also leave private notes, follow authors, and integrate with ORCID.

Read all your favorite online content in one place. Import your subscriptions in one click, find your friends, and start sharing.

Hello friends, this is the first of two, possibly three (if and when I have time to finish the Windows research) writeups. We will start with targeting GNU/Linux systems with an RCE.

Full Django in a single file - views, models, API ,with async support. Automatically convert it to a full project.

• Write a Django site in a single file, using views, models and admin
• Run it locally or in production, or share it as a standalone script
• Automatically convert it to a full Django project when you're ready for it to grow

This program consists of a single print statement wrapped in a while loop. You would not think that this would amount to much, but you would be very, very wrong. A clue to what is happening and how this works is encoded in the ASCII art of the program source.

Have you ever trained a model you thought was good, but then it failed miserably when applied to real world data? If so, you’re in good company.

If someone were to ask me what I think is the most important sonic attribute in sound quality, my answer wouldn’t be imaging or soundstaging, it would be volume. More than anything else, volume determines if the listening experience turns out to be a wow or a meh. I’m not just talking about the overall loudness but also how it fluctuates from moment to moment, which is called dynamics. And the practice of reducing dynamics is called compression.

There are some aliases and Git addons that I use to make my life easier.

It feels like everything these days needs you to create an account and log in to use them. Philips Hue announced you need to plug your home’s light automation to their cloud, even if you just use it locally. They claim it’s for security.

Read more...

Everything you wanted to know about the JSON format.

Super nice story about the Unix OS.

A website about selecting and classifying text editors used in programming systems. These are the programming text editors such as Emacs, VI, Multiedit, slick, Slickedit, ISPF, Notepad, VI and VIM that are used by the vast majority of programmers on UNIX, Windows, VAX, and Mainframe systems. The structure of the website allows any vistor to leave their opinions, knowledge, and mark on the website for others to enjoy.

How to Use Rep

Record a chess game live and upload the PGN to Lichess - GitHub - Pbatch/CameraChessWeb: Record a chess game live and upload the PGN to Lichess

[Simon Tatham, 2023-12-06]

Many years ago, my employer used to use “Can you name any sorting algorithms?” as a quickie interview question.

I’m something of a sorting-algorithms nerd, which is a quality that often comes with strong opinions. My personal prejudice (although I did my best not to let it affect the outcome of the interview) was that I was always extra pleased if our candidate listed a handful of well-known algorithm names and didn’t mention bubblesort.

Why? Because I hate it. Bubblesort is an awful sorting algorithm, and I wish people would stop teaching it.

TDOA Sound Localization is determining the source of a sound when all you know is the differences in the time of arrival of the sound event…

CSS is powerful, you can do a lot of things without JS. - GitHub - you-dont-need/You-Dont-Need-JavaScript: CSS is powerful, you can do a lot of things without JS.

Convert PDF to markdown quickly with high accuracy - GitHub - VikParuchuri/marker: Convert PDF to markdown quickly with high accuracy

I use a system I call homegit to manage config files and scripts in my home directory on all my machines. The idea is simple: a Git repository rooted at ~ that I push to GitHub. I’ve used this system for 6 years and like it a lot. See below to set it up for yourself!

Automatically generated from the github page.