Discover gists

Anti-hype LLM reading list

Goals: Add links that are reasonable and good explanations of how stuff works. No hype and no vendor content if possible. Practical first-hand accounts of models in prod eagerly sought.

Foundational Concepts

Pre-Transformer Models

I've recently joined Amazon Dublin from India and got opportunities to interview with Meta London, Zalando Berlin & some other companies. I extensively researched about companies hiring internationally which support visa & relocation for Tech roles. So sharing list of companies:

Do consider to STAR, if it helped you.

London

Code is clean if it can be understood easily – by everyone on the team. Clean code can be read and enhanced by a developer other than its original author. With understandability comes readability, changeability, extensibility and maintainability.

General rules

Follow standard conventions.
Keep it simple stupid. Simpler is always better. Reduce complexity as much as possible.
Boy scout rule. Leave the campground cleaner than you found it.
Always find root cause. Always look for the root cause of a problem.

Design rules

MySQL

Getting started

Setup Guide for `llama.cpp` on Nvidia Jetson Nano 2GB

This is a full account of the steps I ran to get llama.cpp running on the Nvidia Jetson Nano 2GB. It accumulates multiple different fixes and tutorials, whose contributions are referenced at the bottom of this README.

Procedure

At a high level, the procedure to install llama.cpp on a Jetson Nano consists of 3 steps.

Compile the gcc 8.5 compiler from source.

Installing tmux-256color for macOS

macOS 10.15.5
tmux 3.1b

macOS has ncurses version 5.7 which does not ship the terminfo description for tmux. There're two ways that can help you to solve this problem.

The Fast Blazing Solution

Instead of tmux-256color, use screen-256color which comes with system. Place this command into ~/.tmux.conf or ~/.config/tmux/tmux.conf(for version 3.1 and later):

	[
	{
	"id": "5c3a7efbb734c312",
	"type": "tab",
	"label": "Flow 1",
	"disabled": false,
	"info": "",
	"env": []
	},
	{

	# Top secret decoder
	# The CIA has discovered a plot against a major city
	# SIGINT has intercepted a message with the location and date of the attack
	# Unfortunately, the message is encoded.
	# Due to your awesome Python skills, you have been hired to decode the message
	# A double agent has provided the encoding scheme which is as follows:
	# All numbers need to be changed to spaces
	# All capital letters should be changed to *
	# The lowercase letter q is equal to \n
	# All other lowercase letters should be ignored.

	<?php
	/**
	* Fallout Shelter - Save Game File to JSON Decryption
	*/

	/*
	The save data is simply Rijndael CBC encrypted json using the passphrase "PlayerData" (without the quotes)
	and the salt "tu89geji340t89u2" (without the quotes) stored in a file called Vault1.sav, Vault2.sav, or Vault3.sav
	Locations:
	Android = /sdcard/Android/data/com.bethsoft.falloutshelter/files/Vault*.sav

	// Filename: HttpServer.cs
	// Author: Benjamin N. Summerton <define-private-public>
	// License: Unlicense (http://unlicense.org/)

	using System;
	using System.IO;
	using System.Text;
	using System.Net;
	using System.Threading.Tasks;