Discover gists

🤗Huggingface Model Downloader

Update: The previous version has a bug. When resuming from a breakpoint, there may be an issue causing incomplete files. Please update to the latest version!!!

Considering the lack of multi-threaded download support in the official huggingface-cli, and the inadequate error handling in hf_transfer， this command-line tool smartly utilizes wget or aria2 for LFS files and git clone for the rest.

Features

⏯️ Resume from breakpoint: You can re-run it or Ctrl+C anytime.
🚀 Multi-threaded Download: Utilize multiple threads to speed up the download process.
🚫 File Exclusion: Use --exclude to skip specific files, save time for models with duplicate formats (e.g., .bin and .safetensors).
🔐 Auth Support: For gated models that require Huggingface login, use --hf_username and --hf_token to authenticate.

How to delegate to a worker node

Go to 'Workers' page
Select a Worker node with high APR
Click 'Delegate', select amount to delegate and confirm.
Sign the transaction

Complete Recent Discord Quest

Note

This no longer works in browser!

Note

This no longer works if you're alone in vc! Somebody else has to join you!

How to use this script:

Accept the quest under User Settings -> Gift Inventory

How to update the Go version

System: Debian/Ubuntu/Fedora. Might work for others as well.

1. Uninstall the exisiting version

As mentioned here, to update a go version you will first need to uninstall the original version.

To uninstall, delete the /usr/local/go directory by:

	local SECS = 5;

	local function Min(x, y) {
	if (x < y)
	return x;
	return y;
	}
	local function Max(x, y) {
	if (x > y)
	return x;

	# First let's update all the packages to the latest ones with the following command
	sudo apt update -qq

	# Now we want to install some prerequisite packages which will let us use HTTPS over apt
	sudo apt install apt-transport-https ca-certificates curl software-properties-common -qq

	# After that we will add the GPG key for the official Docker repository to the system
	curl -fsSL https://download.docker.com/linux/ubuntu/gpg \| sudo apt-key add -

	# We will add the Docker repository to our APT sources

	this word list comprises the intersection of 5 letter words occurring in three source lists:
	- wikipedia's list of most 100k most common words in the english language
	- the american english dictionary file on my laptop
	- the british english dictionary file on my laptop

	the source lists are sanitised by dropping words that contain non-alphabetic or non-ascii
	characters and converting capitals to lowercase.

	only words that occur in all three resulting lists are kept.