Orlando Ding - Afternoon with Green Tea

Sign in Subscribe

Orlando Ding

不积小流,无以成江海

Finetuning llama

For Llama2, refer to Fine-Tuning Llama 2 Using LoRA and QLoRA: A Comprehensive Guide. For training phase * Set up QLoRA and BitsAndBytes configuration * Load base model with quantization setting * Tokenizer and perfconfiguraiton * Start SFTTrainer * Save weight to certain folder after training For evaluation phase * Load base model using AutoModelForCausalLM * Merge

DSPy and outlines preparation

Machine Learning

DSPy and outlines preparation

DSPy and outlines preparation on macOS 10.13.6

Conda env share and migration

The passage mainly describes how you and your teammate can share the same conda environment on one system and how to restore your conda environment with the customized location. For sharing on the Ubuntu system, you need to create a shared group for you and your teammate, then assign the

Add SSH keys to authorized_keys file

Reference: https://askubuntu.com/questions/46424/how-do-i-add-ssh-keys-to-authorized-keys-file An alternative way to install your public key in the remote machine's authorized_keys: cat ~/.ssh/id_rsa.pub | ssh USER@HOST "mkdir -p ~/.ssh && cat >> ~/.ssh/authorized_keys"

Perl setup in visual code

Visual code Perl Extension

USB to Android Device

When attaching Android devices on Ubuntu system, they mayn't be recognized by adb directly. Therefore, extra steps are needed to make them ready for usage. 1. figure out the device id by lsusb, refer to https://askubuntu.com/questions/166420/how-to-detect-an-usb-device How to detect an USB device?I got a

How to rebuild 'Open With...' on macOS

A simple trick to reset 'Open With..' menu list on macOS

遗失

SSL enabling for Jupyter and Nginx

How to enable ssl for web server and self-hosted application

忆聂鲁达十四行诗

很久之前，翻译过聂鲁达这首十四行诗，今天忽然发现有人点了我一下，所以blog一下。免得时间长了，忘记了原作： I love the piece of earth you are, because in all the planetary prairies I do not have another star. --- 100 Love Sonnets, Poet, Pablo Neruda 先生雅集：我爱你这篇小小的土地，因为在这广袤如草原的繁星之间在没有属于我的第二颗星辰之前的翻译：君之壤吾心所系虽星海浩瀚别无他地一直觉得没有把prairies和繁星的意境很好的表达出来，anyway，statistics为王，有时间在慢慢找灵感。

Clean committed big file in Git

Just handle with removal of git larger file without hard reset

Upgrade Google Chrome Canary on legacy System

Upgrade Google Chrome Canary on legacy System

Google Chrome Canary on macOS 10.13.6

Enable FLAG_SECURE on Scrcpy

You can find the whole story in Crash on Android 12 Developer Preview 1 about why encountering a black screen when using Scrcpy to stream Android screen in a video stream. Long story in short, Using rootAVD to root Android devices or emulators, also check the video tutorial from Youtube

GPT-4 Architecture, Infrastructure, Training Dataset, Costs, Vision, MoE

GPT4, algorithm, ML architect

Stray Birds译文

Translation of poem

若思念便思念

题记: How long is forever? Sometimes, just a second 剪不断的时间故事里有牵绊宁州夜渐远人在云之南想起却难言萦怀心间静待一叶归期无期的船远山又闻燕归南故楼东望昨炊烟我在心间冰心玉壶时光荏苒云开我知道你在眷恋君心我心即使相隔千里也并不遥远风起你知道我在期盼我心君心如影在侧相伴人若思念便思念灵犀便是相见曲未散淼淼山海间心犹在难逃聚散你在我心间莞尔即是诺言云开我知道你在眷恋尺素情长天涯鸿雁风起你知道我在期盼浅吟低唱风寄心弦飞鸟看故事里的过往我和你穿越时光

Transformer

Reference: Transformers Explained Visually (Part 1): Overview of Functionality Transformers Explained Visually (Part 2): How it works, step-by-step Transformers Explained Visually (Part 3): Multi-head Attention, deep dive Transformers Explained Visually — Not Just How, but Why They Work So Well Foundations of NLP Explained — Bleu Score and WER Metrics Foundations of

Nvidia-smi fail to communicate with driver

Nvidia-smi fail to communicate with driver

After we might periodically update our linux kernel, sometimes we might confront with "Nvidia-smi failure": even if your driver is working correctly, error message will pop up, when running $nvidia-smi, like following: dluser1@cnpvgl903653:~$ nvidia-smi NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the

GRE Analytical Writing Toolkit

GRE Analytical Writing Toolkit

GRE AWA 1.3 toolkit

Debugging Tensorflow via TensorBoard Plugin

Machine Learning

Debugging Tensorflow via TensorBoard Plugin

How to launch Tensorflow debugger via Tensorboard.

Deconvolution Analysis

Computer Vision

Deconvolution Analysis

Analysis to matrix operation for convolution operation

Machine Learning

Chapter 1 - Machine Learning By Professor Zhou

Version Space for chapter 1

Reinforcement Learning

Convergence

To analyze how to guarantee Vs(s) convergence with TD(k) update

Reinforcement Learning

Temporal-Difference Learning

Temporal-Difference Learning in Reinforcement Learning, like what you love, TD(0), TD(1), TD(lambda).

Machine Learning

Template Models for Bayesian Networks

PGM model by Daphe from stanford university based on MIT bibe