Pre-Training Survey