Rapper Lil Wayne was kicked out of an anti-violence charity basketball game after he tried to fight a referee.