Learning from the Inside-Out