White House adviser Hassett: ‘It’s scary to go to work’