An appeals court refused to throw out a lawsuit seeking access to White House visitor logs.