"I believe a boycott of the Beijing Olympics would unfairly harm our athletes who have worked so hard to prepare for the competition," Pelosi said in a statement.