Ohio-based Big Lots announced it would close the remainder of it stores and will hold 'going out of business' sales.