Yui told Kirito that it would be a good idea for him to clear out his inventory as all the items were bugged and he could be detected by the system if they remained. As he was about to, he was hesitant in doing so. I can assume one of the 2 reasons:
All the items were a record of his 2 years in SAO and had a personal connection to them.
Yui's Heart was in the inventory and he was being careful not to delete it.
However, in the anime, it didn't show any sort of filter was applied and his entire inventory was cleared. So I am wondering what happened to Yui's Heart - was it not in his inventory because Yui was right beside him or was Yui protecting it in some way from the system so that it wouldn't appear in his inventory.