Look at the cached memory, windows will cache as much memory as possible, but leave it open for use. You can try clearing this, but windows just takes it back. Here is a sample discussion
https://www.reddit.com/r/Windows10/comments/4c3vqe/is_it_normal_to_have_over_half_of_my_ram_cached/
Windows will cache