Grimoire isn't really too important. A lot if it is from things such as Ghost hunting, just going to a new location, or just getting a weapon. Only sometimes is it relevant, as you can up your score if you go Flawless, kill a specific boss, it complete a Raid. But I do not think it matters.