Hello Sébastien,
Let's try the following.
Map each K2 category into a separate menu item, so each category has its own URLs and module placements.
Finally create a blank K2 categories menu item (leave the category selection empty) and call it eg: content so all orphan tags, users and date/search listing have their own URLs, menu item and modules.