Home manager is the way to do it though.

The main configuration handles configuration of the system, home manager project was created to bring similar functionality for the user home directory. That’s where the name comes from.

Home manager also works great when using Nix on other systems to manage for files, for example on OS X.