I would say family comes first any day any time. Easier said then done. I would take a good look at how and where I am spending my energies and time. Once I determine how much time I need to spend with my family then may be its time to have a 1:1 with the manager and discuss this issue. If the company/manager does not appreciate your concerns then getting another job with lesser stress/responsibilities could be an option? Not sure if getting another job in this economy is as easy? But then again I think I am just stating the obvious.