Definitely know the feeling. Ever since joining the real world, I haven't been able to get back into these games. The witcher 3 was probably the best example of this in that I got a few hours into it and gave up.
First, the ridiculous size of the game and how much there is to do simply stresses me out. If a game is stressing me out, I'm doing something wrong.
Second, knowing I only have an hour or two a day makes it so hard to feel interested in the game and become invested. Playing an hour or two here or there, quitting, then coming back a couple days later makes it really hard to remember what has happened in the story and what I'm supposed to be doing. By the time I remember what I did last, reacquaint myself with where I am and then reread the quest I need to be doing, I've wasted 30 minutes of my time.
Finally, there is so much you can do but also so much that you can miss. Knowing I'm going to play through the game one time, Im extremely anal and feel like I need to do every little side quest and mission before moving on. Really becomes a drag.