Is this a hint that he digs me or is just friendly????

He's mid 30's but new to the office. He finds reasons to chat with me about music, dogs and other stuff we have in common. I catch him constantly stealing glances over at me when he walks by. You would think that he's into me with this, and is interested when I suggest we go to happy hour, but he cancels last minute with "I'm tired" or some other reason. There isn't a reason we can't date, other than the dreaded "don't date people you work with" stigma, but he knows I like to get to know him, but isn't making a real move. I know he doesn't have a girlfriend, and is pretty busy having to move next week, and he volunteered the comment that he doesn't like going out during the week, as it's a long day, but he doesn't ask me out for a weekend either? Is it too soon? Should I just chill and not worry about it? I've only known him a month so I don't want to freak him out, as he's very attentive during the day, like a guy who "likes you" would be. He talks briefly with others, but not like me