"It is going to be difficult this season but I think we have the players that can do it," he says.
"It was a great opportunity last season against Crystal Palace, a massive one that was lost, but we have to look forward now.
"I can't wait for the first game; it is going to be a massive test with Leicester having come down - and it will be interesting with David Connolly there.
"Him going is a loss but things happen in football and we just have to get on with it."
Rufus missed virtually all of last season through a foot injury that required two operations and he admits:
"Last year was a nightmare but I don't want to keep looking back because that is over now.
"Hopefully I can get into this team because there is competition for near enough every position.
"I'm not feeling bad; it is just nice to be playing football.
"Touch wood, everything has been going okay; there have been a few aches and pains but that is to be expected."
Rufus hopes for another chance to play behind Teddy Sheringham at Colchester and he is delighted by the signing.
"You can see his quality in training and he is a great addition to the squad," he says.
"He has looked after himself and that is the main thing."
Teddy's former Spurs team mate Sergei Rebrov, currently in his home country of Ukraine, is not involved at Colchester.