But he insists that the win at Old Trafford earlier in the season - one of just two away wins this campaign - will have no bearing on matters at all.
"We have some difficult games coming up, such as the one against United, but we seem to raise our standards against the better teams.
"We got them in a dry patch earlier in the season but now they are on fire so it will be more difficult.
"Yes, we have had two wins in two years against them, but it is a one-off game and we don't pay any attention to history.
"They are the best team in Europe and we've got to go out there and try to beat them; they are a quality side, but we fancy ourselves against anyone at Upton Park."
As for the was-it-or-wasn't-it debate as to who should be credited for the goal against Everton on Wednesday night, Joe says:
"My shot was going in anyway but the most important thing is we got the win, and I believe one more win, whenever it comes, will be enough - but we're not looking over our shoulders.
"We are keeping positive - now we are tenth in the table now and we obviously want to finish higher."
Joe showed a little bit of 'professionalism' in front of the Chicken Run in the final minutes as he and his colleagues won a series of throw ins and free kicks to use up time and preserve the lead.
Joe says it was the fear of another rollicking from Glenn Roeder that kept them focused and explains:
"It's easier to do that when you are 1-0 up; we have got players like me, Trevor, and Paolo who like to get forward, but last week the gaffer was mad when we gave away that late goal."