James Tomkins made his first Barclays Premier League appearance since April in Saturday's 1-0 defeat at Hull City and the defender was disappointed that he could not mark his return to the team with a positive result.
The Hammers were beaten by Robbie Brady's contentious 12th minute penalty, despite creating a number of chances to get back on level terms.
Tomkins thought the penalty call from referee Kevin Friend was a harsh one, although he admitted the visitors should have helped themselves by making more of their possession.
He said: "The lad's gone down from Joey's challenge and he's bought the foul really. The referee has fallen for it and it's one of those things.
"We can't blame the referee though, we've got to look ourselves and work hard this week.
"From the penalty onwards on we looked the better team. We could have scored - we created a lot of chances - and we might have had a penalty ourselves, but the decisions have gone against us.
"But we're going to stay positive for the games coming up. The good thing was that we did create chances, we just need to make sure we get a couple of goals from it. We'll look at it in training, keep working hard and see where that takes us.
"There's not a lot wrong. The goals we have conceded have been mostly from set plays, two free kicks against Everton and the penalty at Hull. It's just one of those things at the moment."