Mohamed Salah's first-half strike was enough to grab all three points for the Reds to keep up with leaders Manchester City, but it was far from a routine victory.
Huddersfield put in a spirited performance and perhaps deserved a point having had 13 attempts on goal, but just one on target.
Despite the win, Klopp was unhappy with his players' inability to kill the game having been on the back foot for most of the second half.
"It was a good game from Huddersfield and not so good game from us. So we'll take it," Klopp told BT Sport.
"I sometimes look frustrated on the touchline even if we're winning. The performance wasn't 100 per cent, it looked like we could have scored in six or seven situations but we needed one better pass.
"We did lots of good things and then the last pass wasn't good. How can I explain that? I need to look back at the game. The players weren't great with their last pass."
One positive note for Liverpool was that they kept another clean sheet but also the return of Adam Lallana, who was making his first appearance since August.
The 30-year-old has struggled with injuries and had to come off with cramp. However, the midfielder said he was just glad to be back in the side.
"I feel like I’ve done as much as possible to be ready to play and it was nice to contribute after not doing so for so long. There have been constant setbacks and at times you doubt yourself and your ability.
"It’s a long season and only a few weeks ago I was thinking where my next game is going to come from, and then unfortunately some lads came back from international duty injured and that’s when you need your squad."