In the 95th minute, Toni Kroos, popularly referred to as the Sniper by his supporters, pulled a rabbit out of the hat and scored the match-winning goal.
With the win, Germany is on much safer ground to move forward to the knockout stage, as it sits even with Sweden on three points, with both three points behind first-place Mexico.
Low, who led the Germans to glory in Brazil four years ago, paid particular tribute to Kroos, the midfielder whose mistake led to Sweden's goal from Ola Toivonen.
"They didn't create that many good opportunities, our keeper did make a few good saves, but I feel unlucky we didn't get at least one point". Kroos stepped to the ball, tapping it to Marco Reus, who settled it for Kroos to take aim on goal.
From there the Germans launched the attack that led to substitute Jimmy Durmaz tripping Timo Werner and conceding the free kick that set up the chance for Kroos to curl in the victor.
"We know Sweden are tough when they play at their best but we also know that we have a strong team and we are sure we will win this match". Germany forced Sweden to play defensively for nearly the entire second half and eventually the attack paid off.
"Something that I did appreciate was that we didn't lose our nerve, we didn't panic after going down".
Supporters watching on big screens at the Brandenburg Gate huddled nervously under grey clouds and drizzle, before throwing their umbrellas away as Toni Kroos´ late victor saved Germany.
"It was the right decision to pick him and drop Mesut Ozil". The defending world champions come into Saturday's game in Sochi with their hopes of reaching the last 16 hanging by a thread after losing their opening match 1-0 against Mexico.