Four week old puppy hard to raise?

This man offered me a four week old puppy who he says is pure shepherd. He has a white stripe down his snout. I feel so awful for the dog. He says its mother rejected it and he needs a new home for it. I called the Humane Society and she said I could save him if I socialized him with other dogs soon. Should I take the pup? It breaks my heart.