Yes, great advice above, and I'd like to add time! The more time you spend with him early on, the easier I think socialization and training will be. Puppy proof your house but still more important, be there to show him what's ok and what is not ok. Interact with him, make sure he can relax but that you are there for him if he needs you. If he's a pup, he will need to go out often so keep him close!
We didn't get many things before Castor came home - I think just feeding bowls, a little basket bed, a ball, and a leash. Soon we got some more toys, but honestly, the Castor's favourite toys when he was a pup were old cardboard boxes and paper rolls that we used to hide treats.