Picking up and carrying a fussy baby can calm and relax the baby. Having a crying baby can be very stressful for most of us. If you are really stressed out it may be best to leave the baby in a safe place for a few minutes so that you can collect yourself.