In Romans 3:23 we read, “For all have sinned and fall short of the glory of God.” Everyone experiences guilt because everyone is guilty of violating God’s law. James 2:10 says, “For whoever keeps the whole law and yet stumbles in one point, he has become guilty of all.” Everyone deserves God’s just condemnation in hell. But God in His love and mercy sent us a Redeemer. He sent us One that would take our sins upon Himself. He sent us Jesus Christ. And after receiving our sins, the Father spent His wrath upon Him. The punishment for all our sins was received by Him. Thus with the penalty of sin now taken away for those in Christ, we can receive a full pardon for our sins. Remove our sins from God’s presence in Christ and naturally you remove the guilt as well.