It is a part of the work of the ministry to administer the ordinances.  Those who are commanded to teach, as ministers of the gospel, are the same who are to baptize.  “Go ye therefore, and teach all nations, baptizing them in the name of the Father, and of the Son, and of the Holy Ghost; teaching them to observe all things whatsoever I have commanded you; and, lo, I am with you alway, even unto the end of the world.”—Matthew 28:19-20.  In this text the same persons who are commanded to go teach are also commanded to baptize. 

It is the work of the ministry to go teach the things concerning the kingdom of Christ, and it is the work of those who teach these things to baptize those who are taught.  The Primitive Baptists are the only people, in our judgment, who are teaching as Christ commanded.  They are teaching the true doctrine of God our Savior.  Hence, the Primitive Baptist ministers are the persons who are authorized by the Savior to administer baptism. 

Others are not teaching the doctrine of God our Savior, are not teaching the things commanded by the Savior, so are not authorized by him to administer baptism.  If they baptize, it is without the authority of Christ.  Baptism administered without the authority is not gospel baptism.  This is a good reason why Primitive Baptists do not receive the baptism administered by Methodists, Missionary Baptists, or other people.  We do not think the doctrine or principles they hold to and teach are true, and the baptism they administer is no better than the doctrine they teach.

“And I appoint unto you a kingdom, as my Father hath appointed unto me; that ye may eat and drink at my table in my kingdom, and sit on thrones judging the twelve tribes of Israel.”— Luke 22:29-30.  The Savior has appointed a kingdom for his people here in the world, that they may have a blessed home here on earth, that they may eat and drink at his table in his kingdom— only one. 

“There are threescore queens, and fourscore concubines, and virgins without number.  My dove, my undefiled is but one; she is the only one of her mother, she is the choice one of her that bare her.”— Song of Solomon 6:8-9.  The church of Christ is but one.  There are many institutions, but of all the institutions of the world, only one is the church of Christ.  The Savior has never authorized the queens nor concubines nor the virgins to administer the ordinances of his house. These queens, concubines, and virgins represent the many institutions that are in the world.  Jesus has never commanded that his ordinances be administered in these institutions.  His love, his dove, his undefiled, is but one.  That is his church or kingdom, which is but one.  He has authorized and commanded that his ordinances be administered in this one kingdom.  They cannot be administered elsewhere so that they will be recognized or approved by him.  He does not approve of anything being done in a place where he has not commanded.  We think the Primitive Baptist Church is the true church of Christ, the kingdom he set up while he was on earth.  If it is, then that is the place where the ordinances are to be administered.  This is another reason why we do not accept the baptism administered by other people.  If the Primitive Baptist Church is the church of Christ, the others are not.  If any of the others are the church of Christ, then the Primitive Baptist Church is not the church of Christ.

“Wherefore, my brethren, ye are also become dead to the law by the body of Christ; that ye should be married to another, even to him who is raised from the dead, that we should be married to another, even to him who is raised from the dead, that we should bring forth fruit unto God.”—Romans 7:4.  Those who are dead to the law are those who have been born again.  They are dead to the law, and they should now be married to Christ.  In order that they be married to Christ the marriage ceremony must be must be performed by one who has the proper authority to perform it.   If two people desire to marry, in order that they carry out the desire, they must have the ceremony performed by one who is authorized to do so.  They may get a good man to pronounce the ceremony for them, but unless he has the proper authority, the marriage would not be legal  It would make no difference how good the man may be who pronounces the ceremony, his goodness and honesty, or sincerity, would not make the marriage legal  To be married to Christ, the rite must be performed by one authorized to perform it. 

Baptism is the ceremony, or the rite, by which God’s people are married to Christ.  It is the work of the ministry who are set apart by his church to administer baptism, they are the persons who are authorized to administer the ordinance.  They are the only ones who can perform the marriage ceremony.  Others may go through the form, but it is not recognized by the Savior.  The form may be alright, but a form without reality or authority is without value.  So the baptism administered by others is without authority, hence without value, so far as the true church of Christ is concerned.”  (C.H. Cayce vol. 1 ppg 53-55).