Have no fear when people call me the “Vicar of Christ,” when they say to me “Holy Father,” or “Your Holiness,” or use titles similar to these, which seem even inimical to the Gospel. Christ himself declared: “Call no one on earth your father; you have but one Father in heaven. Do not be called ‘Master’; you have but one master, the Messiah” (Mt 23:9-10). These expressions, nevertheless, have evolved out of a long tradition, becoming part of common usage. One must not be afraid of these words either.
Pope John Paul II from “Crossing the Threshold of Hope,” p. 6
Sorry but, yes, I truly am afraid to do this, as all Christians should be. We should be afraid to disobey the Lord. For in addition to not wanting to grieve Him, we know with certainty that we will stand before Him one day.
28 Therefore, since we are receiving a kingdom which cannot be shaken, let us have grace, by which we may serve God acceptably with reverence and godly fear. 29 For our God is a consuming fire.
Serving God acceptably means acknowledging only One Holy Father, the God and Father of our Lord Jesus Christ.