Before HO, OLDHAM, and WILSON, Circuit Judges. ANDREW S. OLDHAM, Circuit Judge: The original opinion in this case issued on July 14, 2021. The petition for rehearing is DENIED. We withdraw our previous opinion and substitute the following in its place. A judge on our court granted Adrian Castro a certificate of appealability (“COA”). It’s undisputed that the COA is invalid under 28 U.S.C. § 2253(c)(2)–(3) because it fails to specify a constitutional issue. The only question is what we should do about it. We vacate the COA and dismiss the appeal. I. Adrian Castro plotted and executed a spree of violent thefts against United States postal workers. The Government indicted Castro and charged him with, inter alia, violating 18 U.S.C. § 2114(a) by assaulting mail carriers and putting their lives in danger, and violating 18 U.S.C. § 924(c)(1)(A) and (c)(3)(B) by using a firearm in relation to a crime of violence. Castro pleaded guilty to the relevant charges, and the district court sentenced him to 552 months in prison. This sentence included four concurrent sentences for 168 months based on the fact that Castro “put[] his [victims'] li[ves] in jeopardy by the use of a dangerous weapon.” 18 U.S.C. § 2114(a). Castro did not appeal. His conviction became final on July 15, 2004. Twelve years later, Castro filed his first motion under 28 U.S.C. § 2255. That was long after the one-year limitations period provided in the Antiterrorism and Effective Death Penalty Act (“AEDPA”). See 28 U.S.C. § 2255(f)(1). But Castro argued he should get a new limitations period based on Johnson v. United States, 576 U.S. 591 (2015). See 28 U.S.C. § 2255(f)(3) (providing a new one-year limitations period where the Supreme Court recognizes a new right and makes it retroactively applicable to cases on collateral review). The magistrate judge determined that Johnson‘s holding as to the residual clause of 18 U.S.C. § 924(e)(2)(B) was inapplicable to Castro’s conviction under § 924(c)(3)(B). Thus, Castro did not get the benefit of § 2255(f)(3), and his motion was time-barred. Castro objected to the report and recommendation, albeit with a concession that his argument was foreclosed by binding Fifth Circuit precedent. The district court adopted the report and recommendation, denied Castro relief, and denied a COA. Castro then asked our court for a COA. One judge of our court granted a COA on a single procedural ground: “whether the district court erred by denying Castro’s § 2255 motion as untimely.” II. Prisoners challenging their custody are not like ordinary litigants. For over a century, Congress has required prisoners—unlike anyone else appealing a judgment—to receive permission before appealing. We first explain that permission requirement. Then we vacate Castro’s COA. A. In 1908, Congress took away the appeal-as-of-right from state prisoners. See An Act restricting in certain cases the right of appeal to the Supreme Court in habeas proceedings, 35 Stat. 40, 40 (1908). In its place, Congress instituted the certificate of probable cause (“CPC”) procedure. The CPC procedure required a state prisoner to obtain certification from “the United States court by which the final decision was rendered or a justice of the Supreme Court” that “probable cause for an appeal” existed. Ibid. This prerequisite to appeal served to preempt frivolous petitions and prevent the expenditure of precious judicial resources on meritless cases. See Davis v. Jacobs, 454 U.S. 911, 917 (1981) (Rehnquist, J., dissenting) (“[C]ongress[] . . . impose[d] th[e] [CPC] requirement as a means of terminating frivolous appeals in habeas corpus proceedings.”). In 1948, Congress broadened the types of judicial officers empowered to grant CPCs to include circuit judges in addition to Supreme Court justices. See An Act to revise, codify, and enact into law title 28 of the United States Code entitled “Judicial Code and Judiciary,” 62 Stat. 869, 967 (1948). And although the statute did not designate the substantive standard for probable cause, the Supreme Court held that a prisoner seeking certification must offer a “substantial showing of the denial of a federal right.” Barefoot v. Estelle, 463 U.S. 880, 893 (1983) (quotation omitted). A tidal shift occurred in 1996 when Congress enacted AEDPA, which overhauled the statutory framework governing habeas corpus with an eye towards “eliminat[ing] delays in the federal habeas review process.” Holland v. Florida, 560 U.S. 631, 648 (2010); see Pub. L. No. 104-132, 110 Stat. 1214 (1996). Section 2253(c)(2), as amended by AEDPA, retained the certification requirement but changed the name to a “certificate of appealability.” And instead of permitting an appeal anytime a prisoner made “a substantial showing of the denial of a federal right,” Barefoot, 463 U.S. at 893 (emphasis added), AEDPA elevated the standard and limited appeals to only those cases in which an applicant makes “a substantial showing of the denial of a constitutional right,” 28 U.S.C. § 2253(c)(2) (emphasis added). As directly relevant here, AEDPA applied the certificate requirement for the first time to federal prisoners like Castro. See United States v. Orozco, 103 F.3d 389, 391 (5th Cir. 1996) (noting “a pre-AEDPA § 2255 movant was not required to obtain [a CPC] in order to appeal the final order in a § 2255 proceeding to a court of appeals”). Today, state and federal prisoners face the same hurdle to noticing an appeal: The applicant must obtain a COA by making “a substantial showing of the denial of a constitutional right.” 28 U.S.C. § 2253(c)(2). The requirement that a COA identify a constitutional issue serves the same interest as the earlier CPC requirement—namely to “screen[] out issues unworthy of judicial time and attention” and to “ensure[] that frivolous claims are not assigned to merits panels.” Gonzalez v. Thaler, 565 U.S. 134, 145 (2012). In short, the COA requirement serves a gatekeeping function. See Jennings v. Stephens, 574 U.S. 271, 291–92 (2015) (Thomas, J., dissenting) (describing the history and purpose of the COA requirement). The must-identify-a-constitutional-issue requirement is not diminished where a district court denies relief on procedural grounds. See Slack v. McDaniel, 529 U.S. 473, 484 (2000). To obtain a COA in such a circumstance, an applicant must show “that jurists of reason would find it debatable whether the petition states a valid claim of the denial of a constitutional right, and that jurists of reason would find it debatable whether the district court was correct in its procedural ruling.” Id. at 478. The rationale for these rules is simple: If a prisoner must eventually prove a constitutional violation to secure release from custody, his appeal should proceed only if he can prove a debatable constitutional issue at the outset. A procedural-only appeal is much ado about nothing. See, e.g., id. at 483–84 (holding that a COA applicant “must make a substantial showing of the denial of a constitutional right”); Miller-El v. Cockrell, 537 U.S. 322, 336 (2003) (“[Section] 2253(c) permits the issuance of a COA only where a petitioner has made a ‘substantial showing of the denial of a constitutional right.’”). Most recently, the Supreme Court confronted a COA issued by our court that is materially identical to the COA our court issued in this case. See Gonzalez, 565 U.S. at 138. Here are the two Fifth Circuit COAs side-by-side: