Abstract
Part 1 of this series demonstrated that a container closure integrity test performed according to ASTM F2338-09 Standard Test Method for Nondestructive Detection of Leaks in Packages by Vacuum Decay Method using a VeriPac 325/LV vacuum decay leak tester by Packaging Technologies & Inspection, LLC (PTI) is capable of detecting leaks ≥5.0 μm (nominal diameter) in rigid, nonporous package systems, such as prefilled glass syringes. The current study compared USP, Ph.Eur. and ISO dye ingress integrity test methods to PTI's vacuum decay technology for the detection of these same 5-, 10-, and 15-μm laser-drilled hole defects in 1-mL glass prefilled syringes. The study was performed at three test sites using several inspectors and a variety of inspection conditions. No standard dye ingress method was found to reliably identify all holed syringes. Modifications to these standard dye tests' challenge conditions increased the potential for dye ingress, and adjustments to the visual inspection environment improved dye ingress detection. However, the risk of false positive test results with dye ingress tests remained. In contrast, the nondestructive vacuum decay leak test method reliably identified syringes with holes ≥5.0 μm.
Introduction
Vacuum decay is a useful and widely accepted leak detection method for nondestructively testing a variety of container/closure systems. The method consists of placing the test container in a chamber, sealing and then evacuating the chamber to a predetermined vacuum level, isolating the test chamber from the vacuum source, and then monitoring the rise in pressure (vacuum decay) inside the chamber resulting from container leakage. Vacuum decay leak test method sensitivity is dependent on several factors, including, for example, test chamber design, pressure transducer sensitivity, test vacuum level, test system dead space volume, and total test time. Thus, the capabilities of any given vacuum decay leak test method are specific to both the leak test instrument and its manufacturer.
As reviewed in Part 1 of this series (1), vacuum decay's usefulness as a nondestructive leak test method for testing pharmaceutical packages has been recognized in published literature as well as in compendium and a recent FDA regulatory guidance. Improvements in vacuum decay technology over the last decade have allowed for more sensitive and reliable testing. Such improvements are reflected in ASTM F2338-09 Standard Test Method for Nondestructive Detection of Leaks in Packages by Vacuum Decay Method (2) in which leak detection tests are described for various pharmaceutical, food, and medical device package systems. Part 1 of the current work presented the latest ASTM F2338 precision and bias studies performed to expand this method's scope to include nonporous rigid packages completely or partially filled with liquid. The “liquid leak test” was performed at about 1 mbar (absolute) target vacuum. Test packages consisted of 1-mL glass syringes. Positive controls had laser-drilled defects in the barrel ranging from about 5 to 15 μm in nominal hole diameter. The leak tester used was the VeriPac 325/LV by Packaging Technologies & Inspection, LLC of (PTI; Tuckahoe, NY). All defective syringes with holes ≥5.0 μm were successfully identified regardless of the package contents, air or water.
While these data are impressive, the question for many remains, “How does such a method compare to a more familiar dye ingress leak test method?” The United States Pharmacopeia (USP), European Pharmacopeia (Ph.Eur.) and International Organization for Standardization (ISO) all describe dye ingress methods for evaluating the integrity of parenteral vial package systems. Both USP 31 〈381〉 Elastomeric Closures for Injection (3) and Ph.Eur. 3.2.9 Rubber Closures for Containers for Aqueous Parenteral Preparations, for Powders and for Freeze-dried Powders (4) include a dye ingress test for verifying the ability of a punctured elastomeric closure to reseal. These tests are identical, requiring the test package to be submerged in a methylene blue aqueous solution (0.1% w/v) while exposing the package to vacuum (−27 kPa) for 10 min followed by atmospheric pressure conditions for an additional 30 min. ISO 8362-5 Injection Containers for Injectables and Accessories—Part 5: Freeze drying closures for injection vials, Annex C Test method for closure/container integrity and self-sealing (5) describes a similar dye ingress test for punctured closures; the principal difference between the ISO and compendia tests being the requirement to maintain the vacuum challenge for 30 min rather than 10.
The current study compared the USP/Ph.Eur. and ISO dye ingress test methods to PTI's vacuum decay technology for the detection of 5-, 10-, and 15-μm laser-drilled hole defects in 1-mL glass prefilled syringes. Tests were performed at three different test site locations. Three PTI VeriPac vacuum decay leak test instruments were used, all programmed with the same leak test method parameter set-points. Dye tests included these standard methods as well as various modifications in attempts to improve the dye test methods' sensitivity and reliability.
Materials and Methods
Materials
The test packages were 1-mL glass syringes with staked needles and elastomeric nonrigid needle shields manufactured by Becton Dickinson (Franklin Lakes, NJ) and purchased by Amgen, Inc. (Thousand Oaks, CA).
Leaks were artificially created by Lenox Laser (Glen Arm, MD; www.lenoxlaser.com) by laser-drilling a defect through the glass barrel of each positive control syringe. These defects were sized to a corresponding nominal hole diameter by measuring the outlet flow of compressed air applied to the defect at 15 psig. Each defect was assigned an equivalent hole diameter to the nearest 0.1 μm by comparing the hole outlet flow rate to calibrated traceable primary transfer standards. Test samples were grouped into target hole diameter subsets of 5, 10 and 15 μm. Each sample fell within ±2 μm of the target diameter. These same holed syringes used for the current study were also used for the ASTM F2338 precision and bias studies described in Part 1.
Each of the three test sites utilized unique negative control (no-hole) and positive control (holed) test sample populations. Each test site was given a total of 20 test syringes: five negative control syringes plus 15 positive control syringes, five per each hole-size subset (5, 10 and 15 μm). The same syringes were used for both the dye ingress and vacuum decay tests. Holed syringes were not tested across sites to minimize hole clogging risks. All costs for generating these defects were underwritten by PTI.
Methods
Test Site Locations:
The test locations included Amgen, Inc. in Thousand Oaks, CA, Bristol-Myers Squibb Co. in New Brunswick, NJ, and Whitehouse Analytical Laboratories, Inc. in Whitehouse, NJ. Test sites are anonymously referred to as Sites 1 through 3.
Vacuum Decay Leak Test:
Vacuum decay leak tests were performed at each test site on all empty (air-filled), stoppered test syringes just prior to subjecting them to dye ingress tests. All vacuum decay leak tests were performed using a PTI VeriPac 325/LV vacuum decay leak tester, one instrument per test site for a total of three test units. The test results were used to verify each hole's presence and relative size. The vacuum decay liquid leak test method parameter set-points used in the Part 1 precision and bias studies were duplicated for the current study (Table I). The differential pressure reading and the Pass/Fail test results were documented for each sample tested.
PTI VeriPac 325/LV Vacuum Decay Leak Test Parameters
Dye Ingress Tests:
After the vacuum decay leak tests were completed, the syringes were prepared for dye ingress testing. The stoppers were first removed from the syringes, each syringe was filled with 1-mL of water, and then the stoppers were slowly reinserted. Syringe stoppering was manually performed by positioning a narrow-gauge wire between the barrel and the stopper to vent the syringe during stopper insertion.
The various dye ingress methods used at the test sites are described in Table II. The USP/Ph.Eur. and ISO tests were performed at Site 1. The only difference between the compendia and ISO methods was the vacuum exposure time (10 min versus 30 min). The USP/Ph.Eur. and ISO methods were modified at Sites 2 and 3 to include greater vacuum conditions (−37 kPa versus −27 kPa). These modifications were attempted to improve dye ingress test method sensitivity and reliability.
Dye Ingress Test Methods
Dye Test Visual Inspection Method and Inspector Qualification:
The USP/Ph.Eur. and ISO dye ingress tests all require visual inspection for package dye ingress verification. No compendia or ISO dye leak test method specifies the inspection environment; therefore, each test site utilized readily available lighting and background materials for the inspection area as described in Table III.
Visual Inspection Environments
No standard dye ingress method imposes inspector capability criteria. Nevertheless, in the current study each inspector participated in a qualification study to demonstrate his or her ability to accurately identify those syringes containing trace amounts of dye. These results only served to characterize each inspector's visual inspection abilities; they were not used as inspector selection criteria.
The qualification study required each individual to inspect a small population of syringes filled with aqueous solutions ranging from 0 to 0.4 ppm in methylene blue dye concentration. The inspector was required to identify each sample as either “containing dye” or “not containing dye”. Samples were blinded to the inspector and were inspected in random order at an inspection pace of no more than 10 seconds per syringe. The inspector was provided known, negative control syringes (no dye) for visual comparison. All inspections were completed within 15 min of test syringe preparation to prevent possible dye fading or package sorption effects. No inspector had been prescreened for visual acuity or formally trained to perform visual inspection.
Results and Discussion
Inspector Qualification Studies
The inspector qualification test results summarized in Table IV illustrate the variability in dye detection ability among the inspectors and the impact of the inspection environment on inspection results. At Sites 1 and 2 the dye concentration detection limit ranged from 0.2 to 0.4 ppm; all 0-ppm negative controls were correctly identified. In contrast, no Site 3 inspector was able to clearly differentiate the negative and positive control syringes during Trial 1. The Site 3 inspection environment was subsequently modified by introducing brighter, whiter lighting, and adding vertical plus horizontal white background surfaces (refer to Table III). In addition, the maximum concentration of dye in the positive controls was increased from 0.4 to 0.6 ppm. Site 3 Trial 2 yielded noticeably improved inspector performance. This Trial 2 inspection environment was utilized for all subsequent Site 3 dye ingress test inspections. (Note: Site 3 inspector 9 was replaced after trial 1 due to lack of inspector availability, not due to qualification performance.)
Inspector Qualification Results Using 1-mL Glass Syringes Spiked with Methylene Blue
Considering Site 1, Site 2, and Site 3 (Trial 2) results, the limit of detection for trace dye in the 1-mL syringes ranged from 0.2 ppm (inspectors 3 and 4) to 0.5 ppm (inspector 7). Inspector 7 was the only individual unable to correctly identify all control, no-dye syringes.
Vacuum Decay Leak Test Studies
The VeriPac 325/LV vacuum decay leak test results obtained at Sites 1 through 3 are provided in Tables V through VIII. All negative control, no-hole syringes were correctly identified. All 15-μm and 10-μm holed syringes were correctly identified as leaking. Of the fifteen 5-μm holed syringes, one syringe (no. 106) yielded differential pressure readings (22 and 25 Pa) near the acceptance criteria (refer to Tables V and VI). (Note: In Part 1, syringe 106 yielded similar differential pressure [dP] values near the pass/fail limit, with one false negative reading. This sample's hole size was certified as the smallest of all test samples [4.7 μm].) All other holed syringes gave differential pressure readings considerably larger than the control, no-hole syringes, roughly correlating to syringe hole size.
USP/Ph.Eur. Dye Ingress Test versus Vacuum Decay Leak Test—Test Site 1
ISO Dye Ingress Test versus Vacuum Decay Leak Test—Test Site 1
Dye Ingress Studies
USP/Ph.Eur. Dye Ingress Test:
The USP/Ph.Eur. dye ingress visual inspection results are summarized in Table V. With this method, it was not possible for the inspectors to correctly identify all holed versus no-hole syringes. Figure 1 illustrates the dye ingress variation seen among these test samples.
USP/Ph.Eur. dye ingress test samples—Test Site 1. Top row, left to right: five control syringes for visual comparison; five no-hole negative control dye test syringes. Second row, left to right: five 5-μm holed syringes; five 10-μm holed syringes. Third row: five 15-μm holed syringes.
ISO Dye Ingress Test:
The ISO method dye ingress test results are provided in Table VI. In this case, all 15-μm holed syringes and all negative control syringes were correctly identified by all inspectors. Some of the 10-μm holed syringes were identified as leakers by all inspectors. Only some of the 5-μm holed syringes were identified as leakers by two of the inspectors. (No photograph was taken of these samples.)
Modified USP/Ph.Eur. Dye Ingress Test:
The modified USP/Ph.Eur. dye ingress visual inspection results are outlined in Table VII. At this greater vacuum condition, visibly detectable dye entered all 10- and 15-μm holed syringes. None of the inspectors could correctly identify the 5-μm holed syringes. One inspector incorrectly identified a no-hole control as containing dye.
Modified USP/Ph.Eur. Dye Ingress Test versus Vacuum Decay Leak Test—Test Site 2
A photograph of these test samples is shown in Figure 2. Comparing Figures 1 and 2, it is clear that the visible ingress of dye is much improved using the modified, higher vacuum USP/Ph.Eur. test method.
Modified USP/Ph.Eur. dye ingress test samples—Test Site 2. Top row, left to right: five 5-μm holed syringes; 1 negative control no-hole syringe. Second row, left to right: five 10-μm holed syringes; 1 negative control no-hole syringe. Third row, left to right: five 15-μm holed syringes; 1 negative control no-hole syringe.
Modified ISO Dye Ingress Test:
The modified ISO dye ingress results are found in Table VIII. The greater vacuum conditions and the longer 30-min vacuum time resulted in noticeably greater dye ingress for all holed syringes. All holed syringes were correctly identified as leakers. However, all threeinspectors failed to correctly identify all control, no-dye syringes, resulting in 40% false positive test results. Figure 3 shows a photograph of these test samples.
Modified ISO Dye Ingress Test versus Vacuum Decay Leak Test—Test Site 3
Modified ISO dye ingress test samples—Test Site 3. Top row, left to right: five 5-μm holed syringes, 1 negative control no-hole syringe. Second row, left to right: five 10-μm holed syringes, 1 negative control no-hole syringe. Third row, left to right: five 15-μm holed syringes, 1 negative control no-hole syringe.
Conclusions
Part 1 of this series demonstrated that a container/closure integrity test performed according to ASTM F2338-09 Standard Test Method for Nondestructive Detection of Leaks in Packages by Vacuum Decay Method using a PTI VeriPac 325/LV vacuum decay leak tester is capable of reliably detecting leaks with nominal diameters ≥5.0 μm in rigid, nonporous package systems, such as prefilled glass syringes.
The current study used the same no-hole and holed 1-mL glass syringes from Part 1 to compare the sensitivity and reliability of the ASTM vacuum decay test method to more traditional dye ingress tests. The dye ingress tests used are the self-seal test described in USP 〈381〉 (also included in Ph.Eur. 3.2.9) and in ISO 8362-5, Annex C. These compendial/ISO methods are performed by immersing test packages in methylene blue dye solution at vacuum and ambient pressure conditions, then visually inspecting the samples for dye ingress. The USP/Ph.Eur. test requires a 10-min vacuum hold, while the ISO test requires a longer, 30-min vacuum hold. Additionally, both tests were modified in the current study to include higher target vacuum (−37 kPa versus −27 kPa). The ASTM F2338 vacuum decay test was performed on the empty, air-filled test syringes using the PTI VeriPac 325/LV leak tester using the liquid leak test method described in Part 1 (1 mbar absolute target vacuum).
The various dye ingress tests were unable to reliably differentiate among defective and nondefective syringes. The visual inspection lighting and background conditions were major factors in inspection sensitivity and accuracy. Inspector capability variations also contributed to the lack of reliability. Inspection environment lighting and background modifications improved inspectors' qualification test results. Longer test times and perhaps a deeper vacuum increased dye ingress. However, even under the best conditions in which all defective samples could be detected by dye ingress, a significant risk of false positive test results was demonstrated.
In contrast, the ASTM vacuum decay leak liquid leak test method reliably identified air-filled negative control syringes and positive control syringes with holes ranging from about 5 to 15 μm. With the exception of one syringe with a 4.7 μm hole, the dP results for defective syringes were significantly greater than for control, no-defect syringes. Vacuum decay test results were similar to those reported in Part 1 of this series. (Part 1 demonstrated even greater differentiation between no-defect and defective test samples when performing the vacuum decay test on water-filled, rather than air-filled, syringes.) Overall, the results from Part 2 indicate that the ASTM F2338 vacuum decay liquid leak test method using a PTI VeriPac 325/LV leak tester is more sensitive and reliable than USP/Ph.Eur. or ISO dye ingress methods for testing rigid, nonporous packages such as small-volume glass syringes.
- © PDA, Inc. 2009