Skip to main content
Download PDF

Comparative evaluation of the performance of the Abbott RealTime HIV-1 assay for measurement of HIV-1 plasma viral load on genetically diverse samples from Greece

Virology Journal volume 8, Article number: 10 (2011) Cite this article

Abstract

Background

HIV-1 is characterized by increased genetic heterogeneity which tends to hinder the reliability of detection and accuracy of HIV-1 RNA quantitation assays.

Methods

In this study, the Abbott RealTime HIV-1 (Abbott RealTime) assay was compared to the Roche Cobas TaqMan HIV-1 (Cobas TaqMan) and the Siemens Versant HIV-1 RNA 3.0 (bDNA 3.0) assays, using clinical samples of various viral load levels and subtypes from Greece, where the recent epidemiology of HIV-1 infection has been characterized by increasing genetic diversity and a marked increase in subtype A genetic strains among newly diagnosed infections.

Results

A high correlation was observed between the quantitative results obtained by the Abbott RealTime and the Cobas TaqMan assays. Viral load values quantified by the Abbott RealTime were on average lower than those obtained by the Cobas TaqMan, with a mean (SD) difference of -0.206 (0.298) log10 copies/ml. The mean differences according to HIV-1 subtypes between the two techniques for samples of subtype A, B, and non-A/non-B were 0.089, -0.262, and -0.298 log10 copies/ml, respectively. Overall, differences were less than 0.5 log10 for 85% of the samples, and >1 log10 in only one subtype B sample. Similarly, Abbott RealTime and bDNA 3.0 assays yielded a very good correlation of quantitative results, whereas viral load values assessed by the Abbott RealTime were on average higher (mean (SD) difference: 0.160 (0.287) log10 copies/ml). The mean differences according to HIV-1 subtypes between the two techniques for subtype A, B and non-A/non-B samples were 0.438, 0.105 and 0.191 log10 copies/ml, respectively. Overall, the majority of samples (86%) differed by less than 0.5 log10, while none of the samples showed a deviation of more than 1.0 log10.

Conclusions

In an area of changing HIV-1 subtype pattern, the Abbott RealTime assay showed a high correlation and good agreement of results when compared both to the Cobas TaqMan and bDNA 3.0 assays, for all HIV-1 subtypes tested. All three assays could determine viral load from samples of different HIV-1 subtypes adequately. However, assay variation should be taken into account when viral load monitoring of the same individual is assessed by different systems.

Background

Quantitative measurement of plasma viral load provides a great insight into the pathogenesis of HIV-1 infection and constitutes an essential parameter of infection prognosis and optimal management of clinical patients [1–4]. Highly active antiretroviral therapy (HAART) results in a sharp decline of plasma HIV-1 RNA levels in patients and therefore initiation as well as treatment changes rely on correct determination of viral load levels [5, 6]. Given the significance of accurate viral load measurements for optimal management of patients, the requirement for ultra-sensitive assays is crucial. A variety of commercial assays, are available for viral RNA levels quantification utilizing target or signal amplification technologies [7–12]. A major innovation of target amplification techniques is the development of assays that monitor accumulation of products in real-time, which are characterized by increased sensitivity, expanded dynamic range, diminished risk of contamination and high throughput [13, 14].

HIV-1 shows a high level of genetic heterogeneity. Group M viruses are responsible for the majority of HIV-1 infections globally and according to the HIV nomenclature proposal, they are subdivided into nine subtypes (A-D, F-H, J and K), sub-subtypes (e.g. A1, A2, F1, F2), several circulating recombinant forms (CRFs) and unique recombinants http://hiv.lanl.gov[15, 16]. In Greece increasing genetic diversity of HIV-1 has been documented and specifically an increase over time of the prevalence of non-B subtypes, particularly subtype A infections, has been reported [17].

Nucleic acid or signal amplification assays rely on the use of sequence specific primers and/or probes. HIV-1 increased heterogeneity may affect assay performance as the presence of natural polymorphisms in the target regions may reduce or inhibit hybridization thus compromising the reliability of viral load quantitation [18–20]. Virus subtype could therefore have a direct influence on assay performance.

The objective of this study was to compare the performance of the Abbott RealTime HIV-1 assay (referred to as the Abbott RealTime) (Abbott Laboratories, Wiesbaden, Germany) with the Cobas TaqMan HIV-1 Test (referred to as the Cobas TaqMan) (Roche Diagnostics GmbH, Manheim, Germany), and the Versant HIV-1 RNA 3.0 assay (referred to as the bDNA 3.0) (Siemens, Tarrytown, N.Y.) in order to determine the effect of viral heterogeneity on quantification of viral load.

Methods

Subjects and specimens

Whole blood was collected in sterile tubes with K3 EDTA as anticoagulant.

Within 4 h of drawing the blood, tubes were centrifuged at 1200× g for 12 min at room temperature. After centrifugation, aliquots of plasma were prepared and immediately frozen at -70°C until tested on the first thaw. This study was performed in compliance with regulations concerning human subject research and was approved by the Athens University Medical School Ethics Committee.

Study design

The performance of the Abbott RealTime was compared to the performance of two pre-existing methods for viral load quantification routinely used in our laboratory. Two different sets of clinical samples from patients with established HIV-1 infection with or without antiviral therapy, previously assessed either by the Cobas TaqMan or the bDNA 3.0, were retrospectively chosen.

Comparison of Abbott RealTime and Cobas TaqMan

A total of 149 plasma samples derived from HIV-1 positive patients of various viral load levels were retrospectively selected for testing with Abbott RealTime. Viral load levels of the same samples had been previously determined by the Cobas TaqMan by which 17 samples were found to have HIV-1 RNA values of <40 copies/ml, 21 samples had values ranging from 40 to 500 copies/ml and 111 samples had a viral load of >500 copies/ml (Table 1).

Table 1 Viral load values distribution of the samples used in the study.
Full size table

Comparison of Abbott RealTime and bDNA 3.0

A total of 161 plasma patient samples the viral load of which had been previously determined by the bDNA 3.0 were selected for testing with Abbott RealTime. bDNA HIV-1 RNA values were <50 copies/ml for 12 samples, 32 samples had viral load measurements ranging from 50 to 500 copies/ml and 117 samples were found with a viral load of >500 copies/ml (Table 1).

Abbott RealTime assay

The assay uses reverse transcription polymerase chain reaction (RT-PCR) technology with homogeneous real-time fluorescent detection [21]. Sample preparation was performed manually according to the manufacturer's specifications (Sample Preparation SystemDNA, Promega Madison, WI, USA). RNA was extracted from 0.6 ml of plasma using magnetic microparticle technology and the HIV-1 RNA quantification range of the assay in the current protocol was 40-10,000,000 copies/ml. Isolated RNA was added manually to the prepared master mix, followed by real-time PCR amplification. Reverse transcription, PCR amplification, and detection/quantitation reactions, were performed on the Abbott m2000rt platform. Detection of PCR product in real time is based on a partially double-stranded probe which targets the integrase (IN) region of the polymerase (pol) gene [21]. The probe consists of two DNA fragments of different lengths: the longer fragment is complementary to the target DNA and is bound to a fluorescent marker, while the shorter fragment holds the quencher molecule. When the target DNA is not present, the long probe binds to the quencher probe and no fluorescence is detected; when the target DNA is present, the long probe preferentially binds to the target DNA and is able to fluoresce giving a quantifiable signal [21–23].

Cobas TaqMan Test (for use with the High Pure System)

Cobas TaqMan is a competitive real-time RT-PCR based assay [24–26] and uses a dual labeled fluorogenic probe (TaqMan probe) targeting a highly conserved region of the HIV-1 gag gene. Sample preparation was performed manually using the High Pure System Viral Nucleic Acid Kit (Roche Diagnostics GmbH, Manheim, Germany) according to the manufacturer's specifications from 0.5 ml of plasma sample. The Cobas TaqMan 48 Analyzer was used for automated real-time RT-PCR and detection of PCR products [27–30]. Results calculations were performed based on parameters defined in the Test Definition File (TDF), in combination with AMPLILINK 3.0.1 software. HIV-1 RNA quantification range of the assay was 40-10,000,000 copies/ml according to the manufacturer's instructions.

bDNA 3.0 assay

HIV-RNA was extracted manually from 1.0 ml of plasma sample. The bDNA 3.0 has a sandwich nucleic acid hybridization format and relies on signal amplification technology. Briefly, HIV-1 RNA is hybridized to a series of oligonucleotide probes complementary to highly conserved regions of the HIV-1 pol gene [7, 31]. Hybridization and detection are carried out in a semiautomated system 340 bDNA analyzer (Siemens Medical Solutions Diagnostics, Tarrytown, NY), which automatically performs all incubations, washing steps, readings, and data processing. The assay has a dynamic range of 50 to 500,000 HIV-1 RNA copies/ml.

All three assays were carried out according to the manufacturer's instructions.

Subtyping

HIV-1 subtype classification was performed on all samples, by DNA sequencing and phylogenetic analysis. Specifically, the sequences of protease (PR) and partial reverse transcriptase (RT) genes, used for HIV drug resistance routine testing, were determined either by the TrueGene HIV-1 Genotyping kit (Bayer Healthcare, LLC, Tarrytown, NY, USA) or the ViroSeqâ„¢ HIV-1 Genotyping System (Abbott Molecular Diagnostics, IL, USA). HIV-1 subtypes and recombinants were determined by phylogenetic analyses using a set of reference sequences including all previously described subtypes and circulating recombinant forms (CRFs) available from http://hiv-web.lanl.gov. Phylogenetic analysis of HIV-1 subtypes and recombinants was performed using Neighbor-joining (NJ) method with a HKY model of nucleotide substitution, as implemented in PAUP*4.0b10 [32]. Unclassified sequences were further examined for any evidence of recombination using bootscanning analysis, as implemented in Simplot 3.2 http://sray.med.som.jhmi.edu/SCRoftware/. Putative recombination pattern was further confirmed by phylogenetic analysis in each individual fragment with a distinct subtype assignment.

Statistical analysis

Pearson's correlation coefficient was used to assess the strength of linear association between the log transformed values of Abbott RealTime and other methods. As the correlation coefficient provides information on the correlation but not on the agreement of the two methods, we further employed Deming regression [33] and Bland-Altman analysis [34, 35]. Specifically, the fitted regression line, obtained using Deming regression for each comparison (Abbott RealTime versus Cobas TaqMan, and Abbott RealTime versus bDNA 3.0), was compared to the line of equality by testing the two-tailed hypothesis of slope = 1 and intercept = 0. Deming regression is similar to ordinary least-squares regression but it takes into account that viral load levels are measured with error by both methods. In the Bland-Altman analysis, the differences between the methods were plotted against their mean. The lack of agreement was then summarized by calculating the bias estimated by the mean difference d − and the standard deviation of the differences (SD). The limits of agreement were then estimated as d − ± 1.96 * SD .

Results

Comparison of Abbott RealTime and Cobas TaqMan

The comparative performance of the Abbott RealTime and the Cobas TaqMan was assessed on 149 specimens. HIV-1 subtype information was available for 126 of them, with the following subtype distribution: 20 samples were characterized as subtype A, 90 as subtype B, seven samples as subtype C, one sample as subtype D, three samples as subtype F1, one sample as subtype G, two samples were found to be intersubtype recombinant strains A/B and two samples were characterized as CRF04_cpx Subtype determination was not possible for 23 samples either because of the low viral load or because of sample exhaustion (Table 2).

Table 2 Subtype distribution of the samples used in the study.
Full size table

Of the 149 samples 127 (85.2%) had a detectable viral load by both assays, 17 (11.4%) were undetectable by both assays and five (3.4%) samples were quantified only by Cobas TaqMan at 43.4, 50.8, 65.5, 257 and 843 copies/ml, respectively whereas the same five samples were reported as having HIV-1 RNA < 40 copies/ml by the Abbott RealTime. Thus, the detection rate of Abbott RealTime was 127/149 (85.2%) versus 132/149 (88.6%) of the Cobas TaqMan. Retesting of the discrepant samples by both assays revealed that only one sample characterized as subtype B (previously quantified at 843 copies/ml) was repeatedly reactive by Cobas TaqMan (674 copies/ml at retesting), while it was repeatedly non-reactive by Abbott RealTime. The remaining four samples were undetectable by both assays at following retesting (Table 3).

Table 3 Repeated testing of the samples with discordant results between Cobas TaqMan and Abbott RealTime.
Full size table

The two assays showed a high degree of correlation (Figure 1), and the linear regression equation was log10 (Abbott RealTime copies/ml) = -0.408 + 1.05 × log10 (Cobas TaqMan copies/ml), (correlation coefficient: r = 0.960, p < 0.001).

Figure 1
figure 1

Correlation between the Cobas TaqMan and the Abbott RealTime assays. The bold line represents the regression line. The equation of the fitted line and the Pearson's correlation coefficient are presented on the plot. Values are expressed as log10 HIV-1 RNA copies/ml.

Full size image

Agreement between the two methods was calculated by the method of Bland Altman by plotting differences (log10 Abbott RealTime - log10 Cobas TaqMan) against the mean obtained by the two assays (Figure 2). On average, the Abbott RealTime gave values of 0.206 log10 copies/ml (SD:0.298, 95% limits of agreement, -0.790 to 0.379) lower than those obtained with the Cobas TaqMan assay. When differences were analyzed according to HIV-1 subtypes (classified in three groups) the mean differences (95% limits of agreement) between the two techniques for samples of subtype A, subtype B, subtype non-A/non-B were 0.089 (-0.602, 0.779), -0.262 (-0.739, 0.215), and -0.298 (-0.971, 0.375) log10 copies/ml, respectively.

Figure 2
figure 2

Abbott RealTime and Cobas TaqMan degree of agreement (log 10 copies/ml). The x axis of the Bland and Altman curves bears the mean values for each sample obtained by the two techniques. The y axis bears the differences between the values obtained by the two techniques. The solid line represents the mean difference between the values, and the dotted lines represent the mean difference plus or minus 1.96SD (95% limits of agreement).

Full size image

Among the 127 patient samples in which viral load levels were determined by both assays, 108 samples (85%) differed less than 0.5 log10 copies/ml. A total of 18 samples (14.1%) differed from 0.5 log10 to 1.0 log10 copies/ml, with the following HIV-1 subtype distribution: two samples were of subtype A, 10 were found as subtype B, three as subtype C, two as subtype F1, and one as CRF04. Finally a viral load value difference between the Abbott RealTime and the Cobas TaqMan of >1.0 log10 copies/ml was observed for one subtype B sample (0.8%) with Abbott RealTime reporting the lowest value.

Comparison of Abbott RealTime and bDNA 3.0

The comparative performance of the Abbott RealTime and the bDNA 3.0 was assessed on 161 specimens. HIV-1 subtype information was available for 134 of them, with the following subtype distribution: 20 samples were characterized as subtype A, 103 sample as subtype B, one sample as subtype C, three samples as subtype D, one sample as subtype F1, one sample as subtype G, one sample as subtype H, one sample was found to be an intersubtype recombinant strain A/B, two were CRF02_AG and one CRF04. HIV-1 subtype could not be determined for the remaining 27 samples, because of insufficient RNA levels or a lack of sample availability (Table 2).

Among the tested samples 142 (88.2%) had a detectable viral load by both assays, 10 (6.2%) were undetectable by both assays and nine (5.6%) showed discordant results. Specifically, discrepant results were observed for seven samples the viral load levels of which were reported at 54, 62, 66, 74, 76, 337 and 674 copies/ml by the bDNA 3.0. The same samples were found to have a viral load of <40 by the Abbott RealTime. Furthermore, two samples with viral load levels determined by the Abbott RealTime at 50 and 143 copies/ml, were reported to have a viral load of <50 copies/ml by the bDNA 3.0. The detection rate of Abbott RealTime, therefore, was 144/161 (89.4%) versus 149/161 (92.5%) of the bDNA 3.0. However, at the repeated testing of the seven samples detected only, six samples were reported to have viral load values of <50 copies/ml by the bDNA 3.0 and only one (previously quantified at 337 copies/ml) was quantified at 152 copies/ml (Table 4), whereas all were reported to have viral load levels of <40 copies/ml by Abbott RealTime. Finally, repeated testing of the two samples detected only by the Abbott RealTime was not possible because sufficient sample quantities were not available for further investigation.

Table 4 Repeated testing of the samples with discordant results between bDNA 3.0 and Abbott RealTime.*
Full size table

Figure 3 shows the scatter plot of log10 HIV-1 RNA copies/ml determined by the bDNA 3.0 and the Abbott RealTime assays, using specimens with detectable RNA levels by both assays. The fitted regression line was described by the equation: log10 (Abbott RealTime copies/ml) = -0.103 + 1.07 × log10 (bDNA 3.0 copies/ml), (correlation coefficient: r = 0.961, p < 0.001).

Figure 3
figure 3

Correlation between the bDNA 3.0 and the Abbott RealTime assays. The bold line represents the regression line. The equation of the fitted line and the Pearson's correlation coefficient are presented on the plot. Values are expressed as log10 HIV-1 RNA copies/ml.

Full size image

Agreement between the two methods was calculated by the method of Bland Altman by plotting differences (log10 Abbott RealTime - log10 bDNA 3.0) against the mean obtained by the two assays (Figure 4). Viral loads values obtained by the two assays differed on average by 0.160 log10 copies/ml (SD:0,287, 95% limits of agreement:-0.402, 0.721). The mean differences (95% limits of agreement) between the two techniques for samples of subtype A, subtype B and subtype non-A/non-B were 0.438 (-0.097, 0.973), 0.105 (-0. 395, 0.604) and 0.191 (-0.418, 0.800), log10 copies/ml, respectively.

Figure 4
figure 4

Abbott RealTime and bDNA 3.0 degree of agreement (log 10 copies/ml). The x axis of the Bland and Altman curves bears the mean values for each sample obtained by the two techniques. The y axis bears the differences between the values obtained by the two techniques. The solid line represents the mean difference between the values, and the dotted lines represent the mean difference plus or minus 1.96SD (95% limits of agreement).

Full size image

Among the 142 samples with a detectable viral load by both assays, 122 samples (86%) differed by less than 0.5 log10 copies/ml. Twenty samples (14%) differed from 0.5 log10 to 1.0 log10 copies/ml. HIV-1 subtype information was available for 17 of them, with the following subtype distribution: 9 A, 6 B, 1 CRF02_AG and 1 CRF04. Finally, none of the samples showed a deviation of more than 1.0 log10 copies/ml between assays.

Discussion

Real-time RT-PCR assays for HIV-1 viral load measurements offer the potential of increased sensitivity, expanded dynamic range, diminished risk of contamination and high through-put. Given the importance of accurate viral load measurement for evaluating the efficacy of therapies and monitoring disease progression, and taking into account the vast genetic heterogeneity of HIV-1, it was our objective to compare the performance of the Abbott RealTime assay with the Cobas TaqMan and the bDNA 3.0 assays, using clinical samples from Greece. The recent epidemiology of HIV-1 infection in Greece has been characterized by increasing genetic diversity and a marked increase in subtype A genetic strains. Notably, subtype A infections have been found at similar frequency to subtype B among the recently infected individuals [17]. Due to the importance of HIV-1 RNA levels as a marker for HAART initiation and clinical management of HIV-infected individuals, the performance of the Abbott RealTime assay was questioned on a set of viral isolates including subtype A variants which have been shown to circulate in the form of a monophyletic clade in Greece. Since all these strains share a recent common ancestor, potential natural polymorphisms accumulating in regions targeted by Abbott RealTime could have caused discrepancies in the quantification of HIV-1 RNA that may also affect clinical practice.

Recently, Abbott RealTime with manual sample preparation was compared to the Roche Cobas Ampliprep/Amplicor HIV-1 Monitor v1.5 [36]. In the present study, Abbott RealTime with manual sample preparation was compared to two other ultra-sensitive assays, the Cobas TaqMan and the bDNA 3.0, in a routine setting of an AIDS reference laboratory, focusing on the inclusion of clinical samples of various viral load levels and various HIV-1 subtypes and CRFs. In all three assays the HIV-1 RNA extraction was performed manually, as that was the available protocol in Greece at the time.

A panel of 149 clinical samples previously tested with the Cobas TaqMan was also tested with the Abbott RealTime. Overall, the viral load results obtained with the two assays had a good correlation (r = 0.96). Correlation coefficients ranging from 0.79 to 0.96 have been reported previously [19, 37–39].

All unquantifiable by Cobas TaqMan samples were also unquantifiable by Abbott RealTime. However, five samples previously quantified by Cobas TaqMan were undetectable by Abbott RealTime (Table 3). The possibility of contamination for these five samples was excluded. It should be noted that these five samples were selected according to their previous Cobas TaqMan result and three of them had marginally positive values (43.3 to 65.5 copies/ml). In order to determine whether the discordance between the two assays was reproducible, the five samples were retested by both assays, in which case all but one samples were found undetectable by both assays. One sample which previously quantified at 843 copies/ml was repeatedly reactive by Cobas TaqMan at 674 copies/ml (Table 3). The differences between the retesting values obtained by Cobas TaqMan could possibly be explained by the fact that the samples had a very low viral load. Measurements at such low levels are influenced by the inherent variability of assay technology, since the coefficient of variation for all these assays is greatest near the limits of their dynamic ranges. Indeed, increased variability in the lower viral load range (log2) seems to be typical for most viral load assays [22, 23] and has been observed in previous comparative studies [26, 31].

Other factors encountered that may have affected the reproducibility of HIV-1 RNA quantification include operator performance, test lot and the long-term storage of frozen plasma. In fact, because of the long period of time between assays we were unable to control for operator variability or test lot. Furthermore, although optimal storage conditions for HIV-1 RNA quantification have been followed [40], prolonged storage (12 months) of frozen plasma could possibly influence the values obtained at retesting especially in samples of such low viral load [40, 41]. Interestingly, one subtype B sample repeatedly reactive by Cobas TaqMan at 843 copies/ml and 674 copies/ml could not be detected by Abbott RealTime at repeating the assay. This could possibly be explained by the presence of mismatches within primer/probe binding sites of the assay.

The viral load values assessed by Abbott RealTime in this study were on average lower (-0.206 log10 copies/ml) than those of Cobas TaqMan. This finding is in accordance with earlier studies where lower viral load values were also observed by the Abbott RealTime compared to the Cobas TaqMan [37–39, 42], with the mean difference ranging from -0.34 to -0.20 log10 copies/ml. On the contrary, Gueudin et al., found an underestimation of viral load values by the Cobas TaqMan compared with the Abbott RealTime [19]. Moreover, in a recent study by Scott et al [23], a mean difference of 0.125 log10 copies/ml between the Abbott RealTime and the Cobas TaqMan has been reported in HIV-1 patients of subtype C. In the present study, differences between the two measurements exceeded 0.5 log10 copies/ml for 14% of the samples. Previously published studies reported differences of more than 0.5 log10 copies/ml (10.4% to 36.8%) in paired results between the two assays [19, 23, 38].

Interestingly, a more substantial difference (>1.0 log10) was observed for one subtype B sample for which lower viral load values were detected by the Abbott RealTime.

The reason for this misquantification is unclear and needs to be further investigated. One likely explanation for this difference in HIV-1 RNA quantification is the existence of mismatches within primer- or probe-binding sites that can have a significant impact on detection and accuracy of quantitation, although Abbott RealTime targets a highly conserved region of the HIV-1 genome, and reagents, cycling conditions, and probe design have been optimized for mismatch tolerance [21, 22, 43]. In earlier comparative studies between the two assays, viral load misquantifications of more than 1.0 log10 copies/ml have involved non-B subtypes (mainly CRF02_AG strains) with the Abbott RealTime generating higher viral load values compared to the Cobas TaqMan [19, 23, 44]. The genomic variability of HIV hinders the development of universal primers and probes for genomic hybridization. This holds for all HIV strains of different subtypes [45]. Most genomes available in sequence banks for primer and probe selection are mainly subtype B, with non-B strains representing a minority. Therefore, the risk of mismatches at primer and probe target sites is higher for non-B subtypes. However, even within subtype B, a simple synonymous mutation may reduce hybridization efficiency resulting in failed detection or inaccurate quantitation [19].

The Abbott RealTime was compared to bDNA 3.0 using 161 clinical plasma samples of various viral load levels and subtypes and a high correlation (r = 0.96) of the viral load results obtained by both assays was observed. Similar correlations of these two assays have been reported in the literature [22, 46].

The Abbott RealTime could quantify two, undetected by bDNA 3.0, samples (viral load values 50 and 143 copies/ml). The assay could not be repeated for the two samples because of insufficient sample. Furthermore, a discrepancy between the two assays was initially observed for seven samples with detectable viral load levels by bDNA 3.0 (viral load values ranging from 55 to 674 copies/ml) and undetectable viral load levels by the Abbott RealTime. However, retesting of the samples by both assays, reported all but one samples undetectable by both assays (Table 4). The sample which previously quantified at 337 copies/ml was repeatedly reactive by bDNA 3.0 at a lower value of 152 copies/ml (Table 4). The possibility of contamination for these seven samples was excluded. As discussed previously, the differences between the retesting values obtained by bDNA 3.0 could be a result of very low viral load titers and prolonged sample storage. Finally, the sample which could not be detected by Abbott RealTime was of undetermined subtype. The presence of mismatches within primer/probe binding sites of the assay could possibly account for this discrepancy.

The viral load values assessed by the Abbott RealTime in this study were on average higher (0.160 log10 copies/ml) than those obtained by the bDNA 3.0, and this observation was consistent for all subtypes and in particular for subtype A. Between the two assays mean differences ranging from -0.14 to -0.01 log10 copies/ml have been reported previously [43, 47, 48]. In accordance with previous data [46], the majority of samples with a detectable viremia (86%) did not differ more than 0.5 log10 copies/ml among paired results. Notably, none of the samples differed more than 1.0 log10 copies/ml among the two assays.

Overall, the properties of the assays used for diagnostic purposes, such as the ones utilized in this study, in terms of how laborious, time consuming and cost effective they may be, vary. The overall turnaround time of the Abbott RealTime and Cobas TaqMan assays is significantly shorter than that of the bDNA 3.0 assay (5 h 15 min and ~24 h, respectively) as the latter involves a longer preparation process and a 16-18 hours incubation, whereas the two real-time assays require a two hour nucleic acid extraction step and a fully automated amplification and detection step. The assay sample throughput of Abbott RealTime as well as Cobas Taqman assays is 42 samples each in a full working day, whereas bDNA 3.0 assay has sample throughput of 84 samples per working day (plus the 16-18 h incubation). Although in this study the nucleic acid extraction step of Abbott RealTime and Cobas Taqman assays were performed manually, it is important to consider that both assays have options for increased testing scales with continuous sample loading on the automated extractor systems, which are not yet available in our lab. In that case, both assays can perform 96 samples/run with the m2000sp/m2000rt and COBAS Ampliprep/COBAS Taqman respectively. Furthermore, the two real-time assays require an initial volume of 0.5 and 0.6 ml, in contrast to the bDNA 3.0 assay that needs 1 ml, which may be a significant advantage where availability of sample volume is a matter.

Conclusions

In this study, subtype-related variability in Abbott RealTime performance was evaluated by using samples from patients infected with HIV-1 subtype Α, Β and non-A/non-B (including circulating recombinant forms) strains. Specimens were quantified by Abbott RealTime with comparable viral load measurements to the other two assays. The viral loads obtained showed variations, with mean differences of -0.298 to 0.089 log10 copies/ml and 0.105 to 0.438 log10 copies/ml, depending on the subtype and the assay of choice. Thus, Abbott RealTime with manual extraction is an acceptable alternative to the conventional Cobas TaqMan and bDNA 3.0 assays for quantification of HIV-1 RNA in daily clinical routine and can be used for monitoring disease progression and the efficacy of antiretroviral therapy. Despite the strong correlation and good agreement observed between the Abbott RealTime and the other two assays, ongoing vigilance is recommended to evaluate assay performance with existing and emerging divergent strains. Furthermore, care is necessary when monitoring of viral load is performed with different assays, due to assay variability which may increase the risk of over- or underestimation of results. Finally, in accordance with relevant studies [44, 49], in cases of discrepancy between viral load and CD4 count or clinical observations, measurement of plasma HIV-1 RNA with an alternative assay in order to highlight underestimation is reccmmended.

References

  1. Ho DD, Neumann AU, Perelson AS, Chen W, Leonard JM, Markowitz M: Rapid turnover of plasma virions and CD4 lymphocytes in HIV-1 infection. Nature 1995, 373: 123-126. 10.1038/373123a0

    Article  CAS  PubMed  Google Scholar 

  2. Mellors JW, Munoz A, Giorgi JV, Margolick JB, Tassoni CJ, Gupta P, Kingsley LA, Todd JA, Saah AJ, Detels R, et al.: Plasma viral load and CD4+ lymphocytes as prognostic markers of HIV-1 infection. Ann Intern Med 1997, 126: 946-954.

    Article  CAS  PubMed  Google Scholar 

  3. Mylonakis E, Paliou M, Rich JD: Plasma viral load testing in the management of HIV infection. Am Fam Physician 2001, 63: 483-490. 495-486

    CAS  PubMed  Google Scholar 

  4. Zhang M, Versalovic J: HIV update. Diagnostic tests and markers of disease progression and response to therapy. Am J Clin Pathol 2002, (118 Suppl):S26-32.

  5. Gazzard BG: British HIV Association Guidelines for the treatment of HIV-1-infected adults with antiretroviral therapy 2008. HIV Med 2008, 9: 563-608. 10.1111/j.1468-1293.2008.00636.x

    Article  CAS  PubMed  Google Scholar 

  6. del Rio C: Updated antiretroviral treatment guidelines from DHHS and EACS. AIDS Clin Care 2008, 20: 7.

    PubMed  Google Scholar 

  7. Collins ML, Irvine B, Tyner D, Fine E, Zayati C, Chang C, Horn T, Ahle D, Detmer J, Shen LP, et al.: A branched DNA signal amplification assay for quantification of nucleic acid targets below 100 molecules/ml. Nucleic Acids Res 1997, 25: 2979-2984. 10.1093/nar/25.15.2979

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  8. Johanson J, Abravaya K, Caminiti W, Erickson D, Flanders R, Leckie G, Marshall E, Mullen C, Ohhashi Y, Perry R, et al.: A new ultrasensitive assay for quantitation of HIV-1 RNA in plasma. J Virol Methods 2001, 95: 81-92. 10.1016/S0166-0934(01)00297-X

    Article  CAS  PubMed  Google Scholar 

  9. Kievits T, van Gemen B, van Strijp D, Schukkink R, Dircks M, Adriaanse H, Malek L, Sooknanan R, Lens P: NASBA isothermal enzymatic in vitro nucleic acid amplification optimized for the diagnosis of HIV-1 infection. J Virol Methods 1991, 35: 273-286. 10.1016/0166-0934(91)90069-C

    Article  CAS  PubMed  Google Scholar 

  10. Mulder J, McKinney N, Christopherson C, Sninsky J, Greenfield L, Kwok S: Rapid and simple PCR assay for quantitation of human immunodeficiency virus type 1 RNA in plasma: application to acute retroviral infection. J Clin Microbiol 1994, 32: 292-300.

    PubMed Central  CAS  PubMed  Google Scholar 

  11. Kern D, Collins M, Fultz T, Detmer J, Hamren S, Peterkin JJ, Sheridan P, Urdea M, White R, Yeghiazarian T, Todd J: An enhanced-sensitivity branched-DNA assay for quantification of human immunodeficiency virus type 1 RNA in plasma. J Clin Microbiol 1996, 34: 3196-3202.

    PubMed Central  CAS  PubMed  Google Scholar 

  12. Sun R, Ku J, Jayakar H, Kuo JC, Brambilla D, Herman S, Rosenstraus M, Spadoro J: Ultrasensitive reverse transcription-PCR assay for quantitation of human immunodeficiency virus type 1 RNA in plasma. J Clin Microbiol 1998, 36: 2964-2969.

    PubMed Central  CAS  PubMed  Google Scholar 

  13. Bustin SA: Absolute quantification of mRNA using real-time reverse transcription polymerase chain reaction assays. J Mol Endocrinol 2000, 25: 169-193. 10.1677/jme.0.0250169

    Article  CAS  PubMed  Google Scholar 

  14. Wong ML, Medrano JF: Real-time PCR for mRNA quantitation. Biotechniques 2005, 39: 75-85. 10.2144/05391RV01

    Article  CAS  PubMed  Google Scholar 

  15. Peeters M, Sharp PM: Genetic diversity of HIV-1: the moving target. Aids 2000,14(Suppl 3):S129-140.

    CAS  PubMed  Google Scholar 

  16. Robertson DL, Anderson JP, Bradac JA, Carr JK, Foley B, Funkhouser RK, Gao F, Hahn BH, Kalish ML, Kuiken C, et al.: HIV-1 nomenclature proposal. Science 2000, 288: 55-56. 10.1126/science.288.5463.55d

    Article  CAS  PubMed  Google Scholar 

  17. Paraskevis D, Magiorkinis E, Magiorkinis G, Sypsa V, Paparizos V, Lazanas M, Gargalianos P, Antoniadou A, Panos G, Chrysos G, et al.: Increasing prevalence of HIV-1 subtype A in Greece: estimating epidemic history and origin. J Infect Dis 2007, 196: 1167-1176. 10.1086/521677

    Article  CAS  PubMed  Google Scholar 

  18. Damond F, Roquebert B, Benard A, Collin G, Miceli M, Yeni P, Brun-Vezinet F, Descamps D: Human immunodeficiency virus type 1 (HIV-1) plasma load discrepancies between the Roche COBAS AMPLICOR HIV-1 MONITOR Version 1.5 and the Roche COBAS AmpliPrep/COBAS TaqMan HIV-1 assays. J Clin Microbiol 2007, 45: 3436-3438. 10.1128/JCM.00973-07

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  19. Gueudin M, Plantier JC, Lemee V, Schmitt MP, Chartier L, Bourlet T, Ruffault A, Damond F, Vray M, Simon F: Evaluation of the Roche Cobas TaqMan and Abbott RealTime extraction-quantification systems for HIV-1 subtypes. J Acquir Immune Defic Syndr 2007, 44: 500-505. 10.1097/QAI.0b013e31803260df

    Article  PubMed  Google Scholar 

  20. Swanson P, de Mendoza C, Joshi Y, Golden A, Hodinka RL, Soriano V, Devare SG, Hackett J Jr: Impact of human immunodeficiency virus type 1 (HIV-1) genetic diversity on performance of four commercial viral load assays: LCx HIV RNA Quantitative, AMPLICOR HIV-1 MONITOR v1.5, VERSANT HIV-1 RNA 3.0, and NucliSens HIV-1 QT. J Clin Microbiol 2005, 43: 3860-3868. 10.1128/JCM.43.8.3860-3868.2005

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  21. Tang N, Huang S, Salituro J, Mak WB, Cloherty G, Johanson J, Li YH, Schneider G, Robinson J, Hackett J, et al.: A RealTime HIV-1 viral load assay for automated quantitation of HIV-1 RNA in genetically diverse group M subtypes A-H, group O and group N samples. J Virol Methods 2007, 146: 236-245. 10.1016/j.jviromet.2007.07.003

    Article  CAS  PubMed  Google Scholar 

  22. Swanson P, Holzmayer V, Huang S, Hay P, Adebiyi A, Rice P, Abravaya K, Thamm S, Devare SG, Hackett J Jr: Performance of the automated Abbott RealTime HIV-1 assay on a genetically diverse panel of specimens from London: comparison to VERSANT HIV-1 RNA 3.0, AMPLICOR HIV-1 MONITOR v1.5, and LCx HIV RNA Quantitative assays. J Virol Methods 2006, 137: 184-192. 10.1016/j.jviromet.2006.06.010

    Article  CAS  PubMed  Google Scholar 

  23. Scott LE, Noble LD, Moloi J, Erasmus L, Venter WD, Stevens W: Evaluation of the Abbott m2000 RealTime human immunodeficiency virus type 1 (HIV-1) assay for HIV load monitoring in South Africa compared to the Roche Cobas AmpliPrep-Cobas Amplicor, Roche Cobas AmpliPrep-Cobas TaqMan HIV-1, and BioMerieux NucliSENS EasyQ HIV-1 assays. J Clin Microbiol 2009, 47: 2209-2217. 10.1128/JCM.01761-08

    Article  PubMed Central  PubMed  Google Scholar 

  24. Higuchi R, Dollinger G, Walsh PS, Griffith R: Simultaneous amplification and detection of specific DNA sequences. Biotechnology (NY) 1992, 10: 413-417. 10.1038/nbt0492-413

    Article  CAS  Google Scholar 

  25. Heid CA, Stevens J, Livak KJ, Williams PM: Real time quantitative PCR. Genome Res 1996, 6: 986-994. 10.1101/gr.6.10.986

    Article  CAS  PubMed  Google Scholar 

  26. Katsoulidou A, Petrodaskalaki M, Sypsa V, Papachristou E, Anastassopoulou CG, Gargalianos P, Karafoulidou A, Lazanas M, Kordossis T, Andoniadou A, Hatzakis A: Evaluation of the clinical sensitivity for the quantification of human immunodeficiency virus type 1 RNA in plasma: Comparison of the new COBAS TaqMan HIV-1 with three current HIV-RNA assays--LCx HIV RNA quantitative, VERSANT HIV-1 RNA 3.0 (bDNA) and COBAS AMPLICOR HIV-1 Monitor v1.5. J Virol Methods 2006, 131: 168-174. 10.1016/j.jviromet.2005.07.014

    Article  CAS  PubMed  Google Scholar 

  27. Desire N, Dehee A, Schneider V, Jacomet C, Goujon C, Girard PM, Rozenbaum W, Nicolas JC: Quantification of human immunodeficiency virus type 1 proviral load by a TaqMan real-time PCR assay. J Clin Microbiol 2001, 39: 1303-1310. 10.1128/JCM.39.4.1303-1310.2001

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  28. Klein SA, Karsten S, Ruster B, Klebba C, Pape M, Ottmann OG, Hoelzer D, Roth WK: Comparison of TaqMan real-time PCR and p24 Elisa for quantification of in vitro HIV-1 replication. J Virol Methods 2003, 107: 169-175. 10.1016/S0166-0934(02)00230-6

    Article  CAS  PubMed  Google Scholar 

  29. Palmer S, Wiegand AP, Maldarelli F, Bazmi H, Mican JM, Polis M, Dewar RL, Planta A, Liu S, Metcalf JA, et al.: New real-time reverse transcriptase-initiated PCR assay with single-copy sensitivity for human immunodeficiency virus type 1 RNA in plasma. J Clin Microbiol 2003, 41: 4531-4536. 10.1128/JCM.41.10.4531-4536.2003

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  30. Drosten C, Seifried E, Roth WK: TaqMan 5'-nuclease human immunodeficiency virus type 1 PCR assay with phage-packaged competitive internal control for high-throughput blood donor screening. J Clin Microbiol 2001, 39: 4302-4308. 10.1128/JCM.39.12.4302-4308.2001

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  31. Katsoulidou A, Papachristou E, Petrodaskalaki M, Sypsa V, Anastassopoulou CG, Gargalianos P, Karafoulidou A, Lazanas M, Kordossis T, Andoniadou A, Hatzakis A: Comparison of three current viral load assays for the quantitation of human immunodeficiency virus type 1 RNA in plasma. J Virol Methods 2004, 121: 93-99. 10.1016/j.jviromet.2004.06.007

    Article  CAS  PubMed  Google Scholar 

  32. Swofford D: PAUP*: phylogenetic analysis using parsimony (*and other methods), version 4.0 beta for Macintosh. Sinauer, Sunderland and Massachusetts, USA; 2002.

    Google Scholar 

  33. Armitage P, Berry G, Matthews JNS: Statistical methods in medical research. Blackwell Science, Oxford, Malden, MA; 2002.

    Chapter  Google Scholar 

  34. Bland JM, Altman DG: Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 1: 307-310.

    Article  CAS  PubMed  Google Scholar 

  35. Bland JM, Altman DG: Measuring agreement in method comparison studies. Stat Methods Med Res 1999, 8: 135-160. 10.1191/096228099673819272

    Article  CAS  PubMed  Google Scholar 

  36. Crump JA, Scott LE, Msuya E, Morrissey AB, Kimaro EE, Shao JF, Stevens WS: Evaluation of the Abbott m2000rt RealTime HIV-1 assay with manual sample preparation compared with the ROCHE COBAS AmpliPrep/AMPLICOR HIV-1 MONITOR v1.5 using specimens from East Africa. J Virol Methods 2009, 162: 218-222. 10.1016/j.jviromet.2009.08.013

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  37. Foulongne V, Montes B, Didelot-Rousseau MN, Segondy M: Comparison of the LCx human immunodeficiency virus (HIV) RNA quantitative, RealTime HIV, and COBAS AmpliPrep-COBAS TaqMan assays for quantitation of HIV type 1 RNA in plasma. J Clin Microbiol 2006, 44: 2963-2966. 10.1128/JCM.00341-06

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  38. Sloma CR, Germer JJ, Gerads TM, Mandrekar JN, Mitchell PS, Yao JD: Comparison of the Abbott RealTime human immunodeficiency virus type 1 (HIV-1) assay to the Cobas AmpliPrep/Cobas TaqMan HIV-1 test: workflow, reliability, and direct costs. J Clin Microbiol 2009, 47: 889-895. 10.1128/JCM.02231-08

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  39. Wolff D, Gerritzen A: Comparison of the Roche COBAS Amplicor Monitor, Roche COBAS Ampliprep/COBAS Taqman and Abbott RealTime Test assays for quantification of hepatitis C virus and HIV RNA. Clin Chem Lab Med 2007, 45: 917-922. 10.1515/CCLM.2007.149

    Article  CAS  PubMed  Google Scholar 

  40. Ginocchio CC, Wang XP, Kaplan MH, Mulligan G, Witt D, Romano JW, Cronin M, Carroll R: Effects of specimen collection, processing, and storage conditions on stability of human immunodeficiency virus type 1 RNA levels in plasma. J Clin Microbiol 1997, 35: 2886-2893.

    PubMed Central  CAS  PubMed  Google Scholar 

  41. Sebire K, McGavin K, Land S, Middleton T, Birch C: Stability of human immunodeficiency virus RNA in blood specimens as measured by a commercial PCR-based assay. J Clin Microbiol 1998, 36: 493-498.

    PubMed Central  CAS  PubMed  Google Scholar 

  42. Schutten M: Comparison of the Abbott RealTime HIV-1 and HCV viral load assays with commercial competitor assays. Expert Rev Mol Diagn 2008, 8: 369-377. 10.1586/14737159.8.4.369

    Article  CAS  PubMed  Google Scholar 

  43. Swanson P, Huang S, Holzmayer V, Bodelle P, Yamaguchi J, Brennan C, Badaro R, Brites C, Abravaya K, Devare SG, Hackett J Jr: Performance of the automated Abbott RealTime HIV-1 assay on a genetically diverse panel of specimens from Brazil. J Virol Methods 2006, 134: 237-243. 10.1016/j.jviromet.2006.01.012

    Article  CAS  PubMed  Google Scholar 

  44. Colson P, Solas C, Moreau J, Motte A, Henry M, Tamalet C: Impaired quantification of plasma HIV-1 RNA with a commercialized real-time PCR assay in a couple of HIV-1-infected individuals. J Clin Virol 2007, 39: 226-229. 10.1016/j.jcv.2007.04.007

    Article  CAS  PubMed  Google Scholar 

  45. Wain-Hobson S: Human immunodeficiency virus type 1 quasispecies in vivo and ex vivo. Curr Top Microbiol Immunol 1992, 176: 181-193.

    CAS  PubMed  Google Scholar 

  46. Swanson P, Huang S, Abravaya K, de Mendoza C, Soriano V, Devare SG, Hackett J Jr: Evaluation of performance across the dynamic range of the Abbott RealTime HIV-1 assay as compared to VERSANT HIV-1 RNA 3.0 and AMPLICOR HIV-1 MONITOR v1.5 using serial dilutions of 39 group M and O viruses. J Virol Methods 2007, 141: 49-57. 10.1016/j.jviromet.2006.11.026

    Article  CAS  PubMed  Google Scholar 

  47. Braun P, Ehret R, Wiesmann F, Zabbai F, Knickmann M, Kuhn R, Thamm S, Warnat G, Knechten H: Comparison of four commercial quantitative HIV-1 assays for viral load monitoring in clinical daily routine. Clin Chem Lab Med 2007, 45: 93-99. 10.1515/CCLM.2007.008

    Article  CAS  PubMed  Google Scholar 

  48. Schutten M, Peters D, Back NK, Beld M, Beuselinck K, Foulongne V, Geretti AM, Pandiani L, Tiemann C, Niesters HG: Multicenter evaluation of the new Abbott RealTime assays for quantitative detection of human immunodeficiency virus type 1 and hepatitis C virus RNA. J Clin Microbiol 2007, 45: 1712-1717. 10.1128/JCM.02385-06

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  49. Wirden M, Tubiana R, Marguet F, Leroy I, Simon A, Bonmarchand M, Ait-Arkoub Z, Murphy R, Marcelin AG, Katlama C, Calvez V: Impact of discrepancies between the Abbott RrealTime and cobas TaqMan assays for quantification of human immunodeficiency virus type 1 group M non-B subtypes. J Clin Microbiol 2009, 47: 1543-1545. 10.1128/JCM.02134-08

    Article  PubMed Central  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

The study was supported by the Hellenic Scientific Society for the Study of AIDS and Sexually Transmitted Disease. The authors thank S.B. BioTechnology Suppliers A.E. for providing the HIV-1 RealTime kits used in the study.

Author information

Authors and Affiliations

  1. National Retrovirus Reference Center, Department of Hygiene and Epidemiology and Medical Statistics, Athens University Medical School, 75 Mikras Asias Street, GR-115 27 Athens (Goudi), Athens, Greece

    Antigoni Katsoulidou, Chrysoula Rokka, Catherine Issaris, Catherine Haida, Kimon Tzannis, Vana Sypsa, Maria Detsika, Dimitrios Paraskevis & Angelos Hatzakis

Authors
  1. Antigoni Katsoulidou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chrysoula Rokka
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Catherine Issaris
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Catherine Haida
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kimon Tzannis
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Vana Sypsa
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Maria Detsika
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Dimitrios Paraskevis
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Angelos Hatzakis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Antigoni Katsoulidou.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

AK participated to the study design and coordination and she prepared the manuscript. CR, CI and CH carried out the experiments. KT and VS performed the statistical analysis. MD participated in the editing of the manuscript. DP was in charge of the HIV subtyping project. AH was the study coordinator and participated in the writing and editing of the manuscript. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Katsoulidou, A., Rokka, C., Issaris, C. et al. Comparative evaluation of the performance of the Abbott RealTime HIV-1 assay for measurement of HIV-1 plasma viral load on genetically diverse samples from Greece. Virol J 8, 10 (2011). https://doi.org/10.1186/1743-422X-8-10

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1743-422X-8-10

Keywords

Virology Journal

ISSN: 1743-422X